A tactile sensor includes a photosensing structure, a volume of elastomer capable of transmitting an image, and a reflective skin covering the volume of elastomer. The reflective skin is illuminated through the volume of elastomer by one or more light sources, and has particles that reflect light incident on the reflective skin from within the volume of elastomer. The reflective skin is geometrically altered in response to pressure applied by an entity touching the reflective skin, the geometrical alteration causing localized changes in the surface normal of the skin and associated localized changes in the amount of light reflected from the reflective skin in the direction of the photosensing structure. The photosensing structure receives a portion of the reflected light in the form of an image, the image indicating one or more features of the entity producing the pressure.

Patent
   RE45176
Priority
Jun 19 2008
Filed
Oct 03 2013
Issued
Oct 07 2014
Expiry
Jun 19 2029
Assg.orig
Entity
Large
2
34
all paid
0. 40. A sensor comprising:
a volume of elastomer capable of transmitting an image, the volume of elastomer having a reflective surface that reflects light incident on the reflective surface from within the volume of elastomer, the reflective surface being deformable in response to pressure applied by an object touching the reflective surface, the deformations causing localized changes in the surface normal of the reflective surface and associated localized changes in the amount of light reflected from the reflective surface in the direction of a photosensing structure, the photosensing structure being disposed to receive a portion of the reflected light in the form of an image, the image indicating one or more features of the object producing said pressure;
at least a first light source and a second light source, each light source disposed to illuminate the reflective surface from within the volume of the elastomer, and each light source disposed to illuminate the reflective surface from substantially different azimuths relative to each other, the first light source producing a first image and the second light source producing a second image; and
a photometric stereo analyzer for receiving information about the one or more features indicated in the first and the second images, the analyzer estimating at least one of a surface normal and a surface height of the object at a plurality of positions on the object based on the information.
0. 27. A method of reconstructing a 3-dimensional shape of an object, the method comprising:
providing a volume of elastomer capable of transmitting an image, the volume of elastomer having a reflective surface that reflects light incident on the reflective surface from within the volume of elastomer;
illuminating the reflective surface through the volume of elastomer with at least a first light source and a second light source, each light source disposed to illuminate the reflective surface from substantially different azimuths relative to each other;
contacting the reflective surface with an object to cause the reflective surface to deform in response to the contact by the object, the deformation causing localized changes in the surface normal of the reflective surface and associated localized changes in the amount of light from each of the light sources reflected from reflective surface;
receiving in a photosensing structure at least a portion of the light from the first light source reflected from the reflective surface in the form of a first image indicating one or more features of the object contacting the reflective surface;
receiving in the photosensing structure at least a portion of the light from the second light source reflected from the reflective surface in the form of a second image indicating one or more features of the object contacting the reflective surface, the first image differing from the second image; and
analyzing information about the one or more features indicated in the first and second images to estimate at least one of a surface normal and a surface height of the object at a plurality of positions on the object.
0. 1. A tactile sensor comprising:
a photosensing structure;
a volume of elastomer capable of transmitting an image; and
a reflective skin covering said volume of elastomer, said reflective skin being illuminated through said volume of elastomer by one or more light sources, said reflective skin having particles that non-directionally reflect light incident on the reflective skin from within the volume of elastomer, said reflective skin being geometrically altered in response to pressure applied by an entity touching said reflective skin, said geometrical alteration causing localized changes in the surface normal of said skin and associated localized changes in the amount of light reflected from said reflective skin in the direction of said photosensing structure; wherein
said photosensing structure is positioned to receive a portion of said reflected light in the form of an image, said image indicating one or more features of the entity producing said pressure.
0. 2. The tactile sensor of claim 1, wherein said volume of elastomer comprises silicone rubber, polyurethane, plastisol, thermoplastic elastomer, natural rubber, polyisoprene, polyvinyl chloride or a mixture thereof.
0. 3. The tactile sensor of claim 1, wherein said volume of elastomer comprises a Shore A hardness between 5 and 90.
0. 4. The tactile sensor of claim 1, wherein the volume of elastomer is in the form of a slab.
0. 5. The tactile sensor of claim 1, wherein said photosensing structure comprises a camera.
0. 6. The tactile sensor of claim 1, wherein said photosensing structure comprises an array of sensing elements.
0. 7. The tactile sensor of claim 1, wherein said one or more features comprise roughness of said entity.
0. 8. The tactile sensor of claim 1, wherein said one or more features comprise the location, amplitude, or direction of the applied pressure.
0. 9. The tactile sensor of claim 1, wherein said one or more features comprise the shape, size, or profile of an object producing said pressure.
0. 10. The tactile sensor of claim 1, wherein said one or more features comprise the motion or slip of a surface touching the reflective skin.
0. 11. The tactile sensor of claim 1, wherein the sensor has physical properties that are similar to those of human skin.
0. 12. The tactile sensor of claim 1, wherein the sensor is formed in the shape of a specified object.
0. 13. The tactile sensor of claim 1, wherein the reflective skin is illuminated by two or more light sources of different colors.
0. 14. A method of performing tactile sensing, comprising:
(a) providing a volume of elastomer capable of transmitting an image;
(b) covering the elastomer with a reflective skin having an inner surface facing the elastomer and an outer surface, wherein the reflective skin comprises particles that non-directionally reflect light incident on the inner surface from within the volume of elastomer;
(c) illuminating the reflective skin through the volume of elastomer with one or more light sources, wherein at least a portion of the light is reflected by the inner surface of the reflective skin;
(d) contacting the outer surface of the reflective skin with an entity, wherein the contact produces pressure that geometrically alters the reflective skin, wherein the alteration causes localized changes in the inner surface of the reflective skin, and wherein the localized changes in the inner surface of the reflective skin cause associated localized changes in the light reflected from the inner surface of the reflective skin;
(e) positioning a photosensing structure to receive a portion of the light reflected from the inner surface of the reflective skin in the form of an image indicating one or more features of the entity contacting the outer surface of the reflective skin.
0. 15. The method of claim 14, wherein said volume of elastomer comprises silicone rubber, polyurethane, plastisol, thermoplastic elastomer, natural rubber, polyisoprene, polyvinyl chloride or a mixture thereof.
0. 16. The method of claim 14, wherein said volume of elastomer comprises a Shore A hardness between 5 and 90.
0. 17. The method of claim 14, wherein the volume of elastomer is in the form of a slab.
0. 18. The method of claim 14, wherein said photosensing structure comprises a camera.
0. 19. The method of claim 14, wherein said photosensing structure comprises an array of sensing elements.
0. 20. The method of claim 14, wherein said one or more features comprise roughness of said entity.
0. 21. The method of claim 14, wherein said one or more features comprise the location, amplitude, or direction of the applied pressure.
0. 22. The method of claim 14, wherein said one or more features comprise the shape, size, or profile of an object producing said pressure.
0. 23. The method of claim 14, wherein said one or more features comprise the motion or slip of a surface touching the reflective skin.
0. 24. The method of claim 14, wherein the sensor has physical properties that are similar to those of human skin.
0. 25. The method of claim 14, wherein the sensor is formed in the shape of a specified object.
0. 26. The method of claim 14, wherein the reflective skin is illuminated by two or more light sources of different colors.
0. 28. The method of claim 27, wherein the reflective surface comprises reflective particles bound to the elastomer.
0. 29. The method of claim 27, wherein the reflective surface comprises reflective particles included in a paint, the paint being applied to the elastomer.
0. 30. The method of claim 27, wherein the reflective surface comprises a reflective skin in contact with the elastomer.
0. 31. The method of claim 30, wherein the reflective skin is bound to the elastomer.
0. 32. The method of claim 27, the photosensing structure comprising a camera.
0. 33. The method of claim 27, the reflective surface comprising reflective particles that reflect light substantially uniformly in all directions, the reflective particles causing the reflective surface to reflect light substantially non-directionally.
0. 34. The method of claim 27, the reflective surface comprising flakes that exhibit at least one of surface roughness, irregular shape, and random alignment relative to each other, the reflective particles causing the reflective surface to reflect light moderately directionally.
0. 35. The method of claim 27, the reflective surface comprising flakes that are substantially flat, have a mirror-like surface, and are substantially well aligned relative to each other, the reflective particles causing the reflective surface to reflect light highly directionally.
0. 36. The method of claim 27, the photosensing structure comprising a first camera and a second camera, the first image based on light reflected from the reflective surface being received in the first camera and the second image based on light reflected from the reflective surface being received in the second camera.
0. 37. The method of claim 27, the illuminating the reflective surface comprising alternating between:
illuminating the reflective surface with the first light source and receiving in the photosensing structure at least a portion of the light from the first light source reflected from the reflective surface; and
illuminating the reflective surface with the second light source and receiving in the photosensing structure at least a portion of the light from the second light source reflected from the reflective surface.
0. 38. The method of claim 27, wherein:
the illuminating the reflective surface comprises illuminating the reflective surface simultaneously with each of the first and the second light sources;
the first light source provides light of a first color and the second light source provides light of a second color;
the photosensing structure comprises a camera responsive to light of the first color and to light of the second color; and
the analyzing information about the one or more features indicated in the first and second images comprises distinguishing between the first and second images based on the color of the light reflected from the reflective surface.
0. 39. The method of claim 38, the photosensing structure comprising a first and a second camera, the first camera being responsive to light of the first color and the second camera being sensitive to light of the second color.
0. 41. The tactile sensor of claim 40, wherein the reflective surface comprises reflective particles bound to the elastomer.
0. 42. The tactile sensor of claim 40, wherein the reflective surface comprises reflective particles included in a paint, the paint being applied to the elastomer.
0. 43. The tactile sensor of claim 40, wherein the reflective surface comprises a reflective skin in contact with the elastomer.
0. 44. The tactile sensor of claim 43, wherein the reflective skin is bound to the elastomer.
0. 45. The sensor of claim 40, the photosensing structure comprising a camera.
0. 46. The sensor of claim 40, the reflective surface comprising reflective particles that reflect light substantially uniformly in all directions, the reflective particles causing the reflective surface to reflect light substantially non-directionally.
0. 47. The sensor of claim 40, the reflective surface comprising flakes that exhibit at least one of surface roughness, irregular shape, and random alignment relative to each other, the reflective particles causing the reflective surface to reflect light moderately directionally.
0. 48. The sensor of claim 40, the reflective surface comprising flakes that are substantially flat, have a mirror-like surface, and are substantially well aligned relative to each other, the reflective particles causing the reflective surface to reflect light highly directionally.
0. 49. The sensor of claim 40, the photosensing structure comprising a plurality of cameras, each camera of the plurality being disposed at an orientation that differs from any other camera relative to the reflective surface.
0. 50. The sensor of claim 40, further comprising an illumination controller for alternating between illuminating the reflective surface with the first light source and illuminating the reflective surface with the second light sources.
0. 51. The sensor of claim 40, wherein:
the first light source provides light of a first color and the second light source provides light of a second color;
the photosensing structure comprises a camera responsive to light of the first color and to light of the second color; and
the photometric stereo analyzer configured to estimate at least one of surface normal and the surface height of the object at a plurality of positions on the object based on the information by distinguishing between the first and the second images based on the color of the light reflected from the reflective surface.
0. 52. The sensor of claim 51, the photosensing structure comprising a first and a second camera, the first camera being responsive to the light of the first color and the second camera being responsive to the light of the second color.

FIG. 13 is a schematic diagram illustrating the elements of a rolling scanner.The sensor skin can be made by adding reflective particles to the elastomer when it is in a liquid state, via solvent or heat, or before curing. This makes a reflective paint that can be attached to the surface by standard coating techniques such as spraying or dipping. The skin may be coated directly on the surface of the bulk elastomer, or it may be first painted on a smooth medium such as glass and then transferred to the surface of the bulk material and bound there. Also, the particles (without binder) can be rubbed into the surface of the bulk elastomer, and then bound to the elastomer by heat or with a thin coat of material overlaid on the surface. Also, it may be possible to evaporate, precipitate, sputter, other otherwise attach thin films to the surface.

The reflective particles in the skin may reflect light directionally or non-directionally. If the particles reflect light uniformly in all directions regardless of the light's angle of incidence, the resulting skin will behave like a Lambertian surface, which is entirely non-directional. Titanium dioxide powder, as is used in white paint, leads to a largely Lambertian reflectance. If the reflective particles are comprised of fine metal flakes, and if these flakes tend to be aligned with each other, then the skin will reflect light directionally, meaning that, for a given angle of incident light, there will be a non-uniform distribution of reflected light. If the metal flakes are flat and mirror-like, and if they are well aligned with each other, the distribution of reflected light will be highly directional. If the metal flakes are rough or irregular, or if there is randomness in their alignment, then the distribution of reflected light will be moderately directional, with an appearance resembling sandblasted metal. Directional reflectance can also be obtained with flakes of other materials such as mica. In addition there are pigments comprising flakes covered with multilayer interference coatings that can have different directionality for different wavelengths of light. Further still, metal flake powder aluminum can be used.

Skin with highly directional reflectance illuminated by a highly directional light source yields a device that is sensitive to small variations in pressure. This sensitivity can be increased by recording the skin's image in its resting state, and using this as a baseline image that is subtracted from images recorded when pressure is applied to the skin. Softer elastomers lead to devices that are more sensitive to low amplitude pressure patterns.

FIG. 2 shows an image obtained with a skin containing gold-colored bronze flakes that are directionally selective. A slab of a clear elastomer about 1 cm thick, was mounted on a sheet of glass. The slab was coated with a thin skin containing fine gold-colored flakes. The slab was pressed against a twenty dollar bill, and the skin was viewed through the glass and the elastomer. Due to the way that bills are printed, the printing on a twenty dollar bill has a raised relief. When the skin is pressed against the bill, its surface deforms in accordance with the bill's relief. The deformation causes a variation in the amount of light reflected toward the camera, revealing the fine details of the bill's surface in the form of an image.

Another example is shown in FIG. 3. A slab of clear elastomer was coated with a reflective skin made with bronze flakes and was placed, skin side up, on the platen of a flatbed scanner. A sea urchin shell was pressed against the reflective skin, causing 3D deformation in the contact region 6. The untouched region 8 remained smooth and the image of this region retained its original smooth appearance. The scanner's internal light source was reflected differently depending on the reflective skin's surface normal, resulting in an image that is recognizable as a shaded relief of the sea urchin shell.

The image pixel values do not directly encode pressure. If spatially uniform pressure is applied to the entire skin surface, there will be no change in surface normal and thus no observable variation in the image. The image pixel values depend on surface normal, which in turn depends on the spatial derivative of pressure. Thus, it is the pattern of pressure variation across the surface that is encoded in the image.

Pressure can be applied to the skin by a rigid object or a non-rigid object. In the case of a non-rigid object, such as a fingertip, both the object and the skin will deform, and the skin's shape will depend on the balance of pressures that the skin and the object exert on each other. Pressure can also be applied by a liquid or gas. For example, a stream of water striking the skin causes it to deform, and the pattern of deformation is visible in the image. If the skin and the elastomer are made of very soft gel-like materials, and if a froth of soap bubbles is placed in contact with the skin, one can visualize the forces exerted by the soap bubble walls.

FIGS. 4A-4D show the elements of the imaging system that can be used in a compact structure such as a robot fingertip. In the illustrated embodiment, there is a rounded piece of elastomer, which is mounted on a rigid member.

FIG. 4A shows a pair of LEDs 12 and a small camera 14, which are looking through the rounded piece of elastomer 16 positioned on a rigid support 17. The skin 18 of the elastomer is reflective, and the camera forms an image of the inner side of the skin. FIG. 4B shows an example wherein the camera is a pinhole camera 20. FIG. 4C shows a folded path optical system that utilizes a curved mirror 22 which reflects light from the skin to the camera 24. FIG. 4D shows the case where the skin is imaged with an endoscope 26 (or the related videoscope, borescope, fiberscope, or the like). This allows the camera 28 to be placed at a distance from the sensor.

FIG. 5A shows an exemplary embodiment of a sensor 30 using an extended diffuse source of light 31. The diffuse light source 31 and camera 36 are positioned on a rigid support 32. A volume of clear elastomer 34 is positioned on the rigid support 32.

To make the structure compact, it may be preferable to introduce the light at the edge of the support. FIG. 5B shows another exemplary embodiment of the invention where one or more light sources 33 illuminates the sensor from a side or edge of the support 32, preferably made of glass or other clear material. Light will bounce off the back face of the support by total internal reflection, and will also be reflected by the reflective skin surface 38 by ordinary reflection. This will cause many of the light rays to remain within the glass+elastomer volume; these rays will illuminate the reflective skin surface 38, and the surface can be viewed by the camera 36. It may be advantageous to use a glass wedge rather than an ordinary sheet of glass. With a wedge (for example, the “Light Wedge” book light) the light reflects off the front and back faces successively, making a larger angle with each bounce. This causes a greater amount of light to exit the wedge at larger distance from the light source.

FIGS. 6A-6B show two exemplary embodiments of the invention wherein deformation and shear can be sensed. Deformation (in particular, changes in surface normal) can be sensed by measuring the change in intensity at each point on the skin 44 produced by a work piece 46, as shown in FIG. 6A. FIG. 6B shows a case in which the surface 48 exerts shear forces on the elastomer and skin 50, causing no change in surface normal, but causing a lateral displacement. The skin typically contains a visible microtexture due to the random pattern of reflective particles, and shear causes a displacement of this microtexture. Motion analysis methods can then be used to estimate the shear.

In some applications it is desirable that the light source and the camera be placed at optical infinity so that the angle of incidence and reflectance are parallel when the device is in its resting state. This causes the devices optical properties to be spatially uniform across the recorded image. FIG. 7A shows a slab of elastomer 136 covered with reflective skin 134 and mounted on lens 146. An object 138 applies pressure to skin 134. The focal length of the lens is such that the light rays from light source 140 are refracted to be parallel when striking skin 134. Camera 144 views the skin through the same lens. The optical properties of the skin 134 as observed by camera 144 will be fairly uniform across the image.

FIG. 7B shows an arrangement in which a slab of elastomer 160 is covered by a reflective skin 152. The elastomer is mounted on a right angle prism 162. Light source 156 passes through lens 164, emerging as parallel rays that enter prism 162 and strike skin 152. An object 154 presses on the skin 152, causing local variation in surface normal. Camera 158 views the skin through a lens 166 that places the skin at optical infinity for that camera. The optical properties of the skin as observed by the camera will be fairly uniform across the image.

In accordance with another exemplary embodiment of the invention, it is desirable to reconstruct the 3-D shape of the deformed surface. In FIG. 8, there are two light sources, 80 and 82, which illuminate the skin 84 thought the elastomer 79. Preferably, the two light sources illuminate the surface from substantially different azimuths, for example one aligned with the x-axis and the other with the y-axis of the slab. The light sources are turned on one after the other and two images are recorded by camera 78. These two images can then be analyzed in accord with the known methods of photometric stereo to estimate the surface normal and surface height at every position. If the two lights 80 and 82 are of different colors, for example red and blue, and if the camera 78 is a color camera, then it is possible to record the two images at the same time in separate color channels. Photometric stereo benefits from the use of additional images. With a color camera it is straightforward to use three light sources and to separate the channels into three images. Alternately, one can use an arbitrary number of light sources if they are turned on one at a time.

The use of multiple lights to get multiple images is useful even when 3D reconstruction is not being performed. Each light brings out surface normal variation along one axis, but not along the orthogonal axis. By using two or more lights, the lights can be arranged so that one light reveals the relief that is missed by another light. This makes it possible to distinguish a wide range of surface normals in different directions. The preferred method of using two or more lights is to have them be different colors, so that a color camera will separate the information about the different lights into different color channels.

It is also possible to use standard stereoscopic techniques as well, in which multiple cameras are placed in different azimuths relative to the skin of the sensor. The techniques set forth herein of sensing changes in luminance are believed to yield better sensitivity and resolution in many applications relative to known techniques. Furthermore, stereopsis can be used in combination with the techniques disclosed herein. The microtexture of the skin and/or the deformation image can be used to establish correspondence.

In some applications it is desirable to make a sensor surface that covers a large area. For example one may require a touchpad that covers an entire desktop. If the device is simply scaled up, then the camera must be placed at a large distance from the surface, making the device undesirably large. One way to ameliorate this problem is to use the methods of folded optics that are used, for example, in many rear projection televisions. Another way is to use a tiled array of cameras, as shown in FIG. 9. The reflective skin 180 covers the clear elastomer 182 which is mounted on a rigid transparent support 184. An array of cameras 186 is placed a short distance from the elastomer and skin. The cameras can be arranged so that their image slightly overlap, and these images can be combined into a single large image by standard stitching techniques.

In another embodiment, a sensor is formed into a cylinder, which can be rolled over the surface of the object. In one illustrative configuration, the sensor would look like a brayer or paint roller. As the roller rolls over the surface, a video camera inside the roller is aimed continuously at the portion that is in contact with the surface of the object. The series of images so obtained can be combined into a single image by the same methods that are used to obtain panoramic photographs from a series of smaller photographs.

Alternatively, the roller could be in a fixed position while the surface of interest was pulled over it. For example, as shown in FIG. 13, an illustrative embodiment of a rolling scanner is a counterfeit banknote detector 300 which has a clear elastomer 310 formed into a cylinder, and a reflective skin 320. The detector 300 also has a slot 330 for feeding a banknote 340. A roller 350, driven by a motor, pulls in the banknote 340 and forms an image of the banknote's surface shape based on an embossed surface of the banknote's paper and/or the raised level of printed ink. A genuine banknote will have a known profile, and a mismatch would indicate a counterfeit banknote.

In some applications it is advantageous for the skin to have a texture rather than being smooth. In some situations one wishes to study the distribution of pressures across a region of human skin. For example, when a skin care product is applied to the skin, the application process produces a certain distribution of pressure on the skin which changes over time. In order to estimate this changing distribution, a sensor can be made that mimics the texture, elasticity, and other properties of human skin. When a skin care product is, for example, wiped across the artificial skin, it causes the skin to distort in a manner similar to that of human skin. The pattern of distortion can be assessed by making a tactile sensor with mechanical properties emulating human skin. This means that the reflective skin has texture and elasticity like the upper layer of human skin, and the clear elastomer beneath the skin has mechanical properties like the deeper layers of human skin. Multiple layers of clear elastomer with different mechanical properties are required to mimic the complex properties of human skin. When a skin care product is applied to this device, the reflective skin distorts in response to the mechanical forces applied to it, and this distortion is viewed by a camera looking through the clear elastomer layers.

In some applications it may be desired to study the distribution of pressure over the surface of a specific object, such as a tire or the sole of a shoe. It is possible to form the tactile sensor into the same shape as this specific object, and with the same hardness or other mechanical properties as this specific object.

In other embodiments, it is not necessary that the image be formed by a camera. Many flatbed scanners use a Contact Image Sensor, or CIS, which is a linear array of lenses and photosensors placed in close contact with the object being scanned. No image forming lens is required. FIG. 10 shows a strip of elastomer 198 covered with reflective skin 192 and mounted on CIS 194. When object 196 presses on the skin, it modifies the surface normal, which modifies the amount of light that will be reflected toward the photosensing elements in that neighborhood. The result is a 1D image that encodes information about the location and amplitude of the pressure variation on the skin.

In another embodiment, a multitouch touchscreen device is made in conjunction with a flat panel LED display. A thin sheet of clear elastomer, covered with a semi-reflective skin, covers the front surface of the display. Most of the light that is emitted by the LED's passes through the skin and is seen by a viewer. A portion of the light is reflected by the skin back toward the LEDs. LEDs have the ability to act as photosensors, and thus can be used to measure the amount of reflected light. Pressure variation on the skin causes local changes in the surface normal, which changes the amount of light reflected toward any given LED in the array. The LED photosensing responses comprise an image that is indicative of the pattern of pressure on the skin. This image indicates where the user is touching the screen. In addition, because this is an inherently high resolution image, it is possible to detect the fingerprint of the user. This allows each finger of each user to be distinguished.

FIG. 11 shows another exemplary embodiment of a tactile sensor 202 in accordance with the invention. A stretchy fabric is placed over the reflective skin. For some applications such a robot manipulator this fabric will produce a surface with desirable mechanical qualities, including the frictional qualities and the ability to withstand the forces of industrial usage. FIG. 11 shows a cross section of a fabric covering 204 that is attached to the reflective skin 206 on the clear elastomer 208. An object 214 presses on the fabric causing the skin to take on the texture 210 of the fabric. In the case of a woven fabric this pattern appears as a gridwork of fibers corresponding to the fabric's construction. Greater pressure leads to a higher contrast fabric pattern, as seen by camera 212. Local properties of this pattern, including the mean value and the contrast, are indicative of the pressure applied at that location.

In another exemplary embodiment, the device is used to measure fluid flow. FIG. 12 shows hairs or whiskers 220 that are attached to the reflective skin 224 at attachment points 222. The attachment points are small pads that are rigidly attached to the whiskers. When fluid flows across the whiskers, it causes the whiskers to tilt, causing the attachment pads to tilt, causing the reflective skin's surface normal to change. The skin is viewed by a camera, and the variation in surface normal causes a variation in image radiance from point to point. The image indicates the speed and direction of fluid flow across each whisker.

There are applications for which high resolution is not needed and not desirable. An extra layer of elastomer on top of the skin acts as a mechanical lowpass filter. For example, a 1 mm thick layer reduces the resolution to be on the order of 1 mm.

A fluorescent pigment can be used in the skin, illuminated by Ultraviolet (UV) light or blacklight. If the blacklight comes at a grazing angle, it can readily reveal variations in surface normal. The material will be fairly close to Lambertian. To reduce interreflections, one would select a surface that appears dark to emitted wavelengths. This principle is true with ordinary light as well. If one is using a Lambertian pigment in the skin, it is better for it to be gray than white, to reduce interreflections.

Blacklight or UV can be used to illuminate a fluorescent surface, which would then serve as a diffuse source. In some cases, it would be useful to use a single short flash (for instance, recording the instantaneous deformation of an object against the surface) or multiple periodic (strobed) flashes (to capture rapid periodic events or to modulate one frequency down to another frequency.)

Although the present invention has been shown and described with respect to several preferred embodiments thereof, various changes, omissions and additions to the form and detail thereof, may be made therein, without departing from the spirit and scope of the invention.

Adelson, Edward

Patent Priority Assignee Title
10837916, Mar 09 2017 Spirit AeroSystems, Inc. Optical measurement device for inspection of discontinuities in aerostructures
9870101, Aug 22 2014 Toyota Jidosha Kabushiki Kaisha Operating device for vehicle having a screen with an operating surface and a projecting unit configured to project an image on the screen
Patent Priority Assignee Title
4120585, Nov 19 1976 FINGERMATRIX, INC , A NY CORP Fingerprint identification system using a pliable optical prism
4340300, Aug 11 1980 Siemens Corporation Input sensor unit for a fingerprint identification system
4481815, Dec 23 1982 Tactile sensor
4549093, Sep 29 1982 Emi Limited Tactile array sensor
4584625, Sep 11 1984 Capacitive tactile sensor
4588348, May 27 1983 AT&T Bell Laboratories Robotic system utilizing a tactile sensor array
4775961, Jun 24 1985 VYSOKA SKOLA DOPRAVY A SPOJOV V ZILINE, A CORP OF 20 MOYZESOVA ZILINA, CZECHOSLOVAKIA Tactile sensor
5357799, Jul 14 1992 Regents of the University of California, The Method and apparatus for determining abrasion potential of tire treads
5448649, May 24 1994 Apparatus for imaging fingerprint or topographic relief pattern on the surface of an object
5616839, Jan 29 1996 Ford Motor Company Apparatus and method for measuring contact force distribution of a tire
5737071, Aug 16 1996 Safariland, LLC Method and apparatus for enhancing live-scan fingerprint reader images
5967940, Sep 17 1997 Toyota Jidosha Kabushiki Kaisha Method and apparatus for reducing backlash sound in gear mechanism
5967990, Aug 13 1998 President and Fellows of Harvard College Surgical probe comprising visible markings on an elastic membrane
6144757, Feb 28 1997 NEC Corporation System and method for identifying an organism
6234031, Nov 27 1997 NEC Corporaion Fingerprint detection apparatus
6909084, Aug 31 2000 Toudai TLO, Ltd Optical tactile sensor having a transparent elastic tactile portion
7707001, Mar 09 2004 Nagoya Industrial Science Research Institute Control of object operating force, object gripping force and robot hands
20030178556,
20040237669,
20040252867,
20040255128,
20060119837,
20070146536,
20070288186,
20080106258,
20080219521,
20080284925,
20100284565,
20130070074,
JP2005121858,
JP2007520040,
JP2008008746,
WO2005085766,
WO2006098719,
//
Executed onAssignorAssigneeConveyanceFrameReelDoc
Oct 03 2013Massachusetts Institute of Technology(assignment on the face of the patent)
Jul 11 2018Massachusetts Institute of TechnologyNATIONAL SCIENCE FOUNDATIONCONFIRMATORY LICENSE SEE DOCUMENT FOR DETAILS 0472870422 pdf
Date Maintenance Fee Events
Jul 30 2014ASPN: Payor Number Assigned.
Sep 19 2016STOL: Pat Hldr no Longer Claims Small Ent Stat
Oct 02 2020M1552: Payment of Maintenance Fee, 8th Year, Large Entity.
Oct 02 2024M1553: Payment of Maintenance Fee, 12th Year, Large Entity.


Date Maintenance Schedule
Oct 07 20174 years fee payment window open
Apr 07 20186 months grace period start (w surcharge)
Oct 07 2018patent expiry (for year 4)
Oct 07 20202 years to revive unintentionally abandoned end. (for year 4)
Oct 07 20218 years fee payment window open
Apr 07 20226 months grace period start (w surcharge)
Oct 07 2022patent expiry (for year 8)
Oct 07 20242 years to revive unintentionally abandoned end. (for year 8)
Oct 07 202512 years fee payment window open
Apr 07 20266 months grace period start (w surcharge)
Oct 07 2026patent expiry (for year 12)
Oct 07 20282 years to revive unintentionally abandoned end. (for year 12)