An apparatus and a method for acquiring an image of skin topology. The apparatus comprises at least one light source, configured to form a source beam; at least one illuminating diffractive optical element (DOE) disposed in the optical path of the source beam, configured to diffract the source beam, thereby forming an illuminating beam; a skin contact surface, disposed in the optical path of the illuminating beam, configured to at least partially reflect the illuminating beam at regions of the boundary between the skin contact surface and skin that are not in contact with the skin contact surface, thereby forming a reflected beam; at least one imaging diffractive optical element (DOE), disposed in the optical path of the reflected beam, configured to diffract the reflected light beam, thereby forming an image beam; and a sensor array, configured to receive at least a portion of the image beam and thereby to detect the acquired image.
|
27. A method of acquiring an image of skin topology, comprising:
directing a source beam from a light source to at least one illumination diffractive optical element (DOE), thereby diffracting the source beam and forming an illuminating beam;
directing the illuminating beam at a skin contact surface, configured to at least partially reflect the illuminating beam when the skin contact surface is not in contact with skin, thereby at least partially reflecting the illuminating beam and forming a reflected beam;
directing the reflected beam to at least one imaging diffractive optical element (DOE), thereby diffracting, redirecting and focusing the reflected light beam and forming an image beam; and
directing the image beam at a sensor array, thereby detecting the acquired image.
45. An apparatus for acquiring an image of skin topology, comprising:
light generating means for forming a source beam;
illuminating diffractive means, disposed in the optical path of the source beam, for diffracting the source beam and thereby forming an illuminating beam;
skin contacting means, disposed in the optical path of the illuminating beam, for at least partially reflecting the illuminating beam at regions of a boundary between the skin contacting means and skin not in contact with the skin contacting means, thereby forming a reflected beam;
at least one imaging diffractive means, disposed in the optical path of the reflected beam, for diffracting, redirecting and focusing the reflected light beam, thereby forming an image beam; and
detection means for receiving at least a portion of the image beam and thereby detecting the acquire image.
1. An apparatus for acquiring an image of skin topology, comprising:
at least one light source configured to form a source beam;
at least one illumination diffractive optical element (DOE) disposed in the optical path of the source beam and configured to diffract the source beam, thereby forming an illuminating beam;
a skin-contact surface disposed in the optical path of the illuminating beam and configured to at least partially reflect the illuminating beam at regions of a boundary between the skin-contact surface and skin not in contact with the skin-contact surface, thereby forming a reflected beam;
a least one imaging diffractive optical element (DOE) disposed in the optical path of the reflected beam and configured to diffract, redirect and focus the reflected light beam, thereby forming an image beam; and
a sensor array configured to receive at least a portion of the image beam and thereby to detect an acquired image.
2. The apparatus of
3. The apparatus of
4. The apparatus of
5. The apparatus of
7. The apparatus of
8. The apparatus of
9. The apparatus of
11. The apparatus of
12. The apparatus of
14. The apparatus of
15. The apparatus of
16. The apparatus of
17. The apparatus of
18. The apparatus of
19. The apparatus of
21. The apparatus of
22. The apparatus of
23. The apparatus of
25. The apparatus of
26. The apparatus of
28. The method of
29. The method of
30. The method of
31. The method of
32. The method of
33. The method of
35. The method of
36. The method of
37. The method of
38. The method of
39. The method of
40. The method of
41. The method of
42. The method of
44. The method of
|
This application claims the benefit of U.S. Provisional Application No. 60/619,459, filed on Oct. 16, 2004. The entire teachings of the above application are incorporated herein by reference.
Growing concerns regarding domestic security have created a critical need to positively identify individuals as legitimate holders of credit cards, driver's licenses, passports and other forms of identification such as those for the military or drivers of hazardous materials, or school teachers, etc. The ideal identification process is reliable, fast, and relatively inexpensive.
A well-established method for identification is to compare a fingerprint with a previously obtained authentic fingerprint of the individual. Fingerprints have traditionally been collected by rolling an inked finger on a white paper. Attempts to employ an electronically imaged fingerprint method use, as a key component, a solid-state device such as a capacitive or optical sensor to capture the fingerprint image in a digital format.
A typical fingerprint comprises a pattern of ridges separated by valleys, and a series of pores that are located along the ridges. The ridges are usually 100 to 300 μm wide and can extend in a swirl-like pattern for several mm to one or more cm. These ridges are separated by valleys with a typical ridge-valley period of approximately 250-500 μm. Pores, roughly circular in cross section, range in diameter from about 60 μm to 240 μm and are aligned along the ridges and can be isolated or grouped into two or more abutting or near abutting features. There are typically more than 400 pores within a fingerprint region with a frequency of occurrence of about 21 pores/cm of ridge length. Almost all present-day fingerprint identification procedures use only ridge/valley minutiae patterns. These are simplified and identified as a pattern of ridge/valley features such as end points, deltoids, bifurcations, crossover points, and islands, all together referred to as minutiae. Typically, a relatively large area of the fingerprint is required in order to obtain enough unique minutiae features, for example, at least 0.50×0.50 inches. Most modern fingerprint imagers therefore use up to one full inch square or even larger, in order to obtain enough features to perform a useful means of identification. Fingerprints are compared using primarily this simplified description of the minutiae patterns.
Due to the more demanding resolution requirements necessary to successfully image friction ridge detail and/or pores, and the requirements for enrolling and analyzing such high resolution imagines, there are no commercial devices available today that use friction ridge detail and pores for fingerprint identification, even though there are typically 7 to 10 ten times as many pores as minutiae in a given fingerprint area. A typical fingerprint image as small as 0.1×0.1 inches may only contain 2-5 minutiae points, not enough to reliably identify a unique individual. The same area, however, may typically contain as many as 40 to 50 pores and several thousand ridge contour details, which along with a few minutiae points can positively identify an individual reliably.
Most optical designs proposed for creating fingerprint images suffer important limitations that reduce their usefulness in real life applications. Many designs are not suitable, for example, to resolve pore patterns or fine detail of the contour of the intersection of ridges and valleys in the fingerprint. Other designs produce distorted images that complicate fingerprint correlation, such as due to trapezoidal distortions, or due to presence of latent fingerprints, or due to the presence of moisture on the skin surface, and still other designs are too bulky or delicate for convenient use in the field.
Accordingly, there is a need for a compact, high-resolution device that reliably operates over a broad range of temperatures.
The present invention is a method and an apparatus for imaging and analyzing the surface topology of two-dimensional (2-D) area of the skin.
In one embodiment, the present invention is an apparatus for acquiring an image of skin topology. The apparatus comprises at least one light source, configured to form a source beam; at least one illuminating diffractive optical element (DOE) disposed in the optical path of the source beam, configured to diffract the source beam, thereby forming an illuminating beam; a skin contact surface, disposed in the optical path of the illuminating beam, configured to at least partially reflect the illuminating beam at regions of the boundary between the skin-contact surface and skin that are not in contact with the skin contact surface, thereby forming a reflected beam; at least one imaging diffractive optical element (DOE), disposed in the optical path of the reflected beam, configured to diffract the reflected light beam, thereby forming an image beam; and a sensor array, configured to receive at least a portion of the image beam and thereby to detect the acquired image.
In another embodiment, the present invention is a method of acquiring an image of skin topology. The method comprises directing a source beam from a light source to at least one illuminating diffractive optical element (DOE), thereby diffracting the source beam and forming an illuminating beam; directing the illuminating beam at a skin contact surface, configured to at least partially reflect the illuminating beam when the skin contact surface is not in contact with skin, thereby at least partially reflecting the illuminating beam and forming a reflected beam; directing the reflected beam to at least one imaging diffractive optical element (DOE), thereby diffracting the reflected light beam and forming an image beam; and directing the image beam at a sensor array, thereby detecting the acquired image.
In another embodiment, the present invention is an apparatus for acquiring an image of skin topology. The apparatus comprises light generating means for forming a source beam; illuminating diffractive means disposed in the optical path of the source beam, for diffracting the source beam and thereby forming an illuminating beam; skin contacting means, disposed in the optical path of the illuminating beam, for at least partially reflecting the illuminating beam at regions of the boundary between the skin contacting means and skin not in contact with the skin contacting means, thereby forming a reflected beam; at least one imaging diffractive means, disposed in the optical path of the reflected beam, for diffracting the reflected light beam and thereby forming an image beam; and detection means for receiving at least a portion of the image beam and thereby detecting the acquired image.
In one embodiment, the present invention is an apparatus for acquiring an image of skin topology. The apparatus comprises light generating means for forming a source beam; illuminating diffractive means, disposed in the optical path of the source beam, for diffracting the source beam and thereby forming an illuminating beam; skin contact means, disposed in the optical path of the illuminating beam, for at least partially reflecting the illuminating beam at regions of the boundary between the skin contact means and skin that are not in contact with the skin contact means, thereby forming a reflected beam; at least one imaging diffractive means, disposed in the optical path of the reflected beam, for diffracting the reflected light beam and thereby forming an image beam; and detection means for receiving at least a portion of the image beam and thereby detecting the acquired image.
In another embodiment, an apparatus of the present invention for acquiring an image of skin topology comprises at least one light source, configured to form a source beam; at least one illuminating diffractive optical element (DOE) disposed in the optical path of the source beam, configured to diffract the source beam, thereby forming an illuminating beam; a skin contact surface, disposed in the optical path of the illuminating beam, configured to at least partially reflect the illuminating beam at regions of the boundary between the skin contact surface and skin that are not in contact with the skin contact surface, thereby forming a reflected beam; at least one imaging diffractive optical element (DOE), disposed in the optical path of the reflected beam, configured to diffract the reflected light beam, thereby forming an image beam; and a sensor array, configured to receive at least a portion of the image beam and thereby to detect the acquired image.
In another embodiment, the present invention is a method of acquiring an image of skin topology. The method comprises directing a source beam from a light source to at least one illuminating diffractive optical element (DOE), thereby diffracting the source beam and forming an illuminating beam; directing the illuminating beam at a skin contact surface, configured to at least partially reflect the illuminating beam when the skin contact surface is not in contact with skin, thereby at least partially reflecting the illuminating beam and forming a reflected beam; directing the reflected beam to at least one imaging diffractive optical element (DOE), thereby diffracting the reflected light beam and forming an image beam; and directing the image beam at a sensor array, thereby detecting the acquired image.
The apparatus and the method of the instant invention produce undistorted images of high resolution by employing a compact design. Specifically, the apparatus of the present invention produces a high-contrast, high-resolution image by illuminating the image surface at a shallow angle, thus inducing total internal at the interface of the imaged surface and the surface that the imaged surface is in contact with. Apparatus of the present invention is portable and can work in a wide range of temperatures due to employing diffractive holographic optical elements.
The foregoing and other objects, features and advantages of the invention will be apparent from the following more particular description of preferred embodiments of the invention, as illustrated in the accompanying drawings in which like reference characters refer to the same parts throughout the different views. The drawings are not necessarily to scale, emphasis instead being placed upon illustrating the principles of the invention.
A description of preferred embodiments of the invention follows.
The apparatus of the present invention comprises an illumination system, with an illumination source and optical elements for beam shaping and for directing the light from the illumination source, a skin-contact window that acts as a skin-contact surface, an imaging system comprising optical elements for beam shaping and directing the light reflected from the skin-contact window and for imaging said light to a detector, and optionally an image processing system.
The illumination system comprises an illumination source and optical elements for beam shaping the light from said source. The illumination source may be, by way of example, at least one coherent or monochromatic light source, or at least one incoherent light source, one or more of at least one laser, light-emitting diode (LED), tungsten lamp, or fluorescent lamp. The preferred illumination sources are compact, efficient (require low power), and inexpensive such as a semiconductor laser or an LED. The illumination source may optionally be arranged as a grouping of LED elements or laser elements, or combinations thereof, so as to homogenize the intensity of the illumination over the area from which the image of the skin surface is to be obtained. Said illumination system also incorporates one or more optical elements for the beam shaping of the illumination system's radiation source. Said beam shaping, by way of example, uses optics that include at least one diffractive optical element (DOE) as a first DOE, referred to herein as the Illuminating or Illumination DOE, and optionally uses other optics such as one or more refractive, or reflective optical elements or combinations thereof.
In one embodiment of this invention, the beam shaping optics of the illumination system comprises an Illumination DOE and a reflective fold-mirror. Other combinations of diffractive, refractive and reflective optical elements are also contemplated by this invention. The Illumination DOE in one embodiment preferably collimates at least one radiation point source of the illumination system and additionally directs the at least one diffracted collimated beam towards the skin-contact surface or window. An apparatus of this invention that optionally incorporates an illumination system comprising diffractive optical elements (DOEs) and a plurality of sources, preferably comprises DOEs that are a combination of volume holograms that may be physically distinct and/or colocationally multiplexed in the same volume of the DOE material. In this manner, the volume holograms can efficiently combine multiple sources of the illumination source into a single beam of a desired wavefront that can be used to illuminate the skin area under examination. When the illumination system of this invention comprises one source, then a single hologram may be used as the Illumination DOE.
In one embodiment of the present invention, the at least one Illumination DOE has substantially the same diffraction efficiency across its clear aperture and its optical prescription and position are preferably determined in accordance with the numerical aperture and uniformity profile of the illumination source such that a beam of reasonable uniformity illuminates the region of skin to be examined. In an alternative embodiment, the diffraction efficiency of the at least one Illumination DOE is non-uniform and the non-uniformity in said efficiency is preferably the inverse match to the non-uniformity of the projected illumination source. In this manner the DOE-based illumination system is able to transform a nonuniform optical beam from the illumination source and create a region of uniform illumination for illuminating the skin topology.
The skin-contact surface or window forms the superstrate surface of an optically transparent substrate. The area of the window is preferentially at least as large as a typical thumbprint or is at least larger than the area of the skin surface that is to be imaged, and, by way of example, may be large enough to correspond to at least an area for the skin surface of more than one finger or thumb. Although not required by the current invention the surface is often planar. Optionally, the skin-contact window can have curvature to aid in illuminating and/or imaging the skin surface of at least one finger or thumb. In typical embodiments of the invention, light from the illumination system is directed by the Illumination DOE through the substrate to the skin-contact window with an incident angle at the superstrate surface that is large enough for total internal reflection (TIR) at the window-to-air interface.
The imaging system of the present invention comprises optical elements for beam directing and shaping light reflected from the skin-contact window, and an image capture device. The beam directing and shaping optics includes at least a second DOE, referred herein as an Imaging DOE, and use of other optics such as one or more reflective and refractive optical elements or combinations thereof is also possible. In one embodiment, the Imaging DOE diffracts the light incident to it from the Illumination DOE, and which is reflected from the skin-contact window or superstrate layer thereon, and said Imaging DOE thereby redirects and partially focuses said light that has reflected from the surface of the skin-contact window or superstrate layer thereon. The redirected light from said Imaging DOE is, by way of example, additionally directed through a conventional refractive lens system, comprising at least one lens element, or optionally through a diffractive lens system or combinations thereof, and onto the focal plane of the image capture device. The Imaging DOE in combination with one or more reflective, diffractive or refractive optical elements, or combinations thereof, can operate so as to focus and thereby demagnify the skin area onto the image capture device. Said demagnification can be by one demagnification ratio, AI/AF, where the ratio has a value less than 1.0 and where AI is the area of the captured fingerprint image on the sensor and AF is the area of the skin area on the superstrate layer. Alternatively, said demagnification can be selected from a group of at least two different demagnification ratios, AI1/AF and AI2/AF. In yet another embodiment, the demagnification value AI/AF may represent a continuum of values such as those that range from AI
The image capture device of the imaging system of the present invention is, by way of example, typically at least one solid state CCD or CMOS detector array. The detector(s) captures the image which is typically converted to a digital form of the image. The captured image optionally is uploaded to a computer for image storage and, additionally, image analysis may be carried out on said uploaded images.
The described imaging system of the apparatus of this invention collects the light that is reflected from the skin-contact window or superstrate layer thereon and images it onto a sensor. When skin with topological structure such as friction ridges in finger and palm prints is pressed against the skin-contact window or superstrate material thereon, raised portions of the skin will make direct contact with the said window or superstrate material and an air gap will form between recessed portions of the skin topological structure and said window or superstrate material. Direct skin contact at the surface of the skin-contact window or superstrate material prevents TIR of the illumination light so that light that strikes these skin-contact regions partially transits the window-to-skin interface or superstrate layer-to-skin interface and is absorbed and scattered by the skin. In contrast, light that strikes the surface of the superstrate layer at air gap regions, such as those corresponding to recessed portions of the skin topological structure comprising valleys and/or pores, undergoes TIR at the window-to-air or superstrate material-to-air interfaces and is imaged by the imaging system onto the image capture device or detector.
It is preferable that light reflected from the skin surface, or the interface of the window or superstrate layer and raised portions of the skin topology that contact said window or superstrate layer, is not imaged onto the sensor. One method of minimizing reflectivity at the interface of the window or superstrate layer and raised portions of the skin topology is to select a material for the window, or a layer of material for coating the window, that has a refractive index that closely matches the index of refraction of skin.
Said imaging system of the apparatus of the present invention is in general composed of a single or a plurality of optical elements wherein each optical element can be refractive, diffractive, or reflective. In one embodiment, the imaging system is composed of an Imaging DOE and at least one additional optical element. In alternative embodiments the Imaging DOE may operate to diffract light incident on said DOE to a preferred direction whereupon imaging is carried out with one or more refractive or diffractive optical elements or combinations thereof. In further embodiments, the imaging DOE may be translated so that light directed by the illumination DOE reflects internally at least twice, such as once at the superstrate surface of the skin-contact window and once at the opposing substrate surface, so as to translate the reflected light that is to be imaged by an amount that substantially separates it from ambient light that otherwise may transmit into the imaging DOE and onto the image capture device. In a preferred embodiment, said Imaging DOE is designed to redirect the reflected light from the window or superstrate layer such that it propagates at an angle substantially normal to said interface.
The Imaging DOE, in addition to redirecting said reflected beam, may optionally have optical power such that it focuses the reflected beam. The Imaging DOE preferentially acts as a field lens and thereby diffracts the incident light onto said DOE into a focused cone of rays that are imaged by at least one additional optical element such as a second set of optics that may be reflective, refractive or diffractive, or combinations thereof. In one embodiment the second set of optics has one optical power, whereas in another embodiment it may have more than one optical power and may have a continuous or variable range of optical powers, much like a zoom optical system, or it may have discrete additional optical powers. In this manner, the imaging optical system can image a large area of the skin, and by using at least one demagnification the other imaging optics, such as a second set of optics, can be appreciably smaller in diameter than the object area being imaged. The imaging DOE acting as a field lens in combination with one or more refractive and/or diffractive optical elements can operate so as to demagnify the skin area by one or more demagnification ratios, AI/AF, where the ratio has values less than 1.0 and where AI is the area of the captured fingerprint image on the sensor and AF is the area of the skin area on the skin contact surface.
Variations of the present invention can be implemented to enhance performance. For example, light can be directed to the skin-contact window or superstrate material thereon at an incident angle that is large enough for TIR at the window-to-water or superstrate material-to-water interface (water can also include water comprising salts such as from sweat) but not large enough for TIR at the window-to-skin or superstrate material-to-skin interface. This embodiment is advantageous in that condensed water, such as from sweat, does not distort the imaging of the skin topology, in particular the pore structures and friction ridge topology. In addition the illumination system can direct light to the skin-contact window or superstrate material thereon at an incident angle that is large enough for TIR at the window-to-skin-oil or superstrate material-to-skin-oil interface but not large enough for TIR at the window-to-skin or superstrate material-to-skin interface. This embodiment preferably eliminates interference from latent prints caused by skin oil deposited on the contact window or superstrate material thereon.
Reduction of reflections at the window-skin or superstrate material-to-skin interface can increase image contrast. One method of minimizing this reflectivity is to choose a superstrate layer material that has an index of refraction that matches the index of refraction of skin as closely as possible. In another embodiment, the skin-contact window surface is coated with a thin-film coating that is designed for low reflectivity for a window-skin interface or for improving optical contact between the raised portion of the skin topology and the window surface. A film that is elastomeric and/or has hydrophilic chemical structure at the surface can be used to improve said optical contact. These coatings can be intended for permanent use, such as those that may be sputtered or deposited onto the surface, or chemisorbed to the surface, or alternatively they can be films of materials that are applied to the window surface. Said materials can, by way of example, be single-use layers that are disposed in a stack of thin films, the bottom layer of said stack disposed so as to contact the window, wherein the superstrate layer in the stack can be peeled apart from the next lower layer in said stack. Alternatively, the single use said films are applied individually so as to contact the window and are preferably removed prior to placing the next said film onto the window. Said materials can preferably be removed, either from the next layer in said stack or from the window material, such that residual organic and/or inorganic material deposited from the skin or from the layer itself is not present on the superstrate surface, said surface being either the next layer in said stack or the window material, or if it is present then it does not cause imaging of latent fingerprints. Additionally, said material can protect the window material from deposits of chemical compounds from the skin surface, thereby preventing formation of latent prints of the skin topology which can otherwise contaminate the surface and thereby compromise the fidelity of captured images of the skin topology.
Additionally the imaging apparatus of this invention can use two or more wavelengths for another aspect of the illumination system that instead illuminates the skin contact surface at angles less than the angle for TIR. Light from the at least two wavelengths that is diffuse reflected from areas of the skin topology that contact the skin surface is then imaged to a detector wherein the ratio of diffuse reflectivity for the at least two wavelengths is determined to analyze whether the skin topology is from a live finger. For instance reflectance from skin of a live finger at a wavelength of about 650 nm will be about two times greater than reflectance from a live finger at about 550 nm, and about 1.5 times greater than reflectance from a live finger at about 500 nm. The optimal ratios of reflectance of specific wavelengths in the visible region, to make a determination of the finger being a live finger, can be selected by those experienced in the art and, by way of example, the spectral reflectivity versus wavelength characteristics of skin can be found in the publication “Understanding the color of human skin”, Eli Angelopoulou, GRASP Laboratory, University of Pennsylvania. The entire teachings of this publication is herein incorporated by reference. The spectrum of skin is closely related to chromophores in the skin, and thus spectrum of fingers that are not live will not exhibit reflectivity bands at 540 nm, 580 nm and 630 nm (see L.A. Brunsting, C. Sheard, “The color of the skin as analyzed by spectrophotometric methods: II. The role of pigmentation”, The Journal of Clinical Investigation, Vol. 7, pp. 574-592, 1929, the relevant portions of which is herein incorporated by reference). Additionally, the dermis contains blood vessels and thus absorption spectrum of skin exhibits characteristic absorption bands at 420 nm and in also in the 545-575 nm range due to the presence of oxygenated hemoglobin, provided the skin is not heavily pigmented.
In one embodiment of this invention, the Illumination DOE and the Imaging DOE are placed in a plane parallel to the window of the imaging apparatus but sufficiently far from said window such that in relationship to the angle and size of the beam of light that propagates within the window material and illuminates the skin under examination, these two DOEs can be spatially separated from each other. In this embodiment, baffles and apertures can optionally be used such that no light from illumination source can escape the imaging apparatus. In a second embodiment, these DOEs are alternatively placed close enough to the window such that they are substantially overlapping. For this second embodiment, light may escape the imaging apparatus due to DOEs that are not 100% efficient, meaning that their diffraction efficiency is not 100%. Optionally with this second embodiment, as well as with the first embodiment, the imaging apparatus of this invention can be designed such that only when skin covers or presses against the window, does the reader system allow (through shutters or by turning on power to the illumination source) light to illuminate the window. In the said second embodiment, the two DOEs can be fabricated in two separate optical elements or combined into the same DOE media layer sandwiched by one pair of substrates. Since the light rays of a reader system with overlapping DOEs must pass through both DOEs when illuminating the skin, and through both DOEs upon reflecting at the skin-window interface, it is preferential that said DOEs are volume diffractive elements such as those fabricated, by way of example, using photopolymerizable materials or photorefractive crystals. Bragg diffraction characteristics can be optimized when using volume gratings for the DOEs such that the holograms have theoretically 100% diffraction efficiency for light propagating in one direction versus another. For the embodiment wherein the DOEs are spatially separated, these DOEs may be volume holograms, but may also be, by way of example, surface-relief gratings, since the requirement of high-efficiency gratings is not as critical when the light rays of the imaging apparatus propagate through each DOE only once.
The second set of imaging optics is preferentially designed such that in conjunction with the design of the Imaging DOE, a location for an aperture stop is fixed. Said aperture stop may, for example, be located between the Imaging DOE and the second set of imaging optics or may be located between one or more optical elements that comprise the second set of imaging optics. Said aperture stop is a preferred component of the reader system in that the acceptance diameter of the aperture stop controls the numerical aperture of the scattered light reflected from the skin and thereby its diameter affects the performance of the overall optical system.
Said second set of imaging optics, whether for one optical power or a grouping or range of optical powers, is also preferentially designed such that the image space is telecentric. In this manner, slight errors in placement of the detector with respect to the image plane result in a minimal magnification error. When the image space is telecentric it preferably allows a sharp notch filter to be incorporated into the optical system near the image plane. Said notch filter preferably allows only the wavelengths of the light from the illumination source to be imaged at the detector plane and rejects other light that may enter the system such as from the ambient environment of the reader system. Examples of such notch filters may include those comprising dichroic layers for filtering visible wavelengths, such as those made with layers of TiO2/SiO2, and also for filtering near infrared wavelengths. Other suitable filters may be absorbance type which transmit the desired wavelengths and absorb the wavelengths that are preferably not to be detected. The more confined the angles of incidence are on a notch filter, the sharper the cutoff can be.
Similarly, for the purposes of contrast enhancement, the illumination source is preferentially polarized and in such cases a linear polarizer is preferably placed in the imaging system to serve as an analyzer of the light being reflected from the skin. Skin, being a volume scatterer, will depolarize the beam, so by accepting only light into the detector that is of the original polarization of the illumination source, the contrast of the collected images of the skin can be maximized. Said linear polarizer, by way of example, may be a separate optical element, a polymer sheet that is laminated to the notch filter of the optical system if one is present, or incorporated into the cover window of the detector, or the diffraction characteristics of the Illumination and/or Imaging DOE may serve to achieve the desired polarization filtering.
The detector of the optical system is preferentially composed of a two-dimensional (2-D) array of photosensitive elements of sufficient density and number such that the electronic image collected has the desired resolution and size. The signal from the detector array that codes the 2-D electronic image of the skin topology may be passed directly out of the reader system to another electronic system capable of processing the data, but preferentially the reader system itself is able to perform some initial data processing. This data processing may entail numerous image processing algorithms that, by way of example, can include rotation, flipping, thresholding, equalization, subsampling, and binning. The imaging apparatus may also contain memory and additional CPU power to do direct comparisons of the skin topology features and to make certain classification and/or identifications of said skin topology
Referring to
Referring to
The Illumination and Imaging DOEs may be surface-relief or volume holograms. In one embodiment, the gratings are spatially overlapping. It is preferable that the gratings of the Illumination and the Imaging DOEs be volume holograms. With reference to
With reference to
The HOEs can be recorded, for example, in low shrinkage photopolymerizable recording media produced by Aprilis, Inc. (Maynard, Mass.).
Referring to
With reference to
In another embodiment, θ is an angle greater than the total internal reflection (TIR) angle for the interface between the material of skin-contact surface 202 and air. In this embodiment, the light from the illumination source (ray 213) does not escape out of the device, improving the contrast and reducing the eye safety hazard. Illumination ray 213 can only escape the material of skin-contact surface 202 if another material having the index of refraction greater than that of the material of skin-contact surface 202, such as skin, makes contact with skin-contact surface 202.
In another embodiment, the angle θ is set to an angle greater than the TIR angle for the interface between water and the material of skin-contact surface 202. In this embodiment, the skin-contact surface 202 has an index greater than 1.33. Consequently, light will not escape the material of skin-contact surface 202 if anything of index about 1.33 or lower is placed in contact therewith.
The advantage of this third embodiment is evident from the example of imaging a fingerprint where water vapor, such as from sweat, has collected between the ridges of the skin and/or is in the pores. If θ is smaller than the TIR angle for the interface between the material of skin-contact surface 202 and water, the fingerprint cannot be imaged since both the areas where the finger makes contact with skin-contact surface 202 and the areas where it does not allow light ray 213 to be transmitted out of the material of skin-contact surface 202. As a result, no light is reflected toward image detector 221 significantly impairing the contrast of the captured image. In another embodiment, the angle θ is larger than the TIR angle for the interface between the material of skin contact surface 202 and skin oil. According to G L Thomas and T E Reynoldson, in J. Phys. D: Appl. Phys, Vol. 8, pp 724-729 (1975), the relevant teachings of which are incorporated herein by reference, the refractive index of oils deposited from fingers is distributed in range of values between about 1.40 and 1.54 with the main portion of the distribution being in the range of values between about 1.42 and 1.52 at 551 nm. These values are consistent with the refractive indices of most of the long chain fatty material found in finger deposits. In this embodiment, if skin oil fills the ridges of the skin, image detector 221 will still be able to distinguish the contrast between the ridges and the valleys.
Note that for the embodiments described above, regarding incident angles θ having varying degrees of TIR, the upper bounds of the incident angles θ will be the angle that is TIR for the interface between the material of skin-contact surface 202 and skin.
It is preferred that light source employed by the device of the present invention be a point source, such as at least one LED or laser. With reference to
Referring again to
Referring to
Preferentially, imaging optics 118 is designed to be telecentric in image space, thereby allowing sensor placement errors to result in minimal magnification error and reducing the angular requirements on optional spectral filter 119. Optional spectral filter 119 may be added to improve the contrast of the image by minimizing the amount ambient light, such as room light or sunlight, detected by 2-D sensor 121. Spectral filter 119 is preferentially designed to transmit light of the wavelengths emitted by light source 107 and filter out light of other wavelengths such as by absorbing and/or reflecting said light at other wavelengths. Examples of such filters may include those comprising dichroic layers for filtering visible wavelengths, such as those made with layers of TiO2/SiO2, and also for filtering near infrared wavelengths. Other suitable filters may be absorbance type which transmit the desired wavelengths and absorb the wavelengths that are preferably not to be detected such as by use of dye compounds. One skilled in the art can place a spectral filter elsewhere within the imaging system of the present invention, such as on the lower surface of substrate block 106 or on the skin-contact surface 102, in lieu of or in conjunction with spectral filter 119. Alternatively, a spectral filter can be placed between imaging optics 118 and 2-D sensor 121 such as by incorporation on the cover glass of the sensor 121 or as an element of the imaging optics 118. In another embodiment, surface 111 of mirror 110 can be constructed with a coating that reflects only the wavelengths and angles of incidence the illumination source and the illumination system are designed to produce.
Sensor 121 suitable for using in an apparatus of the present invention can be, for example, at least one solid state charge-coupled device (CCD) or complementary metal-oxide-semiconductor (CMOS) detector array.
In one embodiment, the contrast of the image is improved through polarization control. Since skin is a volume scatter, it will depolarize light that reflects from it. Therefore, to achieve the highest contrast between areas with skin contact, such as ridges 327 in
Referring to
In another embodiment, either Illumination DOE or Imaging DOE or both can be polarization-sensitive. Referring, for example, to
Generally transmission volume holograms and surface relief gratings are polarization sensitive, and thus diffraction efficiency of the hologram can be significantly reduced when reconstructing a hologram with, for example, p-polarized light, if the grating is designed for s-polarized light. Polarization insensitive volume holograms, however, can also be recorded in materials that are sufficiently thick or exhibit large refractive index modulation or combinations thereof, and such holograms can also be used in the apparatus of the present invention.
Alternatively, and referring now to
In another embodiment, depolarized light is filtered out by employing Imaging DOE 205b (
Referring to
In one embodiment, in which the data is relayed to an external computer, the processed image may be sent to an external computer by using bulk connector 123 attached to circuit board 122 and data cable 124. Alternatively, the data can be transmitted wirelessly, such as by using any of the known protocols and, by way of example, a Wireless Local Area Network (WLAN). The apparatus of the present invention, such as device 100 depicted in
As described above, Illumination and Imaging DOEs may comprise gratings that are spatially separated or co-locationally multiplexed.
d>D/(2 tan θ),
where D is width of skin-contact surface 202 to be illuminated (see
To further separate the DOEs 205a and 205b and thereby aid additionally in stray light management, another embodiment of the invention requires that distance d satisfy the following inequality
d>D/tan θ.
In this manner, the region of the skin being examined will not be directly above either Illumination DOE 205a or Imaging DOE 205b. Therefore, opaque layer 262 can be placed directly above Illumination DOE 205a. Opaque layer 262 will operate so as to block undiffracted light 203 from escaping the apparatus of the present invention.
Although source 207 is depicted as being normal to substrate block 206, it may be oriented at an angle as shown with respect to light source 407 in
Referring again to
In another embodiment, it is preferred that, as depicted in
The embodiment of
In a preferred embodiment, controller board 454 is designed to accept a USB 2.0 input, but may be designed for Firewire, wireless 802.11 g or a host of other communication protocols.
Referring to
Illumination DOE 405a is glued, using a commercially available UV-curable adhesive (Norland 681, Norland Products, Cranbury, N.J.), to Imaging DOE 405b. Similarly to DOE 405a, Imaging DOE 405b comprises a sandwich of two float glass substrates 466 and 468. Preferably, glass substrates 466 and 468 encase a 25-μm layer or thicker layer of Aprilis photopolymer material.
The interface where the above-mentioned UV-curable adhesive is applied is interface 470. It is preferable that the UV-curable adhesive is index-matched to the substrates of imaging and illumination DOEs 405a and 405b, such that reflections at adhesive interface 470 are minimized.
Light ray 464 diffracted by Illumination DOE 405a passes directly through the volume grating of Imaging DOE 405b because ray 464 is not Bragg-matched to this grating. Ray 464, diffracted by illumination DOE 405a, illuminates skin-contact surface 402. Light ray 472, reflected from skin-contact surface 402 is directed towards the grating of Imaging DOE 405b.
Imaging DOE 405b is fabricated holographically by recording a wavefront with a doubled Nd:YAG laser (λ=532 nm) such that reflected beam or rays 472 propagating at 62.7° inside of float glass substrates 466 and 468 is redirected to propagate substantially normal to skin-contact surface 402 while being focused at a distance approximately 75 mm away from Imaging DOE 405b.
Since light ray 474 diffracted by Imaging DOE 405b is not Bragg-matched to the volume grating of Illumination DOE 405a that is located at interface 476 between glass substrates 460 and 462, diffracted ray 474 passes through Illumination DOE 405a unaffected.
Light ray 474 strikes reflective surface 411 of mirror 410 and is directed into imaging optics 418 (as rays 480). In one embodiment, imaging optics 418 includes a 25-mm focal length camera objective lens MV-250-25 from Optical Product Development (Lexington, Mass.) to image reflected image of the skin topology of finger 407 onto 2-D sensor 421. By way of example, an Eastman Kodak (Rochester, N.Y.) CMOS chip KAC-9648 (1288×1032 array of 6×6 μm pixels) can be used as said 2-D sensor. By adjusting imaging optics 418, a magnification of up to −0.2835 can be achieved, resulting in a device capable of capturing images of 27.3×21.8 mm skin areas at a digital resolution of 1200 ppi (points per inch).
In one embodiment, spectral filter 419 is employed in the optical path between imaging optics 418 and detector 421. Spectral filter 419 can comprise filter #5156 Fern Green from Rosco Laboratories (Stamford, Conn.) and filter IRC30 from Sunex Inc. USA (Carlsbad, Calif.). Said Rosco filter rejects visible light except light centered about 535 nm (i.e., it passes light of the Nicchia green diode being used). However, said Rosco filter transmits light in the near-IR band. Therefore, inserting Sunex filter is preferential as it has high transmission in the visible portion of the spectrum, yet cuts out wavelengths above 640 nm from reaching detector 421. In alternative embodiments the spectral filter 419 can be one dichroic filter element that comprises layers designed reject visible light except light centered about the desired wavelength of the illumination source as well as reject light in the near-IR band.
Another embodiment of the device of the presser invention is illustrated in
Similarly to the embodiment depicted in
Preferably, the holographic grating located within grating region 505 includes a sufficient number of holograms to collimate and direct the light from the light sources (507a through 507c) to skin-contact interface 502. Preferably, these holographic gratings are co-locationally multiplexed.
Alternatively, grating region 505 may comprise spatially separated gratings, similarly to the embodiment depicted in
TABLE 1
Imaging Optics for Performance denoted by FIGS. 6A and 6B.
Lens Element
Material
Parameters (mm)
1
LAK10
R1 = 9.324
R2 = −23.875
T = 3.767
Air gap
Air
T = 0.635
2
SF8
R1 = −13.760
R2 = 5.425
T = 1.259
Air gap
Air
T = 5.206
3
SK16
R1 = −1555.9
R2 = −8.637
T = −8.637
The optical system was analyzed observing the performance of the system at field points with coordinates of 10.84 and 13.55, as these represents half of the full fields corresponding to a 1280×1024 CMOS sensor array operating at 1200 ppi.
TABLE 2
Imaging Optics for Performance denoted by FIGS. 7A and 7B.
Lens Element
Material
Parameters (mm)
1
LAK10
R1 = 9.265
R2 = −18.779
T = 3.767
Air gap
Air
T = 0.635
2
SF8
R1 = −11.523
R2 = 5.649
T = 1.259
Air gap
Air
T = 5.206
3
SK16
R1 = 1787.14 (cyl.)
R2 = −8.916
T = −4.709
In
While this invention has been particularly shown and described with references to preferred embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the scope of the invention encompassed by the appended claims.
Berg, John S., Raguin, Daniel H., Ingwall, Richard T., Malyak, Phillip H., Waldman, David A.
Patent | Priority | Assignee | Title |
10289891, | Mar 31 2016 | FINGERPRINT CARDS IP AB | Optical biometric sensor having diffractive optical elements |
10936840, | Sep 30 2016 | FINGERPRINT CARDS IP AB | Optical sensor with angled reflectors |
8269855, | Jan 15 2009 | Essence Security International Ltd.; Essence Security International Ltd | Narrow bandwidth illumination image processing system and method |
8284019, | Mar 08 2007 | Spectroscopic method and system for multi-factor biometric authentication | |
8437517, | Nov 03 2010 | ABACUS INNOVATIONS TECHNOLOGY, INC ; LEIDOS INNOVATIONS TECHNOLOGY, INC | Latent fingerprint detectors and fingerprint scanners therefrom |
8649001, | Aug 24 2011 | Gingy Technology Inc. | Substrate for fingerprint contact |
8805033, | Nov 03 2010 | Lockheed Martin Corporation | Latent fingerprint detectors and fingerprint scanners therefrom |
9127938, | Jul 28 2011 | Massachusetts Institute of Technology | High-resolution surface measurement systems and methods |
9177190, | May 30 2014 | Cheng Uei Precision Industry Co., Ltd. | Fingerprint sensor module |
9188546, | Nov 03 2010 | Lockheed Martin Corporation | Latent fingerprint detectors and fingerprint scanners therefrom |
9292916, | Aug 09 2011 | HID GLOBAL CORPORATION | Methods and systems for estimating genetic characteristics from biometric measurements |
9390309, | Nov 03 2010 | Lockheed Martin Corporation | Latent fingerprint detectors and fingerprint scanners therefrom |
9767340, | Nov 03 2010 | LEIDOS INNOVATIONS TECHNOLOGY, INC. | Latent fingerprint detectors and fingerprint scanners therefrom |
9804096, | Jan 14 2015 | LEIDOS INNOVATIONS TECHNOLOGY, INC | System and method for detecting latent images on a thermal dye printer film |
9897544, | Aug 26 2011 | LEIDOS INNOVATIONS TECHNOLOGY, INC | Latent fingerprint detection |
RE45541, | Jun 19 2008 | Massachusetts Institute of Technology | Tactile sensor using elastomeric imaging |
Patent | Priority | Assignee | Title |
3864042, | |||
4120585, | Nov 19 1976 | FINGERMATRIX, INC , A NY CORP | Fingerprint identification system using a pliable optical prism |
4728186, | Mar 03 1985 | Fujitsu Limited | Uneven-surface data detection apparatus |
5621516, | Feb 04 1994 | Fujitsu Limited | Optical device for forming an image of an uneven surface |
5986746, | Feb 27 1995 | KREMEN, MR STANLEY H | Topographical object detection system |
6665427, | Sep 16 1994 | MORPHOTRUST USA, INC | Apparatus and method for electronically acquiring fingerprint image with low cost removable platen and separate imaging device |
20040240712, | |||
20040252867, | |||
EP45916, | |||
EP194783, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Oct 14 2005 | Aprilis, Inc. | (assignment on the face of the patent) | / | |||
Nov 15 2005 | WALDMAN, DAVID A | APRILIS, INC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 017239 | /0828 | |
Nov 15 2005 | MALYAK, PHILLIP H | APRILIS, INC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 017239 | /0828 | |
Nov 15 2005 | INGWALL, RICHARD T | APRILIS, INC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 017239 | /0828 | |
Nov 16 2005 | RAGUIN, DANIEL H | APRILIS, INC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 017239 | /0828 | |
Dec 29 2005 | BERG, JOHN S | APRILIS, INC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 017239 | /0828 |
Date | Maintenance Fee Events |
Jul 02 2013 | ASPN: Payor Number Assigned. |
Apr 11 2014 | REM: Maintenance Fee Reminder Mailed. |
May 08 2014 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
May 08 2014 | M1554: Surcharge for Late Payment, Large Entity. |
Apr 16 2018 | REM: Maintenance Fee Reminder Mailed. |
Aug 08 2018 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
Aug 08 2018 | M1555: 7.5 yr surcharge - late pmt w/in 6 mo, Large Entity. |
Jan 20 2022 | M1553: Payment of Maintenance Fee, 12th Year, Large Entity. |
Date | Maintenance Schedule |
Aug 31 2013 | 4 years fee payment window open |
Mar 03 2014 | 6 months grace period start (w surcharge) |
Aug 31 2014 | patent expiry (for year 4) |
Aug 31 2016 | 2 years to revive unintentionally abandoned end. (for year 4) |
Aug 31 2017 | 8 years fee payment window open |
Mar 03 2018 | 6 months grace period start (w surcharge) |
Aug 31 2018 | patent expiry (for year 8) |
Aug 31 2020 | 2 years to revive unintentionally abandoned end. (for year 8) |
Aug 31 2021 | 12 years fee payment window open |
Mar 03 2022 | 6 months grace period start (w surcharge) |
Aug 31 2022 | patent expiry (for year 12) |
Aug 31 2024 | 2 years to revive unintentionally abandoned end. (for year 12) |