Every image point of an image of a sample formed by an optical objective, focussed by, for each image point, deriving a representation of the autocorrelation function of the brightness distribution of the image of that image point, deriving a representation of the average of the autocorrelation function of the brightness distribution of a plurality of image points in the region of that image point, deriving a representation constituting a function of the quotient formed by dividing the representation of the autocorrelation function for that image point by the representation of the average of the autocorrelation function, and varying the distance between the objective and the sample while iteratively performing the above steps of deriving for determining the distance at which the function of the quotient has a maximum value.
|
1. A method for automatically focusing every image point of an image of a sample formed by an optical objective, comprising, for each image point: deriving a representation of the autocorrelation function of the brightness distribution of the image of that image point; deriving a representation of the average of the auto correlation function of the brightness distribution of a plurality of image points in the region of that image point; deriving a representation constituting a function of the quotient formed by dividing the representation of said autocorrelation function for that image point by the representation of said average of the autocorrelation function; and varying the distance between the objective and the sample while iteratively performing said steps of deriving for determining the distance at which said function of the quotient has a maximum value.
2. A method as defined in
3. A method as defined in
4. Apparatus for performing the method as defined in
|
The present invention relates to a method and an apparatus for automatic focusing of every image point in an image in a system in which the image is being observed by means of an objective.
In the manufacture and evaluation of multiphase substances, such as, for example, nuclear fuel plates made of mixtures of uranium dioxide and plutonium dioxide, as they are used, for example, for fast breeder reactors, or in the case of plutonium recovery for light water reactors, the distribution of the, e.g., plutonium is different in each manufacturing process. In the case where the manufacturing process or treatment of a starting powder does not impose substantial mixed crystal formation, the plutonium distribution may become inhomogeneous. In such a case there is a need for the manufacturer to learn how the plutonium is distributed in order to draw conclusions therefrom regarding the manufacturing process. The fuel customer, on the other hand, wants to know whether the plutonium in the plates is indeed present in the required homogeneous distribution. If, now, homogeneity or the distribution of a second phase is to be quantified, it is the general practice to utilize the deviation of the concentration from a given standard or a distribution parameter derived therefrom as the measuring index.
If during automatic image analysis more than one sample point is to be examined, it is necessary to displace the sample. It is then assumed that the sample remains continuously at the same distance in front of the objective lens of an observation microscope or of a television camera. If this is not the case with certainty, the image will be out of focus and thus the measuring result will be wrong. To prevent this, the image must be refocused again and again.
It is thus an object of the present invention to achieve automatic focusing of a microscope image with the use of an image analyzer so as to make it possible to perform automatic analysis of samples even if these smples are not entirely planar.
This and other objects are achieved, according to the invention by the provisions of a method and apparatus for automatically focussing every image point of an image of a sample formed by an optical objective, which performs, for each image point, the steps of deriving a representation of the autocorrelation function of the brightness distribution of the image of that image point, deriving a representation of the average of the autocorrelation function of the brightness distribution of a plurality of image points in the region of that image point, deriving representation constituting a function of the quotient formed by dividing the representation of the autocorrelation function for that image point by the representation of the average of the autocorrelation function, and varying the distance between the objective and the sample while iteratively performing the steps of deriving for determining the distance at which the function of the quotient has a maximum value.
FIGS. 1-4 are diagrams illustrating image brightness correlation function parameters as a function of objective lens-to-subject distance for four different objective lenses and utilized to explain the principles of the invention.
FIG. 5 is a block diagram of a preferred embodiment of a system implementing the invention.
FIGS. 6 and 7 are block diagrams of alternative embodiments of one of the components of the system of FIG. 5.
In observation procedures of the type contemplated by the invention, if adjacent image points are observed, the difference in brightness between each two adjacent image points is greatest when the image is sharply focused. Thus, if the autocorrelation function of the brightness distribution of an image is calculated at one point, having for example the coordinates (0,0), and this function value is compared with the average of the autocorrelation function of the image, the above considerations lead to the conclusion that the difference of the two function values must be a maximum for a sharply focused image.
The autocorrelation function F(x,y) of a brightness distribution function f(u,v) is defined as ##EQU1## where f+ is the conjugated complex function of f(u,v).
(u,v) are the coordinates of the plane of the image, and
(x,y) are the coordinates of the plane of the correlation function.
Since the function f(u,v) is zero in the whole plane (u,v) except within the range, where the image is defined and the function f(u,v) does not diverge, the above mentioned integral exists for every experimentally possible case.
If it is assumed that the function f(u,v) is different from zero and real only in the region 0≦u≦a and 0≦v≦b, the integral (1) is simplified to ##EQU2## For a real function f30 is equal to f. Thus an optimally sharp image is obtained if the condition
Δ=F(0,0)-F(X,Y)=maximum has been met (3)
where
F (X,Y) . . . is the value of the autocorrelation function at point (X,Y).
Herein, a bar over a term signifies the average value of that term.
A further characteristic of the autocorrelation function is that
F(0,0)=σ2 +μ2 and F (X,Y)=μ2
so that
Δ=σ2 (4)
with P1 σ=standard deviation of the brightness distribution, and
μ=average value of the brightness in the image.
The illustrated result is also quite informative. It indicates that the standard deviation of the brightness is at a maximum with a sharply focused image.
The broken line curves in FIGS. 1, 2, 3 and 4 show the value of Δ as a function of the distance of the sample, or subject, from the objective of the optical system. Each Figure relates to measurements made with a respective one of two transmitted light objectives manufactured by the firm Leitz and two incident light objectives manufactured by the firm Reichert. While in FIGS. 1, 2 and 4 the value Δ indeed achieves a maximum this cannot be observed in FIG. 3 which shows a curve configuration that has also been found with another sample and another objective. The form of the Δ function curves depends greatly on the preparation. The dimensions of Δ and δ are:
Δ[(cd/m2)2 ]
δ dimensionless [1 ]
A deviation from the theoretically expected curve is produced because with the changing distance between objective and sample the degree of enlargement also changes. That inevitably also changes the image content. This problem can be circumvented if instead of the functions Δ=σ2, the standardized function ##EQU3## is used.
In FIGS. 1, 2, 3 and 4 the corresponding function δ is shown by a solid line curve. It can be seen that now there also is a clear maximum even in the case of FIG. 3. In the cases shown in FIGS. 1, 2 and 4, the maximum of the δ function is more distinct than that of the Δ function.
The δ function can be determined by a densitometric measurement of the image, or object surface. To assemble an automatic device, such as the arrangement shown in FIG. 5, for focusing a microscope, by adjusting its objective 1, it is only necessary to repeatedly, or iteratively, find the maximum of the function δ. This can be realized in practice by coupling a stepping motor 3 to the focusing drive of the objective 1 of a microscope or television camera 5, with a process computer 2, 2', such as a PDP 11/03 C Digital Equipment Corp., Maynard, Mass., U.S.A.) set to calculate equation (3). All commercially available objectives which were considered were found to have an operating range (s. FIGS. 1-4) greater than the uneveness of the samples 4.
The motor 3 is a stepping motor ZSS32 by Phytron-Elektronik GmbH, Grobenzell, West-Germany, which can be coupled either to the objective 1 or the carrier 4. The mode of coupling is dependent of the design of the instrument.
The operating ranges of an automatic focusing device when using the objectives employed to derive the curves of FIGS. 1 through 4 are listed in the following table:
______________________________________ |
Objective 1 Operating Range |
______________________________________ |
LEITZ (FIG. 1) 16 × |
-10 . . . + 16 μm |
Deviation from |
the focal plane |
LEITZ (FIG. 2) 25 × |
- 8 . . . + 8 μm |
Deviation from |
the focal plane |
REICHERT (FIG. 3) 16 × |
-40 . . . + 32 μm |
Deviation from |
the focal plane |
REICHERT (FIG. 4) 40 × |
-15 . . . + 13 μm |
Deviation from |
the focal plane |
______________________________________ |
The present method for focusing can be used not only for image analyzers but also for any type of electrical image transmission, as, for example, with a TV camera 5 and scanning electron microscopes. In this case, the relationship (6) is utilized: ##EQU4## where F (o)=F(0,0) and F=F(X,Y), and an electrical voltage u represents the brightness signal for every image point. This results in the relationship: ##EQU5##
Since the value 1 constitutes only a constant shift, it can be left out. Thus the simplified equation 8 applies: ##EQU6##
Automatic calculation of the equation can be implemented in two ways. FIG. 6 depicts an analog processing circuit where the values U2 and U2, as well as U and U2 are derived from the voltage U and equation (8) is solved by means of a divider 7. FIG. 7 shows digital processing, where conversion takes place first by means of an analog/digital converter 8 and then the result is processed to form the equation terms U2 and U2, whereupon the quotient of those terms is formed in the divider 7' according to equation (8).
Then the stepping motor 3 and a peak search device (not shown in detail) must search out the maximum of Δ' (equation 8).
It is to be understood that the above description of the present invention is susceptible to various modifications, changes and adaptations, and the same are intended to be comprehended within the meaning and range of equivalents of the appended claims.
Patent | Priority | Assignee | Title |
10093957, | Jul 01 2013 | S.D. Sight Diagnostics Ltd. | Method, kit and system for imaging a blood sample |
10176565, | May 23 2013 | S D SIGHT DIAGNOSTICS LTD | Method and system for imaging a cell sample |
10482595, | Aug 27 2014 | S D SIGHT DIAGNOSTICS LTD | System and method for calculating focus variation for a digital microscope |
10488644, | Sep 17 2015 | S D SIGHT DIAGNOSTICS LTD | Methods and apparatus for detecting an entity in a bodily sample |
10640807, | Dec 29 2011 | S D SIGHT DIAGNOSTICS LTD | Methods and systems for detecting a pathogen in a biological sample |
10663712, | Sep 17 2015 | S.D. Sight Diagnostics Ltd. | Methods and apparatus for detecting an entity in a bodily sample |
10831013, | Aug 26 2013 | S D SIGHT DIAGNOSTICS LTD | Digital microscopy systems, methods and computer program products |
10843190, | Dec 29 2010 | S D SIGHT DIAGNOSTICS LTD | Apparatus and method for analyzing a bodily sample |
11099175, | May 11 2016 | S D SIGHT DIAGNOSTICS LTD | Performing optical measurements on a sample |
11100634, | May 23 2013 | S.D. Sight Diagnostics Ltd. | Method and system for imaging a cell sample |
11100637, | Aug 27 2014 | S.D. Sight Diagnostics Ltd. | System and method for calculating focus variation for a digital microscope |
11199690, | Sep 17 2015 | S.D. Sight Diagnostics Ltd. | Determining a degree of red blood cell deformity within a blood sample |
11262571, | Sep 17 2015 | S.D. Sight Diagnostics Ltd. | Determining a staining-quality parameter of a blood sample |
11295440, | May 23 2013 | S.D. Sight Diagnostics Ltd. | Method and system for imaging a cell sample |
11307196, | May 11 2016 | S D SIGHT DIAGNOSTICS LTD | Sample carrier for optical measurements |
11434515, | Jul 01 2013 | S.D. Sight Diagnostics Ltd. | Method and system for imaging a blood sample |
11573411, | Nov 14 2017 | S.D. Sight Diagnostics Ltd. | Sample carrier for microscopy measurements |
11584950, | Dec 29 2011 | S.D. Sight Diagnostics Ltd. | Methods and systems for detecting entities in a biological sample |
11609413, | Nov 14 2017 | S.D. Sight Diagnostics Ltd. | Sample carrier for microscopy and optical density measurements |
11614609, | Nov 14 2017 | S.D. Sight Diagnostics Ltd. | Sample carrier for microscopy measurements |
11721018, | Aug 27 2014 | S.D. Sight Diagnostics Ltd. | System and method for calculating focus variation for a digital microscope |
11733150, | Mar 30 2016 | S D SIGHT DIAGNOSTICS LTD | Distinguishing between blood sample components |
11796788, | Sep 17 2015 | S.D. Sight Diagnostics Ltd. | Detecting a defect within a bodily sample |
11803964, | May 23 2013 | S.D. Sight Diagnostics Ltd. | Method and system for imaging a cell sample |
11808758, | May 11 2016 | S.D. Sight Diagnostics Ltd. | Sample carrier for optical measurements |
11914133, | Sep 17 2015 | S.D. Sight Diagnostics Ltd. | Methods and apparatus for analyzing a bodily sample |
4600832, | Oct 28 1983 | Nanometrics Incorporated | Method and apparatus for automatic optical focusing on an optically discernible feature on an object |
4633073, | Feb 24 1983 | Olympus Optical Co., Ltd. | Data correcting device in an automatic focus detecting system |
4748335, | Apr 19 1985 | ISHIKAWAJIMA-HARIMA HEAVY INDUSTRIES CO , LTD | Method and aparatus for determining surface profiles |
5365053, | Feb 19 1991 | Heidelberger Druckmaschinen AG | Method and apparatus for setting the sharpness of an optical imaging system |
5576975, | Sep 20 1991 | Fujitsu Limited | Distance measuring method and a distance measuring apparatus |
7133078, | May 21 1997 | Olympus Corporation | Automatic focal point sensing device |
7609857, | Jan 17 2002 | Robert Bosch GmbH | Method and device for recognizing obstruction of view in image sensor systems |
8665430, | Jul 01 2009 | Nikon Corporation | Exposure condition determining method and surface inspection apparatus |
9979875, | Mar 16 2015 | ZHEJIANG UNIVIEW TECHNOLOGIES CO , LTD | Focusing for point light source scene |
Patent | Priority | Assignee | Title |
4247762, | Nov 30 1978 | Honeywell Inc. | Contrast sensing apparatus for automatic focus systems |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Mar 19 1980 | Kernforschungszentrum Karlsruhe Gesellschaft mit beschrankter Haftung | (assignment on the face of the patent) | / |
Date | Maintenance Fee Events |
Date | Maintenance Schedule |
Sep 21 1985 | 4 years fee payment window open |
Mar 21 1986 | 6 months grace period start (w surcharge) |
Sep 21 1986 | patent expiry (for year 4) |
Sep 21 1988 | 2 years to revive unintentionally abandoned end. (for year 4) |
Sep 21 1989 | 8 years fee payment window open |
Mar 21 1990 | 6 months grace period start (w surcharge) |
Sep 21 1990 | patent expiry (for year 8) |
Sep 21 1992 | 2 years to revive unintentionally abandoned end. (for year 8) |
Sep 21 1993 | 12 years fee payment window open |
Mar 21 1994 | 6 months grace period start (w surcharge) |
Sep 21 1994 | patent expiry (for year 12) |
Sep 21 1996 | 2 years to revive unintentionally abandoned end. (for year 12) |