A method for high-resolution 3D fluorescence microscopy, wherein fluorescence emitters in a sample are repeatedly excited to emit fluorescence, and still images are produced of the sample by means of a microscope. The microscope has an imaging beam path with an optical resolution and a focal plane, wherein the fluorescence emitters are excited to emit fluorescence in such a manner that at least a subset of the fluorescence emitters is isolated in each still image so that the images of these fluorescence emitters can be separated in the still images within the optical resolution. The positions of the fluorescence emitters are localized in the generated still images, from the images of the isolated fluorescence emitters, with a location accuracy exceeding the optical resolution, and a high-resolution composite image is generated therefrom.
|
1. A method for high-resolution 3D fluorescence microscopy in wide-field imaging, comprising
(a) exciting fluorescence emitters in a sample in a microscope having a wide-field imaging beam path with an optical resolution to emit fluorescence, said fluorescence emitters being stimulated to emit fluorescence in such a manner that at least in a subset of the fluorescence emitters said stimulated fluorescence emitters are isolated from each other so that the images of these fluorescence emitters can be optically separated by said microscope within the optical resolution of said microscope,
(b) wide-field imaging a first focal plane into a first partial image and a second focal plane different from the first focal plane into a second partial image, wherein a deformable mirror, located in a pupil of the imaging beam path, is adjusted to select the first focal plane and the second focal plane, and recording the first and second images in first and second partial image frames,
(c) calculating from the partial image frames, the positions of said fluorescence emitters with a location accuracy exceeding the optical resolution, and
(d) generating a high-resolution composite image from the detected positions.
13. A fluorescence microscope for the purpose of three-dimensional wide-field imaging of a sample with a location accuracy exceeding the optical resolution, comprising:
an illumination device designed for the purpose of repeatedly exciting fluorescence emitters in the sample to emit fluorescence,
a wide-field imaging device having an imaging beam path with an optical resolution designed for the purpose of recording a series of image frames of the sample at the optical resolution,
a control device which is designed for the purpose of controlling the illumination device and the imaging device in such a manner that a series of image frames of the sample are produced, wherein the fluorescence emitters are excited to emit fluorescence in such a manner that at least a subset of the fluorescence emitters is isolated in each individual frame in such a manner that the images of these fluorescence emitters can be separated in the image frames within the optical resolution,
each image frame comprising a first and a second partial image frame by means of a deformable mirror arranged in a pupil of the imaging beam path, said first partial image frame being a wide field image of a first focal plane in the sample, and said second partial image frame being a wide field image of a second focal plane in the sample, said first and second focal planes being different, and both said first and second sectional image frames being recorded separately,
the control device being designed for the purpose of detecting the positions of the isolated fluorescing fluorescence emitters in the generated sectional image frames with a location accuracy exceeding the optical resolution, and of generating a high-resolution composite image therefrom,
the imaging device having at least one camera on which the two partial image frames are imaged,
the control device being designed for the purpose of adjusting the deformable mirror in such a manner that it images the two image frames separately in time or in space, and
the control device being designed for the purpose of adjusting the deformable mirror in such a manner that it implements two different focal lengths for the two partial image frames.
2. The method according to
3. The method according to
4. The method according to
5. The method according to
6. The method according to
7. The method according to
8. The method according to
9. The method according to
10. The method according to
11. The method according to
12. The method according to
14. The fluorescence microscope according to
15. The fluorescence microscope according to
16. The fluorescence microscope according to
17. The fluorescence microscope according to
18. The fluorescence microscope according to
19. The fluorescence microscope according to
20. The fluorescence microscope according to
|
The present application is a U.S. National Stage application of International PCT Application No. PCT/EP2012/075465 filed on Dec. 13, 2012 which claims priority benefit of German Application No. DE 10 2012 201 003.3 filed on Jan. 24, 2012, the contents of each are incorporated by reference in their entirety.
The invention relates to a method for high-resolution 3D localization microscopy, wherein fluorescence emitters in a sample are repeatedly excited to emit fluorescence, and still images of the sample are produced by means of a microscope having an imaging beam path, the same having an optical resolution and a focal plane, wherein the fluorescence emitters are stimulated to emit fluorescence in such a manner that at least a subset of the fluorescence emitters is isolated in each still image, in such a manner that the images of these fluorescence emitters can be separated within the optical resolution in the still images. In the resulting still images, the positions of the fluorescence emitters are localized from the images of the isolated fluorescence emitters, with a location accuracy exceeding the optical resolution. A high-resolution composite image is generated therefrom. Each still image is divided by means of a dividing element into a first and a second sectional image, wherein the first sectional image images a first focal plane in the sample, and the second sectional image images a second focal plane in the sample, wherein both sectional images are imaged next to each other on one camera.
The invention further relates to a fluorescence microscope for the three-dimensional imaging of a sample with a location accuracy exceeding the optical resolution, having: an illumination device which is designed for the purpose of repeatedly exciting fluorescence emitters in the sample to emit fluorescence, an imaging device having an imaging beam path with the optical resolution, designed for the purpose of producing still images of the sample at the optical resolution, a control device which is designed for the purpose of controlling the illumination device and the imaging device in such a manner that multiple still images of the sample are produced, wherein the fluorescence emitters are excited to emit fluorescence in such a manner that at least a subset of the fluorescence emitters in each still image is isolated in such a manner that the images of these fluorescence emitters can be separated in the still images within the optical resolution. The control device is also designed for the purpose of localizing the positions of the isolated fluorescing fluorescence emitters in the generated still images with a location accuracy exceeding the optical resolution, and generating a high-resolution composite image therefrom. The imaging beam path comprises a dividing element which divides each still image into a first and a second sectional image, wherein the first sectional image images a first focal plane in the sample, and the second sectional image images a second focal plane in the sample, and the imaging device includes a camera on which the two sectional images are imaged next to each other.
Various different methods have been developed in the prior art to overcome the diffraction limit in microscopy. A method, abbreviated as PALM (photo-activated light microscopy), is known from WO 2006/0127692 and DE 102006021317 A1, which uses a marking substance to image a sample, wherein said marking substance can be activated by means of optical radiation. The marking substance can only emit specific fluorescent radiation in the activated state. Inactivated molecules of the marking substance do not emit fluorescence radiation—or at least no noticeable fluorescence radiation, even after radiation with excitation light. For this reason, the excitation light is generally termed the switching signal. In the PALM method, the switching signal is applied in such a manner that at least some of the activated marking molecules are spaced apart from neighboring, activated marking molecules in such a manner that they are separated when viewed on the scale of the optical resolution of the microscope, or can be subsequently separated by image processing methods. In this case, one says that a subset of the fluorescence emitters have been isolated. After the fluorescence has been captured, the center of the radiation distribution for these isolated emitters is determined, said distribution being the result of the limit of the resolution. From this, it is possible to calculate the position of the molecules with higher precision than the optical resolution actually allows. This process is termed localization. The enhanced resolution resulting from a computational determination of the nucleus of the diffraction distribution is also termed “super resolution” in the technical literature in English. This resolution requires that at least a subset of the activated marking molecules in the sample can be differentiated—that is, isolated—at the optical resolution. Then, their position can be determined with a higher precision, and they can be localized.
To isolate individual fluorescence markers, the PALM principle exploits statistical effects. For a fluorescence marker which can be stimulated to emit fluorescence after receiving the switching signal at a given intensity, it is possible to adjust the intensity of the switching signal so that the probability of activating fluorescence markers present in a given area of the sample is so small that there is a sufficient number of sub-regions in which only fluorescence markers which can be differentiated within the optical resolution emit fluorescence.
The PALM principle has been further advanced with regards to the activation of the molecule which is targeted for detection. By way of example, for molecules which have a long-lived non-fluorescing state and a short-lived fluorescing state, a separate activation using activation light which is different in spectrum from the excitation light is not at all necessary. Rather, the sample is first illuminated with high-intensity excitation light in such a manner that the overwhelming majority of the molecules are brought into the long-lived state where fluorescence is not possible (e.g. a triplet state). The remaining molecules which are still fluorescing are thereby isolated with respect to the optical resolution.
It is also noted that the PALM principle has also been denoted in the technical literature with other abbreviations, such as STORM, for example. In this description, the abbreviation PALM is used for all microscope-based imaging which achieves a localizing resolution beyond the optical resolution of the apparatus being used, by first isolating fluorescent molecules and then localizing the same. The PALM method has the advantage that it is not necessary to have high localizing resolution for the illumination. A simple wide-field illumination is possible.
The PALM principle requires that many still images of the sample are captured, each containing subsets of isolated molecules. In order to image the sample as a whole, the number of the individual images in total must be sufficient to ensure that as many molecules as possible are at least present one time in one subset. The PALM method therefore regularly requires a plurality of still images, which requires a certain period of time for a composite image to be captured. A significantly complex calculation process is involved because a plurality of molecules must be localized in each still image. Large amounts of data are involved.
This location accuracy is only achieved laterally, by the localization in still images—that is, in a plane to which the image plane of the camera is functionally assigned. The methods are therefore limited in this respect to a two-dimensional analysis of a sample. The PALM principle is therefore combined with a TIRF excitation, which ensures that only fluorophores in a thin layer of the sample emit fluorescence.
Approaches are also known in the prior art for the localization of luminescing fluorescence markers in the third spatial dimension, which is the depth dimension with respect to the imaging of the sample. The term “depth dimension” in this case means the direction along the incident light path—that is, along the optical axis.
The publication B. Huang et al., Science 319, page 810, 2008 describes an imaging beam path for the PALM principle, wherein a weak cylindrical lens lies in the imaging beam path, thereby leading to a specific astigmatic distortion. As a result, the image of the marker on the camera is elliptically distorted as soon as the marker is positioned above or below the focal plane—that is, the symmetry point of the point spread function. The information on the depth position of the fluorescing fluorescence marker can be obtained from the orientation and the degree of the distortion. A disadvantage of this method is that the local environment and orientation of a molecular dipole can also lead to distortion of the image of the fluorescing fluorescence marker, and this distortion nevertheless has nothing to do with the depth position. Such fluorescing fluorescence markers therefore are assigned a false depth value, depending on their orientation.
The publication Pavani et al., PNAS 106, page 2995, 2009, suggests modifying the point spread function in the imaging process to give a double helix structure, by means of a spatial phase modulator. The one-dimensional images of individual, luminescing fluorescence markers then become double spots. Their depth position is encoded in the angular orientation of the common axis of the double spots.
According to the publication by Shtengel, et al, PNAS 106, page 3125, 2009, photons which are emitted by the fluorescing fluorescence markers are caused to interfere with themselves. For this purpose, two lenses which are assembled in the 4π configuration are used to simultaneously observe the fluorescing fluorescence markers. By means of a special, 3-way beam splitter, the different optical paths obtained in this manner are made to achieve interference. Each of the resulting three-point images is detected by a camera, and the proportional intensities of the three-point images provide information on the depth positions.
The publications Toprak et al., Nanolet. 7, pages 3285-3290, 2007, and Juette et al., Nature Methods 5, page 527, 2008, describe an approach wherein a 50/50 beam splitter is installed in the imaging beam path and splits the image of the sample into two sectional images which can be detected independently. In addition, an optical path length difference is inserted into one of the beam paths obtained in this manner, in such a manner that two object planes are produced from the two beam paths, which are spaced apart from each other in the z-—that is, depth—dimension by approximately half of the minimum optical resolution (for example 700 nm), or by the whole minimum optical resolution. The depth position of fluorescence markers which lie between these two planes is then obtained by analysis of the two sectional images of the same fluorescence marker (for example with respect to the width of the point spread function, which can be analyzed by a type of subtraction), or by a corresponding fitting of a three-dimensional point spread function. The method requires two highly resolved sectional images and a precise adjustment of the beam paths and calibration measurements in order to achieve a superimposition of these two sectional images with sub-pixel precision. In addition, the two sectional images of a fluorescence marker generally have a different shape because the lateral expansion of the point spread function of a system being imaged changes according to the position of the object plane being observed.
DE 102009060490 A1, which also lists further citations of literature on 3D high-resolution, likewise follows the approach according to Toprak et al. in this class, to split the image of the sample into two images.
The invention addresses the problem of improving such a method in such a manner that the construction is simplified and the requirements for alignment can be met easily.
The problem is addressed according to the invention by a method for high-resolution 3D fluorescence microscopy, wherein fluorescence emitters in a sample are repeatedly excited to emit fluorescence, and still images are produced of the sample by means of a microscope having an imaging beam path with an optical resolution and a focal plane, wherein the fluorescence emitters are stimulated to emit fluorescence in such a manner that at least a subset of the fluorescence emitters is isolated in each still image, in such a manner that the images of these fluorescence emitters can be separated within the optical resolution in the still images, in the resulting still images, the positions of the fluorescence emitters are localized from the images of the isolated fluorescence emitters, with a location accuracy exceeding the optical resolution, and a high-resolution composite image is generated therefrom. Each still image is divided by means of a dividing element into a first and a second sectional image, wherein the first sectional image images a first focal plane in the sample, and the second sectional image images a second focal plane in the sample, wherein both sectional images are imaged on at least one camera, wherein an adaptive mirror is used as the dividing element, and is substantially arranged in a pupil of the imaging beam path, wherein the adaptive mirror is adjusted in such a manner that it images the two sectional images separately in time or in space, and the adaptive mirror is adjusted in such a manner that it implements two different focal lengths for the two sectional images.
The problem is further addressed by a fluorescence microscope for the three-dimensional imaging of a sample with a location accuracy beyond the optical resolution, having: an illumination device which is designed for the purpose of repeatedly exciting fluorescence emitters in the sample to emit fluorescence, an imaging device having an imaging beam path with the optical resolution, designed for the purpose of producing still images of the sample at the optical resolution, a control device which is designed for the purpose of controlling the illumination device and the imaging device in such a manner that multiple still images of the sample are produced, wherein the fluorescence emitters are excited to emit fluorescence in such a manner that at least a subset of the fluorescence emitters in each still image is isolated in such a manner that the images of these fluorescence emitters can be separated in the still images within the optical resolution, wherein the control device is also designed for the purpose of localizing the positions of the isolated fluorescing fluorescence emitters in the generated still images with a location accuracy exceeding the optical resolution, and generating a high-resolution composite image therefrom, the imaging beam path comprises a dividing element which divides each still image into a first and a second sectional image, wherein the first sectional image images a first focal plane in the sample, and the second sectional image images a second focal plane in the sample, and the imaging device includes at least one camera on which the two sectional images are imaged next to each other, wherein the dividing element is designed as an adaptive mirror which is substantially arranged in a pupil of the imaging beam path, wherein the control device is designed for the purpose of adjusting the adaptive mirror in such a manner that it images the two sectional images separately in time or in space, and the control device is designed for the purpose of adjusting the adaptive mirror in such a manner that it implements two different focal lengths for the two sectional images.
According to the invention, an adaptive mirror is used as the beam-splitting element. It has a double function, because it both spatially separates the sectional image, and also assigns the same to different focal planes. This reduces the effort expended on alignment, which was an inherent characteristic of the principle used by the invention in the prior art.
This is implemented by, generating at least two sectional images for each still image, which are assigned to different focal planes in the sample. Then, in the sectional images, the point images of the isolated fluorophores appear with a size which depends on the depth position of the fluorophore. If the fluorophore is positioned in the focal plane of a sectional image, by way of example, the point image of the fluorescence emitter is as small as the diffraction limit allows. The point image grows with increasing distance from the focal plane, but otherwise with a constant geometry. The size of the point image of a fluorescence emitter encodes the distance from the focal plane. However, what is unknown is whether the fluorescence emitter is above or below the focal plane. For this reason, in the principle used by the invention, at least two sectional images are generated for two different focal planes in the sample in order to not only be able to determine the distance from the focal plane, but also the absolute position with respect to the focal plane. The two sectional images can be imaged on two image capture regions simultaneously or on one single image capture region consecutively.
Compared to the concepts used in the prior art, the adaptive mirror also has the advantage of greater light efficiency. The losses which arise in the prior art with beam splitters, etc., are not an issue with the solution according to the invention. Moreover, the distance between the focal planes of the two images can be adjusted over a wide range without the need to resort to a complicated mechanical actuation of optical path deflecting elements, etc. In addition, the mirror enables the imaging of the sectional images on a camera in rapid succession, because it is possible to implement a quicker change of the focal distance.
Parts of the mirror surface of the adaptive mirror, by way of example, are adjusted with a slightly different focal distance and an angle which is inclined with respect to the remaining elements, for the purpose of generating the two sectional images at the same time. The inclination leads to the desired lateral displacement and the adjacent imaging of the two sectional images on the camera.
In addition, the ratio of the intensity with which the two sectional images are generated can also be adjusted by selecting the mirror surface fraction.
Because the spatial separation of the two (simultaneously generated) sectional images—meaning the divergence of their optical axes—as well as the different focal lengths are achieved merely by a suitable controlling of the adaptive mirror, it is easy to determine and/or specify the alignment positions of the two sectional images with respect to each other. As already mentioned, the two sectional images must be aligned with respect to each other with sub-pixel precision to make it possible to achieve the desired high-resolution with depth position information.
In one particularly simple approach to the alignment of the sectional images, the same are first generated with the same focal length. At this point, two identical sectional images exist next to each other on the camera—meaning that the still image is imaged twice on the camera. It is simple at this point to obtain the reference coordinates for the two sectional images. It is only necessary for this purpose to detect a structure in the sample in the two sectional images with the required high-resolution. The coordinates of the fluorescence emitter thereby detected at high-resolution provide, in a simple manner, the relative positions of the two sectional images on the camera. Once the alignment has been carried out in this manner the mirror is controlled in such a manner that the different focal lengths are implemented. The alignment position of the sectional images does not change in this case, such that the relative specification of the coordinates in the two sectional images determined previously is still valid.
As an alternative or in addition thereto, it is also possible to make the alignment by first imaging the two sectional images on the camera superimposed, and align the positions thereof in this state. Then, the mirror is adjusted in such a manner that the two sectional images come to lie next to each other. In the process, structural elements can optionally be analyzed again.
The term “align the positions” in this case means that coordinate information is determined which makes it possible to locate a point in the second sectional image which exists in the first sectional image as well. In the simplest case, this can be a relative coordinate.
The use of the adaptive mirror makes it easy to modify the difference in the focal lengths, thereby making the depth resolution and/or the detected depth range simple to adjust.
In order to adjust the ratio of the intensities of the sectional images, the mirror surface fractions of the adaptive mirror which produce the image of the first sectional image are simply reduced in size, and the mirror surface fractions which image the second sectional image are enlarged to the same degree.
The adaptive mirror makes it particularly easy to correct imaging errors in the imaging beam path. For this purpose, it is advantageous if the radiation reflected by the mirror is (also) detected by means of a wave front sensor.
Mirrors with segmented surfaces, or continuous, so-called membrane mirrors, are particularly suitable as the adaptive mirror. These are currently known to a person skilled in the art, for example from the publication www.bostonmicromachines.com/light-modulator.htm or www.imagine-optic.com. Additionally, an overview of adaptive mirrors is found at www.wikipedia.org/wiki/Deformable_mirror.
The adaptive mirror is preferably combined with a wave front sensor which detects the wave front of the radiation which has been reflected by the mirror. In this way, imaging errors of the microscope, or imaging errors caused by the sample, are optionally corrected. Moreover, the focal plane can be displaced within certain boundaries without any problem, without the need to adjust the microscope lens. In this way, it is possible to prevent mechanical disturbances of the sample resulting from the movement of the microscope lens.
The term “image of a fluorescence emitter” should be understood to mean the generally diffraction-limited point image thereof.
It should be understood that the features named above and explained below can be used not only in the combinations given, but also in other combinations or alone, without departing from the scope of the present invention. Where method features are mentioned in this description, they are implemented in the operation of the microscope by an accordingly designed control device. Similarly, a disclosure of functional features of the control device also applies as a description of corresponding features—e.g. steps—of the method.
The invention is described in greater detail below with reference to the attached drawings, which also disclose features which are essential to the invention, wherein:
The sample 2 emits fluorescence, and the image of the fluorescing sample 2 is relayed in the imaging beam path 4 to a high-resolution camera K. The resolution of the lens 5, the imaging beam path 4, and the camera K is selected such that a diffraction-limited point image of a single fluorescence emitter falls on multiple pixels. This enables the localization, as required for the PALM principle illustrated above, of a fluorescence emitter with a lateral location accuracy which exceeds the optical resolution of the microscope 5 and the imaging beam path 4.
Of course, the microscope 1 can also be designed with multiple color channels. Then, multiple cameras are included in the imaging beam path 4, and are coupled into the beam path via suitable beam splitters.
The imaging beam path 4 includes—in additional optical elements which are not indicated in greater detail, which are not further characteristic for the microscope 1 and are otherwise conventional technical devices—an adaptive mirror 7 with a curved mirror surface which is part of the imaging beam path 4. It bundles the rays of the fluorescing sample 2 in the direction of the camera K. Its function will be explained.
The adaptive mirror is controlled by the control device C which adjusts the geometry of the mirror surface. A wave front sensor 9 which is switched via a beam splitter in the imaging beam path 4 serves the purpose of making it possible for the control device C to detect the current mirror function as precisely as possible. In this way, it increases the precision, but is not absolutely necessary.
The control device C controls the microscope 1 in such a manner that the PALM principle is executed. The sample 2 is therefore illuminated by the imaging beam path 2 in such a manner that fluorescence emitters in the sample 2 are isolated—meaning that they can be separated within the optical resolution. A plurality of still images is captured, each of which contain isolated, different subsets of the fluorescence emitters in the sample 2. In the still images, then, the position of each isolated fluorescence emitter is determined with high precision by the control device C, by means of known mathematical algorithms, such that a location accuracy which exceeds the optical resolution of the imaging is achieved. This is termed super-resolution in the literature.
The PALM principle makes possible a highly-precise lateral localization of fluorescence emitters—meaning the detection of the position perpendicular to the optical axis. The degree to which a fluorescence emitter is located in front of or behind a focal plane, within a focal plane—that is, the depth position of the fluorescence emitter—is not specified with greater precision by the PALM principle than in other wide-field microscopes.
In order to achieve better resolution in this regard—that is, to provide depth position information for the laterally localized fluorescence emitter—the microscope 1 is operated with control provided by the control device C in such a manner that each still image in which occurs the lateral localization is divided into two sectional images which are assigned to different focal planes in the sample 2.
The control device C can therefore derive corresponding depth position information for the fluorescence emitters from the size of the point images of the fluorescence emitter and the comparison of the sectional images. The lateral localization is obtained, as is known, from the point image 11a.
The sectional images 12b and 13b show a state in which a fluorescence emitter is located between the focal planes of the sectional images. This can be recognized by the fact that the point image 11b of the fluorescence emitter has a size which is greater than the diffraction-limited minimum size, but is also less than the size which would result if the fluorescence emitter were positioned in the focal plane of the sectional image 13.
The sectional images 12c and 13c finally show a state which is inverted with respect to the state a.
The concept of obtaining not only a relative position of the fluorescence emitters with respect to the focal plane of an image, but also the direction of the displacement with respect to the focal plane, using sectional images from different focal planes, is known in the prior art, as described above.
The fluorescence microscope 1 arrives at the sectional images 12 and 13 by using the adaptive mirror 7. This both functions to divide the image of the sample 2 into two sectional images 12, 13, and also to assign the same to different focal lengths using different focal distances for the sectional images 12, 13. This is illustrated schematically in
The adaptive mirror 7 is adjusted in such a manner that it has mirror surface segments 15 which deflect the optical axis OA in a first direction. In addition, interlaced mirror surface segments 16 deflect the optical axis OA in a second direction. The first direction in this case is an optical axis OA1 which is functionally assigned to the camera image region Ka, and the second direction corresponds to an optical axis OA2 which is functionally assigned to the camera image region Kb. The corresponding peripheral rays for the imaging by the first mirror surface segment 15 in this case are sketched with a dotted line in
The mirror surface segments 15 also produce a focal distance difference in the generated sectional image 12. The adaptive mirror 7 is therefore adjusted in such a manner that it not only generates an image division, but also assigns the two sectional images 12 and 13 to different focal planes in the sample 2. This can be recognized by the fact that the peripheral rays for the sectional image 12 meet at the optical axis OA in the camera image region Ka, whereas the dashed peripheral rays for the sectional image 13 are spread out further in the camera image region Kb.
The camera image regions Ka and Kb are preferably, but not absolutely necessarily, image regions of one and the same camera K. This has the advantage that an alignment of the sectional images 12 and 13 can be easily performed with sub-pixel precision. The following options for this can be contemplated, among others:
1. In an alignment step performed prior to the actual measurement process, the adaptive mirror 7 is adjusted in such a manner that the sectional images 12 and 13 are generated along diverging optical axes OA1 and OA2—but with the same focal distance of the mirror 7. The sectional images 12 and 13 then are created during the alignment step from the same focal plane. The high-resolution lateral localization of one or more structures in the sectional images 12 and 13 then makes it easy to obtain a reference specification, by means of which structures in the sectional image 12 can be converted to the coordinate system of the sectional image 13, and vice-versa, during the later measurement operation.
2. If the camera image regions Ka and Kb are image regions of one and the same camera, the sectional images 12 and 13 are first superimposed—meaning depicted overlapping each other. The mirror 7 is then adjusted in such a manner that the optical axes OA1 and OA2 align, wherein the angular difference between the mirror segments 15 and 16 is therefore no longer present. In this overlapping position, it is easy to ensure that the images lie one over the other, despite the different focal distances of the segments 15 and 16. In addition, a referencing of the images to each other can be carried out in a simple manner. Then, in the alignment step, the mirror is moved in such a manner that the angular difference between the mirror segments 15 and the mirror segments 16 is present. In other words, the angle divergence between the optical axes OA1 and OA2 appears, and the sectional images 12 and 13 lie next to each other. The difference in the coordinates between the sectional images 12 and 13 produced as a result can be easily derived from the mirror parameters, such that a highly-precise relative referencing between the sectional images 12 and 13 is ensured by the previously implemented alignment in the superimposed state.
Of course, the method steps 1 and 2 indicated above, which are carried out prior to the actual measuring principle for the purpose of alignment, can also be used in any arbitrary sequence and/or can be combined.
While the invention has been illustrated and described in connection with currently preferred embodiments shown and described in detail, it is not intended to be limited to the details shown since various modifications and structural changes may be made without departing in any way from the spirit of the present invention. The embodiments were chosen and described in order to best explain the principles of the invention and practical application to thereby enable a person skilled in the art to best utilize the invention and various embodiments with various modifications as are suited to the particular use contemplated.
Kalkbrenner, Thomas, Wolleschensky, Ralf
Patent | Priority | Assignee | Title |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Dec 13 2012 | Carl Zeiss Microscopy GmbH | (assignment on the face of the patent) | / | |||
Jul 04 2014 | KALKBRENNER, THOMAS, DR | Carl Zeiss Microscopy GmbH | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 033363 | /0977 | |
Jul 04 2014 | WOLLESCHENSKY, RALF | Carl Zeiss Microscopy GmbH | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 033363 | /0977 |
Date | Maintenance Fee Events |
Jul 28 2021 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
Date | Maintenance Schedule |
Feb 06 2021 | 4 years fee payment window open |
Aug 06 2021 | 6 months grace period start (w surcharge) |
Feb 06 2022 | patent expiry (for year 4) |
Feb 06 2024 | 2 years to revive unintentionally abandoned end. (for year 4) |
Feb 06 2025 | 8 years fee payment window open |
Aug 06 2025 | 6 months grace period start (w surcharge) |
Feb 06 2026 | patent expiry (for year 8) |
Feb 06 2028 | 2 years to revive unintentionally abandoned end. (for year 8) |
Feb 06 2029 | 12 years fee payment window open |
Aug 06 2029 | 6 months grace period start (w surcharge) |
Feb 06 2030 | patent expiry (for year 12) |
Feb 06 2032 | 2 years to revive unintentionally abandoned end. (for year 12) |