A method for rapid OCT image acquisition includes acquiring by OCT a plurality of compressive measurements (y) representing a set of under-sampled OCT data in a dirac domain below a nyquist rate by sampling an object of interest at randomly spaced vertical and horizontal lines in a cartesian geometry using a raster scan, and recovering a 3d volumetric OCT image (f) from the compressive measurements (y) using compressive sampling. The method may also include recovering the 3d volumetric OCT image (f) from the compressive measurements (y) based at least in part on a sparsifying matrix (S) capable of transforming the 3d volumetric OCT image (f) into a sparse representation, such as a matrix representation of the 3d volumetric OCT image (f) in a shift-invariant wavelet transform domain. The method may also be applied to radial OCT scan patterns.
|
1. A method for rapid optical coherence tomography image acquisition comprising:
acquiring by optical coherence tomography a plurality of compressive measurements (y) representing a set of under-sampled optical coherence tomography data in a dirac domain below a nyquist rate by sampling an object of interest at randomly spaced vertical and horizontal lines in a cartesian geometry using a raster scan; and
recovering a 3d volumetric optical coherence tomography image (f) from the compressive measurements (y) using compressive sampling.
20. A method for rapid tomographic image acquisition comprising:
acquiring by emissive imaging means a plurality of compressive measurements (y) representing a set of under-sampled tomographic data in a dirac domain below a nyquist rate by sampling an object of interest at randomly angularly spaced radial scan lines in a radial geometry using a radial scan;
mapping said compressive measurements (y) from said radial geometry to a cartesian grid having radial coordinates;
recovering a set of recovered radial scan images (f) from the compressive measurements (y) using compressive sampling; and
mapping said recovered radial scan images from said cartesian grid to a 3d cartesian geometry having cartesian coordinates to produce a physical 3d volumetric tomographic image.
10. A method for rapid optical coherence tomography image acquisition comprising:
acquiring by optical coherence tomography a plurality of compressive measurements (y) representing a set of under-sampled optical coherence tomography data in a dirac domain below a nyquist rate by sampling an object of interest at randomly angularly spaced radial scan lines in a radial geometry using a radial scan;
mapping said compressive measurements (y) from said radial geometry to a cartesian grid having radial coordinates;
recovering a set of recovered radial scan images (f) from the compressive measurements (y) using compressive sampling; and
mapping said recovered radial scan images from said cartesian grid to a 3d cartesian geometry having cartesian coordinates to produce a physical 3d volumetric optical coherence tomography image.
2. The method for rapid optical coherence tomography image acquisition according to
forming a sparsifying matrix (S) capable of transforming the 3d volumetric optical coherence tomography image (f) into a sparse representation; and
recovering the 3d volumetric optical coherence tomography image (f) from the compressive measurements (y) based at least in part on the sparsifying matrix (S).
3. The method for rapid optical coherence tomography image acquisition according to
4. The method for rapid optical coherence tomography image acquisition according to
5. The method for rapid optical coherence tomography image acquisition according to
6. The method for rapid optical coherence tomography image acquisition according to
7. The method for rapid optical coherence tomography image acquisition according to
8. The method for rapid optical coherence tomography image acquisition according to
9. The method for rapid optical coherence tomography image acquisition according to
analyzing said 3d volumetric optical coherence tomography image (f) for at least one ophthalmological criterion.
11. The method for rapid optical coherence tomography image acquisition according to
forming a sparsifying matrix (S) capable of transforming the recovered radial scan images (f) into a sparse representation; and
recovering the recovered set of radial scan images (f) from the compressive measurements (y) based at least in part on the sparsifying matrix (S).
12. The method for rapid optical coherence tomography image acquisition according to
13. The method for rapid optical coherence tomography image acquisition according to
14. The method for rapid optical coherence tomography image acquisition according to
15. The method for rapid optical coherence tomography image acquisition according to
analyzing said 3d volumetric optical coherence tomography image for at least one ophthalmological criterion.
16. The method for rapid optical coherence tomography image acquisition according to
17. The method for rapid optical coherence tomography image acquisition according to
18. The method for rapid optical coherence tomography image acquisition according to
19. The method for rapid optical coherence tomography image acquisition according to
21. The method for rapid tomographic image acquisition according to
|
The present invention relates generally to the field of signal acquisition and reconstruction, and more particularly, to the field of signal acquisition and reconstruction of images acquired using Optical Coherence Tomography (“OCT”).
Optical Coherence Tomography (hereinafter referred to as “OCT”) is emerging as a dominant medical imaging modality for diagnostic ophthalmology. Optical coherence tomography works similarly to ultrasound tomography, however substituting use of light waves instead of sound waves to reconstruct images of tissue layers based on the reflection of light from tissue interfaces. By using the time-delay, and/or magnitude variance information contained in the light waves which have been reflected from different depths inside a tissue sample, an OCT system can reconstruct a depth-profile of the sample structure. Three-dimensional images can then be created by scanning the light beam laterally across the sample surface to create a 3D tomographic grid. Conventional OCT scanning schemes suffer from a number of drawbacks. Morphometric analysis and clinical applications typically demand high resolution OCT images, which necessitate dense sampling, leading to long scan times. During such long scan times, a person subject to the OCT scan is often required to remain still, sometimes for up to ten seconds, with a fixed gaze on a point without blinking—a challenging feat even for the most determined and those without eye health issues. Long scan times may inevitably increase the likelihood of image corruption from motion artifacts, such as image blurring and ghosting resulting from the subject's eye blinking during an OCT scan session. Although some OCT systems may implement motion tracking features in an attempt to reduce the potential effect of motion artifacts in OCT images, such motion tracking systems typically do not reduce OCT scan times, and may in fact increase scan durations. Additionally, some subjects with eye problems more likely to require OCT scans may be unable to fixate their gaze or eye focus for long OCT scan sessions which may be required by conventional OCT image acquisition. An outstanding need therefore exists for an improved system and method for OCT image acquisition for the benefits of reduced scan times, without significantly comprising the quality of the image acquired from the subject of interest.
Compressive sampling, or compressive sensing, is a technique for signal acquisition and reconstruction utilizing the prior knowledge that the sampled signal is sparse or compressible in nature. Conventional acquisition and reconstruction of images from frequency data using compressive sampling techniques typically follows the basic principle of the Nyquist density sampling theory, which states that to reconstruct an image, the number of Fourier samples that need to be acquired must match the desired resolution, and by extension, the number of pixels of the image. Compressive sampling suggests the possibility of new data acquisition protocols that show that super-resolved signals and images may be reconstructed from far fewer data or measurements than that which was considered necessary under the Nyquist sampling theory. An overview of compressive sampling may be found, for example, in E. J. Candes, J. Romberg, and T. Tao, Robust Uncertainty Principles: Exact Signal Reconstruction from Highly Incomplete Frequency Information, IEEE Trans. Inform. Theory, 52, 489-509 (2004); and E. J. Candes and D. L. Donoho, New Tight Frames of Curvelets and Optimal Representations of Objects with Piecewise-C2 Singularities, Communications on Pure and Applied Mathematics, 57, no. 2, 219-266 (2004).
Certain features, aspects and examples disclosed herein are directed to a method for rapid OCT image acquisition. Additional features, aspects and examples are discussed in more detail herein.
In accordance with a first embodiment of the invention, a method for rapid OCT image acquisition is provided. The exemplary method for rapid OCT image acquisition includes acquiring by OCT a plurality of compressive measurements (y) representing a set of under-sampled OCT data in a Dirac domain below a Nyquist rate by sampling an object of interest at randomly spaced vertical and horizontal lines in a Cartesian geometry using a raster scan, and recovering a 3D volumetric OCT image (f) from the compressive measurements (y) using compressive sampling.
Exemplary embodiments of the above-described method of the present invention may additionally include one or more of the following features. In some embodiments, a method for rapid OCT image acquisition further includes forming a sparsifying matrix (S) capable of transforming the 3D volumetric OCT image (f) into a sparse representation, and recovering the 3D volumetric OCT image (f) from the compressive measurements (y) based at least in part on the sparsifying matrix (S). According to certain embodiments, the sparsifying matrix (S) represents a matrix representation of the 3D volumetric OCT image (f) in a shift-invariant wavelet transform domain.
In some embodiments, the compressive measurements (y) represent a range between 25 and 77 percent of the data present in the 3D volumetric OCT image (f). In other embodiments, the compressive measurements (y) represent less than 50 percent of the data present in the 3D volumetric OCT image (f).
In accordance with a further embodiment of the present invention, another method for rapid Optical Coherence Tomography image acquisition is provided. In such exemplary embodiment, the method for rapid OCT image acquisition comprises acquiring by Optical Coherence Tomography a plurality of compressive measurements (y) representing a set of under-sampled Optical Coherence Tomography data in a Dirac domain below a Nyquist rate by sampling an object of interest at randomly angularly spaced radial scan lines in a radial geometry using a radial scan. The exemplary method further comprises mapping said compressive measurements (y) from said radial geometry to a Cartesian grid having radial coordinates; recovering a set of recovered radial scan images (f) from the compressive measurements (y) using compressive sampling; and mapping said recovered radial scan images from said Cartesian grid to a 3D Cartesian geometry having Cartesian coordinates to produce a physical 3D volumetric Optical Coherence Tomography image.
In some embodiments, the compressive measurements (y) represent a range between about 12 and 40 percent of the data present in the set of recovered radial scan images (f). In other embodiments, mapping said compressive measurements (y) from said radial geometry to a Cartesian grid having radial coordinates additionally comprises mapping the radial coordinate θ to the x Cartesian grid coordinate, and mapping the radial coordinate r to the y Cartesian grid coordinate. In yet further embodiments, mapping said recovered radial scan images from said Cartesian grid to a 3D Cartesian geometry having Cartesian coordinates additionally comprises using the transform θ=x and r=y.
In a particular embodiment of the present invention, the method for rapid Optical Coherence Tomography image acquisition may be adapted for use with either time-domain and/or Fourier domain OCT (also known as spectral domain OCT and/or swept source domain OCT) systems and imaging technologies, and also for use with other imaging systems, and in further alternative embodiments may be adapted for particular use with alternative emissive imaging means comprising one or more of: ultrasound, magnetic resonance and x-ray imaging.
Further advantages of the invention will become apparent when considering the drawings in conjunction with the detailed description.
The present invention will now be described with reference to the accompanying drawing figures, in which:
Similar reference numerals refer to corresponding parts throughout the several views of the drawings.
To address certain shortcomings of the aforementioned prior art OCT scanning methods, in one embodiment the present invention provides a method for rapid OCT image acquisition using compressive sampling, in which OCT acquisition of a reduced random or pseudo-random subset of the raster scans that make up the 3D volumetric field of view of the entire image of a subject of interest is performed during the scanning process. Thereafter, by exploiting the sparsity of image coefficients in a predetermined transform domain (e.g. a shift-invariant wavelet transform domain), the recovery of missing samples may desirably be achieved with high fidelity, thereby reducing the overall OCT scan time and the associated patient discomfort and motion artifacts that may typically follow slower conventional OCT scanning schemes, while recovering a full 3D image of the scanned volume. The systems and methods disclosed in the present specification may be applied to both Fourier domain (also known as spectral domain and/or swept source) and time-domain based OCT image acquisition methodologies and applications according to embodiments of the present invention. In further alternative embodiments of the present invention, the systems and methods disclosed in the present specification may also be adapted for use with other imaging systems, and in particular alternative embodiments may be adapted for use with alternative emissive imaging means comprising one or more of: ultrasound, magnetic resonance and x-ray imaging, for example.
Compressive Sampling
To clarify the advantages and benefits of the present method for rapid OCT image acquisition using compressive sampling as disclosed according to embodiments of the invention herein, a discussion of compressive sampling is provided.
Prior to the introduction of compressive sampling, conventional wisdom as exemplified by the Nyquist sampling theorem states that a signal needs to be sampled at a rate greater than the inverse of twice its bandwidth to permit perfect signal reconstruction, commonly referred to as the Nyquist sampling rate. If the signal is a vector of length N, then the acquisition of at least N number of samples is required to reconstruct that signal according to Nyquist sampling methods. The sensing or measurement matrix is therefore a N*N square matrix.
Compressive sampling however permits accurate signal reconstruction from highly under-sampled measurements, i.e. data sampled at significantly below the Nyquist rate. In particular, it has been shown that when the unknown signal has an S-sparse representation, i.e. one can find a basis in which its representation has less than S non-zero entries, compressive sampling may desirably offer successful recovery with relatively few under-sampled measurements K, where K<<N. Accordingly, a sample measurement matrix may therefore be reduced to a K*N matrix. To allow for successful signal reconstruction, the theory of compressive sampling provides that the measurement matrix needs to be incoherent or uncorrelated with the sparsifying matrix used to transform the signal into its sparse representation, or satisfies the so-called Restricted Isometry Property (RIP). To satisfy the mutual incoherency criterion, random measurement matrices are often used since they will most likely be uncorrelated with any specific sparsifying matrix. See E. J. Candes, J. Romberg, and T. Tao, Robust uncertainty principles: Exact recovery from highly incomplete Fourier information, IEEE Trans. Inform. Theory, 52 489-509 (2004). Then, relying on the fact that the underlying signal is compressible, an appropriate non-linear method enforcing signal sparsity and consistency of the reconstruction with the acquired samples can be used to reconstruct the signal from randomly under-sampled data.
Accordingly, a successful application of compressive sampling can be said to have three requirements: 1) Transform sparsity—the desired image should have a sparse representation in a known transform domain (i.e. it must be compressible by transform coding); 2) Incoherence of under-sampling artifacts—the artifacts in linear reconstruction caused by K-spare under-sampling should be incoherent in the sparsifying domain; and 3) Nonlinear reconstruction—the image should be reconstructed by a non-linear method which simultaneously enforces sparsity of the image representation and consistency of the reconstruction with the acquired samples.
Transform Sparsity
As suggested by the theory of compressive sampling, successful signal recovery from under-sampled data depends in part on the signal having a sparse representation in a known transform domain. Hereinafter, a transform that provides sparse representation of 3D OCT image data in a basis different from one in which the image data is acquired is referred to as a “sparsifying transform”, a mathematical operator that maps a vector of image data to a sparse vector. In a preferred embodiment of the invention, a suitable sparsifying transform for the method for rapid OCT image acquisition using compressive sampling to recover data may be chosen depending on several factors:
Suitable sparsifying transforms satisfying the above-mentioned four factors according to an embodiment of the invention may include the curvlet transform, surfacelet transform, and wavelet transform, for example. In a preferred embodiment of the method for rapid OCT image acquisition using compressive sampling, the sparsifying transform may be a shift-invariant wavelet transform.
In one embodiment of the method for rapid OCT image acquisition using compressive sampling, the problem of single recovery of a 3D volumetric OCT image from a subset of under-sampled OCT data may be characterized by the following forward model:
y=RMf+n (1.1)
In the equation (1.1), f is a vector of N entries that denotes the 3D image of a subject of interest, such as a biological tissue structure for example, defined on a 3D Cartesian grid, obtainable by OCT using conventional raster scan geometry. In one embodiment of the invention, the method for rapid OCT image acquisition using compressive sampling proposes to recover the full 3D image f by taking K measurements of the full 3D image f at a sampling rate significantly below the Nyquist rate. The reduced number of measurements from which the full data vector f may be recovered are hereinafter referred to as compressive measurements or samples, represented by vector y in the equation (1.1) with K entries, where K<<N, and where each component of y is a linear measurement of the full data vector f. Symbol n represents the noise present in the acquired OCT data. In one embodiment of the present invention, the K compressive measurements represented by y may comprise a subset of measurements containing between 25% and 77% of the number of measurements or samples in the full 3D image f, for example.
The matrix M in equation (1.1) refers to the domain from which the compressive measurements y are acquired. In a preferred embodiment of the invention, the OCT is a Fourier domain or time-domain OCT, and OCT images are acquired in a 3D space with Cartesian geometry. As such, in the signal recovery problem as represented by the equation (1.1), M is the identity or the Dirac measurement basis such that M:=Id, where identity matrix Id has a dimension of d×d. The matrix R is a restriction operator, i.e., it extracts those rows from the identity matrix M that represent the number of compressive measurements that are actually acquired. The dimensions of the measurement basis and the restriction operator may be determined by the acquisition geometry, or the raster scanning geometry of the OCT image acquisition system or scanning path.
As suggested by the theory of compressive sampling, the basis functions of the sparsifying transform selected in embodiments of the invention may desirably be as incoherent as possible with respect to the domain from which compressive measurements are acquired, and thereby represent mutual incoherency. It has been shown that sampling an object of interest in a measurement basis at randomly spaced vertical and horizontal lines in a Cartesian geometry skipping a large portion of the image during acquisition satisfies this mutual incoherency criterion, as random measurement matrices are often used since they will most likely be uncorrelated with any specific sparsifying matrix. See E. J. Candes, J. Romberg, and T. Tao, Robust uncertainty principles: Exact recovery from highly incomplete Fourier information, IEEE Trans. Inform. Theory, 52 489-509 (2004). In one embodiment of the present invention, the acquired subset of OCT image data or measurements, y, may be acquired corresponding to random vertical and horizontal lines imposed on the physical volume to be imaged. Such random vertical and horizontal scanning or measurement lines may be generated by a binary restriction mask R comprising vertical and horizontal lines with uniform and random placement, which may be applied during data acquisition such that certain random horizontal and vertical raster-scan lines are skipped during the raster-scanning process, thereby generating randomly sub-sampled OCT image volumes y of the 3D image of a subject of interest f. As such, the application of a restriction mask R results in the reduction in the number of samples being acquired as compared to a conventional OCT raster scan, as best illustrated by
As shown in
Referring again to the signal recovery problem in equation (1.1), ignoring temporarily the noise n, a solution to the signal recovery problem is to solve a matrix equation of the form y=RMf. Since vector y is of length K and vector f is of length N with K<<N, this system of linear equations is underdetermined and does not have a unique solution in general. However, the theory of compressive sampling states that adding the constraint that the signal f is compressible enables one to solve this underdetermined system of linear equations. That is, if one can find a sparsifying transform domain represented by matrix S that offers good compressibility, i.e. a small number of coefficients x=Sf can describe the 3D image f in the sparsifying domain, then the signal f can be represented as f=SHx, where SH, the conjugate transpose of matrix S, is the synthesis operator transforming the coefficients x from the sparsifying domain back to the image domain represented by matrix M, or the domain from which compressive measurements are acquired and in which the signal is wished to be reconstructed. Therefore, given incomplete measurements y of the image f, instead of recovering the unknown image f directly, in an embodiment of the present invention, the unknown sparse coefficients x parameterizing f may be selected such that the reconstructed signal SHx followed by the application of a known restriction mask R is close to the observed under-sampled data y, subject to the constraint that the l2 mean-squared error ∥y−RSHx∥2 is small. Put in other words, given a set of incomplete measurements y of the signal f, an approximation ˜f such is desired to be obtained such that (i) f˜=SHx˜, where x˜ is sparse, and (ii) ∥y−RSHx∥2 is small. From the many potential solutions to this problem, the desired x˜ is one with the smallest l1 norm ∥x˜∥1, representing a measure of sparsity. Therefore, the recovery of sparsely sampled OCT images may be realized by solving the following optimization problem via l1 minimization:
x˜=arg min∥x˜∥1 subject to ∥y−RSHx∥2≦ε (1.2)
In a preferred embodiment of the present invention, the matrix SH may be determined as a synthesis matrix in the shift-invariant wavelet domain which offers good compressibility of OCT images. Other sparsifying domains that offer good compressibility of OCT images and satisfy the conditions as discussed in the above-section titled “Transform Sparsity” may also be used in other embodiments of the invention.
The optimization problem in equation (1.2) is a convex optimization problem and may be cast into a linear program to solve the problem in equation (1.2), from which suitable conventional linear programs from the field of convex optimization may be employed. In a preferred embodiment of the present invention, the method for rapid OCT image acquisition using compressive sampling may employ the iterative soft thresholding (IST) solver to solve the l1 minimization problem given in equation (1.2). Before the IST solver may be applied directly to solve the l1 minimization problem, equation (1.2) is reformulated into a series of unconstrained problems using Lagrange multipliers λ as:
x˜=arg min∥x˜∥1+λ∥y−RSHx∥2 (1.3)
where λ is a parameter that controls the tradeoff between the sparsity of the solution (minimization of l1 norm) and the l2 data misfit. To simplify notation, a matrix A is defined to be A: RMSH.
An exemplary IST program code according to an embodiment of the invention for solving the l1 minimization problem may be represented as follows:
Result: Estimate for x
1
initialization;
2
x0 ← initial guess for x;
3
λ0 ← initial Lagrange multiplier;
4
L ← number of inner iterations;
5
while ∥y − Ax∥2 ≧ ε do
6
|
for l = 1 to L do
7
|
|
i ← i + 1;
8
|
|
xi+1 ← Sλk(xi + AH (y-Axi));
9
|
end
10
|
λk+1 ← αkλk with 0 < αk <1;
11
|
k ← k + 1;
12
end
Using the IST solver such as the above-described exemplary IST solution method, the iterative update x→Tλ(x+AT(y−Ay)) desirably converges to the solution for a particular value of λ as the number of iterations goes to infinity. In practice, only a finite number of iterations may be required to achieve convergence of x˜. According to an embodiment of the invention, after obtaining an approximation of the sparsifying coefficients xλ, the full OCT image f is recovered by the following equation:
f˜=SHx˜ (1.4)
In a preferred embodiment, the full 3D OCT image volume may be recovered with the IST solver using approximately six (6) inner loops and forty (40) outer loop iterations, for example.
In certain embodiments of the present inventive method for rapid OCT image acquisition using compressive sampling as above described thus far, the OCT system is a Fourier domain or time-domain OCT system and the measurement basis in which the compressive measurements are acquired may be the Dirac basis, however in other embodiments of the invention, other measurement bases may be utilized by way of modifying the OCT system hardware by which the OCT data is acquired, as may be obvious to a person skilled in the OCT art. In other embodiments, other measurement bases may be used, such as sparcifying transform matrices which form a tight-frame and pass a dot-test, for example. One way of checking whether a specific measurement matrix will allow for sparse solutions to be recovered and thereby be potentially suitable for utilization according to an embodiment of the present invention, is to check if the measurement matrix follows the Restricted Isometry Property (RIP).
In a preferred embodiment of the invention, the IST solver is selected as the l1 minimization algorithm for its fast convergence and ease of implementation. However, in other embodiments, any other suitable known l1 minimization algorithms may be applied, such as iteratively reweighted least squares, SPGL1 solver, projected gradient methods, and iterative hard-thresholding, for example
Following the modeling of the signal recovery problem, at step 320, K compressive measurements (y) representing a subset of the raster scans that make up the 3D volumetric field of view of the entire image (f) of a subject of interest are sampled in the Dirac domain by random under-sampling.
Following data acquisition at operations 310 and 320, the method for rapid OCT image acquisition using compressive sampling proceeds to signal reconstruction. At operation 330, a sparsifying domain that offers good compressibility of the full 3D image f is selected. In the embodiment as shown in
Accordingly, as described by illustrative embodiments, the method for rapid OCT image acquisition using compressive sampling of the invention, by acquiring a small random or pseudo-random subset of the raster scans that make up the 3D volumetric field of view of the entire OCT image of a subject of interest, followed by exploiting the sparsity of image coefficients in a predetermined transform domain (e.g. shift-invariant wavelet transform domain), enables the recovery of missing samples with high fidelity, thereby advantageously reducing the overall OCT scan time and the associated patient discomfort and motion artifacts that typically follow conventional OCT scanning schemes.
A full 3D OCT original image volume (f) was acquired by raster-scanning the optic nerve head of a healthy male subject using OCT. An example of a transversal slice, or C-scan, extracted from the OCT volume is shown in
The full 3D OCT image volume for each level of subsampling was recovered according to an embodiment of the present method for rapid OCT image acquisition using compressive sampling employing an exemplary IST solver (detail: using 6 inner and 40 outer loop iterations). SNR based on recovered images corresponding to 23, 35, 53, 61, and 75 percent missing data was found to be 14.9, 13.0, 10.6, 9.8, and 7.5 db respectively showing decreasing SNR with increasing degradation due to missing data. The compressive sampling (‘CS’) recovery result for 53% missing data (corresponding to a 47% sub-sampling rate) and the error |f−f˜| image for this cross-section is shown in
Comparing the two vertical and horizontal B-scans recovered from a volume with 53% missing data (corresponding to a compressive sampling rate of 47%) using the CS interpolation method as are shown in
Validation
Experiments were performed to quantify how the degradation in recovered images affected the measurement of anatomically meaningful parameters such as the optic nerve cup shape from ophthalmologic OCT image volumes acquired using compressive sampling scanning and recovery methods such as disclosed above according to embodiments of the present invention. This was done by manually segmenting, using established protocols, the clinically relevant Inner Limiting Membrane (“ILM”) surface for the reconstructed image volume for each of five exemplary levels of image degradation. These segmentations were performed on each B-scan slice of every volume.
The extracted ILM surface from one of the segmentations of the original 3D image is shown in
The recovered image may be deemed to have passed a test of required fidelity for potential morphometric use if the location of the ILM surface segmented from the recovered image falls within the variability of the surface segmentations performed multiple times on the original image volume by the same rater. To quantify the segmentation variability due to the manual rater, the ILM in the original 3D image was segmented thrice, each time by the same rater but without consulting the previous segmentations.
Using these segmented surface images, an average ILM surface was created representing a baseline or ground truth of the ILM surface. The standard deviation of each point's position as observed in the three manual segmentations of the ILM surface was calculated, and the height or color of the colormap shown in
For each point on the ILM surface segmented from the reconstructed data, the relative position to the average ILM surface (the baseline) was found. This process was used to generate so-called Topographical Change Analysis (TCA) maps representing the variability in position of the ILM surface from a known baseline/ground truth. Topographical Change Analysis (TCA) maps showing the position of the ILM surface relative to the mean, overlaid on top of summed-voxels-projection images of recovered volumes at 23%, 35%, 53%, 61% and 75% missing data (corresponding to sampling rates of 77%, 65%, 47%, 39%, and 25% respectively in embodiments of the present invention) are shown in
It can be seen that in the illustrative experimental embodiments discussed above, the quality of the summed-voxel-projection images begins to deteriorate at the 61% missing data volume shown in
TABLE 1
% Missing Data
23
35
53
61
75
DS.A. (%)
0.49
0.65
4.79
4.25
6.51
DVOL. (%)
0.36
0.81
1.14
0.85
0.84
Changes in surface area and volume of the optic nerve cup resulting from the use of images recovered from compressively sampled scans according to an embodiment of the invention were assessed to be clinically negligible.
The reduction in scan time, presented as a function of percent of missing data, is shown in
Radial OCT Imaging Using Compressive Sampling
In accordance with an alternative embodiment of the present invention, a method for rapid OCT image acquisition using radial image collection or scanning geometry and compressive sampling is provided, in which OCT acquisition of a reduced random or pseudo-random subset of radially oriented scans that make up the 3D volumetric field of view of the entire image of a subject of interest is performed during the radial scanning process. In such an alternative radial embodiment, the data comprised in the reduced random or pseudo-random subset of radial scans are further transformed and mapped to a Cartesian coordinate system with coordinates of (r, θ) on a rectangular Cartesian grid prior to compressive sampling (CS) interpolation and reconstruction, such as by using the exemplary CS interpolation and reconstruction method described above in reference to raster scanning embodiments, for example. Following such CS interpolation and reconstruction, the reconstructed radial scan data is thereafter transformed from radial coordinates of (r, θ) to an (x, y) Cartesian coordinate grid to transform and restore the physically corresponding positions of the reconstructed image to a 3D Cartesian grid to facilitate storage and display of the OCT volume in a conventional 3D Cartesian grid-based system.
In one embodiment of a radial OCT image acquisition method using compressive sampling according to the present invention, the procedure comprises an OCT imaging process using sparse radial samples of the subject volume to be imaged, which in one embodiment may comprise at least a portion of the retina and/or optic nerve head of a subject, or other ophthalmological or biological subject of interest for example. In such a radial OCT sampling embodiment, the OCT data is initially acquired by randomly-spaced radial B-scans of the subject. In the context of the present invention disclosure, random-radial B-scans refer to OCT scans where the angle of a subsequent B-scan, relative to the previous B-scan, is drawn from a random or pseudo-random distribution. Suitable such radial B-scan “spokes” consisting of a fixed number of A-scans may be acquired at a random angular spacing within a range defining a maximum and minimum allowable step size, for example, to provide a randomly subsampled set of radial scans of the subject volume. In one such embodiment, the sparseness of the random radial B-scan subsampling acquisition may accordingly be determined by selecting the maximum allowable angular step size between radial B-scans.
Following random radial OCT scanning of the subject, the method comprises a step of mapping the acquired random radial B-scan or “spoke” data to place it in a Cartesian system by converting the radial (r, θ) coordinates of the radial B-scans to a Cartesian grid where θ is mapped to the x coordinate (x=θ), and r is mapped to the y coordinate (y=r) to result in a Cartesian grid in (r, θ) space, as is illustrated in a schematic view in
Following the mapping of acquired random radial B-scans to an exemplary Cartesian grid as described above, the method comprises the step of interpolating the missing equivalent vertical raster scans in the Cartesian grid according to a suitable CS method to reconstruct a series of equivalent vertical raster scans and provide a suitably accurate interpolated set of vertically oriented B-scans in the Cartesian grid, as illustrated in schematic view in
In one embodiment, incorporating CS interpolation of the “missing” vertically oriented scans, f may be used to denote the full 3D tissue image, R to be a 3D restriction mask that restricts the image samples actually acquired, M to be a measurement basis and y to be the image samples actually acquired. In such an embodiment, the sparse image acquisition problem can now be formulated as y=RMf+n, where n is the noise in the collected data. If S is an exemplary transform domain that offers good compressibility of f, and x=Sf are the transform coefficients of f then f may desirably be exactly reconstructed by f=SHx, where SH is the synthesis of S. In such an embodiment, instead of directly recovering the image f, we find a set of coefficients {tilde over (x)} so that {tilde over (f)}=SH{tilde over (x)} is a good approximation of f. In such case, the approximating coefficients may be found by solving the following constrained optimization problem:
{tilde over (x)}=argminx∥x∥1 subject to ∥y−RSHx∥2≦ε.
In one such embodiment, the above constrained optimization problem may be solved using a suitable exemplary Iterative Soft-Thresholding solver, for example.
Following the interpolation and reconstruction of the missing vertically oriented radial B-scans in the exemplary Cartesian grid as described above, the method according to one embodiment thereof comprises the step of mapping the interpolated B-scan and acquired B-scan data back onto a representative physical 3D Cartesian volume by applying the inverse of the earlier mapping, as illustrated in schematic view in
Examples of Radial OCT Scanning and Compressive Sampling Method
In one exemplary embodiment, a full 3D OCT original image volume (f) was acquired by raster-scanning the optic nerve head of a healthy male subject using Fourier-domain OCT. The exemplary OCT system used for the scan had a line rate of 20 kHz, with axial and lateral resolutions of 4 μm and 25 μm, respectively. The cross sectional B-scans consisted of 512 A-scans and the full volume consisted of 400 B-scans, covering an area of approximately 3.7 mm×1.8 mm.
To simulate the sparsely sampled OCT image volume (y) that would be acquired by the above-described method of random radial B-scans to rapidly sub-sample the desired subject volume, three random radial sampling masks (R) were generated consisting of n=200, n=100 and n=60 radial B-scans, and were applied to this full OCT image f, to correspond to 61.5%, 80.9% and 88.3% missing data from the original image volume and create three sub-sampled volumes y comprising 200, 100 and 60 radial B-scans, respectively. In this exemplary embodiment, a first radial B-scan is taken oriented along the horizontal axis, and the radial direction of each subsequent radial B-scan is incremented by a random angle, randomly drawn from a normal distribution over [0, π/n], so that the maximal angular increment between adjacent radial B-scans is θmax≦2π/n.
Following the application of the particular radial subsampling masks (R) to the full image data volume (f), the missing radial B-scan data was interpolated and reconstructed using the CS procedure described above in the previous section, including the mapping and reverse mapping steps described above in connection with
As can be seen by examining the reconstructed B-scan images and comparison to the original full volume B-scans illustrated in
Validation of Radial OCT Scanning and Compressive Sampling Method
Experiments were performed to quantify how the degradation in recovered images affected the measurement of anatomically meaningful parameters such as the optic nerve cup shape from ophthalmologic OCT image volumes acquired using random radial B-scans and compressive sampling recovery methods such as disclosed above according to exemplary radial scanning embodiments of the present invention. This was done by manually segmenting, using established protocols, the clinically relevant Inner Limiting Membrane (“ILM”) surface for the reconstructed radial OCT scan image volumes for each of three exemplary levels of image degradation corresponding to 200, 100 and 60 radial B-scans in the exemplary original 400 raster scan full image volume. These segmentations were performed on each B-scan slice of each of the full and recovered volumes.
The Inner Limiting Membrane (ILM) of the original raster-scanned volume was independently manually segmented three times and the standard deviation of the segmentation at each point on the resulting ILM surface was computed. Subsequently, the ILM on each of the recovered surfaces was segmented by the same internal segmentation protocol and the points on each ILM surface lying more than one standard deviation away from the mean ILM surface were located. Points on each of the three degraded and recovered ILM surfaces lying more than one standard deviation from the mean ILM surface were shown in a Topographical Change Analysis (TCA) plot overlaid on top of the summed-voxels-projection images of the recovered volume.
As can be seen by reviewing the TCA map images in
The advantageous reduction in scan time required to acquire a subsampled random radial OCT B-scan volume according to the method described above according to a radial scanning embodiment of the invention, relative to the scan time required to acquire a full raster scanned volume of the same subject, is directly proportional to the number of radial B-scans acquired according to the exemplary embodiment of the invention compared to the number of original raster scans required in the raster scanned volume. The percentage reduction in scan time can be calculated by the formula (1−n/N) where n is the number of acquired radial B-scans and N is the number of original raster scans. For example, the original raster scanned volume (f) described in the above-mentioned exemplary embodiment consisted of 382 raster scans, so the subsampled radial scan volume consisting of 60 radial scans corresponds to an 82.3% reduction in scan time.
In yet a further alternative embodiment of the present invention, the method described above using a random radial subsampling pattern for acquiring a reduced set of radial B-scans and use of radial to Cartesian coordinate mapping and reverse transformation in connection with CS interpolation and reconstruction of missing data may also be applied to radial imaging of other non-OCT image acquisition systems, such as ultrasound, magnetic resonance (MRI) and x-ray (including Computed Tomography) imaging systems, for example. The method of radial subsampling according to an embodiment of the invention may also be advantageously be applied to imaging of particular subject volumes where the critical or desired features to be imaged may be concentrated in one area which may be used to center a random radial scanning pattern according to the invention, so as to advantageously concentrate sampling data acquired by random radial scans of the central area and associate features, while reducing sampling of features distant from the center of the radial scan pattern, for example. In yet another embodiment, random radial scan and CS image acquisition methods according to the present invention may also advantageously be used in applications where it is desired to reduce the exposure to imaging radiation, such as in x-ray based imaging systems, for example, where the reduced number of scans and scan time offered by the present inventive methods may significantly reduce the total exposure of a subject to imaging radiation, for example. Further, the above-described random radial scanning methods using CS may also be applied to scanning subject volumes where radial symmetry or access to the subject are limited to or optimized for radial scanning over raster imaging patterns, such as in trans-rectal imaging of the prostate using ultrasound, for example, where a point source imager may be rotated through a radial scan pattern advantageously over a raster scan pattern, for example.
The exemplary embodiments herein described are not intended to be exhaustive or to limit the scope of the invention to the precise forms disclosed. They are chosen and described to explain the principles of the invention and its application and practical use to allow others skilled in the art to comprehend its teachings.
As will be apparent to those skilled in the art in light of the foregoing disclosure, many alterations and modifications are possible in the practice of this invention without departing from the spirit or scope thereof. Accordingly, the scope of the invention is to be construed in accordance with the substance defined by the following claims.
Beg, Mirza Faisal, Lebed, Evgeniy, Sarunic, Marinko V.
Patent | Priority | Assignee | Title |
10022047, | Sep 04 2015 | Canon Kabushiki Kaisha | Ophthalmic apparatus |
10502544, | Jun 15 2016 | CARL ZEISS MEDITEC, INC | Efficient sampling of optical coherence tomography data for explicit ranging over extended depth |
Patent | Priority | Assignee | Title |
7145661, | Dec 31 2003 | CARL ZEISS MEDITEC, INC | Efficient optical coherence tomography (OCT) system and method for rapid imaging in three dimensions |
7532772, | Jul 20 2004 | Duke University | Coding for compressive imaging |
7646924, | Aug 08 2005 | The Board of Trustees of the Leland Stanford Junior University | Method and apparatus for compressed sensing |
8446593, | Jun 16 2010 | The Board of Trustees of the Leland Stanford Junior University | Optical coherence tomography system and method therefor |
20080100612, | |||
20080140341, | |||
20090080739, | |||
20090270738, | |||
20090279098, | |||
CA2737822, | |||
WO2010009447, | |||
WO2012027849, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Aug 31 2011 | Simon Fraser University | (assignment on the face of the patent) | / | |||
Mar 10 2015 | LEBED, EVGENIY | Simon Fraser University | NUNC PRO TUNC ASSIGNMENT SEE DOCUMENT FOR DETAILS | 035175 | /0537 | |
Mar 11 2015 | BEG, MIRZA FAISAL | Simon Fraser University | NUNC PRO TUNC ASSIGNMENT SEE DOCUMENT FOR DETAILS | 035175 | /0537 | |
Mar 11 2015 | SARUNIC, MARINKO V | Simon Fraser University | NUNC PRO TUNC ASSIGNMENT SEE DOCUMENT FOR DETAILS | 035175 | /0537 |
Date | Maintenance Fee Events |
Oct 22 2018 | M2551: Payment of Maintenance Fee, 4th Yr, Small Entity. |
Dec 12 2022 | REM: Maintenance Fee Reminder Mailed. |
May 29 2023 | EXP: Patent Expired for Failure to Pay Maintenance Fees. |
Date | Maintenance Schedule |
Apr 21 2018 | 4 years fee payment window open |
Oct 21 2018 | 6 months grace period start (w surcharge) |
Apr 21 2019 | patent expiry (for year 4) |
Apr 21 2021 | 2 years to revive unintentionally abandoned end. (for year 4) |
Apr 21 2022 | 8 years fee payment window open |
Oct 21 2022 | 6 months grace period start (w surcharge) |
Apr 21 2023 | patent expiry (for year 8) |
Apr 21 2025 | 2 years to revive unintentionally abandoned end. (for year 8) |
Apr 21 2026 | 12 years fee payment window open |
Oct 21 2026 | 6 months grace period start (w surcharge) |
Apr 21 2027 | patent expiry (for year 12) |
Apr 21 2029 | 2 years to revive unintentionally abandoned end. (for year 12) |