A method for the analysis of three dimensional scan data representing an articular cartilage is provided to extract a quantitative parameter indicative of joint pathology. A measure representative of cartilage homogeneity is derived from this three dimensional image data. The measured value is compared with similar measured values previously established in respect of healthy joints and/or joints characterised by a pathology.
|
1. A method for the analysis of three dimensional image data representing an articular cartilage to extract a quantitative parameter indicative of joint pathology, which method comprises determining from the data a measure representative of cartilage homogeneity, and further comprising comparing the measured value for the joint with measured values previously established in respect of healthy joints and/or in respect of joints characterised by a pathology, wherein said measure representative of cartilage homogeneity is the entropy, the mean, the standard deviation or the uniformity of measured intensities within a region of interest of the image.
2. A method as claimed in
3. A method as claimed in
4. A method as claimed in
5. A method as claimed in
9. A method as claimed in
10. A method as claimed in preceding
11. A method as claimed in
12. A method as claimed in
13. A method as claimed in
14. A method as claimed in
15. A method as claimed in
16. A method as claimed in
17. A method as claimed in
|
The present invention relates to a method for deriving a useful quantitative measure indicative of joint pathology from three dimensional scan data of a joint cartilage, e.g. of a knee joint, which may be useful in the diagnosis and prognosis of said pathology, especially of osteoarthritis.
Osteoarthritis (OA) affects the daily lives of the majority of the older part of the world population—for some by minor morning stiffness and for others to the degree of causing severe pain and reduced range of motion. Furthermore, even though promising new treatment possibilities are arising, a major, thoroughly documented breakthrough in effective treatment of OA beyond symptom control is still awaited. One limiting factor in the development and evaluation of new treatments is the effectiveness of the methods for quantification of disease progression in clinical studies.
Accuracy and precision of quantification methods are essential, together with the ability to monitor the actual progression of the disease. These factors, accuracy and precision (accuracy is used to mean correctness whereas precision is used for reproducibility), affect both the number of test subjects needed in a clinical study and the required duration of the study. In addition to accuracy and precision, there is very substantial value in automating quantification methods. Fully automatic (typically computer based) quantification methods by definition eliminate intra-observer variation and thereby potentially allow better precision. Furthermore, for studies based on medical imaging data (X-ray, MRI, CT, etc.), the load on the radiologists is potentially overwhelming—and increasingly so when morphometric measures in 3D are desired. Morphometric measures require fully segmented structures with anatomical correspondence defined. Thereby, computer-based methods can not only relieve the radiologists but also allow quantification measures that would otherwise be unfeasible in large-scale studies or simply even impossible.
In the detailed illustrative description of the present invention, we shall focus on quantification of articular knee cartilage from Magnetic Resonance Imaging (MRI) by way of example with particular reference to OA. This is without limitation of the general scope of the invention either as regards imaging technology, joint of interest, or relevant pathology but will aid ready understanding. MRI offers some obvious advantages compared to traditional X-ray based OA monitoring. First, the cartilage is visible.
Other methods exist for segmentation and quantification of articular cartilage from MRI data. However, to our knowledge, no other fully automatic method has been evaluated and published. In general, the MR based methods are more often evaluated for segmentation accuracy and precision rather than for morphometric quantification and ability to monitor OA progression.
A semi-automatic method based on watershed transformation and requiring 5-10 minutes of human interaction per knee is presented in (Grau, Mewes, Alcaniz, Kikinis & Warfield 2004) showing good segmentation performance on four knees.
Another method performs region growing based on voxel intensities from fused scans followed by classification and editing of the resulting regions requiring 10-40 minutes of human interaction per knee (Pakin, Tamez-Pena, Totterman & J. Parker 2002, Tamez-Pena, Barbu-McInnis & Totterman 2004). The method is sparsely evaluated but thickness measures repeated on the same scan results in a CV of 3.2% for the tibial medial compartment.
Also, some methods perform cartilage segmentation by slice-wise 2D segmentation (Stammberger, Eckstein, Michaelis, Englmeier & Reiser 1999, Lynch, Zaim, Zhao, Stork, Peterfy & Genant 2001). They rely on experts marking the cartilage sheet in most slices and thereby become quite time-consuming (about 2.5 hours per knee (Stammberger et al. 1999)). Furthermore, the resulting segmentations are less suitable for morphometric analysis.
The method from (Stammberger et al. 1999) is evaluated in (Koo, Gold & Andriacchi 2005) on four test subjects giving a coefficient of variation (CV) for cartilage thickness measurement of 6.6% for inter-observer variability and about 4% relative difference between measurements from repeated scans of a single test subject.
Another semi-automatic method based on region growing is used in (Ding, Garnero, Cicuttini, Scott, Cooley & Jones 2005) where they show that cartilage volume is significantly related to presence of cartilage defects in a study including 372 test subjects. Methods focusing on measurement of the joint space width from radiographs have been extensively evaluated in clinical studies.
WO03/012724 discusses automatic processing of scan images to extract measurements of biomarkers. Semi-automatic segmentation of images is described and an attempt is made to track biomarkers through time on subsequent scans. A large number of biomarkers are mentioned, including the signal intensity distribution within the cartilage layers. However, whilst it is indicated that it may be of interest to track changes in such structural measures through time, there is no suggestion that the value for a given patient at any one time could be compared in a diagnostically meaningful way with values from other individuals. There is no specific method for performing any quantification. There is moreover no clinical data provided to show that this parameter does actually change with disease progression. Accordingly, it cannot be deduced from this teaching that it would be diagnostic to compare a value of signal intensity distribution of a cartilage obtained from a patient to equivalent values established in respect of a population of pathology free individuals or a population of patients suffering from a cartilage pathology. Indeed, it is not even deducible from this teaching whether a higher or a lower value for such quantification should be regarded as more pathological.
Before the cartilage even starts to thin there are various biochemical changes undergoing in the cartilage. For example, during the early stages of OA the cartilage may swell up due to the inclusion of water. As a result, measuring volume at this stage may not be adequate.
In this respect, some changes in the cartilage structure have to be observed at microscopic scale, for example, loss of proteoglycan, loss of collagen type II, diminished water content, and early structural damage such as minor lesions are not directly visible at the macroscopic scale. Due to limitations in the available imaging resolution, these microscopic events will affect the intensities observed at MRI indirectly through partial volume effects.
Most research in MRI on quantitative imaging of cartilage quality has been focused towards developing specific pulse sequences where the resulting intensities are linked to the concentration of certain molecules (e.g. water) or certain proteins (e.g. proteoglycan or collagen). Thereby, a loss of concentration results in an overall darkening of the cartilage in the scan and the mean intensity can be used as a biomarker for monitoring the process.
The T2 relaxation time is one of the first structural biomarkers based on MRI. The T2 time is related to both collagen matrix organisation and water content. In (Lusse, S., Claassen, H., Gehrke, T., Hassenpflug, J., Schunke, M., Heller, M., Gluer, C. C.) they showed a correlation between T2 and water content on 3 subjects in vivo. In (Smith, H. E., Mosher, T. J., Dardzinski, B. F., Collins, B. G., Collins, C. M., Yang, Q. X., Schmithorst, V. J., Smith, M. B.) they investigated the spatial variation of T2 times from 3T scans on 15 healthy subjects and found higher T2 values near the articular surface—consistent with the structural cartilage layering. In (Liess, C., Lusse, S., Karger, N., Heller, M., Gluer, C.), they showed reduced T2 times after exercise on 20 healthy subjects—consistent with a loss of water content. Also, they showed a 5% loss of cartilage thickness as a result of the same exercise session. Finally, in (Mosher, T. J., Liu, Yi, Yang, Q. X., Yao, J., Smith, R., Dardzinski, B. J, Smith, M. B) they investigate 30 asymptomatic women using 3T scans. They showed increased T2 times for women over the age of 45—and in particular they investigated the location of the structural changes with results indicating that the age-related changes in cartilage structure begins at the articular surface and progresses to the deeper layers with advancing age.
The T2 relaxation time is not the only marker from relatively simple MRI sequences suitable for inspection of cartilage quality. The mean intensity across the entire cartilage sheet from a 3D spoiled gradient-echo fat suppression sequence (sagittal, 0.6 mm in-plane, 2 mm slice thickness, 1.5 T) was investigated in (Naish, J. H., Vincent, G., Bowes, M., Kothari, M., White, D., Waterton, J. C., Taylor, C. J.). The scan intensities were normalized in order to minimize scanner variation. They reported a 1% intensity decrease over a 1 year period (p<0.01) for a group of 50 OA subjects. This is related to loss of hydration, but since the GE signal is proportional to proton density but also affected by T1 and T2* it is not a specific marker for a single biological/chemical process. The method was not evaluated for the ability to quantify progression of OA.
According to the present invention, there is provided a method for the analysis of three dimensional image data representing an articular cartilage to extract a quantitative parameter indicative of joint pathology, which method comprises determining from the data a measure representative of cartilage homogeneity, and further comprising comparing the measured value for the joint with measured values previously established in respect of healthy joints and/or in respect of joints characterised by a pathology.
In the present invention, it has been realised that the early loss of integrity could be measured by quantifying the decrease in alignment of the collagen fibers in the three layers of the cartilage.
However, microscopic changes in the cartilage structure will not be directly visible in macroscopic medical scans, such as magnetic resonance images (MRI), however such changes will affect the intensity appearance in the scans.
Accordingly, and due to limitations in resolution and acquisition times, at this stage we settle for analysis of the intensities observed in regular magnetic resonance images (MRI) as a first step. Instead of measuring integrity of cartilage layer alignment directly, we therefore quantify the cartilage homogeneity by quantifying the intensity distribution of cartilage in a magnetic resonance image at macroscopic level.
It will be appreciated that the word “homogeneity” may be interpreted in several ways. The term homogeneity describes a specific equation that can quantify the spatial dependence of gray level values, as shown in (Haralick, R. M., Shanmugam, K., Dinstein, I.). Alternatively, the term homogeneity may be used as a general term for describing the uniformity of textural appearance of scan intensities. In the broader sense, the term embraces a number of mathematically defined measures of first order or higher orders (homogeneity in the narrower sense being one of these). Such homogeneity measures include entropy, as discussed in more detail below. This broader latter sense is usually intended where the phrase cartilage homogeneity is used in this specification. Where the specific mathematical definition is intended, the term is accompanied by the relevant formula.
Analysis of structure has previously been applied to anatomical structures other than cartilage. For example, the structure of trabecular bone can be quantified by fractal signature analysis as described in (Buckland-Wright, J., Lynch, J., Macfarlane, D.). This sort of analysis offers a means of detecting targets in background clutter that have similar spectral characteristics. Texture analysis has also been used for the measurement of osteoporosis progression analysis in the form of Minkowski functionals and scaling vectors. However, the thin cartilage structure with a typical thickness of only a few voxels complicates the analysis.
In an embodiment, the measure is representative of the homogeneity of measured intensities within a region of interest of the image. Various first and second order statistical methods may be used to approximate the probability of observing a particular intensity at a randomly chosen location. For example, to provide a measure representative of the homogeneity of the measured intensities, we can measure the mean (average intensity value), standard deviation (contrast of image) or uniformity (energy of image). Preferably, we measure the entropy (randomness) of the measured intensities in the image.
In an embodiment, the method further comprises partitioning the region of interest into at least two sub-regions and comparing the measured value representative of homogeneity obtained from the sub-region that has previously been found to best discriminate between healthy joints and joints characterised by a pathology.
Preferably, the method further comprises regularising data representative of said measured intensities within said region of interest to enhance measurements derived from said signals. There are three different regularisation approaches: the first approach regularises the partitioned regions by applying geometric curve evolution by iterating the median filter; the second approach uses binary morphological filtering on the regions and the third approach uses the concept of bootstrap sampling.
The region of interest is preferably selected such that it lies in a load bearing area of said cartilage. More preferably, a sub-region of interest is selected such that it is predominantly at the medial part of the medial tibial cartilage sheet (away from the centre of the knee). In particular, the region of interest is preferably all or some of (e.g. at least 50% or at least 75% of) that part of the cartilage that overlies and bears upon one of the two menisci of the knee joint. Preferably the region of interest is chosen such that at least 50%, more preferably at least 75%, most preferably at least 90% of the region of interest consists of areas of the cartilage that overly and bear upon one of the two menisci of the knee joint.
Whilst the invention is applicable to any joint cartilage, for instance cartilage of the hip joint, finger joints, vertebra cartilage, shoulder joints or elbow joints, the cartilage is preferably a knee cartilage, especially a tibial cartilage and more especially a medial tibial cartilage.
Preferably, a comparison of said quantitative parameter is made both with values of the quantitative parameter previously established in respect of healthy joints and with values of said quantitative parameter previously established in respect of joints characterised by a pathology.
In an embodiment, a comparison of said quantitative parameter is made with values of the quantitative parameter established in the same joint but at a subsequent period of time to enable an assessment of disease progression.
Said pathology is preferably osteoarthritis or rheumatoid arthritis, but may be pigmented villonodular synovitis, Lipoid dematoarthritis (Multicentric reticulohistiocytosis), Enteropathic arthritis, hemophilia (intraarticular bleeding), Gout, Familial Mediterranean fever, Pseudogout, Ochronotic arthropathy, Secondary OA, Syphilis (tabes dorsalis), Pyrogenic arthritis, Tuberculous arthritis or Fungal arthritis.
Whilst the invention is applicable to any 3-dimensional image data, however acquired, for instance from an NMR scan, or by X-ray tomography, it is preferred that said three dimensional scan data is produced by magnetic resonance imaging (MRI).
Although the invention has principally been defined as a method of extracting significant information from a digital image, it is of course equally applicable as an instruction set for a computer for carrying out a said method or as a suitably programmed computer.
The comparison step is preferably conducted making use of previous measurements on a healthy or diseased population of reference joints for which values or average values are stored in a database or memory location in such a computer. The computer may be programmed to display the results of the comparison as a read out.
The invention will be further described and illustrated with reference to specific embodiments thereof with reference being made to the accompanying drawings, in which:
As set out above, the present inventors have realised that the early loss of integrity in cartilage could be measured by quantifying the decrease in alignment of the collagen fibres in the three layers of an area of cartilage.
In order to quantify homogeneity, described below is a method of measuring various parameters related to the intensity of signals in an MRI scan, including measuring the mean signal intensity and entropy of the signal intensities, using a grey scale histogram, which in turn represents the distribution of intensities inside a region of cartilage. The results are then refined by determining the area of interest within the region of cartilage that provides the best indicator of osteo-arthritis.
Entropy is a measure of the information content or alternatively randomness of data. Calculating the entropy of the magnetic resonance intensities derived from a scan can be used to provide a measure of homogeneity in the cartilage of a joint.
We shall describe a specific embodiment of the invention starting from the taking of MRI scans of knees and working through the steps of voxel classification and quantification of diagnostic parameters.
An Esaote C-Span low-field 0.18 T scanner dedicated to imaging of extremities was used to acquire Turbo 3D T1 scans (40° flip angle, TR 50 ms, TE 16 ms). The scans were made through the sagittal plane with a voxel size in the range 0.7031×0.7031×(0.7031/0.7813/0.8594) mm3. The scans all had the size 256×256×104 voxels, but we only used the central 170×170×104 voxels because only they contained information.
For comparative purposes, the scans were manually segmented on a slice-by-slice basis by radiologists. A scan slice with the tibial and femoral medial cartilage manually segmented is shown in
For the segmentation of cartilage we use an approximate kNN classifier, which is implemented in an ANN (Approximate Nearest Neighbour) framework and developed by Mount and colleagues (Arya et al, 1994). The ANN classifier is in principle the same as a kNN classifier, but with the modification that one can allow for a small amount of error in the search for nearest neighbours which may improve the run time significantly. An error bound, ε, is introduced, so instead of returning the k nearest neighbours from a data set, the ANN search algorithm returns k points such that the ratio of the distance between the ith reported point (1≦i≦k) and the true ith nearest neighbour is at most 1≦ε. We have found empirically that examining the 100 nearest neighbours yields a good balance between computational complexity and accuracy, and we set ε=2, a value that only marginally lowers the accuracy while reducing computational time significantly.
Here, we examine the medial cartilage since OA is more often observed in this compartment (Dunn et al, 2004) and in particular in the medial tibial part (Kamibayashi et al, 1995), thus these compartments are of major interest when it comes to finding disease markers for OA. In order to separate different types of cartilage from one another we use a three class classifier, where the classes are tibial medial cartilage, femoral medial cartilage and background.
The classification is hierarchical, and the first step is a two class classification where the voxels are roughly separated into cartilage or background. The kNN produces class probabilities for every voxel, and in this step we set the threshold at 0.65 yielding a sensitivity for medial cartilage close to 99%. This also results in a large amount of false positives, but since typically only a few percent of the total volume within the knee belongs to the cartilage, this first step is a way of reducing data significantly. In the second step, the voxels classified as cartilage in the first step are reconsidered. This time we use a three class classifier, where the three classes are tibial and femoral medial cartilage and background, and class membership is decided based on a majority vote. The three class classifier contains more features and the features are optimized to separate the three classes whereas the classifier in the first step has features optimized to separate cartilage from background. A sketch of the hierarchical classification scheme is illustrated in
We have also tested a direct partitioning into the three classes, but the hierarchical approach yields better results and is faster, since the first step has less features and thus lower computational complexity. The classifier in the first step has a set of 33 features compared to the three class classifier in the second step that contains 51 features.
In order to find a feature set that performs well for our classification scheme, we here introduce our set of candidate features and the subsets of the features that were found from our feature selection method, which consists of sequential forward selection followed by sequential backward selection.
When a radiologist examines an MR scan for cartilage, she or he takes the location and the intensity in the image into consideration. We therefore consider these as candidate features.
One can also consider features that are related to the geometry of the object in question. The 3-jet, which is all first, second and third order derivatives with respect to (x,y,z) forms a basis which can describe all geometric features up to third order and are listed as candidate features. All the derivatives mentioned in this section are Gaussian derivatives and are defined as
Ii
where g is a Gaussian, D a differential operator and σl is the scale.
Cartilage can be described as a thin curved disc in 3D. The Hessian (H), which is the symmetric matrix containing second order derivatives with respect to the coordinates (x,y,z),
is therefore considered. The eigenvectors of the Hessian points in the directions of the principal curvatures and its eigenvalues correspond to the curvature in those directions. A thin disc such as cartilage will locally yield one large and two small eigenvalues. The eigenvalues as well as the three eigenvectors are candidate features.
A feature that has been shown to be significant in the detection of thin structures such as fingerprints is the structure tensor (ST). It is a symmetric matrix containing products of the first order derivatives convolved with a Gaussian,
where σ is not necessarily the same scale as the one used for obtaining the derivatives. The ST examines the local gradient distribution at each location (x,y,z). The directions of the eigenvectors depend on the variation in the neighbourhood. The eigenvalues and eigenvectors of the ST were considered as potential features with a combination of three scales of σ1 and three scales of σ2.
The third order derivatives with respect to (x,y,z) can be conveniently represented in the third order tensor Iijk. Examining the third order structure in the local gradient direction (Ix, Iy, Iz) can be described using Einstein summation as
Lwww=IijkIiIjIk/(IiIi)3/2
The third order tensor is examined in the gradient direction on three different scales, which were considered as possible features.
The features used in the two class classifier are the position in the image, the Gaussian smoothed intensities on three different scales (0.65 mm, 1.1 mm, 2.5 mm) and the raw intensities, the first order Gaussian derivatives on scales 0.65 mm and 2.5 mm, the eigenvalues and the eigenvector corresponding to the largest eigenvalue of the structure tensor with σ1=0.65 mm and σ2=2.5 mm, and the eigenvalues of the Hessian on scales 1.1 mm and 2.5 mm.
The features in the three class classifier consist of combinations of first, second and third order Gaussian derivatives on the three different scales mentioned, the Gaussian smoothed intensities on three different scales (0.65 mm, 1.1 mm, 2.5 mm) and the raw intensities, the position, the eigenvector corresponding to the largest eigenvalue of the ST with σ1=0.65 mm and σ2=1.1 mm, the eigenvalues of the ST with σ1=1.1 mm and σ2=2.5 mm, the eigenvalues of the Hessian on scales 1.1 mm and 2.5 mm.
The features selected as most significant are the Hessian and the structure tensor along with the intensity and the position in the image. The features were normalized between zero and one. Normalization for unit variance was also examined, but the normalization of values between zero and one produces slightly better results.
The placement of the knee varies slightly in clinical studies but is still a strong cue to the location of cartilage, which will be evident in the segmentation method described below, where the position in the scan is selected as one of the most significant features. Even though the global location is a strong cue the minor variation in placement is a source of errors. Segmentation methods that rely on manual interaction are usually less sensitive to knee placement. However, in an automatic system, it is desirable to eliminate manual labour in segmentation tasks and accordingly, placement variation is an issue that needs attention.
In order to adjust the segmentation method to become more robust to variations in knee placement, an iterative scheme, consisting of two steps, has been developed. First, the coordinates of the scan are shifted so that the cartilage centre of mass found from the segmentation is positioned at the location of the centre of mass for the cartilage points in the training set. Then the volume is re-classified with the other features unchanged and re-segmented.
The method is trained on 25 scans and evaluated on 114 scans. Of the 114, 31 knees have been re-scanned and the reproducibility is evaluated by comparing the first and second scanning.
The automatic segmentation yields an average sensitivity, specificity and DSC are 81.15 (+/−11.0% s.d), 99.9% (+/−0.04% s.d) and 0.79 (+/−0.07s.d) respectively in comparison with manual segmentations. As to inter-scan reproducibility of the volumes from the automatic segmentations, the linear correlation coefficient between the first and second scanning is 0.86 for the 31 knees, with an average volume difference of 9.3%.
The fully automatic segmentation requires 10 minutes of computation (on a standard 2.8 GHz desktop computer) using an optimised algorithm for voxel classification. The segmentation mean accuracy is evaluated to sensitivity 84.2% and specificity 99.9%.
After applying position normalisation, the average sensitivity, specificity and DSC are 83.9% (+/−8.37 s.d), 99.9% (+/−0.04% s.d) and 0.80 (+/−0.06% s.d) respectively and it converges in only one iteration. Compared to the initial segmentation there is a significant increase in sensitivity (p<1.0*10−7) and in DSC (p<2.5*10−3) according to a students t-test. In order to illustrate how the segmentations are affected, the best results shown in
The reproducibility of the segmentation is improved with an increase of the linear correlation coefficient from 0.86 to 0.93 and the average volume difference decreases from 9.3% to 6.2%. These reproducibility values can be compared to the volumes from the manual segmentations by a radiologist for the same data set. The linear correlation coefficient is 0.95, and the radiologist has an average volume difference of 6.8%.
From a subset of 71 scans from our collection we use 25 for training and 46 for the evaluation of our segmentation algorithm. The results of our automatic segmentation is compared to the manual segmentation made by radiologists, resulting in an average sensitivity and specificity of 90.0% and 99.8% respectively for the test set for the medial cartilage compartments. A comparison between gold standard segmentation and an automatically segmented knee MR scan can be seen in
The Dice similarity coefficient between our automatic segmentation and the gold standard segmentation is for the test set on average 0.80.
Comparing our method with a competing semi-automatic segmentation algorithm (Pakin et al. 2002), we get a distinctly higher sensitivity and a slightly better specificity. Our segmentation algorithm performs well compared to two leading cartilage segmentation schemes, which demonstrates that fully automatic cartilage segmentation is achievable in low-field MR scanners.
A total of 114 scans of knees were taken of both left and right knees and used for validation and evaluation of the cartilage homogeneity quantifications. A week later 31 knees were rescanned for the precision and reproducibility study. The test subjects are both males and females aged between 21 and 72 years. They have no, mild or sever OA symptoms, diagnosed by radiologists as being 0,1,2 and 3 on the Kellgren and Lawrence Index (Kellgren & Lawrence 1957). Among the 114 test subjects 51 are healthy (KL:0) and 62 have OA (KL: 1-3).
We define cartilage homogeneity to be a measure of the variation of the intensities inside the cartilage compartment. To quantify homogeneity we calculate a number of measures of mean signal intensity and entropy of the signal intensities based on two different types of statistical methods.
The first order statistical methods rely on approximating the probability of observing a particular intensity at a randomly chosen location in the image. The measures are calculated form the grey scale histogram of the image defined by:
where N is the number of pixels in the image, ni is the number of occurrences for intensity i and L is the number of grey levels in the image. Using the equation for histogram we define the following measures:
To ensure invariance to change in the image quantisation levels, we normalise entropy by log1 (base 2) of the quantisation levels (q=4096).
The second order statistical methods measure the joint probability distribution of pairs of voxels in the image. This involves the estimation of the discrete second-order probability function Cdθ(i,j) which represents the probability of occurrence of a voxel pair with grey levels i and N given the spacing between the pair of voxels is d along a given direction θ. Cdθ(i,j) is called the grey level co-occurrence matrix (GLCM). Due to the small size of the cartilage region we only consider the immediate neighbouring voxels. Furthermore to reduce the dimensionality we assume that the joint probabilities are direction independent. Therefore we have an averaged L×L GLCM where L is the number of grey levels in the image.
In order to quantify this spatial dependence of gray level values (Haralick, R. M., Shanmugam, K., Dinstein, I.) suggests 14 measures which are extracted from the GLCM. A subset of the four most relevant measures is chosen:
Accordingly, a population of test subjects was prospectively selected. The subjects were randomly selected such that the population had an even distribution between sexes and across ages. Furthermore, the subjects were selected for the study such that the number of healthy and subjects with OA symptoms were approximately equal. Subjects with previous knee joint replacement, inflammatory arthritis or presenting any contraindication for MRI examination were excluded prior to the study.
Thereby, we have a total of 114 manually segmented knee MR Images. For each knee we have the segmentations both for the tibial and the femoral medial cartilage. The values of the measures for both tibial and femoral in each image are calculated and the measures are grouped according to the KL values of the subjects: being healthy or having OA. To determine the amount of discrimination a measure provides we test the null hypothesis that the two distributions (healthy and OA) have the same mean using the t-test. The resulting p-value is the probability with which the hypothesis can be rejected. If this p-value is less than a chosen level of significance α then we will reject the null hypothesis. Using α=0.05 the following measures succeeded to discriminate healthy from OA: standard deviation, uniformity and entropy from first order statistics and contrast from second order.
Measure
P-Value
Measure
P-Value
Volume
0.002
GLCM:Contrast
0.007
Mean
0.1
GLCM:Corrleation
0.8
standard deviation (σ)
0.0000
GLCM:Energy
0.3
Uniformity
0.002
GLCM:Homogeneity
0.1
Entropy
0.0005
The table above lists the p-values for the hypothesis testing of all the first (left-hand column) and second (right-hand column) order measures calculated from manual segmentations of the tibial medial cartilage. The p-values are low suggesting that the measures can significantly discriminate healthy from OA. Volume of the knee cartilage is considered a good measure for monitoring OA progression. To assess and compare the discriminatory power of our measures we also include p-values for volume (volume of each cartilage is normalised by width of the subject's tibial plateau).
Std dev
Type
Volume
(σ)
Uniformity
Entropy
GLCM:Contrast
Whole
0.3
0.4
0.06
0.2
0.1
femur
Load
0.3
0.05
0.01
0.02
0.1
bearing
The first row of the above table shows the results for manual segmentations of the femoral medial cartilage. The first row shows the values for the whole femur while the second row shows the values for the load bearing region. The p-values are high which means that the method fails to discriminate. It has been shown that the accuracy of the thickness measurements from MR images is better in the weight bearing regions of the femoral cartilage. It is because the weight bearing region of the femur sustains contact with the tibial cartilage during the gait cycle. The load bearing region is approximated by the intersection between femoral cartilage and the result of applying a 3D morphological dilation operator to the tibial region 10 times.
The above results can also be used in the assessment of disease progression in the same subjects. Specifically, the results above are obtained at baseline. The present inventors have shown that the measure of homogeneity in cartilage of a joint decreases over time as the disease progresses. Accordingly, the homogeneity measure described can be used to provide a biomarker that can separate healthy cartilage from that subjected to early osteoarthritis in a cross-section of the general public at any given time, and, the homogeneity measure can also be used to indicate the progression of disease over time.
In a specific example, a population was scanned at baseline and after 21 months using a Turbo 2D T1 sequence (flip angle 40°, TR 50 ms, TE 16 ms, scan time 10 minutes, resolution 0.7 mm*0.7 mm*0.8 mm) on a 0.18 T MRI Esaote scanner. At baseline there were 313 knees of which 25 were used for training of computer-based methods. The validation set had 288 right and left knees at baseline (subject aged: 21-81, females: 44%, BMI: 26.7±4.3) and 243 at follow-up. The knees were examined by radiography and categorised by the Kellgren and Lawrence Index (with distribution [145,88,30,24,1] for KL 0-4). The medial compartments of the tibial and femoral cartilage sheets were segmented using a fully automatic voxel classification scheme and the cartilage volume and homogeneity were quantified.
Homogeneity was quantified by measuring entropy from the MRI signal intensities—specifically, areas of cartilage with fewer, more dominant intensities are quantified as being more homogenous. For precision evaluation, as above, 31 knees were re-scanned a week after baseline. The healthy subjects at baseline were divided into two groups: 1) 101 subjects that remained healthy at follow-up and 2) 25 subjects that progressed to early OA (KL 1). For each group both volume and homogeneity changes over the 21 month period were computed and the statistical significances based on an un-paired t-test were calculated.
The results are shown in
In continuation of these results, we divide the cartilage in different regions to see which region contributes most to homogeneity discrimination. The following computations are done for manual segmentation of the tibial medial cartilage. However, the results for the automatic segmentation described below suggest the same conclusions.
However, if as shown in
If, on the same pattern we do some more divisions and compute p-values for entropy of each region, the following results are obtained. If the cartilage is partitioned in two equal halves in a different direction as shown in
Our results for this region, i.e. medial area of the medial tibial cartilage correlates with the observation that the cartilage often first breaks down in this region and this is what contributes to more homogeneity discrimination.
It can be seen in
Thus, it has been shown above that calculating homogeneity from the medial part of the tibial medial cartilage leads to more homogeneity discrimination and results in improving our previous results. This area corresponds to the region of cartilage which often breaks down first during osteoarthritis (OA), and this could explain the better results.
Based on this principle, that certain regions of the segmented cartilage display stronger cartilage discrimination, we have devised the following region-partitioning algorithm.
We first divide each algorithm in 2D in the axial plane into squared regions each having the same size. The resolution of the division however, can vary. Then using a region shrinking technique we partition those regions that evaluate the objective function as being true. The objective function is finding the best p-value that can separate healthy (KL 0) individuals from individuals having OA (KL>0) based on the homogeneity measure. After the algorithm terminates we combine all regions of high discrimination as one single region and compute entropy for each knee. Finally we compute the p-value, which represents the significance level for the regions in separating healthy from OA.
To evaluate the accuracy/robustness of the partitioning algorithm with a particular focus on over-fitting we divide the original set of 114 knees randomly in two subsets (train and test) of 57 knees each, such that the KL distribution of each set resembles the initial set. We then execute the partitioning algorithm on the training set and using the resultant partitioned regions we compute the p-value for the test set. Over-fitting errors between the significance levels of train and test set are reduced by smoothing or regularising the partitioned regions. Three different regularisation approaches are evaluated. The first approach regularises the partitioned regions by applying geometric curve evolution by iterating the median filter. The second approach uses binary morphological filtering on the regions. The partitioned regions after regularisation are re-evaluated to get a significance level on the test set. The third approach uses the concept of bootstrap sampling. We do this by dividing the set of 114 knees in two sub-sets of 76 and 38 knees having the same KL distribution as the initial set. We keep the set of 38 knees for final evaluation. From the set of 76 knees we pick 38 knees randomly and perform partitioning on it. We repeat this 1000 times.
We then compute a Vote Map, i.e. for each individual region (number of total regions depends on the resolution) we count the number of times it was marked as being significant in the 1000 different trials. The Vote Map gives us the “importance” level of each region. To use the Vote Map we divide the set of 76 knees randomly 10 times in pairs of train and test sets of 38 knees each. We partition only those regions that are counted at least thresh (where 1<=thresh <=1000) times in the Vote Map. The Vote Map gives us the “importance” level of each region. We then threshold the Vote Map using thresh=500 that is we consider all the regions that have at least half the votes. Then the resulting regions are further regularized by applying geometric curve evolution by iterating the median filter. Alternatively, instead of regularizing with the median filter, we could for each level of thresh using the partitioned regions compute the p-value for the 10 different pairs of train and test sets and then pick a level at which the mean p-value of the train sets is minimum. This is illustrated in
The results summarised in the table below are computed considering the whole cartilage sheet as one region, that is, without applying the partitioning algorithm. They show that measurement of cartilage entropy enables separation of healthy (KL 0) versus OA (KL>0), and in addition allows for separation of healthy from early OA (KL 1).
Medial Tibial
Measure
(p-value)
KL 0 vs KL 1
Volume
0.1
Entropy
0.0004
KL 0 vs KL > 0
Volume
0.001
Entropy
0.00004
The results for executing the partitioning algorithm on 114 knees using arbitrarily chosen region sizes or resolutions are summarised in the table below.
Resolution
Entropy
(rows × columns)
(p-value)
2 × 5
6 × 10−9
15 × 25
8 × 10−14
74 × 136
9 × 10−17
The mean size of the medial tibial cartilage sheet is 27×68 voxels. The results show that the regions partitioned by the algorithm enable a higher discrimination of homogeneity than using the whole cartilage (shown in the table above). Furthermore as we move to finer resolutions (sub-voxel accuracy) we obtain higher significance levels.
The results for the robustness test of the partitioning algorithm at different resolutions for three trials are shown below.
1
2
3
Resolution
Train
Test
Train
Test
Train
Test
2 × 5
3 × 10−5
8 × 10−5
6 × 10−4
3 × 10−6
4 × 10−3
1 × 10−4
15 × 25
3 × 10−10
8 × 10−5
3 × 10−9
5 × 10−6
2 × 10−6
7 × 10−7
74 × 136
3 × 10−11
1 × 10−6
4 × 10−13
6 × 10−6
1 × 10−10
2 × 10−6
The results show that at finer resolutions (e.g. 74×136) there is over-fitting. To overcome this we regularise the partitioned regions by using geometric curve evolution and morphological filtering. We observe that both techniques fail to reduce the difference between the p-values of test and train. However we succeed in minimising the difference between the two significance levels using the third technique of bootstrap sampling combined with curve evolution. Using the resulting regions after regularization we now get a significance level for the evaluation set of 38 knees. The table below shows the p-values for the evaluation set using the whole cartilage and using the regularised partitioned regions. It should be noted that the p-values shown in this table are higher than those above as this data set contains only 38 knees compared to the earlier data set of 114 knees.
p-value for
homogeneity discrimination
Type
(separating healthy from OA)
Whole cartilage
0.03
Regularized region
1 × 10−3
We can see that even after regularisation, the results for the regularised regions are still more significant.
The following Table (last column) shows the p-values for separating the different groups when using the regularized region of interest on the full set of 283 knees. The precision of homogeneity for this region assessed as a test-retest root mean square coefficient of variation (RMS-CV %) was 3.3%.
Table—P-values for separating groups of KL 0 from KL 1 and groups of KL 0 from KL>0 based on the two different measures. The first two columns of the table list the p-values for the previously described data set of 114 knees and the further data set of 169 knees respectively. The table also lists the p-value for the partition region from
Entropy
Entropy
Volume
Entropy
Entropy
(114
(169
(283
(283
(Partitioned)
Type
knees)
knees)
knees)
knees)
(283 knees)
KL 0 vs
3 × 10−3
2 × 10−3
6 × 10−3
2 × 10−5
5 × 10−9
KL 1
KL 0 vs
8 × 10−4
4 × 10−5
7 × 10−6
1 × 10−7
1 × 10−15
KL > 0
The region of interest resulting from the bootstrap regularized partitioning based on homogeneity results in the above study and on an extension of that work involving a larger number of knee scans was far from corresponding to the central, load-bearing part of the cartilage—rather it outlines the peripheral part of the cartilage. The region that is being partitioned appears to correspond to the cartilage covered by the meniscus (
Our automatic approach partitioned the region seeking out that part which is statistically most significant in separating groups of healthy subjects versus OA based on homogeneity without any prior assumption of the significance of the meniscus. Thereby our results demonstrate that the meniscal region of the cartilage is informative when evaluating the disease and particularly when monitoring early OA, as the region has proved to be quite significant when separating groups of healthy subjects from early OA. It should be noted here that the region was partitioned while minimizing the p-value for separating groups of healthy subjects from those having OA, therefore the fact that it could also significantly separate early OA further highlights the importance of the region.
This cross sectional study does not rule out that increased homogeneity is a genetic disposition for early OA. This observation is further nurtured by the fact that entropy seem to be indistinguishable between KL1 through 3, albeit they all were significantly different from the group of healthy.
The results show that cartilage entropy provides sensitivity and information beyond that of volume quantifications. Specifically, cartilage homogeneity, measured by entropy, is able to detect early OA and separate healthy individuals from diseased with a higher statistical significance than volume. Our automatic partitioning algorithm outlines the regions on the cartilage that separates healthy from OA on the basis of homogeneity. We have shown that OA affects certain regions of the cartilage more rapidly and distinctly, and these regions are more towards the medial section and at the edges of the cartilage. These results should provide valuable clues in the detection of OA and thus may improve treatment efficacy.
In this specification, unless expressly otherwise indicated, the word ‘or’ is used in the sense of an operator that returns a true value when either or both of the stated conditions is met, as opposed to the operator ‘exclusive or’ which requires that only one of the conditions is met. The word ‘comprising’ is used in the sense of ‘including’ rather than in to mean ‘consisting of’.
References
Karsdal, Morten, Qazi, Arish, Dam, Erik B., Nielsen, Mads, Christiansen, Claus, Petterson, Paola C.
Patent | Priority | Assignee | Title |
8908918, | Nov 08 2012 | NAVIGATE SURGICAL TECHNOLOGIES INC | System and method for determining the three-dimensional location and orientation of identification markers |
Patent | Priority | Assignee | Title |
5533519, | Jun 24 1993 | Biomet Sports Medicine, LLC | Method and apparatus for diagnosing joints |
6537233, | Nov 06 2000 | UNIVERSITY TECHNOLOGIES INTERNATIONAL INC | Auditory display of knee joint vibration signals |
7141026, | Oct 01 2001 | ECOLE POLYTECHNIQUE FEDERALE DE LAUSANNE SERVICE DES RELATIONS INDUSTRIELLES SRI | Body movement monitoring system and method |
7239908, | Dec 16 1998 | The Board of Trustees of the Leland Stanford Junior University | Assessing the condition of a joint and devising treatment |
8036729, | Dec 16 1998 | The Board of Trustees of the Leland Stanford Junior University | Assessing the condition of a joint and devising treatment |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Sep 19 2007 | Synarc Inc. | (assignment on the face of the patent) | / | |||
May 25 2009 | CHRISTIANSEN, CLAUS | NORDIC BIOSCIENCE IMAGING A S | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 022844 | /0703 | |
May 25 2009 | KARSDAL, MORTEN | NORDIC BIOSCIENCE IMAGING A S | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 022844 | /0703 | |
May 26 2009 | NIELSEN, MADS | NORDIC BIOSCIENCE IMAGING A S | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 022844 | /0703 | |
May 26 2009 | DAM, ERIK B | NORDIC BIOSCIENCE IMAGING A S | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 022844 | /0703 | |
May 29 2009 | PETTERSON, PAOLA C | NORDIC BIOSCIENCE IMAGING A S | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 022844 | /0703 | |
Jun 08 2009 | QAZI, ARISH | NORDIC BIOSCIENCE IMAGING A S | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 022844 | /0703 | |
Apr 01 2011 | NORDIC BIOSCIENCE IMAGING A S, A K A SYNARC IMAGING TECHNOLOGIES A S | Synarc Inc | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 026693 | /0479 | |
Nov 23 2011 | Synarc Inc | BANK OF AMERICA, N A , AS ADMINISTRATIVE AGENT | SECURITY AGREEMENT | 027282 | /0959 | |
Apr 05 2012 | BANK OF AMERICA, N A , AS ADMINISTRATIVE AGENT | Synarc Inc | TERMINATION AND RELEASE OF SECURITY INTEREST IN U S PATENTS REEL 027282, FRAME 0959 | 030173 | /0902 | |
Apr 05 2013 | Synarc Inc | BANK OF AMERICA, N A , AS ADMINISTRATIVE AGENT | NOTICE OF SECURITY INTEREST IN PATENTS | 030157 | /0547 | |
Mar 10 2014 | Synarc Inc | CREDIT SUISSE AG, AS FIRST LIEN COLLATERAL AGENT | PATENT SECURITY AGREEMENT FIRST LIEN | 032776 | /0798 | |
Mar 10 2014 | BANK OF AMERICA, N A | Synarc Inc | TERMINATION AND RELEASE OF SECURITY INTEREST IN UNITED STATES PATENTS RELEASES REEL 030157 FRAME 0547 | 032776 | /0402 | |
Mar 10 2014 | Synarc Inc | CREDIT SUISSE AG, AS SECOND LIEN COLLATERAL AGENT | PATENT SECURITY AGREEMENT SECOND LIEN | 032777 | /0066 | |
Sep 18 2015 | BIOCLINICA, INC | THE BANK OF NEW YORK MELLON, AS COLLATERAL AGENT | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 036596 | /0889 | |
Sep 18 2015 | Synarc Inc | THE BANK OF NEW YORK MELLON, AS COLLATERAL AGENT | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 036596 | /0889 | |
Oct 20 2016 | Credit Suisse AG, Cayman Islands Branch | SYNARC, INC | RELEASE OF FIRST LIEN SECURITY | 040458 | /0915 | |
Oct 20 2016 | Credit Suisse AG, Cayman Islands Branch | BIOCLINICA, INC | RELEASE OF FIRST LIEN SECURITY | 040458 | /0915 | |
Oct 20 2016 | Credit Suisse AG, Cayman Islands Branch | SYNARC, INC | RELEASE OF SECOND LIEN SECURITY | 040458 | /0849 | |
Oct 20 2016 | Credit Suisse AG, Cayman Islands Branch | BIOCLINICA, INC | RELEASE OF SECOND LIEN SECURITY | 040458 | /0849 | |
Oct 20 2016 | Synarc Inc | JEFFERIES FINANCE LLC | PATENT SECURITY AGREEMENT | 040458 | /0810 | |
Oct 20 2016 | BANK OF NEW YORK MELLON | BIOCLINICA, INC | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 040085 | /0965 | |
Oct 20 2016 | BANK OF NEW YORK MELLON | Synarc Inc | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 040085 | /0965 | |
Oct 20 2016 | BIOCLINICA, INC | JEFFERIES FINANCE LLC | FIRST LIEN SECURITY AGREEMENT | 040458 | /0800 | |
Oct 20 2016 | Synarc Inc | JEFFERIES FINANCE LLC | FIRST LIEN SECURITY AGREEMENT | 040458 | /0800 | |
Oct 20 2016 | BIOCLINICA, INC | JEFFERIES FINANCE LLC | PATENT SECURITY AGREEMENT | 040458 | /0810 | |
Feb 21 2019 | Synarc Inc | BIOCLINICA, INC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 048468 | /0743 | |
Apr 27 2021 | JEFFERIES FINANCE LLC, AS COLLATERAL AGENT | BIOCLINICA, INC | SECOND LIEN RELEASE OF SECURITY INTEREST IN PATENTS | 056064 | /0563 | |
Apr 27 2021 | JEFFERIES FINANCE LLC, AS COLLATERAL AGENT | BIOCLINICA, INC | FIRST LIEN RELEASE OF SECURITY INTEREST IN PATENTS | 056064 | /0341 | |
Mar 20 2023 | BIOCLINICA, INC | GOLDMAN SACHS BANK USA, AS COLLATERAL AGENT | FIRST LIEN SECURITY AGREEMENT | 063123 | /0066 | |
Mar 20 2023 | BIOCLINICA, INC | GOLDMAN SACHS BANK USA, AS COLLATERAL AGENT | SECOND LIEN SECURITY AGREEMENT | 063141 | /0589 |
Date | Maintenance Fee Events |
Apr 14 2016 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
Jun 22 2020 | REM: Maintenance Fee Reminder Mailed. |
Dec 07 2020 | EXP: Patent Expired for Failure to Pay Maintenance Fees. |
Dec 10 2020 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
Dec 10 2020 | M1558: Surcharge, Petition to Accept Pymt After Exp, Unintentional. |
Dec 10 2020 | PMFG: Petition Related to Maintenance Fees Granted. |
Dec 10 2020 | PMFP: Petition Related to Maintenance Fees Filed. |
Apr 17 2024 | M1553: Payment of Maintenance Fee, 12th Year, Large Entity. |
Date | Maintenance Schedule |
Oct 30 2015 | 4 years fee payment window open |
Apr 30 2016 | 6 months grace period start (w surcharge) |
Oct 30 2016 | patent expiry (for year 4) |
Oct 30 2018 | 2 years to revive unintentionally abandoned end. (for year 4) |
Oct 30 2019 | 8 years fee payment window open |
Apr 30 2020 | 6 months grace period start (w surcharge) |
Oct 30 2020 | patent expiry (for year 8) |
Oct 30 2022 | 2 years to revive unintentionally abandoned end. (for year 8) |
Oct 30 2023 | 12 years fee payment window open |
Apr 30 2024 | 6 months grace period start (w surcharge) |
Oct 30 2024 | patent expiry (for year 12) |
Oct 30 2026 | 2 years to revive unintentionally abandoned end. (for year 12) |