A method of planning an image-guided interventional procedure to be performed on a patient, where expected motion of the patient, such as that of a breathing cycle, is determined on a sequence of preoperative images, and the procedure trajectory is planned accordingly. The method takes into account the initial positions of the interventional entry, the target region, and any obstructions or forbidden regions between the entry point and the target region, and uses object tracking methods of image processing on the preoperative images to determine how the positions of these three elements change relative to each other during the patient's motion cycle. The method may automatically search in at least some of the preoperative images taken at different temporal points of the motion cycle, for a path connecting the entry point with the target and avoiding the obstacles, which provides minimal lateral pressure on the patient's tissues.
|
6. A system for pre-operatively planning an image-guided insertion procedure for inserting a tool into a tissue in a region of interest of a subject; comprising:
a user interface configured to receive user inputs regarding at least positions of an entry point for entry of said tool into said tissue, a target point and one or more forbidden regions into which entry by said tool during said insertion procedure is forbidden, defined on a first image of a plurality of time-separated images of the region of interest derived at different times during the breathing cycle of said subject; and
at least one processor configured to:
determine the positions of said entry point, said target point and said one or more forbidden regions in at least one other image of said plurality of time-separated images;
calculate at least one trajectory for said needle insertion procedure between said entry point and said target point, which avoids entry into all of said one or more forbidden regions, in at least said first image of said plurality of time-separated images;
check for said calculated at least one trajectory, one or more trajectory characteristics selected from: (i) the curvature, (ii) the entry angle at said entry, point, and (iii) the proximity to each of said one or more forbidden regions, to determine if at least one predetermined level relating to said one or more trajectory characteristics is exceeded; and
if said one or more predetermined levels relating to said one or more trajectory characteristics are determined not to be exceeded, ascertain pre-operatively that said calculated at least one trajectory is a suitable trajectory for said insertion procedure.
11. A method of pre-operatively planning an image-guided insertion procedure for inserting a tool into a tissue in a region of interest of a subject, comprising:
(a) obtaining a plurality of time-separated images of the region of interest;
(b) defining on a first image of said plurality of time-separated images an entry point for entry of said tool into said tissue, a target point and one or more forbidden regions into which entry by said tool during said insertion procedure is forbidden;
(c) calculating on said first image a first trajectory for said insertion procedure between said entry point and said target point, which avoids entry into all of said one or more forbidden regions;
(d) determining the positions of said entry point, said target point and said one or more forbidden regions in one or more other images of said plurality of time-separated images;
(e) calculating, on at least one of said one or more other images, at least one new trajectory between said entry point and said target point, which avoids entry into all of said one or more forbidden regions, based on the positions of said entry point, said target point and said one or more forbidden regions in said at least one of said one or more other images, as determined in step (d);
(f) calculating, for each of said first trajectory and said at least one new trajectory, the maximal curvature level;
(g) comparing the calculated maximal curvature level to a predetermined maximal curvature level; and
(h) if the calculated maximal curvature level of each of said first trajectory and said at least one new trajectory is determined not to exceed said predetermined maximal curvature level, ascertaining pre-operatively that said first trajectory and said at least one new trajectory are suitable trajectories for said insertion procedure.
1. A method of pre-operatively planning an image-guided insertion procedure for inserting a tool into a tissue in a region of interest of a subject, comprising:
(a) obtaining a plurality of time-separated images of the region of interest, said plurality of time-separated images derived at different times during the breathing cycle of said subject;
(b) defining on a first image of said plurality of time-separated images an entry point for entry of said tool into said tissue, a target point and one or more forbidden regions into which entry by said tool during said insertion procedure is forbidden;
(c) calculating on said first image a first trajectory for said insertion procedure between said entry point and said target point; which avoids entry into all of said one or more forbidden regions;
(d) determining the positions of said entry point, said target point and said one or more forbidden regions in one or more other images of said plurality of time-separated images;
(e) calculating; on at least one of said one or more other images; at least one new trajectory between said entry point and said target point; which avoids entry into all of said one or more forbidden regions, based on the positions of said entry point, said target point and said one or more forbidden regions in said at least one of said one or more other images, as determined in step (d);
(f) checking for each of said first trajectory and at least one new trajectory, one or more trajectory characteristics selected from: (i) the curvature, (ii) the entry angle at said entry point, and (iii) the proximity to any of said one or more forbidden regions, to determine if one or more predetermined levels relating to said one or more trajectory characteristics is exceeded; and
(g) if said one or more predetermined levels relating to said one or more trajectory characteristics are determined not to be exceeded in each of said first trajectory and at least one new trajectory, ascertaining pre-operatively that said first trajectory and said at least one new trajectory are suitable trajectories for said insertion procedure.
2. A method according to
defining an alternative entry point on said first image; and
repeating steps (c) to (g) using said alternative entry point with said target point and said one or more forbidden regions initially defined in step (b).
3. A method according to
4. A method according to
5. A method according to
7. A system according to
8. A system according to
9. A system according to
10. A system according to
12. A method according to
defining an alternative entry point on said first image; and
repeating steps (c) to (h) using said alternative entry point with said target point and said one or more forbidden regions initially defined in step (b).
|
This application is a continuation of U.S. Ser. No. 15/122,421, entitled “DYNAMIC PLANNING METHOD FOR NEEDLE INSERTION” and filed on Aug. 30, 2016 as the national stage of PCT/IL2015/050230, having the same title and filed Mar. 4, 2015, which claims the benefit of provisional application No. 61/966,754, filed Mar. 4, 2014.
The present invention relates to systems and methods of planning automated (e.g., robotically controlled) needle insertion procedures, especially taking into account the motion of the insertion point, the target point and any region between them which should be avoided, as a result of cyclic body motion, such as the breathing cycle.
Current static needle insertion planning uses a preoperative image of the region of interest including the point of entry, the target and any obstacles en route which have to be avoided. An obstacle can be understood to mean a real physical obstacle, such as a rib, or it can mean a sensitive area where damage could be caused by entry of the needle, such as a major blood vessel or an important nerve. The problem is that this procedure does not take into account cyclical motion of the patient, such as from breathing, which could cause the entry point, the target point and the position of any obstacles en route to move in some sort of reproducible cycle from their initial positions relative to each other.
In existing methods, the progress of the needle (or of the process) is reviewed intraoperatively and the images are synchronized to the motion cycle, and then appropriate correction is taken during the motion cycle. This is the method used in following heart motion and pulsating arteries during angioplasty, or during valve correction operations, with the heart beat continuing during the procedure. Such methods have a serious disadvantage in that they require constant, generally fluoroscopic, imaging during the complete duration of the procedure, with concomitant significant radiation exposure for the patient and the medical staff. In other known methods, such as that shown in U.S. Pat. No. 7,833,221 to J. W. Voegele et al, for “System and Method for Treatment of Tissue using the Tissue as a Fiducial”, there is described an ultrasound method in which the respiration cycle is monitored to indicate when a tissue target is approaching the dwell position—the brief pause between inhalation and exhalation in each respiratory cycle—so that the surgeon can insert his surgical device to a tumor when the tumor is positioned according to an image of the tumor generated at the dwell position. However, such methods limit insertion of a tool to a single target point imaged non-iteratively at a repeated fixed point in the breathing cycle. Further, in some existing methods, as disclosed, for example, in U.S. Pat. No. 7,008,373 to Stoianovici et al, for “System and method for robot targeting under fluoroscopy based on image servoing”, it is preferred that patient respiration is shortly stopped during the image acquisition prior to target selection and during needle insertion, thus requiring the physician to rely solely on the patient's ability to hold his breath at the required times and for the required durations.
The current application attempts to provide a method whereby the expected motion of the patient is determined at the planning stage on the preoperative images, and the trajectory is planned accordingly, taking into account not only the initial positions of the entry, obstruction and target points, but also how these three elements are expected to move relative to each other during the course of the patient's motion cycle.
According to some implementations, a sequence of video frames is taken of the region of interest, which follows the complete cycle of the motion, such as a breathing cycle. Alternatively, a series of cycles can be recorded, which can then be averaged. The video frames are generally taken from the CT scans of the patient's region of interest. In some implementations, the user/doctor/physician (the terms “user”, “doctor” and “physician” are used interchangeably throughout this disclosure) marks the target point, the obstacles en route and an initial point of entry, on an initial static image taken from the video sequence of the region of interest. The doctor's experience of the best trajectory to follow preferably plays a role in choosing the entry point. In some implementations, the user does not define the initial trajectory, since the system software is adapted to automatically search for a path connecting the point of entry with the target and avoiding the obstacles en route, which provides minimal lateral pressure on the patient's tissues. In so doing, the system can also select the appropriate entry angle at the input point chosen. In other implementations, the system may require or allow for the doctor to select the entry angle of the needle.
From the video sequence, there can be determined how the positions of the point of entry, the obstacles, and the target point change from frame to frame during the course of the patient's motion cycle.
In some implementations, an initial preplanned trajectory, which is calculated taking into account the position of the entry point, target point and obstacle/s en route in an initial static image, is followed through the series of frames comprising a complete body motion cycle. If, during the whole of the cycle, a safe trajectory is indicated, taking into account all of the motions and a safety margin around obstructions, then the doctor can use his initial preplanned static trajectory for the entire breathing cycle. If there is a problem with the preplanned trajectory in one or more of the subsequent frames, then, where possible, the doctor can modify his selection of the element locations in these frames (e.g., reduce the safety margin around an obstacle) and/or in the initial static image (e.g., choose a different entry point and/or change the entry angle) to resolve the problem and then repeat the path verification in the entire video sequence. Alternatively, the doctor/user may select a different image (also sometimes referred to in this disclosure as “image frame”, or simply as “frame”), representing a different time point in the body motion cycle, to use as the initial static image for the calculation of the trajectory. In this method implementation, a single trajectory, calculated based on the locations of the target and obstacle in one initial image frame, is checked on all remaining image frames. Since the locations of the target and obstacle might be different in a different image frame, a different trajectory is likely to be calculated. This new trajectory, unlike its predecessor, may be acceptable for all the image frames. This process can be repeated iteratively until a safe trajectory is indicated throughout the whole of the cycle.
In some implementations, during the planning stage, after the doctor has selected the entry point and has marked the target and en-route obstacles in the first CT image, the system algorithm runs through the series of frames comprising a complete body motion cycle, and, taking into account how the entry point, target and obstacles move at each frame, calculates a single trajectory using the initial entry point, that will reach the target yet avoid all obstacles at every one of the frames in the complete cycle.
In other implementations, the system algorithm may run through the series of frames and calculate for each of the frames, separately, an optimal trajectory that will reach the target yet avoid all obstacles at that particular frame. In such implementations, all or at least one of the calculated trajectories may be followed through all of the other frames in the sequence, and one of the trajectories which is found to be applicable to the entire series of frames may be selected for the needle insertion procedure. Such a trajectory may be the trajectory having the minimal curvature and/or the shortest distance from the entry point to the target point, for example. In some implementations, an average of all or at least two of the trajectories may be calculated and selected.
According to some implementations, the system can check the calculated trajectory/trajectories and if it appears from an inspection of the frames in the cycle that for a particular trajectory, the needle at any part of the cycle diverts more than a predetermined amount from an optimum trajectory, meaning that excessive lateral pressure would be exerted on the tissues of the patient, then that entry point can be abandoned and the doctor/user can repeat the planning procedure with a different entry point, with the aim of providing a better trajectory, i.e. one with less severe curvature and hence generating less lateral pressure on the tissues of the patient. Alternatively, the same entry point can be maintained, but the initial orientation of the needle at the entry point can be changed in order to select an alternative initial planned trajectory which may result in a better overall trajectory for the entire procedure. In some implementations, both a new entry point and a new entry angle may be selected. The dynamically chosen trajectories can be optionally shown to the user (e.g., attending physician), for confirmation that they are surgically and safety-wise acceptable.
The above described planning methods may be subsequently utilized when the doctor is performing the needle insertion procedure by selecting one or more time frames during the cycle of motion of the patient, in which the trajectory shows the minimum curvature, for example, and limiting the needle insertion steps to be performed only during that time frame or those time frames of the complete motion cycle. For example, for the case of a breathing cycle, insertion could be limited to that or those time frames when the patient has fully expired his breath. This procedure thus enables the insertion to be performed without the need to amend the angle of entry of the needle, thereby enabling the entire insertion procedure to be performed, in contrast to prior art procedures, without any intra-procedural imaging intervention at all for the purposes of following the patient's body motion, or for safety reasons, with minimal selected imaging. Therefore, one substantial advantage over prior art methods, engendered by use of the planning methods described in this application is that it enables the procedure to be performed with reduced radiation exposure to the patient and medical staff. Obviously, any fluoroscopic imaging required for the implementation of the needle guidance procedure itself, as opposed to for following body motion, cannot be avoided.
Although some method implementations have been described relating to inspection of or taking into account every one of the frames of the sequence, it is to be understood that the method can also be executed using only some of the frames of the sequence, so long as the number selected are sufficiently close together that extreme situations are not generated in the intervening missed frames.
In addition, although the method has been described in this disclosure using two-dimensional images, it is to be understood that it is equally applicable using three-dimensional images, which may be the preferred situation when CT scans are being used as the preoperative images on which the dynamic path is to be calculated. Furthermore, the described method implementations are not limited to the use of CT scans, and they can be implemented using images generated by other imaging systems, such as an X-ray fluoroscopic system, an ultrasonic system, or an MRI system.
One exemplary implementation involves a method of planning an image-guided interventional procedure in a region of interest of a subject, comprising:
(a) obtaining a plurality of time-separated images of the region of interest,
(b) defining on a first image of the plurality of images, an entry point, a target point and one or more regions into which entry by the interventional procedure is forbidden,
(c) calculating a trajectory for the interventional procedure between the entry point and the target point, which avoids entry into any of the one or more forbidden regions,
(d) selecting a second image of the plurality of images generated at a time different from that at which the first of the plurality of images was generated,
(e) determining changes in the position of the entry point, target point and any regions into which entry by the interventional procedure is forbidden in the second image of the plurality of images, and
(f) repeating step (c) on the second image of the plurality of images based on the changes in position determined in step (e).
Such a method may further comprise the step of selecting on the first image of the plurality of images, an entry angle for the interventional procedure at the entry point. Additionally, these methods may further comprise the step of determining if one or more characteristics of at least one of the calculated trajectories exceeds a predetermined level along any part of the at least one of the calculated trajectories' length. The one or more characteristics may optionally be the curvature of the trajectory, or the distance from any of the one or more regions into which entry by the interventional procedure is forbidden. If it evolves that one or more characteristics of at least one of the calculated trajectories exceeds a predetermined level along a part of the at least one of the calculated trajectories' length, the method may include repeating the planning using an alternative entry point.
In any of the above described methods involving the selection of an entry angle, if one or more characteristics of at least one of the calculated trajectories exceeds a predetermined level along a part of at least one of the calculated trajectories' length, then the planning may be repeated using at least one of an alternative entry point and an alternative entry angle. In the case of the curvature characteristic, the method may further comprise the step of selecting that planning which generates a trajectory having a lesser curvature along any part of its length than any trajectory provided by a different planning.
Additionally, alternative implementations of any of the above-described systems may further comprise the step of storing one or more of the calculated trajectories.
Still other exemplary implementations involve the above described methods and further comprising the steps of:
(a) determining if one or more of the calculated trajectories are applicable to each of the plurality of images, and
(b) if one or more of the calculated trajectories is determined to be applicable to each of the plurality of images, determining which trajectory of the one or more applicable trajectories is optimal for all of the plurality of images.
In the last described method, the step of determining if one or more of the calculated trajectories is applicable to each of the plurality of images may comprise determining if one or more of the calculated trajectories terminates at the target point in each of the plurality of images and avoids entry into any of the one or more forbidden regions in each of the plurality of images. Furthermore, the step of determining which trajectory of the one or more applicable trajectories is optimal for all of the plurality of images may comprise one or more of:
(a) determining which of the one or more applicable trajectories comprises a lesser curvature, and
(b) determining which of the one or more applicable trajectories comprises a lesser distance between the entry point and the target point.
These methods may further comprise the step of selecting that planning which generates a trajectory having a lesser curvature along any part of its length than any trajectory provided by a different planning.
Yet other implementations perform a method of planning an image-guided interventional procedure in a region of interest of a subject, comprising:
(a) obtaining a plurality of time-separated images of the region of interest,
(b) defining on a first image of the plurality of images, an entry point, a target point and one or more regions into which entry by the interventional procedure is forbidden,
(c) calculating a trajectory for the interventional procedure between the entry point and the target point, which avoids entry into any of the forbidden regions,
(d) selecting a second image of the plurality of images generated at a time different from that at which the first image of the plurality of images was generated,
(e) determining changes in the position of the entry point, target point and any regions into which entry by the interventional procedure is forbidden in the second image of the plurality of images, and
(f) determining if in the second image of the plurality of images the calculated trajectory connects between said entry point and said target point and avoids entry into any of said forbidden regions.
This method may also include a step of determining if one or more characteristics of the calculated trajectory exceeds a predetermined level along any part of the calculated trajectory length. The one or more characteristics may be curvature.
An alternative implementation performs a method of planning an image-guided interventional procedure in a region of interest of a subject, comprising:
(a) obtaining a plurality of time-separated images of the region of interest,
(b) defining on a first image of the plurality of images, an entry point, a target point and one or more regions into which entry by the interventional procedure is forbidden,
(c) selecting a second image of the plurality of images generated at a time different from that at which the first image of the plurality of images was generated,
(d) determining changes in the position of the entry point, target point and any regions into which entry by the interventional procedure is forbidden in the second image of the plurality of images, and
(e) calculating a trajectory for the interventional procedure between the entry point and the target point, which avoids entry into any of the one or more forbidden regions in the first image of the plurality of images and in the second image of the plurality of images.
This method may further comprise the step of determining if one or more characteristics of at least one of the calculated trajectories exceeds a predetermined level along any part of the at least one of the calculated trajectories' length. That one or more characteristics may be curvature.
Additionally, alternative implementations may further involve a method of planning an image-guided interventional procedure in a region of interest of a subject, comprising:
(a) calculating a trajectory for the interventional procedure between an entry point and a target point, which avoids entry into any of one or more forbidden regions, wherein the entry point, the target point and the one or more forbidden regions have been defined on a first image of a plurality of time-separated images of the region of interest,
(b) determining changes in the position of the entry point, target point and any regions into which entry by the interventional procedure is forbidden in a second image of the plurality of images generated at a time different from that at which the first image of the plurality of images was generated, and
(c) repeating step (a) on the a second image of the plurality of images based on the changes in position determined in step (b).
Such a method can further include the step of obtaining the plurality of time-separated images. Additionally, the method may further comprise the step of storing the entry point, the target point and the one or more regions into which entry by the interventional procedure is forbidden.
According to yet further implementations of the methods described in the present application, there is provided a method of planning an image-guided interventional procedure in a region of interest of a subject, comprising:
(a) imaging the region of interest, the imaging comprising generating a plurality of time-separated images,
(b) defining on a first image of the plurality of images, an entry point, a target point and one or more regions into which entry by the interventional procedure is forbidden,
(c) calculating a trajectory for the interventional procedure between the entry point and the target point, which avoids entry into any of the one or more forbidden regions,
(d) selecting a second image of the plurality of images generated at a time different from that at which the first image of the plurality of images was generated,
(e) determining changes in the position of the entry point, target point and any regions into which entry by the interventional procedure is forbidden in the second image of the plurality of images, and
(f) repeating step (c) on the second image of the plurality of images based on the changes in position determined in step (e).
Any of the above described methods, may include the step of determining a cyclic motion sequence in the images, and selecting one or more of the images in the cyclic sequence in order to perform interventional steps of the procedure at the times associated with the one or more images.
Additionally, in any of the above described methods, the plurality of time-separated images may be generated over a predetermined period of time. Furthermore, in any of the above described methods, the changes in the position of the entry point, target point and any regions into which entry by the interventional procedure is forbidden may arise from cyclic motion of the region of interest of the patient, such as the breathing motion of the patient. Also, the one or more regions into which entry by the interventional procedure is forbidden may include at least one of a bone, a blood vessel, a nerve, an internal organ or an implanted medical element.
Still other example implementations involve a system for planning an image-guided interventional procedure in a region of interest of a subject, comprising:
(i) a user interface adapted to receive user inputs regarding at least positions of an entry point, a target point and one or more regions into which entry by the interventional procedure is forbidden, defined on a first image of a plurality of time-separated images of the region of interest, and
(ii) at least one processor adapted to:
(a) determine changes in the position of the entry point, target point and any regions into which entry by the interventional procedure is forbidden, in a second image of the plurality of images generated at a time different from that at which the first image of the plurality of images was generated, and
(b) calculate at least one trajectory for the interventional procedure between the entry point and the target point, which avoids entry into any of the one or more forbidden regions, in at least the first image of the plurality of images.
Such a system may further comprise a display adapted to display at least the plurality of time-separated images. In addition, it may further comprise a memory component adapted to store at least the plurality of images, the entry point, the target point and the one or more regions into which entry by the interventional procedure is forbidden. The at least one processor may be further adapted to determine if one or more characteristics of the at least one trajectory exceeds a predetermined level along any part of its length. Additionally, the at least one processor may be further adapted to determine if one or more of the at least one trajectory is applicable to the plurality of images. In that case, the at least one processor may be further adapted to determine which trajectory of the one or more applicable trajectories is optimal for all of the plurality of images. Finally, any of the above described systems may further comprise a communication module adapted to obtain images from an imaging system.
Implementations of the method and system described above may include any of the features described in the present disclosure, including any of the features described above in relation to other method/system implementations.
It is to be understood that although the examples used throughout this disclosure relate to methods and systems for planning a path for insertion of a needle, the methods and systems are not meant to be limited to insertion of a needle but are understood to include insertion of any tool intended to be inserted into a subject's body for diagnostic and/or therapeutic purposes, such as a port, an introducer, a surgical tool, an ablation catheter or a fluid delivery tool.
Some exemplary implementations of the methods and systems of the present disclosure are described with reference to the accompanying drawings. In the drawings, like reference numbers indicate identical or substantially similar elements.
Reference is now made to
In some implementations of the methods of this disclosure, in order to ensure that the needle trajectory will not cross paths with the obstacle, and that the initially planned trajectory will be optimal for the entire cycle, independent of when during the motion cycle the procedure is performed, the user may encircle together the time varying positions of the obstacle throughout the entire cycle, and mark them as a single larger obstacle on all the images in the series.
In step 401, a sequence of time separated images/image frames of the region of interest is generated over a predetermined period of time. The predetermined period of time may correspond to one or more complete cycles of the patient's motion, such as the breathing cycle.
In step 402, these image frames are stored as a video sequence.
In step 403, the user selects one of the image frames, which can be anywhere in the sequence, but may conveniently be selected at a readily recognized temporal point in the motion cycle of the patient, such as at a point when the patient has completely exhaled. The user then marks on the selected image frame, the entry point which he intends using, the target point, and the region of forbidden access in the patient's anatomy. Obviously, the user selects to the best of his professional judgment, an entry point that will appear to provide the shortest trajectory to the target with the least curvature and yet still avoiding the forbidden regions. In some implementations, step 403 is performed by the system software, i.e., the program may be adapted to select the initial image frame and/or mark on the selected image frame at least one of the target point, the obstacles en route and the initial entry point.
Then, in step 404, the program calculates the optimal trajectory from the entry point to the target avoiding all forbidden areas, including determination of the entry angle of the needle at the entry point. In the case of a program option which does not calculate the entry angle, the user also has to input the entry angle which he judges to be the most appropriate entry angle for the entry point and estimated trajectory chosen. This step is not shown in the flowchart of
In step 405, the optimal trajectory calculated in step 404 for the selected frame is stored.
In step 406, another image frame is selected from the stored sequence, which may most conveniently be the next frame in the sequence, but could be a frame later on in the sequence, or even a frame prior to the first selected frame, since the frame sequence is cyclical. In some implementations the user manually selects the image to be processed next. In other implementations, the system software automatically selects a new image for processing.
In step 407, the program then uses object tracking image processing methods in order to detect the newly acquired positions in the new image frame, of the entry point, the target point and the forbidden access area, these new positions having resulted from the cyclic movement of the patient.
In step 408, the program then calculates the optimal trajectory for that frame, in accordance with the new locations of the three defined reference positions—entry point, target point and forbidden access area.
In step 409, the optimal trajectory calculated for that new frame is stored.
Then, in step 410, the program ascertains whether all of the image frames of the sequence chosen have had their optimal trajectories calculated. If not, then the program returns the procedure to step 406, another image frame is chosen from the stored sequence of frames, and steps 407 to 410 are repeated for this next selected frame.
If, on the other hand, in step 410, all of the image frames of the complete sequence of frames have been processed, then the program proceeds to step 411, in which all of the calculated trajectories are examined to determine whether any of them has a curvature which exceeds the predetermined maximum defined curvature along any part of its length. It can be appreciated that curvature is only one example of a characteristic of the trajectory checked in step 411. Another characteristic may be, for example, distance from obstacles, in which case the program will check if the trajectory deviates from a minimal acceptable distance. A further characteristic may be the insertion angle, if selected automatically by the system software, as some insertion angles may be impossible to achieve due to the design of the automated insertion system (e.g., robot). A combination of several characteristics may also be checked for deviation in step 411. If no excessive trajectory curvature has been found in any of the frames, then that plan for needle insertion is regarded as a valid plan for implementing the needle insertion procedure over the whole of the patient's motion cycle, as shown in step 412. The term “valid plan” may indicate that for each of the image frames in the sequence, taken at different times during the patient's motion cycle, there is an acceptable/safe trajectory. Thus, the user may begin the needle insertion procedure at any point during the motion cycle, and the insertion procedure will be performed according to the optimal trajectory calculated for that specific point in time during the cycle. If, on the other hand, such an excessive curvature is found in any of the calculated trajectories, then that insertion plan for the needle is regarded as being invalid, as shown in step 413, and the doctor has to select an alternative entry point and/or, if relevant, an alternative entry angle. The whole procedure should then be repeated in order to attempt to obtain an insertion plan without any of the trajectories calculated for the series of image frames having an excessive curvature.
In some implementations of these methods, after optimal trajectories have been calculated separately for all of the frames in the sequence, all or at least one of the calculated trajectories may be run through all or at least several of the other frames in the sequence, and from the checked trajectories a single optimal trajectory for the entire series of frames may be selected for the needle insertion procedure. Such a trajectory may be the trajectory having the minimal curvature and/or the shortest distance from the entry point to the target point, for example.
In step 501, a sequence of time separated images/image frames of the region of interest is generated over a predetermined period of time. The predetermined period of time may correspond to one or more complete cycles of the patient's motion, such as the breathing cycle.
In step 502, these image frames are stored.
In step 503, the user/doctor selects one of the image frames, and marks on the selected image frame, the entry point which he intends using, the target point, and the region of forbidden access in the patient's anatomy. In other implementations, the program may be adapted to select the initial image frame and/or to mark on the selected image frame at least one of the target point, the obstacles en route and the initial entry point.
Then, in step 504, the program calculates the optimal trajectory from the entry point to the target avoiding all forbidden areas. In some implementations, calculation of the optimal trajectory may include determination of the entry angle of the needle at the entry point. In other implementations, the user/doctor also has to input the entry angle prior to trajectory calculation.
In step 505 the program determines if a characteristic of the calculated trajectory, e.g., curvature, exceeds a predetermined threshold. If so, then in step 506 the doctor has to select an alternative entry point and/or an alternative entry angle for the initially selected frame, or choose a different image frame for which the trajectory will be calculated, and steps 504 and 505 are repeated. If no relevant characteristic exceeds a predetermined threshold, then the calculated optimal trajectory is stored, in step 507. Another characteristic may be, for example, distance from obstacles. In such a case, determining if a characteristic of the trajectory exceeds a predetermined threshold may mean that the program determines if the distance between the calculated trajectory and a marked obstacle is less than a minimal acceptable distance.
In step 508, another image frame is selected from the stored sequence, which may most conveniently be the next frame in the sequence, but could be a frame later on in the sequence, or even a frame prior to the first selected frame, since the frame sequence is cyclical. In some implementations the user/doctor manually selects the image to be processed next. In other implementations, the system software automatically selects a new image for processing.
In step 509, the program uses object tracking image processing methods in order to detect the newly acquired positions in the new image frame, of the entry point, the target point and the forbidden access area, which having resulted from the cyclic movement of the patient.
In step 510, the program runs the stored trajectory on the image frame selected in step 508, taking into account the new positions of the entry point, the target point and the forbidden area.
Then, in step 511, the program checks if the stored trajectory is acceptable/safe for the selected image frame. Acceptable/safe (or—applicable) may mean that the trajectory leads from the entry point to the target point, while avoiding the obstacle, given the newly acquired positions of these elements. In some cases, the automated insertion system used for executing the calculated trajectory may be adapted to adjust the trajectory during the insertion process, e.g., a closed-loop system, such as the systems disclosed in U.S. Pat. No. 8,348,861, to Glozman et al, for “Controlled Steering of a Flexible Needle”, and U.S. Pat. No. 8,663,130 to Neubach et al, for “Ultrasound Guided Robot for Flexible Needle Steering”, both incorporated herein by reference in their entireties. In such cases, the checked trajectory may be also considered acceptable/safe if in order for it to reach the target and/or avoid the obstacle, an acceptable level of adjustment will be required.
If the program determines that for that image frame the stored trajectory is not safe/acceptable, i.e., it does not reach the target point and/or it encounters the obstacle en route and/or an unacceptable level of adjustment will be required during the insertion procedure in order for it to reach the target and/or avoid the obstacle, then the process returns to step 506 and the doctor has to select an alternative entry point and/or an alternative entry angle for the initially selected frame, or choose a different image frame for which the trajectory will be calculated. If, on the other hand, the program determines that for the currently processed image frame the stored trajectory is acceptable/safe, then it proceeds to step 512, in which it ascertains if all of the image frames of the complete sequence of frames have been processed, i.e., if the stored optimal trajectory has been run through all of the image frames in the series. If not, then the program returns the procedure to step 508, and another image frame is chosen from the stored sequence of frames, and steps 509 to 512 are repeated for this next selected frame. If, on the other hand, in step 512, all of the image frames of the complete sequence of frames have been processed, meaning that the stored optimal trajectory has been run through all of the image frames in the series, and it has been determined that for each of the images the stored trajectory is acceptable/safe, then the stored trajectory is set, in step 513, as the trajectory for the insertion procedure.
Although a few variations have been described in detail above, other modifications are possible. For example, the logic flows depicted in the accompanying figures and described herein do not require the particular order shown, or sequential order, to achieve desirable results.
Although particular implementations have been disclosed herein in detail, this has been done by way of example for purposes of illustration only, and is not intended to be limiting with respect to the scope of the appended claims, which follow. In particular, it is contemplated that various substitutions, alterations, and modifications may be made without departing from the spirit and scope of the disclosure as defined by the claims. Other aspects, advantages, and modifications are considered to be within the scope of the following claims. The claims presented are representative of the implementations and features disclosed herein. Other unclaimed implementations and features are also contemplated. Accordingly, other implementations are within the scope of the following claims.
Patent | Priority | Assignee | Title |
Patent | Priority | Assignee | Title |
10485577, | Feb 18 2016 | Synergetics USA, Inc.; SYNERGETICS USA, INC | Surgical device with triggered propulsion system for inserting a trocar-cannula assembly |
6400979, | Feb 20 1997 | Johns Hopkins University | Friction transmission with axial loading and a radiolucent surgical needle driver |
6580938, | Feb 25 1997 | Biosense, Inc | Image-guided thoracic therapy and apparatus therefor |
7008373, | Nov 08 2001 | Johns Hopkins University, The | System and method for robot targeting under fluoroscopy based on image servoing |
7167180, | Feb 23 1998 | ALGOTEC SYSTEMS LTD | Automatic path planning system and method |
7833221, | Oct 22 2004 | Ethicon Endo-Surgery, Inc. | System and method for treatment of tissue using the tissue as a fiducial |
8348861, | Jun 05 2006 | TECHNION RESEARCH & DEVELOPMENT FOUNDATION LTD | Controlled steering of a flexible needle |
8663130, | May 28 2008 | TECHNION RESEARCH & DEVELOPMENT FOUNDATION LTD | Ultrasound guided robot for flexible needle steering |
20050033160, | |||
20050267359, | |||
20060089625, | |||
20080234700, | |||
20090281452, | |||
20100082040, | |||
20100130853, | |||
20110125011, | |||
20120046545, | |||
20120215096, | |||
20120226145, | |||
20120265098, | |||
20120302873, | |||
20130225984, | |||
20130229504, | |||
20140086470, | |||
20180360609, | |||
CN101869501, | |||
CN102949240, | |||
KR20130116970, | |||
WO2006081409, | |||
WO2013114994, | |||
WO2015132787, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Aug 30 2016 | SHOCHAT, MORAN | XACT ROBOTICS LTD | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 048569 | /0302 | |
Feb 22 2019 | XACT ROBOTICS LTD | (assignment on the face of the patent) | / |
Date | Maintenance Fee Events |
Feb 22 2019 | BIG: Entity status set to Undiscounted (note the period is included in the code). |
Mar 08 2019 | SMAL: Entity status set to Small. |
Feb 26 2024 | REM: Maintenance Fee Reminder Mailed. |
Aug 12 2024 | EXP: Patent Expired for Failure to Pay Maintenance Fees. |
Date | Maintenance Schedule |
Jul 07 2023 | 4 years fee payment window open |
Jan 07 2024 | 6 months grace period start (w surcharge) |
Jul 07 2024 | patent expiry (for year 4) |
Jul 07 2026 | 2 years to revive unintentionally abandoned end. (for year 4) |
Jul 07 2027 | 8 years fee payment window open |
Jan 07 2028 | 6 months grace period start (w surcharge) |
Jul 07 2028 | patent expiry (for year 8) |
Jul 07 2030 | 2 years to revive unintentionally abandoned end. (for year 8) |
Jul 07 2031 | 12 years fee payment window open |
Jan 07 2032 | 6 months grace period start (w surcharge) |
Jul 07 2032 | patent expiry (for year 12) |
Jul 07 2034 | 2 years to revive unintentionally abandoned end. (for year 12) |