The invention relates to a method for controlling a medical apparatus, wherein: patient image data is generated using an image-generating medical apparatus; a patient image is produced on the basis of this data and displayed on an image output unit; and a medical apparatus is in turn controlled by an interaction with the image.
|
18. A method for controlling a medical imaging apparatus by using a computer, comprising:
using an image-generating medical imaging apparatus configured to capture image data corresponding to a tomographic scan of a patient;
producing a patient image based on the generated image data and displaying the patient image on an image output unit, said patient image comprising an anatomical representation of the patient;
controlling the medical imaging apparatus based on an interaction with the patient image, said controlling comprising altering at least one image acquisition parameter usable for controlling the medical imaging apparatus to capture new image data corresponding to a new tomographic scan of the patient, and said interaction comprising vision detection and/or eye movement detection based on how a viewer looks at the patient image;
changing the image at the point being viewed by partially replacing the patient image with reconstructed images based on the new image data;
switching the image output unit on or off based on how the viewer looks at the patient image; and
evaluating whether the altered parameters exceed boundaries of a patient data set, which causes image data to be re-captured.
1. A method for controlling a medical imaging apparatus by using a computer, comprising:
using an image-generating medical imaging apparatus configured to capture image data corresponding to a tomographic scan of a patient;
producing a patient image based on the generated image data and displaying the patient image on an image output unit, said patient image comprising an anatomical representation of the patient;
controlling the medical imaging apparatus based on an interaction with the patient image, said controlling comprising altering at least one image acquisition parameter usable for controlling the medical imaging apparatus to capture new image data corresponding to a new tomographic scan of the patient, and said interaction comprising:
using multi-touch inputs which are executed by touching the anatomical representation of the patient on the image output unit simultaneously at different positions, and
vision detection and/or eye movement detection based on how a viewer looks at the patient image;
changing the image at the point being viewed by partially replacing the patient image with reconstructed images based on the new image data; and
switching the image output unit on or off based on how the viewer looks at the patient image,
wherein generating image data corresponding to the patient includes generating a multi-layered patient scan, further comprising generating a new multi-layered patient scan based on the altered parameters;
evaluating whether the altered parameters exceed boundaries of a patient data set, which causes image data to be re-captured.
2. The method according to
3. The method according to
4. The method according to
5. The method according to
6. The method according to
7. The method according to
8. The method according to
9. The method according to
10. The method according to
11. The method according to
changing the position of the apparatus or of its image detection element;
changing the image detection resolution;
changing the image detection angle;
changing or shifting the image detection range;
changing the penetration depth; or
changing the layer detection depth.
12. The method according to
adding or superimposing reconstructed images obtained from imaging data sets (CT, MR) onto the patient image;
administering image-enhancing substances to the patient;
altering ECG or pacemaker parameters;
manipulating an instrument by manipulating an image of the instrument; or
localizing areas marked in the image.
13. The method according to
14. The method according to
15. A computer program embodied on a non-transitory computer readable medium, comprising computer executable instructions configured to perform the method in accordance with
16. The method according to
altering image recording characteristics of an endoscope;
detecting a new image using the altered image acquisition parameters;
altering sound penetration parameters or a position of an ultrasound probe;
altering image recording characteristics of a microscope;
altering room lighting or operation light;
altering radiation parameters and/or image recording characteristics of a LINAC.
17. The method according to
|
|||||||||||||||||||||||||||||
This application claims the priority of U.S. Provisional Application No. 61/045,313, filed on Apr. 16, 2008, which is hereby incorporated in its entirety by reference.
The invention relates to an image-based controlling method for medical apparatuses. In particular, image-generating medical apparatuses such as for example endoscopes, CT apparatuses, MR apparatuses, ultrasound apparatuses or video apparatuses are controlled within the framework of the invention.
Currently, medical image-generating apparatuses are provided with a range of input apparatuses, such as for example buttons, joysticks, switches and software user-interface elements, and parameters for the image-generating apparatuses are input via software using user interfaces such as for example text input fields, scroll bars and the like.
Other apparatuses are controlled by operator interaction, such as for example when a person carrying out a treatment holds an ultrasound head and positions it at various points on a patient's body. An endoscope system is known from U.S. Pat. No. 5,558,619 which includes automatic control in accordance with the movement of an operator. A method and system for guiding a medical apparatus within a patient using image data is known from U.S. Pat. No. 6,778,846 B1.
It is the object of the present invention to optimize the control of medical apparatuses, in particular medical imaging apparatuses. The intention is in particular to make control more direct and better adjusted to the user's requirements.
This object is solved in accordance with the invention by a method for controlling a medical apparatus, wherein: patient image data is generated using an image-generating medical apparatus; a patient image is produced on the basis of this data and displayed on an image output unit; and a medical apparatus is in turn controlled by an interaction with the image. The sub-claims define preferred embodiments of the invention.
In the method in accordance with the invention, patient image data is generated using an image-generating medical apparatus, and a patient image is produced on the basis of this data. This image is then displayed on an image output unit. An interaction with the image is then in turn performed, which controls a medical apparatus, for example the image-generating apparatus or another image-generating apparatus (image generation).
In other words, the invention closes a previously open cycle between generating the image, displaying the image and viewing the image, by enabling interaction with the image and then in turn applying the result of this interaction back onto the image-generating apparatus, i.e. onto image production. Thus, the invention uses the images generated in order to in turn control image generation. It enables this by omitting input apparatuses (indirect input apparatuses) such as buttons, joysticks, switches and software interfaces and nonetheless activating desired changes in image representation. Thus, the operator merely has to manipulate the image in order to arrive at the desired new image. This advantageously enables a more direct way of interacting with the medical apparatuses, and desired images or views can be generated in a simple way. It is also possible to provide the user with a simple and very intuitive access to important functions, and it is for example possible to leave the operating details of mechanical devices completely hidden from the user, which significantly simplifies image generation.
The apparatuses can be controlled without contact by an interaction at the image output unit, in particular using touch inputs, multi-touch inputs or gesture inputs (gesture recognition) in front of the image output unit. Another way is by vision detection and/or eye movement detection, wherein it is possible to switch the image output unit on or off, depending on whether a viewer is looking at the patient image or not. The image can also be altered (for example increased in size, brightness or contrast) at the point which is currently being viewed.
In principle, the image data can be influenced in various ways using the apparatus control in accordance with the invention. It is possible to generate new images, retrieve new images from a memory and/or alter the image data using the apparatus control, wherein regenerating often involves a change to the image recording parameters and a new image recording procedure. When retrieving new data, this can be provided in the form of a patient data set, in situ or on a network, and the patient data can for example be changed as a response to inputs by a physician who makes planning inputs (markings, operation instructions, etc.) via the image output.
Within the framework of the invention, it is possible to alter an image recording parameter at the image-generating apparatus using the apparatus control, wherein in particular one or more of the following manipulations is/are performed:
A number of specific embodiments of the method in accordance with the invention are conceivable, in which one or more of the following actions is/are performed within the framework of image-based apparatus control:
Again speaking very generally, the method in accordance with the invention can be performed such that the new or altered image data is used to renew, alter or supplement the patient image on the image output unit.
The invention also relates to a program which, when it is running on a computer or is loaded onto a computer, causes the computer to perform a method such as has been described above in various embodiments. It also relates to a computer program storage medium which comprises such a program.
The invention is described in more detail below on the basis of a number of embodiments. It can include any of the features described here, individually and in any expedient combination, and can also be interpreted as a device invention if the described or necessary apparatuses are assembled in such a way that a method as described here is implemented. The one enclosed FIGURE schematically shows a control cycle in accordance with the invention, on the basis of a zoom adjustment.
The enclosed FIGURE schematically shows an image display unit 1 which, in the present case, is a touch screen monitor, adjacently to the right of which an image-generating apparatus 4, which again is only schematically shown, is also shown in the FIGURE. The reference signs 2 and 3 schematically show images before and after a change, and the letters A, B, C and D illustrate the steps of the method sequence.
A general method sequence in accordance with the present invention would then be the following: the image output 1 initially shows only the image 2—for example, a part of a patient's body—which is or has been recorded with the aid of the image recording apparatus 4; the image recording can be displayed on the basis of new or stored images.
If an operator then wishes to view the object 2 at a greater resolution or size, he goes to the screen 1, which comprises a multi-touch surface. He “grabs” the image 2 at two points and then draws it apart in accordance with the arrows A, such that it acquires the size of the image 3.
This input on the screen 1 is relayed, as apparatus control information, to the image-generating apparatus 4, as shown by the arrow B, wherein the zoom movement (A) can be converted into an apparatus control command directly on the screen by a graphic processing unit, or only later at the medical image recording apparatus.
In the present case, it is shown that the information B concerning the zoom-in arrives at the image-generating apparatus 4, where it is converted into a zoom command which is shown schematically by the box C. This zoom command then generates a change in the image recording parameters of the apparatus 4. For example, the recording element (an image detection element such as a camera, lens, etc.) is moved nearer to the object, or the resolution is increased.
The new image data generated using the altered recording parameters is then transmitted back to the monitor 1, as shown by the arrow D, and the image 3 is then displayed on said monitor 1 at the improved resolution and in its enlarged form. Thus, the control cycle is closed, and the operator is provided with a new image, without having to manipulate the apparatus 4 himself.
Various embodiments of the invention shall now be discussed in more detail below:
Endoscope: the image-generating medical apparatus can be an endoscope. An endoscope generally has a rigid or flexible tube which, when introduced into a patient, sends back an image (through the tube). In accordance with the invention, gestures performed on the image are used to modify the position and/or other parameters of the endoscope. In this case, and more generally, such gestures can in the sense of the invention be gestures which are performed by touching a touch-sensitive monitor (touch screen), or gestures which are identified by gesture recognition systems and which do not necessarily require touching a monitor or image output apparatus. In the present case, gesture recognition can for example cause the tip of the endoscope tube to be moved forwards (zoom-in) or backwards (zoom-out). Such a movement can be mechanically assisted, wherein the control commands then act on this mechanism. It is also possible to alter the viewing direction of the endoscope, for example by performing a shifting gesture on the image, by which the tip of the endoscope can be shifted in any direction. A rotation of the endoscope can for example be triggered by a rotating control movement. Other gestures could be used to increase or reduce the light intensity, change the lens of the endoscope, or perform any other action which is possible using the endoscope hardware.
Reconstructed image (instead of or in addition to the endoscope image): when controlling an endoscope (or also when controlling other imaging apparatuses), it is possible using the invention to extend imaging by superimposing the generated image (endoscope image) with an image which is reconstructed from magnetic resonance or computer tomography data, wherein it can be fluidly superimposed in a transition to desired portions, or the region being viewed by the apparatus (endoscope) can also be completely replaced with an MR or CT reconstruction, if for example an endoscope image is not available or the endoscope cannot physically be moved to the position at which the image is to be produced.
MR/CT: in this case, an image which is to be viewed by a user is generated using a tomographic scan, such as for example MR (magnetic resonance tomography), CT (computer tomography) or PET (positron emission tomography) or any other device which generates multilayered scans. In accordance with the invention, the gestures performed on the image then modify the scan characteristics of the image-generating apparatus. The user can for example define an area of interest in the image, and the image-generating apparatus then performs a more detailed re-scan of the area of interest. One gesture can for example be used to alter the tomograph detection distance during such a re-scanning procedure, so as to increase the precision. In another conceivable application, a user navigation input which exceeds/overextends the current boundaries of the data set causes images to be re-acquired, wherein it may be advantageous for the patient to remain on the scanner table while the first images are evaluated.
Ultrasound: in order to control ultrasound image acquisition, gestures on an ultrasound image by the user can for example alter the penetration depth of the image (zoom image). In the case of TEE (trans-esophageal echocardiogram) ultrasound detection, the ultrasound probe is arranged in the patient's esophagus and rotated in order to acquire multiple tomographs. In the case of this recording, a scroll gesture on the images can for example be used to alter the rotation of the probe and so display different layers. A shifting gesture on the images is for example used to move the ultrasound probe upwards or downwards in the esophagus.
Microscope: when using a medical microscope (pathological microscope), any zoom gestures or shifting gestures on the images can be converted into movements of the microscope lenses and/or the position of the microscope. For the user, this creates the impression that he is “navigating” through a set of images.
Acquisition parameters: in the prior art, the user can only change the brightness and contrast of images after they have been acquired, whereas in accordance with the invention, user gestures on the image can alter the brightness and contrast in the area which is provided by the image or also in an area influenced by the acquisition parameters of the apparatus. This enables the apparatus to be used to improve image acquisition for exactly those settings which the user has chosen. In an extension of this concept, it is possible to define gestures which can in turn change any acquisition parameters of the apparatus.
Contrast agent: in this case, image manipulation can be used to trigger the administering of a contrast agent. For example, the user would perform a gesture which incorporates the command for viewing the image with contrast, and if no such image is available, this request automatically causes a contrast agent to be injected, in order to be able to generate such an image.
ECG: ECG curves show electrical cardiac activity. Interactive images, which display an ECG trace, can be manipulated. Modifications to the ECG curve, for example quickening or slowing the pulse, are interpreted by another device which takes steps to change the current ECG to the desired ECG (for example, administering dobutamine in order to quicken the pulse).
Pacemakers: In an extension of the concept of regulating the pulse, it is possible to use an ECG curve to modify the parameters of a pacemaker or implantable cardioverter defibrillator. These devices are fine-tuned for each patient, and the heart rate is changed by changing the apparatus parameters. In accordance with the present invention, the user can directly change the ECG curve (ECG diagram), and this modification is then converted into changed parameters for the pacemaker or defibrillator. In this way, such apparatuses can be more quickly and easily fine-tuned. This case also shows that within the framework of the present invention, the displayed images do not necessarily have to be images of actual objects, but can also be images such as diagrams which represent physical functions. These images are also referred to in the present case as “patient images”.
Operating room lighting: in this embodiment, an image display device can be used to control another apparatus which does not necessarily generate an image itself but which assists image generation. By selecting a point on an image at the image output unit, the lights in the operating room are automatically rotated into a position in which they concentrate their light on the chosen point. This is advantageously performed after the patient and the acquired images have been registered in a navigation/tracking system. If, in accordance with this embodiment, the illuminated point becomes brighter, it may be possible to take a better or more precise video image which can then likewise be displayed on the image output unit, on its own or in addition to the previous image. Thus, within the framework of the invention, the imaging apparatus controlled by manipulating can be the same as the imaging apparatus which took the first image (the manipulated image) or can be another imaging apparatus which generates additional image data.
Controlling an apparatus in the image: in this embodiment variant, an image is used to control a device which is displayed on the image. One example is when an intra-operative image shows the position of a biopsy needle. By moving the needle in the image (using input gestures), the actual physical object is automatically moved, which enables exact positioning.
LINAC: in order to control a linear accelerator (radiotherapy), this variation of the invention uses gestures which manipulate the image, to select and alter beams and/or beam shapes. Together with an image produced during the procedure, this is used to correct and shift the beams (interaction with intra-procedural images).
Regions or images marked on the patient: in this case, any region (two-dimensional or three-dimensional) can be marked in a medical image. If the position of the patient has been registered relative to the image data, it is then for example possible to project the exact position of the region—marked in the image output—onto the patient, for example using a laser.
Modifying accessories/other apparatuses: in accordance with this variation, non-medical images are output and objects in them are manipulated. One example is to display an image of an operating theatre, wherein by manipulating the image with the aid of gestures, it is for example possible to change the position or inclination of a table. Another example is a dashboard software for operating room planning, in which the software images show all the operating rooms and their current status. Using gestures on the doors and lifts, it is then possible to change their position. One example is to open all the doors to the rooms which are accessible from one hallway.
Visual control: in accordance with this embodiment, non-tactile interaction with the systems is used, such as has already been described above. Visual controls are used instead of touching monitors or gesture recognition, in order to interact with the images. A device which is suitable for this purpose recognizes eye movements, for example, and automatically sets the image display in accordance with the focus of view. In one example, the parameters of a medical image detection apparatus are changed for or in accordance with the area of the image which the user is currently looking at. Another example is to extend scan detection when the user directs his view towards the boundaries of the scan image material provided.
Computer program elements of the invention may be embodied in hardware and/or software (including firmware, resident software, micro-code, etc.). The computer program elements of the invention may take the form of a computer program product which may be embodied by a computer-usable or computer-readable storage medium comprising computer-usable or computer-readable program instructions, “code” or a “computer program” embodied in said medium for use by or in connection with the instruction executing system. Within the context of this application, a computer-usable or computer-readable medium may be any medium which can contain, store, communicate, propagate or transport the program for use by or in connection with the instruction executing system, apparatus or device. The computer-usable or computer-readable medium may for example be, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared or semiconductor system, apparatus, device or medium of propagation such as for example the Internet. The computer-usable or computer-readable medium could even for example be paper or another suitable medium on which the program is printed, since the program could be electronically captured, for example by optically scanning the paper or other suitable medium, and then compiled, interpreted or otherwise processed in a suitable manner. The computer program product and any software and/or hardware described here form the various means for performing the functions of the invention in the example embodiments.
Although the invention has been shown and described with respect to one or more particular preferred embodiments, it is clear that equivalent amendments or modifications will occur to the person skilled in the art when reading and interpreting the text and enclosed drawings of this specification. In particular with regard to the various functions performed by the elements (components, assemblies, devices, compositions, etc.) described above, the terms used to describe such elements (including any reference to a “means”) are intended, unless expressly indicated otherwise, to correspond to any element which performs the specified function of the element described, i.e. which is functionally equivalent to it, even if it is not structurally equivalent to the disclosed structure which performs the function in the example embodiment or embodiments illustrated here. Moreover, while a particular feature of the invention may have been described above with respect to only one or some of the embodiments illustrated, such a feature may also be combined with one or more other features of the other embodiments, in any way such as may be desirable or advantageous for any given application of the invention.
Frielinghaus, Nils, Steinle, Wolfgang, Hamilton, Christoffer
| Patent | Priority | Assignee | Title |
| Patent | Priority | Assignee | Title |
| 5091926, | Mar 26 1990 | Head activated fluoroscopic control | |
| 5099846, | Dec 23 1988 | Method and apparatus for video presentation from a variety of scanner imaging sources | |
| 5204625, | Dec 20 1990 | General Electric Company | Segmentation of stationary and vascular surfaces in magnetic resonance imaging |
| 5531520, | Sep 01 1994 | ENGILITY CORPORATION | System and method of registration of three-dimensional data sets including anatomical body data |
| 5558619, | Apr 23 1991 | Olympus Optical Co., Ltd. | Endoscope system with automatic control according to movement of an operator |
| 5562448, | Apr 10 1990 | Method for facilitating dental diagnosis and treatment | |
| 5769640, | Dec 02 1992 | Immersion Corporation | Method and system for simulating medical procedures including virtual reality and control method and system for use therein |
| 5788688, | Nov 05 1992 | KARL STORZ ENDOSCOPY-AMERICA, INC | Surgeon's command and control |
| 5867308, | Oct 26 1994 | LEICA INSTRUMENTS PTE LTD ; LEICA INSTRUMENTS SINGAPORE PTE LTD | Microscope, in particular for surgical operations |
| 5886683, | Jun 25 1996 | Sun Microsystems, Inc | Method and apparatus for eyetrack-driven information retrieval |
| 5911036, | Sep 15 1995 | Intuitive Surgical Operations, Inc | Head cursor control interface for an automated endoscope system for optimal positioning |
| 5926264, | Oct 12 1994 | Qinetiq Limited | Position sensing of a remote target |
| 6016439, | Oct 15 1996 | Biosense, Inc | Method and apparatus for synthetic viewpoint imaging |
| 6166544, | Nov 25 1998 | General Electric Company | MR imaging system with interactive image contrast control |
| 6167295, | Jan 28 1991 | INTEGRA BURLINGTON MA, INC | Optical and computer graphic stereotactic localizer |
| 6175610, | Feb 11 1998 | Siemens Aktiengesellschaft | Medical technical system controlled by vision-detected operator activity |
| 6201984, | Jun 13 1991 | International Business Machines Corporation | System and method for augmentation of endoscopic surgery |
| 6317616, | Sep 15 1999 | Philips Electronics Ltd | Method and system to facilitate image guided surgery |
| 6363134, | Jan 13 1999 | Toshiba Medical Systems Corporation | X-ray computed tomography apparatus |
| 6405072, | Jan 28 1991 | INTEGRA BURLINGTON MA, INC | Apparatus and method for determining a location of an anatomical target with reference to a medical apparatus |
| 6478425, | Dec 29 2000 | Koninklijke Philips Electronics N V | System and method for automatically adjusting a lens power through gaze tracking |
| 6560492, | Nov 07 1997 | Hill-Rom Services, Inc. | Medical equipment controller |
| 6603992, | Oct 18 2000 | GE Medical Systems Global Technology Company, LLC | Method and system for synchronizing magnetic resonance image acquisition to the arrival of a signal-enhancing contrast agent |
| 6608628, | Nov 06 1998 | Administrator of the National Aeronautics and Space Administration | Method and apparatus for virtual interactive medical imaging by multiple remotely-located users |
| 6638223, | Dec 28 2000 | GE Medical Systems Global Technology Company, LLC | Operator interface for a medical diagnostic imaging device |
| 6665554, | Nov 18 1998 | MICRODEXTERITY SYSTEMS, INC | Medical manipulator for use with an imaging device |
| 6734880, | Nov 24 1999 | KONINKLIJKE PHILIPS ELECTRONICS, N V | User interface for a medical informatics systems |
| 6738656, | Sep 15 1994 | GE Medical Systems Global Technology Company, LLC | Automatic registration system for use with position tracking an imaging system for use in medical applications |
| 6778846, | Mar 30 2000 | Medtronic, Inc. | Method of guiding a medical device and system regarding same |
| 6847336, | Oct 02 1996 | Selectively controllable heads-up display system | |
| 6886137, | May 29 2001 | Tobii AB | Eye gaze control of dynamic information presentation |
| 6990170, | Aug 09 2001 | Toshiba Medical Systems Corporation | X-ray computed tomographic imaging apparatus |
| 7038212, | Apr 30 2004 | General Electric Company | Method and system for normalization of a positron emission tomography system |
| 7058901, | Oct 29 2002 | KONINKLIJKE PHILIPS ELECTRONICS, N V | Methods and apparatus for controlling the display of medical images |
| 7133137, | Jun 27 2002 | AMO Manufacturing USA, LLC | Integrated scanning and ocular tomography system and method |
| 7176937, | Sep 23 2003 | Honeywell International, Inc. | Methods and apparatus for displaying multiple data categories |
| 7203277, | Apr 25 2003 | Brainlab AG | Visualization device and method for combined patient and object image data |
| 7206627, | Mar 06 2002 | MAKO SURGICAL CORP | System and method for intra-operative haptic planning of a medical procedure |
| 7220000, | Feb 19 2002 | NOTAL VISION, LTD | Methods, devices and systems for assessing eye disease |
| 7227149, | Dec 30 2004 | General Electric Company | Method and system for positron emission tomography image reconstruction |
| 7259906, | Sep 03 2002 | OMNI CONTINUUM, LLC | System and method for voice control of medical devices |
| 7298383, | Jun 11 2003 | AGFA NV | Method and user interface for modifying at least one of contrast and density of pixels of a processed image |
| 7313260, | Nov 24 2000 | U-Systems, Inc. | Controlling thick-slice viewing of breast ultrasound data |
| 7515954, | Jun 13 2006 | Boston Scientific Scimed, Inc | Non-contact cardiac mapping, including moving catheter and multi-beat integration |
| 7542210, | Jun 29 2006 | TEDDER, DONALD RAY | Eye tracking head mounted display |
| 7561143, | Mar 19 2004 | SAMSUNG ELECTRONICS CO , LTD | Using gaze actions to interact with a display |
| 7648461, | Jun 10 2003 | Koninklijke Philips Electronics N.V. | User interface for a three-dimensional colour ultrasound imaging system |
| 7697972, | Nov 19 2002 | Medtronic Navigation, Inc | Navigation system for cardiac therapies |
| 7734331, | Mar 02 2004 | General Electric Company | Systems, methods and apparatus for preparation, delivery and monitoring of radioisotopes in positron emission tomography |
| 7835498, | Feb 18 2005 | Koninklijke Philips Electronics N V | Automatic control of a medical device |
| 7912249, | May 11 2006 | Dental Imaging Technologies Corporation | Tomographic imaging |
| 7965907, | Nov 21 2002 | Canon Kabushiki Kaisha | Medical image handling system and method |
| 8016758, | Oct 30 2004 | Sonowise, Inc. | User interface for medical imaging including improved pan-zoom control |
| 8069420, | Dec 29 2004 | Karl Storz Endoscopy-America, Inc. | System for controlling the communication of medical imaging data |
| 8190238, | Dec 09 2005 | AURIS HEALTH, INC | Robotic catheter system and methods |
| 8269729, | Jan 31 2007 | Microsoft Technology Licensing, LLC | Methods of interfacing with multi-point input devices and multi-point input systems employing interfacing techniques |
| 8432465, | Sep 25 2006 | Siemens Healthcare GmbH | System and method for establishing zoom settings for display of an anatomical image |
| 8520974, | Jan 11 2008 | Shimadzu Corporation; THE RITSUMEIKAN TRUST | Image processing method, an apparatus therefor and a tomographic apparatus for removing artifacts from a sectional image |
| 8527032, | May 16 2007 | General Electric Company | Imaging system and method of delivery of an instrument to an imaged subject |
| 8527094, | Nov 20 1998 | Intuitive Surgical Operations, Inc | Multi-user medical robotic system for collaboration or training in minimally invasive surgical procedures |
| 20010051881, | |||
| 20020004729, | |||
| 20020068862, | |||
| 20020087061, | |||
| 20020105482, | |||
| 20020109735, | |||
| 20020113943, | |||
| 20020195565, | |||
| 20030004409, | |||
| 20030053061, | |||
| 20030055686, | |||
| 20030093503, | |||
| 20030095144, | |||
| 20030095697, | |||
| 20040030219, | |||
| 20040106916, | |||
| 20040114034, | |||
| 20040212712, | |||
| 20040242988, | |||
| 20050228256, | |||
| 20050267360, | |||
| 20060025679, | |||
| 20060026521, | |||
| 20060030773, | |||
| 20060100642, | |||
| 20060112334, | |||
| 20060262968, | |||
| 20060281971, | |||
| 20070049815, | |||
| 20070150841, | |||
| 20070226646, | |||
| 20070297663, | |||
| 20080021288, | |||
| 20080021741, | |||
| 20080025461, | |||
| 20080072151, | |||
| 20080086051, | |||
| 20080168403, | |||
| 20080183074, | |||
| 20080253519, | |||
| 20090037840, | |||
| 20090097723, | |||
| 20090125147, | |||
| 20090131793, | |||
| 20090138800, | |||
| 20090146950, | |||
| 20100050110, | |||
| 20100123831, | |||
| 20100231504, | |||
| 20110214087, | |||
| 20110282188, | |||
| 20120059249, | |||
| 20120109150, | |||
| EP150726, | |||
| EP1720039, | |||
| JP4047567, | |||
| WO2006040697, | |||
| WO2007017642, | |||
| WO2000051080, |
| Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
| Mar 10 2009 | STEINLE, WOLFGANG | Brainlab AG | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 022564 | /0867 | |
| Mar 10 2009 | HAMILTON, CHRISTOFFER | Brainlab AG | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 022564 | /0867 | |
| Mar 26 2009 | FRIELINGHAUS, NILS | Brainlab AG | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 022564 | /0867 | |
| Apr 06 2009 | Brainlab AG | (assignment on the face of the patent) | / | |||
| Jul 26 2017 | Brainlab AG | Brainlab AG | ASSIGNEE CHANGE OF ADDRESS | 043338 | /0278 |
| Date | Maintenance Fee Events |
| Jul 29 2024 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
| Date | Maintenance Schedule |
| Feb 02 2024 | 4 years fee payment window open |
| Aug 02 2024 | 6 months grace period start (w surcharge) |
| Feb 02 2025 | patent expiry (for year 4) |
| Feb 02 2027 | 2 years to revive unintentionally abandoned end. (for year 4) |
| Feb 02 2028 | 8 years fee payment window open |
| Aug 02 2028 | 6 months grace period start (w surcharge) |
| Feb 02 2029 | patent expiry (for year 8) |
| Feb 02 2031 | 2 years to revive unintentionally abandoned end. (for year 8) |
| Feb 02 2032 | 12 years fee payment window open |
| Aug 02 2032 | 6 months grace period start (w surcharge) |
| Feb 02 2033 | patent expiry (for year 12) |
| Feb 02 2035 | 2 years to revive unintentionally abandoned end. (for year 12) |