An apparatus for interfacing the movement of a shaft with a computer includes a support, a gimbal mechanism having two degrees of freedom, and three electromechanical transducers. When a shaft is engaged with the gimbal mechanism, it can move with three degrees of freedom in a spherical coordinate space, where each degree of freedom is sensed by one of the three transducers. A fourth transducer can be used to sense rotation of the shaft around an axis.
|
1. A method, comprising:
generating a graphical simulation on a computer coupled to a display;
manipulating a user controlled object coupled to an interface including a mechanism, the mechanism configured to allow movement of the user controlled object in at least three rotary degrees of freedom all intersecting at a single common pivot point, the common pivot point between a first end and a second end of the user controlled object, wherein the first end of the user controlled object is contacted by a user;
sensing movement of the user controlled object in a linear degree of freedom as the user controlled object is slidably moved through the mechanism of the interface;
transmitting position information of the sensed movement to the computer;
updating the displayed graphical simulation in response to the updated position information;
transmitting a force command from the computer to the interface based on the updated position information; and
generating a force on the user controlled object in response to the force command.
9. A method comprising:
generating a graphical simulation on a computer coupled to a display;
sensing movement of a user controlled object coupled to an interface having a mechanism, wherein the mechanism is configured to allow movement of the user controlled object in at least three rotary degrees of freedom all intersecting at a single common pivot point, the common pivot point between a first end and a second end of the user controlled object, wherein the first end of the user controlled object is contacted by a user, wherein the sensed movement is in a rotary degree of freedom;
transmitting position information of the sensed movement to the computer, wherein the sensed linear movement is of the user controlled object sliding through the mechanism of the interface;
updating the displayed graphical simulation in response to the updated position information;
transmitting a force command from the computer to the interface based on the updated position information; and
generating a force on the user controlled object to be felt by the user in response to the force command.
17. An interface apparatus comprising:
means for engaging a user controlled object having a first end and a second end, the first end in contact with and physically manipulatable by a user, wherein the means for engaging is configured to allow movement of the user controlled object in at least three rotary degrees of freedom all intersecting at a single common pivot point, the common pivot point between the first end and the second end of the user controlled object;
means for sensing movement of the user controlled object in at least one degree of freedom when the user controlled object is slidably moved in a linear direction through the means for engaging;
means for outputting data indicative of the linear movement to a computer running a graphical user interface program, wherein the computer is configured to update the graphical user interface program in response to receiving the data; and
means for outputting a force to the user controlled object to be felt by the user in response to receiving a control signal from the computer system, wherein the force is applied in the degree of freedom.
2. The method of
3. The method of
4. The method of
5. The method of
6. The method of
7. The method of
8. The method of
sensing movement of the user controlled object about a first axis; and
sensing movement of the user controlled object about a second axis, wherein the first and second axes are substantially perpendicular to one another.
10. The method of
11. The method of
12. The method of
13. The method of
14. The method of
15. The method of
16. The method of
sensing movement of the user controlled object about a first axis; and
sensing movement of the user controlled object about a second axis, wherein the first and second axes are substantially perpendicular to one another.
18. The interface apparatus of
19. The interface apparatus of
|
This application is a continuation of U.S. application Ser. No. 10/674,423, filed Oct. 1, 2003 now U.S. Pat. No. 7,215,326, which is a continuation of U.S. application Ser. No. 09/996,487, filed Nov. 27, 2001, now U.S. Pat. No. 6,654,000, which is a continuation of U.S. application Ser. No. 09/276,012, filed Mar. 25, 1999, now U.S. Pat. No. 6,323,837, which is a continuation of application Ser. No. 08/833,502, filed Apr. 7, 1997 now U.S. Pat. No. 6,037,927, which is a continuation of application Ser. No. 08/275,120, filed Jul. 14, 1994, now U.S. Pat. No. 5,623,582.
This invention relates generally to human/computer interface devices, and more particularly to computer input devices such as mice, trackballs, etc.
Virtual reality computer systems provide users with the illusion that they are part of a “virtual” environment. A virtual reality system will typically include a personal computer or workstation, specialized virtual reality software, and virtual reality I/O devices such as head mounted displays, pointer gloves, 3D pointers, etc.
For example, a virtual reality computer system can allow a doctor-trainee or other human operator or user to “manipulate” a scalpel or probe within a computer-simulated “body”, and thereby perform medical procedures on a virtual patient. In this instance, the I/O device is typically a 3D pointer, stylus, or the like. As the “scalpel” or “probe” moves within the body image displayed on the screen of the computer system, results of such movement are updated and displayed so that the operator can gain the experience of such a procedure without practicing on an actual human being or a cadaver.
For virtual reality systems to provide a realistic (and therefore effective) experience for the user, sensory feedback and manual interaction should be as natural as possible. As virtual reality systems become more powerful and as the number of potential applications increases, there is a growing need for specific human/computer interface devices which allow users to interface with computer simulations with tools that realistically emulate the activities being represented within the virtual simulation. Such procedures as laparoscopic surgery, catheter insertion, and epidural analgesia should be realistically simulated with suitable human/computer interface devices if the doctor is to be properly trained.
While the state of the art in virtual simulation and medical imaging provides a rich and realistic visual feedback, there is a great need for new human/computer interface tools which allow users to perform natural manual interactions with the computer simulation. For medical simulation, there is a strong need to provide doctors with a realistic mechanism for performing the manual activities associated with medical procedures while allowing a computer to accurately keep track of their actions.
There are number of devices that are commercially available for interfacing a human with a computer for virtual reality simulations. There are, for example, such 2-dimensional input devices such as mice, trackballs, and digitizing tablets. However, 2-dimensional input devices tend to be awkward and inadequate to the task of interfacing with 3-dimensional virtual reality simulations. In contrast, a 3-dimensional human/computer interface tool sold under the trademark Immersion PROBE™ is marketed by Immersion Human Interface Corporation of Palo Alto, Calif., and allows manual control in 3-dimensional virtual reality computer environments. A pen-like stylus allows for dexterous 3-dimensional manipulation, and the position and orientation of the stylus is communicated to a host computer. The Immersion PROBE has six degrees of freedom which convey spatial coordinates (x, y, z) and orientation (role, pitch, yaw) of the stylus to the host computer.
While the Immersion PROBE is an excellent 3-dimensional interface tool, it may be inappropriate for certain virtual reality simulation applications. For example, in some of the aforementioned medical simulations three or four degrees of freedom of a 3-dimensional human/computer interface tool is sufficient and, often, more desirable than five or six degrees of freedom because it more accurately mimics the real-life constraints of the actual medical procedure. Therefore, a less complex, more compact, lighter weight, lower inertia and less expensive alternative to six degree of freedom human/computer interface tool is desirable for certain applications.
The present invention provides a 3-dimensional human/computer interface tool which is particularly well adapted to virtual reality simulation systems that require fewer degrees of freedom, e.g. two, three, or four degrees of freedom. The present invention therefore tends to be less complex, more compact, lighter weight, less expensive, more reliable and have less inertia than 3-dimensional human/computer interface tools of the prior art having more degrees of freedom.
The present invention is directed to a method and apparatus for providing an interface between a human and a computer. The human end of the interface is preferably a substantially cylindrical object such as a shaft of a surgeon's tool, a catheter, a wire, etc. Alternatively, it can comprise a pool cue, a screw driver shaft, or any other elongated object that is manipulated in 3-dimensional space by a human operator. In certain embodiments of the present invention, the computer develops signals to provide force feedback to the object. For example, a twisting or resisting force can be imparted on the object to provide haptic or force feedback of a medical procedure being performed in a virtual reality simulation.
An apparatus for interfacing with a electrical system includes a support, a gimbal mechanism coupled to the support, and preferably three electromechanical transducers, although certain embodiments (e.g. for use with catheters) may require only two electromechanical transducers. The gimbal mechanism has a base portion which is rotatably coupled to the support to provide a first degree of freedom, and an object receiving portion rotatably coupled to the base portion to provide a second degree of freedom. A first electromechanical transducer is coupled between the support and the base portion, a second electromechanical transducer is coupled between the base portion and the object receiving portion, and a third electromechanical transducer is coupled between the object receiving portion and an intermediate portion of an elongated object that is at least partially disposed within the object receiving portion. The third electromechanical transducer is associated with a third degree of freedom. Therefore, each of the three transducers are associated with a degree of freedom of movement of the object when it is engaged with the object receiving portion of the gimbal mechanism.
More specifically, an apparatus for interfacing an operator manipulable shaft with a computer includes a support, a gimbal mechanism, and four sensors. The gimbal mechanism preferably includes a U shaped base portion having a base and a pair of substantially parallel legs extending therefrom, where the base of the U shaped base portion is rotatably coupled to the support, and a shaft receiving portion pivotally coupled between the legs of the base portion. The shaft receiving portion includes a translation interface and a rotation interface that engage the shaft when it is engaged with an aperture of the shaft receiving portion. The base portion rotates around a first axis and the shaft receiving portion rotates around a second axis substantially perpendicular to the first axis, such that an axis of the shaft defines a radius in a spherical coordinate system having an origin at an intersection of the first axis and the second axis. A first sensor is coupled between the support and the U shaped base portion to provide a first output signal, a second sensor is coupled between the U shaped base portion and the shaft receiving portion to produce a second output signal, a third sensor is coupled to the translation interface to produce a third output signal, and a fourth sensor is coupled between the rotation interface and the object to produce a fourth output signal. The output signals are preferably coupled to an input of a computer by an electronic interface.
In an alternative embodiment of the present invention a first actuator is coupled between the support and the U shaped base portion to produce a movement therebetween in response to a first input electrical signal, a second actuator is coupled between the U shaped base portion and the shaft receiving portion to produce a movement therebetween in response to a second input electrical signal, a third actuator is coupled to the translation interface to produce a mechanical movement of the elongated cylindrical object relative to the shaft receiving portion in response to a third input electrical signal, and a fourth actuator is coupled to the rotation interface to produce a mechanical movement of the elongated cylindrical object relative to the shaft receiving portion in response to a fourth input electrical signal.
A method for providing a human/computer interface includes the steps of: (a) defining an origin in a 3-dimensional space; (b) physically constraining a shaft that can be grasped by an operator such that a portion of the object always intersects the origin and such that the portion of the object extending past the origin defines a radius in a spherical coordinate system; (c) transducing a first electrical signal related to a first angular coordinate of the radius in the spherical coordinate system with a first transducer; (d) transducing a second electrical signal related to a second angular coordinate of the radius in the spherical coordinate system with a second transducer; (e) transducing a third electrical signal related to the length of the radius with a third transducer; and (f) electrically coupling the transducers to a computer system to provide a human/computer interface. The method can further include the step of transducing a fourth electrical signal related to a rotation of the shaft around an axis with a fourth transducer. The transducers are either sensors, actuators, or bi-directional transducers which can serve as either input or sensors.
It will therefore be appreciated that a human/computer interface of the present invention includes a support, a gimbal mechanism coupled to the support, and an elongated shaft engaged with the gimbal mechanism and having a grip area that can be grasped by a hand of an operator. The gimbal mechanism has a base portion rotatably coupled to the support, and a shaft receiving portion rotatably coupled to the base. A first sensor is coupled between the support and the base portion, a second sensor is coupled between the base portion and the shaft receiving portion, and a third sensor is coupled between the shaft receiving portion and an intermediate portion of the shaft. The three sensors are coupled to an input of a computer to provide the human/computer interface. Preferably, the interface further includes a fourth sensor coupled between the shaft receiving portion and an intermediate portion of the shaft, where the third sensor is a translation sensor and the fourth sensor is a rotation sensor.
The advantage of the present invention is that a 3-dimensional human/computer interface tool is provided which has the three or four degrees of freedom available that are desirable for many virtual reality simulation applications. The mechanism of the present invention is relatively straight-forward allowing for low cost production and high reliability. Furthermore, since the human/computer interface tool of the present invention is constrained from movement along at certain degrees of freedom, it can more accurately simulate the use of tools and other elongated mechanical objects which are similarly constrained. Importantly, the present interface is of low inertia since the primary mass of the interface is located at the pivot point. This, along with the light weight of the interface, makes the interface less fatiguing to use.
In another embodiment of the present invention a human/computer interface tool is provided which is provided with only two degrees of freedom. This is particularly advantageous when the shaft is flexible, such as with very thin shafts, wires, catheters, and the like. With, for example, catheters, it is only necessary to provide two degrees of freedom (i.e. in-and-out, and rotation) and, therefore, sensors and/or actuators for the other degrees of freedom do not need to be provided.
These and other advantages of the present invention will become apparent to those skilled in the art upon a reading of the following descriptions of the invention and a study of the several figures of the drawing.
In
A laparoscopic tool 18 used in conjunction with the present invention is manipulated by an operator and virtual reality images are displayed on a screen 20 of the digital processing system in response to such manipulations. Preferably, the digital processing system is a personal computer or workstation, such as an IBM-PC AT or Macintosh personal computer, or a SUN or Silicon Graphics workstation. Most commonly, the digital processing system is a personal computer which operates under the MS-DOS operating system in conformance with an IBM PC AT standard.
The human/interface apparatus 12 as illustrated herein is used to simulate a laparoscopic medical procedure. In addition to a standard laparoscopic tool 18, the human/interface apparatus 12 includes a barrier 22 and a standard laparoscopic trocar 24. The barrier 22 is used to represent portion of the skin covering the body of a patient. Trocar 24 is inserted into the body of the patient to provide an entry and removal point from the body of the patient for the laparoscopic tool 18, and to allow the manipulation of the laparoscopic tool 18 within the body of the patient while minimizing tissue damage. Laparoscopic tools 18 and trocars 24 are commercially available from sources such as U.S. Surgical of Connecticut. Preferably, the laparoscopic tool 18 is modified such that the end of the tool (such as any cutting edges) are removed, leaving only the handle and the shaft. The end of the laparoscopic tool 18 is not required for the virtual reality simulation, and is removed to prevent any potential damage to persons or property. A gimbal apparatus 25 is shown within the “body” of the patient in phantom lines.
The laparoscopic tool 18 includes a handle or “grip” portion 26 and a shaft portion 28. The shaft portion is an elongated mechanical object and, in particular, is an elongated cylindrical object. The present invention is concerned with tracking the movement of the shaft portion 28 in three-dimensional space, where the movement has been constrained such that the shaft portion 28 has only three or four free degrees of motion. This is a good simulation of the real use of a laparoscopic tool 18 in that once it is inserted into a trocar 24 and through the gimbal apparatus 25, it is limited to about four degrees of freedom. More particularly, the shaft 28 is constrained at some point of along its length such that it can move with four degrees of freedom within the patient's body.
While the present invention will be discussed with reference to the shaft portion 28 of laparoscopic tool 18, it will be appreciated that a great number of other types of objects can be used with the method and apparatus of the present invention. In fact, the present invention can be used with any elongated mechanical object where is desirable to provide a human/computer interface with three or four degrees of freedom. Such objects may include catheters, hypodermic needles, wires, fiber optic bundles, screw drivers, pool cues, etc. Furthermore, although the described preferred embodiment of the present invention contemplates the use of a elongated cylindrical mechanical object, other embodiments of the present invention provide a similar human/computer interface for an elongated mechanical objects which are not cylindrical in shape.
The electronic interface 14 is a part of the human/computer interface apparatus 12 and coupled the apparatus 12 to the computer 16. An electronic interface 14 that is particularly well adopted for the present is described in U.S. patent application Ser. No. 08/092,974, filed Jul. 16, 1993, now U.S. Pat. No. 5,576,727, —assigned to the assignee of the present invention and incorporated herein by reference in its entirety. The electronic interface described therein was designed for the Immersion PROBE™ 3-D mechanical mouse and has six channels corresponding to the six degrees of freedom of the Immersion PROBE. However, in the context of the present invention, the electronic interface 14 requires the use of only four of the six channels, since the present invention is preferably constrained to no more than four degrees of freedom.
The electronic interface 14 is coupled to a gimbal apparatus 25 of the apparatus 12 by a cable 30 and is coupled to the computer 16 by a cable 32. In some embodiments of the present invention, interface 14 serves solely as an input device for the computer 16. In other embodiments of the present invention, interface 14 serves solely as an output device for the computer 16. In yet other embodiments of the present invention, the interface 14 serves as an input/output (I/O) device for the computer 16.
In an alternative embodiment of the present invention, interface 14 has a local microprocessor 33 preferably coupled with any transducers present in the interface 14 and with a transceiver 35. In such an embodiment, the computer 16 is coupled to the transceiver 35 and, typically, not coupled directly with any transducers present in the interface 14. As will be appreciated, the transceiver 35 may be any suitable transceiver capable of bi-directional communication through serial or parallel communication strategies. The local microprocessor 33 will be programmed to execute computer instructions locally such that a computing burden is removed from the computer 16. For example, positional information generated by the transducers may be processed locally by the local microprocessor 33, which in turn can send absolute position and velocity information to the computer 16. Still further, the local microprocessor 33 is capable of receiving incoming force commands from the computer 16, decoding such commands, and controlling the interface 14 accordingly. For more details, see U.S. Pat. No. 5,576,727 of Rosenberg et al.”
In the perspective view of
The gimbal mechanism 36 also includes an elongated object (shaft) receiving portion 44 provided with an aperture 46 which extends entirely through the object receiving portion. The aperture 46 defines an object axis A0 for an elongated cylindrical object, such that the shaft portion 28 of the laparoscopic tool 18 of
The object receiving portion 44 also includes a translation interface 50 and a rotation interface 52. The object receiving portion 44 includes a bearing section 54, a translation sensor section 56, and a rotation sensor section 58. The bearing section 54 includes a mass of material provided with a cylindrical bore 60 forming a portion of the aperture 46. The translation sensor section 56 includes a pair of opposing wall surfaces 62a and 62b, each of which is provided with a cylindrical bore receptive to the cylindrical object and forming a part of the aperture 46 which extends through the object receiving portion. The translation sensor section 56 includes a pair of opposing wall surfaces 64a and 64b of a wall 63 and which are provided with cylindrical bores receptive to the cylindrical object and therefore also forming a part of the aperture 46. In consequence, when an elongated cylindrical object is inserted into the object receiving portion 44 along axis A0 it engages the bore 60 of the bearing section 54, and extends through bores provided in the surfaces 62a, 62b, 64a, and 64b to extend completely through the object receiving portion 44 along aperture 46. In another embodiment of the present invention, wall 63 (and therefore wall surfaces 64a and 64b) is eliminated as being superfluous.
Referring briefly to
The object receiving portion 44 is preferably a unitary mass of material made from aluminum or some other lightweight material such as a plastic. The object receiving portion 44 is preferably cast, molded, and/or machined as a monoblock member having the aforementioned bearing section, translation sensory section, and rotation sensory section. The materials and construction of U shaped base portion 38 preferably match the materials and construction techniques used for the production of object receiving portion 44.
The gimbal apparatus 25 illustrated in
Four electromechanical transducers are used in association with these four degrees of freedom. More particularly, a first degree of freedom electromechanical transducer 66 is arranged to transduce motion and/or force between the U shaped base portion 38 and the support 34, a second degree of freedom electromechanical transducer 68 is arranged to transduce motion and/or force between the U shaped base portion 38 and the object receiving portion 44, a third degree of freedom electromechanical transducer 70 is arranged to transduce motion and/or force between the object receiving portion 44 and an object engaged with the object receiving portion 44, and a fourth degree of freedom transducer 72 is arranged to transduce motion and/or force between the object receiving portion 44 and an object engaged with the object receiving portion 44.
By “associated with”, “related to”, or the like, it is meant that the electromechanical transducer is influenced by or influences one of the four degrees of freedom. The electromechanical transducers can be input transducers, in which case they sense motion along a respective degree of freedom and produce an electrical signal corresponding thereto for input into computer 16. Alternatively, the electromechanical transducers can be output transducers which receive electrical signals from computer 16 that cause the transducers to impart a force on the object in accordance with their respective degrees of freedom. The electromechanical transducers can also be hybrid or bi-directional transducers which operate both as sensors and as actuator devices.
A variety of transducers, readily available in the commercial market are suitable for use in the present invention. For example, if the transducers are input transducers (“sensors”), such sensors can include encoded wheel transducers, potentiometers, etc. Output transducers (“actuators”) include stepper motors, servo motors, magnetic particle brakes, friction brakes, pneumatic actuators, etc. Hybrid or bi-directional transducers often pair input and output transducers together, but may also include a purely bi-directional transducer such as a permanent magnet electric motor/generator.
It should be noted that the present invention can utilize both absolute and relative sensors. An absolute sensor is one which the angle of the sensor is known in absolute terms, such as with an analog potentiometer. Relative sensors only provide relative angle information, and thus require some form of calibration step which provide a reference position for the relative angle information. The sensors described herein are primarily relative sensors. In consequence, there is an implied calibration step after system power-up wherein the shaft is placed in a known position within the gimbal mechanism and a calibration signal is provided to the system to provide the reference position mentioned above. All angles provided by the sensors are thereafter relative to that reference position. Such calibration methods are well known to those skilled in the art and, therefore, will not be discussed in any great detail herein.
A preferred input transducer for use of the present invention is an optical encoder model SI marketed by U.S. Digital of Vancouver, Wash. This transducer is an encoded wheel type input transducer. A preferred output transducer for use of the present invention is a d.c. motor model 2434.970-50 produced by Maxon of Fall River, Mass. This type of transducer is a servo motor type output transducer.
There are a number of ways of attaching the transducers to the various members of the gimbal apparatus 25. In this preferred embodiment, a housing of transducer 66 is attached to the U shaped base portion 38, and a shaft of the transducer extends through an oversize bore (not shown) in base 40 to engage a press-fit bore (also not shown) in support 34. Therefore, rotation of the us shaped base portion 38 around axis A1 will cause a rotation of a shaft of transducer 66. A housing of transducer 68 is attached to leg 42a of the U shaped base portion 38 such that its shaft forms pivot 48a. Therefore rotation of the object receiving portion 44 around axis A2 will cause a rotation of the shaft of a second transducer 68. The transducer 70 is attached to object receiving portion 44 and extends through a bore (not shown) in a wall 74 of the translation sensor section 56. The shaft 76 provides an axis about which the translation interface 50 can rotate. The fourth transducer 74 is attached to a wall 78 of rotation sensor section 58 and extends through a bore 80 in that wall 78. The shaft 82 of the transducer 72 engages a circumferential surface of rotation interface 52 and rotates therewith.
Axes A1 and A2 are substantially mutually perpendicular and intersect at an origin point O within object receiving portion 44. Axis A0 also intersects this origin O. Shaft 76 rotates around an axis A3 which is substantially perpendicular to the axis A0. Shaft 58 of transducer 72 rotates around an axis A4 which is substantially parallel to the axis A0.
In
In
The four degrees of freedom are illustrated graphically in
In
With reference to
In
Another embodiment 72′″ for the fourth transducer is illustrated in
With reference to all of the figures, and with particular reference to
To this point, the majority of the discussion has been under the assumption that the transducers are input transducers, i.e. the human/computer interface device is used an input device to the computer 16. However, it is also been mentioned that the interface device 12 can serve as an output device for the computer 16. When used as an output device, output transducers (“actuators”) are used to respond to electrical signals developed by the computer 16 to impart a force upon the shaft 28 of the laparoscopic tool 18. This can provide useful movement and force (haptic) feedback to the doctor/trainee or other user. For example, if the laparoscopic tool encounters dense mass of tissue or a bone in the “virtual” patient, a force can be generated by transducer 70 making it harder for the doctor/trainee to push the shaft 28 further into the gimbal apparatus 25. Likewise, twisting motions can be imparted on the shaft 28 when the shaft encounters an obstacle within the virtual patient.
It should be noted that force applied to the shaft may not result in any movement of the shaft. This is because the shaft may be inhibited from movement by the hand of the operator who is grasping a handle or grip portion of the shaft. However, the force applied to the shaft may be sensed by the operator as haptic feedback.
With reference to
It will be noted that the electrical system most frequently described in the present invention is a digital processing system or a computer. However, other digital systems, analog systems, and simple electric or electromechanical system can also be utilized with the apparatus and method of the present invention.
It will also be noted that while specific examples of “elongated objects” and “shafts” have been given, that these examples are not meant to be limiting. In general, equivalents of “elongated objects”, “elongated cylindrical objects”, “shafts”, etc. include any object which can be grasped by a human operator to provide an interface between the operator and a computer system. By “grasp”, it is meant that operators may releasably engage a grip portion of the object in some fashion, such as by hand, with their fingertips, or even orally in the case of handicapped persons. The “grip” can be a functional grip or handle attached to an elongated portion of the object, or can be a portion of the object itself, such as a portion of the length of a shaft that can be gripped and/or manipulated by the operator.
It should also be noted that flexible shafts, such as wires or catheters, do not always require three or four degrees of freedom. For example, if a human/computer interface for a catheter insertion virtual reality system is desired, only a translation interface (e.g. translation interface 50′ of
While this invention has been described in terms of several preferred embodiments, it is contemplated that alternatives, modifications, permutations and equivalents thereof will become apparent to those skilled in the art upon a reading of the specification and study of the drawings. It is therefore intended that the following appended claims include all such alternatives, modifications, permutations and equivalents as fall within the true spirit and scope of the present invention.
Patent | Priority | Assignee | Title |
10026016, | Jun 26 2009 | Regents of the University of Minnesota | Tracking and representation of multi-dimensional organs |
10314661, | Aug 03 2012 | Stryker Corporation | Surgical robotic system and method for controlling an instrument feed rate |
10350017, | Aug 03 2012 | Stryker Corporation | Manipulator and method for controlling the manipulator based on joint limits |
10410746, | Mar 13 2013 | Stryker Corporation | System and method for arranging objects in an operating room in preparation for surgical procedures |
10420619, | Aug 03 2012 | Stryker Corporation | Surgical manipulator and method for transitioning between operating modes |
10426560, | Aug 03 2012 | Stryker Corporation | Robotic system and method for reorienting a surgical instrument moving along a tool path |
10463440, | Aug 03 2012 | Stryker Corporation | Surgical manipulator and method for resuming semi-autonomous tool path position |
10512509, | Mar 13 2013 | Stryker Corporation | Systems and methods for establishing virtual constraint boundaries |
10613629, | Mar 27 2015 | Chad, Laurendeau | System and method for force feedback interface devices |
11045958, | Aug 03 2012 | Stryker Corporation | Surgical robotic system and method for commanding instrument position based on iterative boundary evaluation |
11103315, | Dec 31 2015 | Stryker Corporation | Systems and methods of merging localization and vision data for object avoidance |
11179210, | Aug 03 2012 | Stryker Corporation | Surgical manipulator and method for controlling pose of an instrument based on virtual rigid body modelling |
11183297, | Mar 13 2013 | Stryker Corporation | System and method for arranging objects in an operating room in preparation for surgical procedures |
11202682, | Dec 16 2016 | MAKO Surgical Corp. | Techniques for modifying tool operation in a surgical robotic system based on comparing actual and commanded states of the tool relative to a surgical site |
11464579, | Mar 13 2013 | Stryker Corporation | Systems and methods for establishing virtual constraint boundaries |
11471232, | Aug 03 2012 | Stryker Corporation | Surgical system and method utilizing impulse modeling for controlling an instrument |
11639001, | Aug 03 2012 | Stryker Corporation | Robotic system and method for reorienting a surgical instrument |
11672620, | Aug 03 2012 | Stryker Corporation | Robotic system and method for removing a volume of material from a patient |
11806089, | Dec 31 2015 | Stryker Corporation | Merging localization and vision data for robotic control |
11850011, | Dec 16 2016 | MAKO Surgical Corp. | Techniques for modifying tool operation in a surgical robotic system based on comparing actual and commanded states of the tool relative to a surgical site |
11918305, | Mar 13 2013 | Stryker Corporation | Systems and methods for establishing virtual constraint boundaries |
12070288, | Aug 03 2012 | Stryker Corporation | Robotic system and method for removing a volume of material from a patient |
8716973, | Feb 28 2011 | NISSIN DENTAL PRODUCTS INC | Haptic user interface |
9119655, | Aug 03 2012 | Stryker Corporation | Surgical manipulator capable of controlling a surgical instrument in multiple modes |
9226796, | Aug 03 2012 | Stryker Corporation | Method for detecting a disturbance as an energy applicator of a surgical instrument traverses a cutting path |
9383832, | Feb 28 2011 | NISSIN DENTAL PRODUCTS INC | Haptic user interface |
9480534, | Aug 03 2012 | Stryker Corporation | Navigation system and method for removing a volume of tissue from a patient |
9566122, | Aug 03 2012 | Stryker Corporation | Robotic system and method for transitioning between operating modes |
9566125, | Aug 03 2012 | Stryker Corporation | Surgical manipulator having a feed rate calculator |
9603665, | Mar 13 2013 | Stryker Corporation | Systems and methods for establishing virtual constraint boundaries |
9652591, | Mar 13 2013 | Stryker Corporation | System and method for arranging objects in an operating room in preparation for surgical procedures |
9681920, | Aug 03 2012 | Stryker Corporation | Robotic system and method for reorienting a surgical instrument moving along a tool path |
9795445, | Aug 03 2012 | Stryker Corporation | System and method for controlling a manipulator in response to backdrive forces |
9820818, | Aug 03 2012 | Stryker Corporation | System and method for controlling a surgical manipulator based on implant parameters |
9921712, | Dec 29 2010 | MAKO SURGICAL CORP | System and method for providing substantially stable control of a surgical tool |
ER5690, |
Patent | Priority | Assignee | Title |
4571834, | Feb 17 1984 | XENON RESEARCH, INC | Knee laxity evaluator and motion module/digitizer arrangement |
4642055, | Jun 24 1985 | Hemodynamic monitoring trainer | |
4907973, | Nov 14 1988 | ETHICON, ENDO-SURGERY, INC | Expert system simulator for modeling realistic internal environments and performance |
4986280, | Jul 20 1988 | Arthur D. Little, Inc. | Hand position/measurement control system |
5022407, | Jan 24 1990 | Topical Testing, Inc. | Apparatus for automated tactile testing |
5050608, | Jul 12 1988 | MIZUHO IKAKOGYO CO , LTD | System for indicating a position to be operated in a patient's body |
5086401, | May 11 1990 | INTERNATIONAL BUSINESS MACHINES CORPORATION, A CORP OF NY | Image-directed robotic system for precise robotic surgery including redundant consistency checking |
5149270, | Oct 29 1990 | Apparatus for practicing surgical procedures | |
5217003, | Mar 18 1991 | Wilk Patent Development Corporation | Automated surgical system and apparatus |
5230623, | Dec 10 1991 | INTEGRA BURLINGTON MA, INC | Operating pointer with interactive computergraphics |
5251127, | Feb 01 1988 | XENON RESEARCH, INC | Computer-aided surgery apparatus |
5334017, | Apr 02 1992 | Kaltenbach & Voigt GmbH & Co. | Dental articulator |
5376007, | Dec 19 1991 | Apparatus and method for teaching and learning microsurgical operating techniques | |
5391081, | May 13 1992 | UNIVERSITSY OF FLORIDA RESEARCH FOUNDATION, INCORPORTED | Method and apparatus for simulating neuromuscular stimulation during medical surgery |
5397323, | Oct 30 1992 | International Business Machines Corporation | Remote center-of-motion robot for surgery |
5417210, | May 27 1992 | INTERNATIONAL BUSINESS MACHINES CORPORATION A CORP OF NEW YORK | System and method for augmentation of endoscopic surgery |
5435729, | Oct 19 1990 | System Control Technolgoy Inc. | Motor control loading system |
5436542, | Jan 28 1994 | Surgix, Inc.; SURGIX, INC | Telescopic camera mount with remotely controlled positioning |
5445166, | Nov 02 1993 | International Business Machines Corporation | System for advising a surgeon |
5451924, | Jan 14 1993 | MASSACHUSETTS INSTITUTE OF TECHNOLOGY, THE | Apparatus for providing sensory substitution of force feedback |
5587937, | Oct 01 1993 | Massachusetts Institute of Technology | Force reflecting haptic interface |
5629594, | Dec 02 1992 | Immersion Corporation | Force feedback system |
5701140, | Jul 12 1994 | IMMERSION CORPORATION DELAWARE CORPORATION | Method and apparatus for providing a cursor control interface with force feedback |
5742278, | Jan 27 1994 | Microsoft Technology Licensing, LLC | Force feedback joystick with digital signal processor controlled by host processor |
5808665, | Jan 21 1992 | SRI International | Endoscopic surgical instrument and method for use |
5909380, | May 04 1994 | Universite des Sciences et Techniques de Lille; Centre Hospitalier Regional et Universitaire de Lille; Universite de Lille II | Device and method for simulating an examination or a surgical operation performed on a simulated organ |
5976156, | Jun 13 1991 | International Business Machines Corporation | Stereotaxic apparatus and method for moving an end effector |
6037927, | Jul 14 1994 | Immersion Corporation | Method and apparatus for providing force feedback to the user of an interactive computer simulation |
6057828, | Jan 18 1995 | Immersion Corporation | Method and apparatus for providing force sensations in virtual environments in accordance with host software |
6323837, | Jul 14 1994 | IMMERSION MEDICAL, INC | Method and apparatus for interfacing an elongated object with a computer system |
6437771, | Jul 12 1994 | Immersion Corporation | Force feedback device including flexure member between actuator and user object |
6758843, | May 14 1994 | SRI International, Inc. | Remote center positioner |
7091950, | Jul 16 1993 | Immersion Corporation | Force feedback device including non-rigid coupling |
7215326, | Jul 14 1994 | Immersion Corporation | Physically realistic computer simulation of medical procedures |
SU1124372, | |||
WO9106935, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Jul 13 1994 | ROSENBERG, LOUIS B | Immersion Human Interface Corporation | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 020637 | /0645 | |
Apr 06 1998 | Immersion Human Interface Corporation | Immersion Corporation | CHANGE OF NAME SEE DOCUMENT FOR DETAILS | 020649 | /0782 | |
Nov 02 1999 | IMMERSION CORPORATION CALIFORNIA CORPORATION | IMMERSION CORPORATION DELAWARE CORPORATION | MERGER SEE DOCUMENT FOR DETAILS | 020669 | /0225 | |
Mar 19 2007 | Immersion Corporation | (assignment on the face of the patent) | / |
Date | Maintenance Fee Events |
Feb 11 2013 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
Feb 13 2017 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
Mar 29 2021 | REM: Maintenance Fee Reminder Mailed. |
Sep 13 2021 | EXP: Patent Expired for Failure to Pay Maintenance Fees. |
Date | Maintenance Schedule |
Aug 11 2012 | 4 years fee payment window open |
Feb 11 2013 | 6 months grace period start (w surcharge) |
Aug 11 2013 | patent expiry (for year 4) |
Aug 11 2015 | 2 years to revive unintentionally abandoned end. (for year 4) |
Aug 11 2016 | 8 years fee payment window open |
Feb 11 2017 | 6 months grace period start (w surcharge) |
Aug 11 2017 | patent expiry (for year 8) |
Aug 11 2019 | 2 years to revive unintentionally abandoned end. (for year 8) |
Aug 11 2020 | 12 years fee payment window open |
Feb 11 2021 | 6 months grace period start (w surcharge) |
Aug 11 2021 | patent expiry (for year 12) |
Aug 11 2023 | 2 years to revive unintentionally abandoned end. (for year 12) |