A method and apparatus is disclosed for transmitting data about an object within a defined field and using the transmitted data to generate a virtual object on the display screen of a computer. In one embodiment of the present invention the object used to transmit input data is a wireless glove assembly. The glove assembly supports a transmitting device which transmits data bursts, containing position and gesture information, in the radio frequency wavelength to four stationary receivers. The received signal is converted to a digital signal and input to a microprocessor control unit. The software used in the microprocessor control unit uses an averaging method to generate a virtual object on the computer display screen. The position of the virtual object is calculated based on the strength of the signal received. The movement of the virtual object on the computer display screen is in the same direction as and is proportional to the glove movement.
|
15. A system for estimating a position of an object, comprising:
a transmitter, disposed on said object, which transmits signals: a plurality of receivers which receive the signals transmitted by the transmitter; and a position calculating unit configured to estimate a position of said object by averaging strengths of the signals received by at least some of said plurality of receivers.
8. A method for tracking the movement of an object comprising:
transmitting a data burst from an object; detecting the transmitted signal from said object; and coupling the detected signal to a computer; wherein the signal is detected by a plurality of receivers; further comprising displaying a virtual object on a screen and controlling the movement of said virtual object on said screen; wherein movement of said virtual object is dependent on the strength of the receiver signals; and wherein the z position value of said virtual object is a function of the average value of all said receiver signals.
1. A radio frequency tracking system for tracking the movement of an object not in direct physical contact with the system comprising:
a transmitting means affixed on said object; a receiving means for detecting the transmitted signal; and an interface means for coupling signals from said receiving means to the computer; and wherein the receiving means comprises a plurality of receivers; further comprising a display means for displaying a virtual object on a screen and a means for controlling said virtual object on said screen; wherein movement of said virtual object is dependent on the strength of the receiver signals; and wherein the z position value of said virtual object is a function of the average value of all said receiver signals.
3. A radio frequency tracking system as in
4. A radio frequency tracking system as in
5. A radio frequency tracking system as in
6. A radio frequency tracking system as in
7. A system according to
a subsystem configured to generate a virtual object on a screen using an estimated position of said object determined by the position calculating unit.
9. A method for tracking the movement of an object as in
11. A method for tracking the movement of an object as in
12. A method for tracking the movement of an object as in
13. A method for tracking the movement of an object as in
14. A method for tracking the movement of an object as in
16. A system according to
strengths of signals from a first plurality of receivers are used to estimate a position along an x axis and strengths of signals from a second plurality of receivers are used to estimate a position along a y axis.
17. A system according to
19. A system according to
a display for displaying the estimated position of said object.
|
This application is a continuation of U.S. patent application Ser. No. 08/354,018, entitled "Radio Frequency Tracking System", filed Dec. 5, 1994, now U.S. Pat. No. 6,094,188 which is a continuation of U.S. patent application Ser. No. 08/155,359, filed Oct. 6, 1993, now abandoned, which is a continuation of U.S. patent application Ser. No. 07/863,312, filed Mar. 20, 1992, now abandoned, which is a continuation of U.S. application Ser. No. 07/621,447, filed Nov. 30, 1990, now abandoned.
1. Field of the Invention
This invention relates generally to the field of devices for data entry into a computer system, and relates more particularly to an apparatus and method for inputting data based on an object within a specified field into a computer and using inputted data to move a virtual object on a display screen.
2. Description of the Relevant Art
Typically, devices such as keyboards, joy sticks, mice, and light pens are used to input data into a computer. A function of these input devices is to position a virtual object such as a cursor on the display screen of a computer. Once the cursor is positioned at a desired location, the computer typically will be instructed to perform an operation. The processes of positioning the cursor and selecting the operation are discrete operations, since separate motions are required to perform each operation. With a mouse, for example, cursor positioning is accomplished by moving a mouse along the surface, while selection of the operation is accomplished by pushing keys located either on the mouse or on a separate keyboard. Mastering the operation of such input devices is often difficult because the hand movements required to operate the devices do not correspond to the visual feedback presented by the display screen of the computer. Furthermore, the operator's hand must be removed from the keyboard positioned on the mouse and then returned to the keyboard.
Glove input devices also have been used to supply data to computers. U.S. patent application Ser. No. 317,107 by Thomas G. Zimmerman et al., and entitled "Computer Data Entry and Manipulation Apparatus and Method", describes one such glove input device. This glove input device allows the user to control the movement of a virtual object on a video display screen and perform an operation using a single movement of the operator's hand.
A problem with such a system is that it requires a wire connection between the object and the computer system to sense the operator's hand movement. The wire adds to the expense of the manufacture of the system, and may become twisted or broken affecting operation.
Another problem with prior glove input systems is the added expense necessary for the object sensing field. The glove system disclosed in U.S. patent application Ser. No. 317,107 uses a low frequency magnetic field such as the 3SPACE™ system available from Polhemus Inc. of Colchester, Vt. to sense object movement. The wireless input control system in U.S. Pat. No. 4,654,648 uses an acoustical field to sense object movement. The creation of these sensing fields increases manufacturing costs of the computer system.
Tracking systems use software to generate the virtual object on the computer screen. The positioning of the virtual object typically uses triangulation to determine object position on the display screen. Using triangulation to determine object position necessitates knowledge of the distance of the object from the receiver, and computation can be complicated by determination of the squares or square root of the object to receiver distance. The present invention uses a simple averaging method of receiver signal strength to determine virtual object positioning on the computer display terminal; no distance calculation is required. Using this simpler averaging method increases computation speed and decreases complexity.
The present invention provides an inexpensive method and apparatus for transmitting data about an object within a defined field and using transmitted data to generate a virtual object on the display screen of a computer. In one embodiment of the present invention the object used to transmit input data is a wireless glove assembly. The tracking and display system uses a radio frequency signal to track the glove positioning, instead of a more expensive low frequency magnetic or acoustical field. Also, a single averaging method is used to determine the object position instead of the more complex triangulation method.
The glove assembly supports a transmitting device which transmits data bursts of gesture information at a radio frequency to four stationary receivers. The received signal is converted to a digital signal and input to a microprocessor control unit. The software used in the microprocessor control unit uses the inputted data to generate a virtual object on the computer display screen. The position of the virtual object is calculated based on the strength of the signal received. The movement of the virtual object on the computer display screen is in the same direction as and is proportional to the object movement.
Appendix 1 is a text description of alternative embodiments of the present invention.
In
In operation, the glove assembly is worn on the hand of an operator, and is used to position a cursor or other representative of the glove on the display screen of the computer. The glove assembly 12 typically consists of an inner (not shown) and outer glove. In one embodiment of the present invention, the transmitter is affixed to the inner glove. The inner glove also supports five sensors to detect the opening or closing of the finger positions. These sensors may be metal contacts affixed to the fingers and pals of the inner glove. When the switches of the glove are open, i.e. the sensors do not contact each other, the transmitting device sends out a high digital signal. When the finger positions are closed, i.e. the sensors are in contact with each other, a low digital signal is transmitted.
Data is transmitted to the receivers in radio frequency bursts of approximately 9.5 milliseconds in duration by the transmitter circuitry illustrated in FIG. 2.
The clock 140 comprises a chip 100 which combines an oscillator and binary down counter function, such as the National Semiconductor CD4060. The chip 100 is coupled to a crystal 102 and a capacitor 103. In operation, the clock 140 generates a square wave on lines 104, 120, and 133. The chip 100 outputs an 884 Hz signal on line 133, a 218 Hz signal on line 104, and a 223,750 Hz signal on line 120. The 223,750 Hz square wave generated on line 120 serves as the carrier frequency for the radio frequency data burst.
The buffer control circuitry 150 controls the timing of the data transmission of the transmitter circuit 17. The buffer control circuit 150 comprises a NAND gate 106 which is coupled to the cathode of a diode 108. The anode of diode 108 is coupled to a resistor 109, a capacitor 110, and the input to NAND gate 112. The output of the NAND gate 112 is line 113 which is coupled to data buffer section 160. The output of NAND gate 113 is similarly coupled to the anode of diode 114. The cathode of diode 114 is coupled to the resistor 115 and the capacitor 117, and the input to NAND gate 118. The output of NAND gate 118 is fed back to the input of NAND gate 106.
The NAND gates 106, 112, and 118 exhibit characteristics similar to that of the National Semiconductor CD4093. The CD4093 has a logic threshold which is approximately 50% of the line supply voltage. This logic threshold value allows us to generate a sine wave out of the square wave generated in the clock 140, in conjunction with the choke coil 125 and capacitors 126 and 127 in the output circuit 170.
In operation, the buffer control circuitry 150 controls the timing of the data transmission of the circuit by controlling when data is sent into the data buffer. In the steady state, line 104 is low and no data is transmitted. When line 104 is low, a high data signal is output from the NAND gate 106. A high output from NAND gate 106 reverse biases diode 108 allowing 120K resistor 109 to charge the 0.01 μF capacitor 110 resulting in a high data input value to NAND gate 112 and a low data output signal on line 113.
Line 113 connects the buffer control circuit 150 to the data buffer section 160 and controls the input of data to the shift register 119. When line 113 is low, no data is input to the shift register 119 and therefore no data is transmitted. A high data signal on line 105, does not change the steady state since both values must be high to change the output of NAND gate 106. In order to transmit data, line 104 must be high. This, in conjunction with the high data signal on line 105, results in a low data output on line 107 which causes 0.01 μF capacitor 110 to discharge resulting in a high data signal on line 113.
The triggering to load transmit data into the shift register 119 occurs at about 218 Hz which is too fast a rate for the shift register 119 to shift out data. The buffer control circuitry 150 works by causing a delay in the transmission of the data signal. This delay is created by the RC load comprised of a 33K resistor 115 and the 1 μF capacitor 117 on line 116.
Data buffer 160 comprises a shift register 119, a series of resistors 134-138, and a series of switches 141 through 145. Shift register 119 is an 8-bit parallel in, serial out shift register. Line 113 is connected to pin 9 of shift register 119 and controls the input of data into the shift register. A high data signal on line 113 causes the shift register 119 to parallel load the data on lines 128-132 into the shift register 119.
The first two bits of the 8-bit shift register are not used for transmittal of data, but are held high so that the receivers have time to stabilize and accurate positional data is received. The next five bits of the shift register 119 are used for finger data. The data on lines 141-145 indicate whether the finger position is open or closed. If the finger position is open, a high data signal is sent to the shift register. If the finger position is closed, a low data signal is input into the shift register. The eighth bit of the shift register 119 is unused, and may be used to indicate, for example, whether the data signal is from a left or right glove, or whether the glove is in front of the receivers or in back of the receivers.
The data output circuitry 170 is comprised of a NAND gate 134, which is coupled to capacitor 123 which is coupled to choke coil 125, capacitor 126, and capacitor 127 in parallel. The output from shift register 119 and the 223,754 Hz signal from clock-circuitry 140 are input into NAND gate 134 so that line 122 modulates the carrier frequency. The output from line 122 is input into the antiresonance circuit which is slop tuned to 223,750 Hz. The 100 μH coil 125 acts as a cylindrically direction antenna to transmit data to the receivers.
The ferrite loop stick and two capacitors, together, form an antiresonance circuit which tunes the receiver to the same frequency as a transmitted signal in the glove. The transmitted signal is input into the first amplifying stage 220 and then rectified in the second stage 230 which acts as a half wave rectifier. The result at node 200 is an amplified unipolar signal that has been rectified. The amplified signal is then sent through a third stage 240 which acts as a filtering network to filter out the radio frequency signal and restores the DC level. The resulting signal at node 201 is the originally transmitted signal without the addition of the radio frequency signal and restored the DC level. The signal at node 201 is then sent through the fourth stage 250 which is a two-to-one non-inverting buffer. This resulting signal is sent to the interface unit shown in FIG. 4.
The receiver signals are input to the analog-to-digital converter 440 and the voltage threshold unit 410. The voltage threshold unit 410 comprises a series of comparators coupled to an RC network. The comparators have their negative inputs tied to the negative reference voltage. The output of the comparators are open collector and are wired together so that an interrupt is triggered when the threshold is exceeded by any of the receivers.
The negative reference leads of the comparators are tied to a network of resistors and capacitors in order to prevent false triggering. The RC network keeps both the analog-to-digital converter and the comparators at the same voltage level, which prevents false triggering. The NAND gate in series with the 4.7K resistor and 0.01 μF capacitor provides additional protection against false triggering by preventing terrestrial noise from triggering a false conversion process.
The signal control unit 420 controls the conversion of the analog signal to a digital signal, and the output of the converted signal to the microprocessor unit. In order to read a channel from the analog-to-digital converter, the accumulator must be loaded and then written to the zero channel (DE00). To perform a write operation, the data input signal to NAND gate 401 on line 402 must be high. A high signal on line 402 results in a high data signal to pins 22 and 6 of the analog-to-digital converter, enabling the address latch function and starting the conversion process for whatever address is on lines A0 through A1. The microprocessor must then wait 100 μsec before being able to read data output on the data bus D0 through D7.
The interrupt control unit 430 generates an interrupt signal on line IRQ4 to signal to the microprocessor that a data burst is ready to be read. The software, in an interrupt handling subroutine, clears the interrupt and stores the receiver data. The receiver data is used in determining gestures and also in the calculation of the position of a virtual object on the display screen.
In determining signal strength, the receiver values are first scaled before calculations are performed. The receiver values are scaled such that the highest receiver value is 255 which is the maximum output of the analog-to-digital converter on the interface. After the receiver values are read, the x, y, and z positions of the virtual object are calculated. The display screen is divided into a right and left side, and a top and bottom side. Receiver 0 is affixed to the bottom left corner of the prototype mounting. Receiver 1 is affixed to the top left corner of the mounting. Receivers 2 and 3 are on the right side of the prototype mounting; receiver 2 being in the top corner and receiver 3 being in the bottom corner.
In calculating the position of the virtual object, the display screen uses an averaging method instead of a triangulation method used in other tracking systems. This averaging method decreases computation time and simplifies the calculation of the position. The software first determines averages of the right and left values. The values of receivers 2 and 3 are added together and averaged by dividing the sum by 2. The values of receivers 1 and 0 are added together and divided by 2 to determine the average of those two values. The software then determines if the object is on the right or left side of the screen. To determine the X position, the center screen value is added to the right side value or the left-hand side value is subtracted from the center value.
A similar calculation is performed for determining the y position value. In determining the y position, the averages of the lower and upper receivers are calculated. The y position is then calculated, based on whether the object is in the upper or lower portion of the field. If the object is in the upper portion of the field, the y position is determined by subtracting the upper receiver value from the center screen value. If the object is in the lower portion of the screen, the y position is calculated by adding the lower receiver value to the center screen value.
The z value is calculated by averaging all four receiver values. In the code listing in
The data burst includes gesture data. The software routine has a gesture recognition routine. The gesture recognition routine compares the current gesture with the old gesture. If there is a new gesture the gesture recognition routine compares it to the gestures stored in a gesture table. The routine continue searching through the table until it finds a gesture that matches the current gesture. This gesture table increases user flexibility, since it may easily be enlarged to include new gestures for new input values.
The foregoing is a description of the preferred embodiment of the invention. It should be understood that specific details, such as component types, have been provided to explain the construction of the invention. For example, in
Grimaud, Jean-Jacques, Teitel, Michael, Horton, Robert, Maddy, Daniel
Patent | Priority | Assignee | Title |
10296085, | Mar 05 2014 | Markantus AG | Relatively simple and inexpensive finger operated control device including piezoelectric sensors for gesture input, and method thereof |
6891527, | Dec 06 1999 | ELO TOUCH SOLUTIONS, INC | Processing signals to determine spatial positions |
7312788, | Mar 11 2003 | Fraunhofer-Gesellschaft zur Foerderung der Angewandten Forschung E V | Gesture-based input device for a user interface of a computer |
7637817, | Dec 26 2003 | KABUSHIKI KAISHA SEGA DOING BUSINESS AS SEGA CORPORATION | Information processing device, game device, image generation method, and game image generation method |
8436808, | Dec 06 1999 | ELO TOUCH SOLUTIONS, INC | Processing signals to determine spatial positions |
8552983, | Jul 11 2007 | Intelligent robotic interface input device | |
9958529, | Apr 10 2014 | Massachusetts Institute of Technology | Radio frequency localization |
Patent | Priority | Assignee | Title |
4303910, | Apr 28 1977 | Parmeko Limited | Detection system |
4352098, | May 18 1979 | Parmeko Limited | Surveillance systems |
4654648, | Dec 17 1984 | Wireless cursor control system | |
4688037, | Aug 18 1980 | CHITTENDEN BANK | Electromagnetic communications and switching system |
4988981, | Mar 17 1987 | Sun Microsystems, Inc | Computer data entry and manipulation apparatus and method |
5021765, | May 07 1988 | Transaqua Technology Limited | Security system having detector means sensitive to the proximity of at least one detected object |
6094188, | Nov 30 1990 | Sun Microsystems, Inc | Radio frequency tracking system |
6222523, | Mar 24 1987 | Sun Microsystems, Inc. | Tactile feedback mechanism for a data processing system |
EP312481, | |||
JP59117631, | |||
JP62008009, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Jul 24 2000 | Sun Microsystems, Inc. | (assignment on the face of the patent) | / |
Date | Maintenance Fee Events |
Feb 17 2006 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
Mar 03 2010 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
Apr 25 2014 | REM: Maintenance Fee Reminder Mailed. |
Sep 17 2014 | EXP: Patent Expired for Failure to Pay Maintenance Fees. |
Date | Maintenance Schedule |
Sep 17 2005 | 4 years fee payment window open |
Mar 17 2006 | 6 months grace period start (w surcharge) |
Sep 17 2006 | patent expiry (for year 4) |
Sep 17 2008 | 2 years to revive unintentionally abandoned end. (for year 4) |
Sep 17 2009 | 8 years fee payment window open |
Mar 17 2010 | 6 months grace period start (w surcharge) |
Sep 17 2010 | patent expiry (for year 8) |
Sep 17 2012 | 2 years to revive unintentionally abandoned end. (for year 8) |
Sep 17 2013 | 12 years fee payment window open |
Mar 17 2014 | 6 months grace period start (w surcharge) |
Sep 17 2014 | patent expiry (for year 12) |
Sep 17 2016 | 2 years to revive unintentionally abandoned end. (for year 12) |