A direct ocular virtual 3D workspace (laser-based 3D display system) utilizes traditional binocular methods of image composition to produce a 3D workspace in the observers' psyche. This direct ocular virtual 3D workspace is implemented such that in moving environments, such as on a ship or vehicle, the immersion of the individual into the display environment will not result in vertigo and/or motion sickness. This is resolved by utilizing a system that accomplishes eye-tracking, and produces the display image within the eye by means of laser projection. Two images can thus be projected into an individual's eyes to produce a 3D holographic-like image space. The individual will still maintain partial vision, resulting in a holographic-like display in space that the observer can look through. The images provided to multiple collaborators/users are geometrically corrected for each collaborator.
|
7. A direct ocular virtual three-dimensional (3D) workspace comprising:
a plurality of laser projectors; and
means for operating the plurality of laser projectors such that the plurality of laser projectors produce a three-dimensional image space that is geometrically corrected for at least one workspace user, and further such that the at least one workspace user views the same image from their particular viewing location.
13. A method generating a direct ocular virtual 3D workspace image, the method comprising the steps of:
providing a plurality of laser projectors; and
operating the plurality of laser projectors such that the plurality of laser projectors produce a three-dimensional image space that is geometrically corrected for at least one workspace user, and further such that the at least one workspace user views the same image from their particular viewing location.
1. A direct ocular virtual three-dimensional (3D) workspace comprising:
a plurality of laser projectors;
means for tracking eye movement and eye location associated with at least one workspace user and generating positional signals there from; and
means for moving at least two laser projectors within the plurality of laser projectors, in response to the positional signals, such that the at least two laser projectors cause two images to be projected into the at least one workspace user's eyes to produce a three-dimensional holographic-like image space that the at least one workspace user can look through.
16. A direct ocular virtual three-dimensional (3D) workspace comprising:
a plurality of laser projectors;
an eye tracking system operational to track eye movement and eye location associated with at least one workspace user and to generate positional signals there from; and
a rotational system operational to rotate at least two laser projectors within the plurality of laser projectors, in response to the positional signals, such that the at least two laser projectors cause two images to be projected into the at least one workspace user's eyes to produce a three-dimensional holographic-like image space that the at least one workspace user can look through.
2. The direct ocular virtual 3D workspace according to
3. The direct ocular virtual 3D workspace according to
4. The direct ocular virtual 3D workspace according to
a plurality of stereoscopic display units; and
algorithmic software responsive to movement and positional data associated with the object immersed within the three-dimensional holographic-like image space and generated via the stereoscopic display units to modify the eye tracking positional signals such that immersion of the object into the three-dimensional holographic-like image space does not disrupt workspace user data cues.
5. The direct ocular virtual 3D workspace according to
an optical transceiver associated with each laser projector and operational to generate the positional signals;
an optical transceiver associated with each workspace user; and
algorithmic software to establish a calibrated wireless link between the laser projector transceivers and respective workspace user optical transceivers in response to the optical transceiver positional signals such that each laser projector is positionally calibrated with a single workspace user.
6. The direct ocular virtual 3D workspace according to
8. The direct ocular virtual 3D workspace according to
a horizontally and vertically rotational gimbal device associated with each laser projector and operational to provide horizontal and vertical targeting of each laser projector in response to workspace user eye tracking data; and
an eye tracking system associated with each laser projector and operational to generate eye tracking data associated with a respective workspace user.
9. The direct ocular virtual 3D workspace according to
an optical transceiver associated with each laser projector;
an optical transceiver associated with each workspace user; and
algorithmic software configured to establish a calibrated wireless link between each laser projector transceiver and a respective workspace user transceiver to provide the horizontal and vertical targeting of each laser projector.
10. The direct ocular virtual 3D workspace according to
11. The direct ocular virtual 3D workspace according to
12. The direct ocular virtual 3D workspace according to
a plurality of stereoscopic projection units; and
algorithmic software responsive to movement and positional data associated with the object immersed within the three-dimensional holographic-like image space and generated via the stereoscopic projection units to modify the three-dimensional holographic-like image space produced via the laser projectors.
14. The method according to
providing a horizontally and vertically rotational gimbal device associated with each laser projector that is operational to provide horizontal and vertical targeting of each laser projector in response to workspace user eye tracking data;
providing an eye tracking system associated with each laser projector that is operational to generate eye tracking data associated with a respective workspace user; and
operating the horizontally and vertically rotational gimbal device in response to the eye tracking data such that each laser projector will project a desired image into at least one eye of the respective workspace user to produce the 3D image space.
15. The method according to
providing algorithmic geometric correction software for geometrically correcting the image space associated with each workspace user; and
operating the horizontally and vertically rotational gimbal device in response to the algorithmic geometric correction software such that workspace user sees the same image space without geometric abnormalities from their particular viewing location.
17. The direct ocular virtual 3D workspace according to
18. The direct ocular virtual 3D workspace according to
|
|||||||||||||||||||||||||||
This application claims the benefit, under 35 U.S.C. §119(e)(1), of U.S. Provisional Application No. 60/590,898, entitled Direct Ocular Virtual 3D Workspace, filed Jul. 23, 2004 by Brian L. Uhlhorn, Robert J. Monson and Steven H. Ernst.
1. Field of the Invention
This invention relates generally to displays, and more particularly to a laser-based, three-dimensional (3D) display system that generates a holographic-like image in space for simultaneous observation and interaction by a plurality of display system users.
2. Description of the Prior Art
Military systems are becoming more complex with a larger array of information being supplied at a faster rate to fewer decision makers (war fighters) at all levels of the decision chain. The war fighter, for example, needs tools and resources that provide the sufficient and requisite leverage to respond to this challenge. Such tools and resources are presently limited to use of 1) an immersive environment such as the CAVE system designed and developed by Iowa State University, or 2) individual displays for each participant, wherein collaboration is achieved via a non-intuitive pointing device within the display system, e.g. mouse, track, etc.
Modern laser-based 3D display systems are capable of providing such tools and resources for use by a single system user, such as that described by John R. Lewis in his article In the Eye of the Beholder, IEEE Spectrum, pp. 24-28, May 2004. A need exists however, for a display system that allows simultaneous immersion of multiple users into a holographic-like display environment without disruption of the holographic-like image produced by the laser-based 3D display system, or without causing individual user vertigo or motion sickness.
In view of the foregoing background, it would be extremely beneficial and advantageous to provide a next generation interactive display system (direct ocular virtual 3D workspace) that allows simultaneous observation and interaction via immersion of multiple users into the display environment without overwriting other visual data cues.
The present invention is directed to a direct ocular virtual 3D workspace (laser-based 3D display system) that utilizes traditional binocular methods of image composition to produce a 3D workspace in the observers' psyche. This direct ocular virtual 3D workspace is implemented such that in moving environments, such as on a ship or vehicle, the immersion of the individual into the display environment will not result in vertigo and/or motion sickness. This is resolved by utilizing a system that accomplishes eye-tracking, and produces the display image within the eye by means of laser projection. Two images can thus be projected into an individual's eyes to produce a 3D holographic-like image space. The individual will still maintain partial vision, resulting in a holographic-like display in space that the observer can look through. The images provided to multiple collaborators/users are geometrically corrected for each collaborator, allowing multiple individuals to see the same 3D image space from their particular viewing location without overwriting other visual data cues. This allows an individual collaborator to point within the image space such that other collaborators could see the pointing finger within their own 3D image space; and all parties would see the same item identified by the individual collaborator.
A feature of the direct ocular virtual 3D workspace is the generation of a rich three-dimensional information display.
Another feature of the direct ocular virtual 3D workspace is the provision of user interaction with systems and other users in a 3D environment.
Yet another feature of the direct ocular virtual 3D workspace is enhanced situational awareness.
Still another feature of the direct ocular virtual 3D workspace is improved safety/reduced collateral damage.
Still another feature of the direct ocular virtual 3D workspace is more effective planning and execution.
Still another feature of the direct ocular virtual 3D workspace is improved target detection, tracking, classification, identification and targeting.
Other aspects, features and advantages of the present invention will be readily appreciated as the invention becomes better understood by reference to the following detailed description when considered in connection with the accompanying drawing figures wherein:
While the above-identified drawing figures set forth particular embodiments, other embodiments of the present invention are also contemplated, as noted in the discussion. In all cases, this disclosure presents illustrated embodiments of the present invention by way of representation and not limitation. Numerous other modifications and embodiments can be devised by those skilled in the art which fall within the scope and spirit of the principles of this invention.
Looking now at
Moving now to
Many techniques are suitable to implement the requisite vertical and horizontal rotation of the laser projector assemblies 20 to accommodate the eye tracking. A rotational gimbal apparatus, for example, can be employed to provide the requisite movement of the laser projector assemblies 20.
Several known techniques can be employed to accomplish the eye tracking. Eye movement and location may, for example, be accomplished using an optical transceiver in association with each laser projector 20 to generate positional signals. A second optical transceiver 108, 110, can then be employed via each workspace user to receive and retransmit signals back to the respective optical transmitter. Appropriate algorithmic tracking and calibration software, including handshaking software between the laser projector transceiver and workspace user transceiver 108, 110, then functions to establish a calibrated wireless link between the laser projector 20 transceivers and the respective workspace user transceiver 108, 110, thus allowing the laser projector 20 to track the respective workspace user eye movement and location.
Traditional binocular methods of image composition are employed to produce a 3D workspace in each observer's 102, 104 psyche by generating the display within each observer's 102, 104 eye by means of laser projection. Two images, as stated herein before, are projected into each observer's eye to produce a 3D image space. Each observer 102, 104 will still maintain partial vision, resulting in a common holographic-like display in space that the observer 102, 104 can look through.
The image 106 provided to multiple observers (collaborators) 102, 104 is geometrically corrected for each collaborator, allowing multiple individuals to see the same 3D image space from their particular viewing location without overwriting other visual data cues. The algorithmic geometric correction can be implemented, for example, via software that may be an integral part of the workspace user's transceiver, implemented via micro-electro-mechanical system (MEMS) technology. The requisite eye-tracking can be accomplished using any number of known tracking technologies such as, but not limited to, for example, optical mirrors, gimbal, gyro, phased-array, MEMS technology, and the like familiar to those skilled in the particular arts employed to implement eye-tracking. The selected eye-tracking technology is then configured, using appropriate algorithmic software, to geometrically correct the image provided to each collaborator 102, 104, allowing multiple individuals to see the same 3D image space from their particular viewing location without overwriting other visual data cues, as stated herein before. An individual collaborator can then point a finger within the image space, and other collaborators could see the pointing finger within their own 3D image space such that all parties would see the same item identified.
Because the two user system layout 100 employs more than one projector assembly 20 configured for simultaneous use by multiple observers (collaborators) 102, 104, the individual collaborators 102, 104 can communicate with one another by means of body language, tone and content not available using known laser-based 3D display system technology. The foregoing techniques also allow remote collaborators to be included in the environment, allowing true remote collaboration between individual sites. Further, allowing additional visual cues not currently present in an immersive environment will lessen the likelihood of vertigo and motion sickness that is inherently associated with known immersive environments.
In summary explanation, a direct ocular virtual 3D workspace 100 employs multiple projectors 20 within a table-like pedestal assembly 10. The projectors 20 utilize traditional technology to provide binocular visual data for each user utilizing eye position scanning and projection to the location of the user's iris. Since the workspace 100 employs multiple output devices (projectors) 20, each device is dedicated to a specific user location to ensure specific user data is geometrically correct with respect to other users of the workspace 100. This technique allows collaboration within the 3-dimensional viewing space, with semi-opaque images provided to allow direct interface between users of the system.
Direct interfacing may employ any number of techniques such as, but not limited to, using stereoscopic displays in association with the pedestal such that when a collaborator's finger is encased in a white glove which is then inserted into the holographic-like image space and between the stereoscopic displays, the appropriate algorithmic software will synchronize the finger location data with the holographic-like image data to allow direct interfacing between the users of the workspace 100.
In view of the above, it can be seen the present invention presents a significant advancement in the art of workstation design. Further, this invention has been described in considerable detail in order to provide those skilled in the ocular arts with the information needed to apply the novel principles and to construct and use such specialized components as are required.
It should be apparent that the present invention represents a significant departure from the prior art in construction and operation. However, while particular embodiments of the present invention have been described herein in detail, it is to be understood that various alterations, modifications and substitutions can be made therein without departing in any way from the spirit and scope of the present invention, as defined in the claims which follow.
The complete disclosure of all patents, patent documents, and publications are incorporated herein by reference as if individually incorporated.
Monson, Robert J., Uhlhorn, Brian L., Ernst, Steven H.
| Patent | Priority | Assignee | Title |
| Patent | Priority | Assignee | Title |
| 5661667, | Mar 14 1994 | VIRTEK LASER SYSTEMS INC | 3D imaging using a laser projector |
| 5781229, | Feb 18 1997 | CURATORS OF THE UNIVERSITY OF MISSOURI, THE | Multi-viewer three dimensional (3-D) virtual display system and operating method therefor |
| 5855425, | Jul 19 1996 | Sanyo Electric Co., Ltd. | Stereoscopic display |
| 6278418, | Dec 29 1995 | Kabushiki Kaisha Sega Enterprises | Three-dimensional imaging system, game device, method for same and recording medium |
| 6937210, | Nov 06 2002 | U S DEPARTMENT OF COMMERCE | Projecting images on a sphere |
| 20020135738, | |||
| 20030043146, | |||
| 20070127121, |
| Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
| Jul 22 2005 | Lockheed Martin Corporation | (assignment on the face of the patent) | / |
| Date | Maintenance Fee Events |
| Date | Maintenance Schedule |
| Jan 06 2012 | 4 years fee payment window open |
| Jul 06 2012 | 6 months grace period start (w surcharge) |
| Jan 06 2013 | patent expiry (for year 4) |
| Jan 06 2015 | 2 years to revive unintentionally abandoned end. (for year 4) |
| Jan 06 2016 | 8 years fee payment window open |
| Jul 06 2016 | 6 months grace period start (w surcharge) |
| Jan 06 2017 | patent expiry (for year 8) |
| Jan 06 2019 | 2 years to revive unintentionally abandoned end. (for year 8) |
| Jan 06 2020 | 12 years fee payment window open |
| Jul 06 2020 | 6 months grace period start (w surcharge) |
| Jan 06 2021 | patent expiry (for year 12) |
| Jan 06 2023 | 2 years to revive unintentionally abandoned end. (for year 12) |