An apparatus in one example comprises a first component display with a first display area, a second component display with a second display area, and a beamsplitter. The first component display is positioned such that the first display area is viewable through the beamsplitter as a transmitted display area. The second component display is positioned such that the second display area is viewable from the beamsplitter as a reflected display area. The first component display, the second component display, and the beamsplitter are positioned such that the beamsplitter provides a composite image of the transmitted display area and the reflected display area. The reflected display area of the composite image is at least partially offset from the transmitted display area.
|
1. An apparatus, comprising:
a first component display with a first display area, a second component display with a second display area, and a beamsplitter;
wherein the first component display is positioned in a first plane such that the first display area is viewable through the beamsplitter as a transmitted display area;
wherein the second component display is positioned in a second plane such that the second display area is viewable from the beamsplitter as a reflected display area;
wherein the first component display, the second component display, and the beamsplitter are positioned such that the beamsplitter provides a composite image of the transmitted display area and the reflected display area, wherein the reflected display area of the composite image is at least partially offset from the transmitted display area of the composite image along a line that intersects the first and second plane.
20. An apparatus, comprising:
a beamsplitter positioned in a plane of symmetry between a first plane and a second plane, wherein the first plane is orthogonal to the second plane;
a first set of component displays aligned along a first line in the first plane; and
a second set of component displays aligned along a second line in the second plane, wherein the first line is parallel to the second line;
wherein each component display of the first set of component displays comprises a light-modulating element viewable through the beamsplitter as a transmitted display area, and
wherein each component display of the second set of component displays comprises a light-modulating element viewable reflected from the beamsplitter as a reflected display area;
wherein the first set of component displays and the second set of component displays are spaced apart along the first and second lines, respectively, such that the transmitted display areas of the first set of component displays are interleaved with the reflected display areas of the second set of component displays to provide a substantially seamless composite image displayed across the first and second set of component displays.
2. The apparatus of
3. The apparatus of
wherein the transmitted display area abuts the reflected display area at a vertical seam;
wherein an edge of the first bezel comprises a first overhang and an edge of the second bezel comprises a second overhang along the vertical seam;
wherein the first and second overhangs comprise a width T, wherein the first display area and the reflected area comprise a repeated image portion of width 2T such that at an oblique angle to the composite image, a portion of the repeated image portion is visible from beneath one of the first and second overhangs and blocked by the other of the first and second overhangs.
4. The apparatus of
5. The apparatus of
6. The apparatus of
wherein the first component display is positioned at a forty-five degree angle relative to a first side of the beamsplitter;
wherein the second component display is positioned at a forty-five degree angle relative to a second side of the beamsplitter.
7. The apparatus of
wherein the first component display and the second component display are positioned such that the transmitted display area overlaps a portion of the second bezel and the reflected display area overlaps a portion of the first bezel when viewed from the beamsplitter.
8. The apparatus of
wherein the first component display, the second component display, and the beamsplitter are enclosed within a substantially light-tight enclosure to reduce illumination of the first bezel and the second bezel.
9. The apparatus of
wherein the first component display and the second component display are selected such that a thickness of the first and second bezel is minimized or the bezel is removed.
10. The apparatus of
wherein a portion of the first bezel and the second bezel adjacent to a seam in the composite image are beveled back from vertical by an angle equal to a maximum anticipated departure of a user's sight line from a normal to the composite image.
11. The apparatus of
12. The apparatus of
13. The apparatus of
a first set of at least one component display that comprises the first component display and a second set of at least one component display that comprises the second component display;
wherein the first set of at least one component display is positioned in a first plane and the second set of at least one component display is positioned in a second plane;
wherein the first set of at least one component display is horizontally interleaved with the second set of at least one component display;
wherein the beamsplitter is positioned in a plane of symmetry between the first plane and the second plane such that the first set of at least one component display is viewable through the beamsplitter and the second set of at least one component display is viewable as a set of reflected areas from the beamsplitter to form the composite image, wherein the set of reflected areas comprise the reflected area.
14. The apparatus of
15. The apparatus of
at least one retarder positioned between the beamsplitter and at least one component display of the first component display and the second component display.
16. The apparatus of
17. The apparatus of
wherein the quarter-wave film is positioned at a 45 degree offset from a polarization plane of the at least one LCD.
18. The apparatus of
wherein the composite image comprises the first image and the second image;
wherein the first component display, the second component display, and the beamsplitter are positioned such that the first image abuts the second image along a seam within the composite image.
19. The apparatus of
21. The apparatus of
a hood that substantially encloses the first set of component displays, the second set of component displays, and the beamsplitter and configured to provide a substantially light-tight enclosure.
22. The apparatus of
wherein the first component display comprises a first bezel of thickness B that surrounds the light-modulating element of the first component display, wherein the second component display comprises a second bezel of thickness B that surrounds the light-modulating element of the second component display;
the apparatus further comprising:
a first overhang that comprises an outside edge mounted along a vertical edge of the first bezel and comprises an inside edge that extends over a first vertical strip of the light-modulating element of the first component display, wherein the first overhang comprises a width T between the inside edge and the outside edge, and
a second overhang that comprises an outside edge mounted along a vertical edge of the second bezel and comprises an inside edge that extends over a first vertical strip of the light-modulating element of the second component display, wherein the second overhang comprises a width T between the inside edge and the outside edge;
wherein the first component display and the second component display are positioned such that the inside edge of the first overhang and the inside edge of the second overhang lie in a same vertical plane.
23. The apparatus of
24. The apparatus of
wherein the first component display is configured to display the repeated image portion over the first vertical strip of the light-modulating element of the first component display and an adjacent second vertical strip of width T;
wherein the second component display is configured to display the repeated image portion over the first vertical strip of the light-modulating element of the second component display and an adjacent second vertical strip of width T.
25. The apparatus of
at least one retarder positioned between the beamsplitter and at least one component display of the first set of component displays and the second set of component displays.
26. The apparatus of
27. The apparatus of
wherein the quarter-wave film is positioned at a 45 degree offset from a polarization plane of the at least one LCD.
28. The apparatus of
|
The increased availability of high-resolution imagery in the scientific and intelligence communities has led to an increased demand for displays capable of rendering such imagery. Conventional flat-panel displays are commonly available at resolutions up to 1600×1200 pixels, with a few displays (such as the Apple Cinema HD and IBM 221T) offering greater resolutions (2560×1600 and 3840×2400, respectively). Nonetheless, even the highest resolution single displays remain inadequate for close-in, immersive viewing of extremely high-resolution imagery.
A method of combining less expensive component displays into a large, high-resolution display would be advantageous for workstations such as those used in the intelligence and scientific communities. Abutting component displays one aside another in a tiled manner is a simple and convenient approach, but the bezel surrounding each component display does not allow for the seamless display of a single high-resolution image across the component monitors. Overlapping the bezels is possible if some component displays are positioned in a plane forward of the plane containing the remaining displays, but the resulting offset between adjacent displays interferes with the illusion of a single large display.
Gesture recognition against a changing background is known, as gesture recognition technologies are highly useful for manipulation of virtual objects and desktops. Recognition using visible light cameras is difficult, however, as accommodating the changing contrast associated with projected backgrounds is computationally expensive and unreliable. One solution is to use infrared light. Any active infrared illumination is invisible to the human eye, and the IR-sensitive camera receiving the reflected light is not affected by the projected background (assuming the visible light projector has a filter to block IR from being emitted). Infrared detection may be passive, such as a system that uses an IR camera to detect the temperature difference between a user's arm and the tabletop display. One example of a passive infrared system is disclosed by Koike et al. (Integrating Paper and Digital Information on EnhancedDesk: A Method for Realtime Finger Tracking on an Augmented Desk System, ACM Transactions on Computer-Human Interaction, Vol. 8, No. 4, December 2001, Pages 307-322). Other systems use active IR sources to illuminate a diffuser or other projection surface from the same side as an IR-sensitive camera, so that a user's hand or other object held on or near the surface reflects IR back to the camera. Sony's HoloWall and HoloTable use this method to detect gestures when a hand is between 0 and 30 cm from the surface, depending on the threshold setting.
The invention in one implementation encompasses an apparatus. The apparatus comprises a first component display with a first display area, a second component display with a second display area, and a beamsplitter. The first component display is positioned such that the first display area is viewable through the beamsplitter as a transmitted display area. The second component display is positioned such that the second display area is viewable from the beamsplitter as a reflected display area. The first component display, the second component display, and the beamsplitter are positioned such that the beamsplitter provides a composite image of the transmitted display area and the reflected display area. The reflected display area of the composite image is at least partially offset from the transmitted display area.
Another implementation of the invention encompasses an apparatus. The apparatus comprises a beamsplitter positioned in a plane of symmetry between a first plane and a second plane, a first set of component displays aligned along a first line in the first plane, and a second set of component displays aligned along a second line in the second plane. The first plane is orthogonal to the second plane and the first line is parallel to the second line. Each component display of the first set of component displays comprises a light-modulating element viewable through the beamsplitter as a transmitted display area. Each component display of the second set of component displays comprises a light-modulating element viewable reflected from the beamsplitter as a reflected display area. The first set of component displays and the second set of component displays are spaced apart such that the transmitted display areas of the first set of component displays are interleaved with the reflected display areas of the second set of component displays to provide a substantially seamless composite image displayed across the first and second set of component displays.
A further implementation of the invention encompasses a method. A first component display is positioned at a forty-five degree angle to a beamsplitter such that the first component display is visible as a transmitted display area through the beamsplitter. A second component display is positioned at a forty-five degree angle to the beamsplitter and ninety degrees to the first component display such that the second component display is visible from the beamsplitter as a reflected display area and the transmitted display area is offset from the reflected display area.
Features of example implementations of the invention will become apparent from the description, the claims, and the accompanying drawings in which:
Beamsplitters have been used to combine multiple displays, but only to merge the component displays into a virtual display in which each component display is coincident with the other component displays. For example, U.S. Pat. No. 6,703,988, the disclosure of which is hereby incorporated by reference, discloses a system that merges two component displays into the same light path for 3D left eye and right eye views. Beamsplitters have also been used to attain the large number of pixels required for holographic displays.
An embodiment of the invention is a system that uses a beamsplitter to seamlessly combine multiple component displays into a single high-resolution display.
The central component display 253 is positioned in a reflected manner about a plane of symmetry inclined to the left and right displays. A beamsplitter 310 is placed coincident with this plane of symmetry. In one embodiment, the bezel areas 271, 272, and 273 surrounding the component display areas are of a dark color. Then, if the monitors and beamsplitter are enclosed within a substantially light-tight enclosure, a viewer viewing the apparatus from the front sees a single composite image with three times the pixels of each component display. Specifically, the composite image is provided by the display areas 261 and 262 of the left and right displays as viewed through the beamsplitter, and the display area 263 of the central display as reflected area 410 from the beamsplitter. For example, the composite image comprises the display area 261, the reflected area 410, and the display area 262. Referring to
The beamsplitter 310 in one example is positioned in a plane of symmetry between a first plane 314 and a second plane 316. The first plane 314 is orthogonal to the second plane 316. In one embodiment, a first set of component displays (e.g., component displays 251 and 252) are aligned along a first line 318 in the first plane 314. A second set of component displays (e.g., component display 253) are aligned along a second line 320 in the second plane 316, where the first line 318 is parallel to the second line 320. Additional component displays may be added alternately to the first set and the second set, as will be appreciated by those skilled in the art.
Turning to
The beamsplitter 310 in one example is manufactured using a metal coating such as a nickel alloy coating. Thin film coatings may be used, but may cause color variations observed with changing viewing angle. In one example, the beamsplitter 310 comprises a trapezoidal, balanced (30% reflective, 30% transmissive), half-silvered mirror (nickel alloy metal deposition on water-white glass). In a further example, an anti-reflective coating is also applied to the side of the glass opposite the nickel coating.
Also shown in
In some embodiments of the invention, the component displays 251, 252, and 253 are LCDs that emit polarized light, as will be understood by those skilled in the art. For many surfaces, the fraction of polarized light that is reflected, absorbed, or transmitted is based on the incident angle. Consequently, the brightness of the component displays 251, 252, and 253 may vary between opposing edges of the display areas 261, 262, and 263. For example, in the embodiment of
Typically, the magnitude of the observed variation in brightness is small. However, it is possible for the sense of the variation to vary between adjacent displays. For example, the component displays viewed in transmission may appear brighter at the bottom while the component displays viewed in reflection may appear darker at the bottom. When the comparatively bright bottoms of the transmitted component displays are abutted against the comparatively dark bottoms of the reflected component displays, even a small variation may be noticeable by the user.
To mitigate this variation in brightness, a retarder 602 may be placed between the front surface of each component display 251, 252, and 253 and the beamsplitter 310. The retarder 602 in one example comprises a quarter-wave film that may be inserted behind a bezel 170, oriented approximately 45 degrees offset from the LCD plane of polarization. In this configuration, the light emitted from the LCD is circularly polarized, greatly reducing the variation in reflection, absorption, and transmission noted above. Other retarders (e.g. half-wave films) at other orientations may also be used.
In some embodiments of the invention, the variation in brightness may be greater for either the component displays viewed in transmission or the component displays viewed in reflection. In such instances, it may be sufficient to place quarter wave plates in front of only those component displays where the effect is greatest.
The above methodology alone provides a satisfactory high-resolution display that renders a seamless image when viewed directly from the front (perpendicular to the vertical plane). However, if a user views the high-resolution display from an oblique angle, the high-resolution display may appear to contain dark strips at the seams between adjacent component displays.
Turning to
The control mode menu presents the user with one or more control mode buttons 551, 552, 553, 554, and 555. Referring to the embodiment of
For example, in
The selection of other control modes is performed in a similar manner. For example, should the user select the Layers control mode by touching the Layers control mode button 551, the buttons are assigned functions appropriate for control of imagery layers on the display, and a corresponding set of function labels is displayed. For example, in the layers control mode, all five knobs may be activated and assigned functions Select Layer, Transparency, Red Intensity, Blue Intensity, and Green Intensity. The first knob thus allows the user to select the imagery layer to be controlled, and the last four knobs allow the user to adjust the overall visibility and color balance of the selected layer.
To aid the user in navigating the above described control scheme, the menu buttons, function labels, and knob illuminators in one example are color-coded. More specifically, the control mode buttons are each assigned a unique color. When a particular control mode is selected, the knob illuminators illuminate the activated knobs with the color of the corresponding control mode button. This may be achieved through the use of red, green, and blue light emitting diodes (RGB LED's) within each knob illuminator. A user or software program can set an individual value for each of the red, green, and blue LEDs to display a desired color.
The control knobs in one example are configured to provide haptic feedback or force-feedback. The haptic feedback may be provided by a control loop that comprises an optical encoder and a torque actuator coupled to the knob shaft. A knob console computer 941 (
The infrared light source 820 illuminates the diffusion surface 830, such as a rear projection screen, from a front side 832 on which the user is positioned. The diffusion surface is at least partially transparent to infrared and visible light. The visible light projector 840 projects the imagery 845 onto a back side 834 of the diffusion surface 830. Alternatively, the visible light projector may project imagery onto the front side of the diffusion surface, though this configuration is not preferred as the user will case shadows within the projected imagery. In either case, the projector 840 may be equipped with an IR cut filter that eliminates the emission of IR light.
The IR-sensitive camera 850 is focused on the rear 834 of the diffusion surface 830. The IR camera 850 sees the diffuser illuminated with the IR source, resulting in a bright IR backdrop. The IR-sensitive camera 850 in one example comprises a visible light camera with an IR band- or notch-pass filter, such as a charge-coupled device chip. Objects approaching the surface, such as the finger of a user's hand 860, will block the IR source and throw a shadow 865 on the diffusion surface 830. The more closely the object approaches the diffusion surface 830, the sharper the edges of the shadow 865 will become. Since, because of the IR cut filter, the IR illumination is unaffected by the visible light projector, the sharpness of the shadow is a reliable measure of the object's distance from the diffusion surface in a direction perpendicular to the surface. The sharpness is detectable by analyzing the spatial frequency of the imagery acquired by the camera 850, with higher spatial frequency content corresponding to increased sharpness. This measure of sharpness is often measured directly by auto-focus systems, and in some embodiments may be obtained from an existing auto-focus system onboard the camera. The distance information acquired in this manner may be used for advanced 3-dimensional gesture recognition capabilities that do not require physical contact with the diffusion surface 830. For example, a momentary mouse-over gesture could be simulated by waving a finger over an object, and the object could be selected by tapping the surface.
Turning to
Each component display 911, 912, 913, 914, and 915 in one example is driven by one or more component display computers 921, 922, 923, 924, 925. Each of the five computers receives information from a state computer 926 that keeps track of the current state of the workstation 900. The state of the workstation comprises displayed content of the high resolution display 910, interfaces 930 and 940 offered to the user, and user input that is provided back through the interfaces 930 and 940. The state computer 926 provides instructions to the component display computers 921, 922, 923, 924, and 925 through a communication pathway 927. The state computer 926 in one example does not receive any information from the component display computers.
Referring to the implementation of
The user interface 930 comprises the infrared gesture interface 800 and an infrared gesture interface computer 931. The infrared gesture interface 800 in one example allows the user to execute gestures that provide instructions to the state computer 926 that will then provide appropriate instructions to the high resolution display 910. It allows the users to execute gestures that will control the behavior of the high-resolution display. The infrared gesture interface computer 931 in one example comprises a two-way communication pathway 932 with the state computer 926 to send instructions to and receive instructions from the state computer 926.
The auxiliary display component 950 in one example comprises an auxiliary display computer 951 and one or more auxiliary displays 952 and 953. The auxiliary display computer 951 receives information from the state computer 926 through communication pathway 954. The auxiliary display component 950 may be used for alternate views of the composite image or additional images and/or menus.
Ferren, Bran, Hope, Clinton B.
Patent | Priority | Assignee | Title |
9709816, | Jul 21 2014 | Korea Institute of Science and Technology | Image display apparatus using transflective electro-optic device |
Patent | Priority | Assignee | Title |
6449090, | Jan 28 1995 | Sharp Kabushiki Kaisha | Three dimensional display viewable in both stereoscopic and autostereoscopic modes |
6703988, | Jul 08 1999 | Fergason Patent Properties LLC | Monitor for showing high-resolution and three-dimensional images and method |
6710797, | |||
7401923, | Mar 09 2004 | Fergason Patent Properties, LLC | Monitor for showing high-resolution and three-dimensional images and method |
20010038412, | |||
20040257788, | |||
20060268407, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Jan 17 2007 | FERREN, BRAN | Northrop Grumman Space & Mission Systems Corporation | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 018829 | /0535 | |
Jan 17 2007 | HOPE, CLINTON B | Northrop Grumman Space & Mission Systems Corporation | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 018829 | /0535 | |
Jan 19 2007 | Northrop Grumman Systems Corporation | (assignment on the face of the patent) | / | |||
Nov 25 2009 | NORTHROP GRUMMAN CORPORTION | NORTHROP GRUMMAN SPACE & MISSION SYSTEMS CORP | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 023699 | /0551 | |
Dec 10 2009 | NORTHROP GRUMMAN SPACE & MISSION SYSTEMS CORP | Northrop Grumman Systems Corporation | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 023915 | /0446 |
Date | Maintenance Fee Events |
Feb 11 2011 | ASPN: Payor Number Assigned. |
Jul 17 2014 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
Jul 16 2018 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
Jul 19 2022 | M1553: Payment of Maintenance Fee, 12th Year, Large Entity. |
Date | Maintenance Schedule |
Jan 25 2014 | 4 years fee payment window open |
Jul 25 2014 | 6 months grace period start (w surcharge) |
Jan 25 2015 | patent expiry (for year 4) |
Jan 25 2017 | 2 years to revive unintentionally abandoned end. (for year 4) |
Jan 25 2018 | 8 years fee payment window open |
Jul 25 2018 | 6 months grace period start (w surcharge) |
Jan 25 2019 | patent expiry (for year 8) |
Jan 25 2021 | 2 years to revive unintentionally abandoned end. (for year 8) |
Jan 25 2022 | 12 years fee payment window open |
Jul 25 2022 | 6 months grace period start (w surcharge) |
Jan 25 2023 | patent expiry (for year 12) |
Jan 25 2025 | 2 years to revive unintentionally abandoned end. (for year 12) |