An apparatus for detecting a pointer within a region of interest includes at least one pair of imaging devices. The imaging devices have overlapping fields of view encompassing the region of interest. At least one light source provides illumination across the region of interest and is within the field of view of at least one of the imaging device. A filter is associated with the at least one imaging device whose field of view sees the light source. The filter blocks light projected by the light source to inhibit the imaging device from being blinded by the projected light.
|
1. An apparatus for detecting a pointer within a region of interest comprising:
at least one pair of imaging devices, said imaging devices having overlapping fields of view encompassing said region of interest;
at least one light source providing illumination across said region of interest and being within the field of view of at least one of said imaging devices; and
an optical filter associated with the at least one imaging device whose field of view sees said light source, said filter blocking light projected by said light source to inhibit said imaging device from being blinded by said projected light.
41. An apparatus for detecting a pointer within a region of interest comprising:
at least two monochrome imaging devices having overlapping fields of view looking generally across said region of interest;
processing circuitry receiving and processing images acquired by said imaging devices to determine the location of said pointer relative to said region of interest;
at least one illumination source projecting light across said region of interest; and
at least one filter changing the frequency band of light in a cycle thereby to enable said imaging devices to capture images looking across said region of interest in different lighting conditions.
44. An apparatus for detecting a pointer within a region of interest comprising:
at least one pair of imaging devices, said imaging devices having overlapping fields of view looking generally across said region of interest;
a light source associated with each imaging device, each said light source providing illumination across said region of interest and being in the field of view of the non-associated imaging device; and
a different optical filter device associated with each imaging device so that substantially only light projected by the light source associated therewith is received by said associated imaging device to avoid the imaging device from being blinded by other light.
31. An apparatus for detecting a pointer within a region of interest comprising:
at least two color imaging devices having overlapping fields of view looking generally across said region of interest;
processing circuitry receiving and processing images acquired by said imaging devices to determine the location of said pointer relative to said region of interest; and
at least one illumination source projecting light in a specified frequency range across said region of interest thereby to provide lighting for said imaging devices, wherein said color imaging devices are sensitive to ambient light to capture color images and are sensitive to the light projected by said at least one illumination source to capture monochrome images.
38. An apparatus for detecting a pointer contact on a generally rectangular touch surface comprising:
a color imaging device at each corner of said touch surface and having a field of view looking generally across said touch surface;
processing circuitry receiving and processing images acquired by said imaging devices to determine the location of said pointer relative to said region of interest; and
illumination sources surrounding said touch surface and projecting light in a specified frequency range across said touch surface thereby to provide backlighting for said imaging devices, wherein said color imaging devices are sensitive to ambient light to capture color images and are sensitive to the light projected by said illumination sources to capture monochrome images.
24. An apparatus for detecting a pointer within a region of interest comprising:
an imaging device adjacent at least two corners of said region of interest, the imaging devices having overlapping fields of view looking generally across said region of interest from different viewpoints, each imaging device having a different optical filter associated therewith so that each imaging device substantially only captures light having a particular characteristic thereby to avoid being blinded by light not having said particular characteristic; and
a light source associated with each imaging device, each said light source projecting light across said region of interest having a particular characteristic such that the projected light only passes through the optical filter of said associated imaging device.
14. An apparatus for detecting a pointer within a region of interest comprising:
at least one pair of imaging devices, said imaging devices having overlapping fields of view looking generally across said region of interest;
a light source associated with each imaging device, each said light source providing illumination across said region of interest and being in the field of view of the non-associated imaging device;
an optical filter device associated with each imaging device so that substantially only light projected by the light source associated therewith is received by said associated imaging device to avoid the imaging device from being blinded by other light; and
a filter device associated with each light source to alter a characteristic of projected light such that the projected light is unable to pass through the filter device associated with the non-associated imaging device.
2. An apparatus according to
3. An apparatus according to
4. An apparatus according to
5. An apparatus according to
6. An apparatus according to
7. An apparatus according to
8. An apparatus according to
9. An apparatus according to
10. An apparatus according to
11. An apparatus according to
12. An apparatus according to
13. An apparatus according to
17. An apparatus according to
18. An apparatus according to
retro-reflective elements bordering said region of interest, said retro-reflective elements returning light impinging thereon in the direction of impingement without altering the polarization thereof.
19. An apparatus according to
20. An apparatus according to
22. An apparatus according to
23. An apparatus according to
26. An apparatus according to
27. An apparatus according to
28. An apparatus according to
29. An apparatus according to
30. An apparatus according to
32. An apparatus according to
33. An apparatus according to
34. An apparatus according to
36. An apparatus according to
39. An apparatus according to
40. An apparatus according to
42. An apparatus according to
43. An apparatus according to
|
The present invention relates generally to interactive systems and in particular to an apparatus for detecting a pointer within a region of interest.
Touch systems are well known in the art and typically include a touch screen having a touch surface on which contacts are made using a pointer such as for example a pen tool, finger or other suitable object. Pointer contacts with the touch surface are detected and are used to generate output pointer position data representing areas of the touch surface where pointer contacts are made.
International PCT Application No. PCT/CA01/00980 filed on Jul. 5, 2001 and published under number WO 02/03316 on Jan. 10, 2002, assigned to SMART Technologies Inc., assignee of the present invention, discloses a passive camera-based touch system. The camera-based touch system comprises a touch screen that includes a touch surface on which a computer-generated image is presented. A rectangular bezel or frame surrounds the touch surface and supports digital cameras at its corners. The digital cameras have overlapping fields of view that encompass and look across the touch surface. The digital cameras acquire images of the touch surface from different locations and generate image data. The image data is processed by digital signal processors to determine if a pointer exists in the captured image data. When it is determined that a pointer exists in the captured image data, the digital signal processors convey pointer characteristic data to a master controller, which in turn processes the pointer characteristic data to determine the location of the pointer in (x,y) coordinates relative to the touch surface using triangulation. The pointer location data is conveyed to a computer executing one or more application programs. The computer uses the pointer location data to update the computer-generated image that is presented on the touch surface. Pointer contacts on the touch surface can therefore be recorded as writing or drawing or used to control execution of an application program executed by the computer.
Although this camera-based touch system works extremely well, it has been found that when the digital camera frame rates are high, in less favorable light conditions, the ability to determine the existence of a pointer in the captured image data is diminished. As a result, there exists a need to improve the lighting environment for the digital cameras to ensure high resolution irrespective of ambient lighting conditions.
U.S. patent application Ser. No. 10/354,168 to Akitt et al. entitled “Illuminated Bezel And Touch System Incorporating The Same”, assigned to SMART Technologies Inc., assignee of the present invention, discloses an illuminated bezel for use in the above-described camera-based touch system. The illuminated bezel projects infrared backlighting across the touch surface that is visible to the digital cameras. As a result, when no pointer is positioned within the fields of view of the digital cameras, the digital cameras see bright bands of illumination as a result of the projected backlighting. When a pointer is positioned within the fields of view of the digital cameras, the pointer occludes the backlight illumination. Therefore, in each captured image the pointer appears as a high-contrast dark region interrupting the bright band of illumination allowing the existence of the pointer in the captured image to be readily detected.
Although the illuminated bezel works very well, because the illuminated bezel completely surrounds the touch surface and makes use of an array of infrared light emitting diodes mounted on a printed circuit board that is disposed behind a diffuser, manufacturing costs are significant especially in cases where the illuminated bezel surrounds large touch surfaces. As will be appreciated, lower cost backlight illumination for touch systems of this nature is desired.
Also, although the existence of the pointer in captured images can be readily detected, currently the use of monochrome digital cameras to capture images increases costs and provides limited information concerning attributes of the pointer used to contact the touch system.
It is therefore an object of the present invention to provide a novel apparatus for detecting a pointer within a region of interest.
Accordingly, in one aspect of the present invention, there is provided an apparatus for detecting a pointer within a region of interest comprising:
at least one pair of imaging devices, said imaging devices having overlapping fields of view encompassing said region of interest;
at least one light source providing illumination across said region of interest and being within the field of view of at least one of said imaging devices; and
a filter associated with the at least one imaging device whose field of view sees said light source, said filter blocking light projected by said light source to inhibit said imaging device from being blinded by said projected light.
In one embodiment, the filter blocks light having a characteristic different from a characteristic assigned to the at least one imaging device. The characteristic may be one of polarization and frequency. The apparatus may include a light source associated with each imaging device, with each light source being in the field of view of the non-associated imaging device. Light projected by each light source is visible to its associated imaging device but is blocked by the filter associated with the non-associated imaging device.
The region of interest may overlie a touch surface on which pointer contacts are made, with imaging devices and associated light sources being provided adjacent each corner of the touch surface.
According to another aspect of the present invention there is provided an apparatus for detecting a pointer within a region of interest comprising:
at least one pair of imaging devices, said imaging devices having overlapping fields of view looking generally across said region of interest;
a light source associated with each imaging device, each said light source providing illumination across said region of interest and being in the field of view of the non-associated imaging device; and
a filter device associated with each imaging device so that substantially only light projected by the light source associated therewith is received by said associated imagining device.
According to still yet another aspect of the present invention there is provided an apparatus for detecting a pointer within a region of interest comprising:
an imaging device adjacent at least two corners of said region of interest, the imaging devices having overlapping fields of view looking generally across said region of interest, said imaging devices being configured to capture light having a particular characteristic; and
a light source associated with each imaging device, each said light source projecting light across said region of interest having a characteristic of the type capturable by said associated imaging device.
According to still yet another aspect of the present invention there is provided an apparatus for detecting a pointer within a region of interest comprising:
at least two color imaging devices having overlapping fields of view looking generally across said region of interest;
processing circuitry receiving and processing images acquired by said imaging devices to detect the existence of a pointer in said images and to determine the location of said pointer relative to said region of interest; and
at least one illumination source projecting light in a specified frequency range across said region of interest thereby to provide lighting for said imaging devices, wherein said color imaging devices are sensitive to ambient light to capture color images and are sensitive to the light projected by said at least one illumination source to capture monochrome images.
According to still yet another aspect of the present invention there is provided an apparatus for detecting a pointer contact on a generally rectangular touch surface comprising:
a color imaging device at each corner of said touch surface and having a field of view looking generally across said touch surface;
processing circuitry receiving and processing images acquired by said imaging devices to detect the existence of a pointer in said images and to determine the location of said pointer relative to said region of interest; and
illumination sources surrounding said touch surface and projecting light in a specified frequency range across said touch surface thereby to provide backlighting for said imaging devices, wherein said color imaging devices are sensitive to ambient light to capture color images and are sensitive to the light projected by said illumination sources to capture monochrome images.
According to still yet another aspect of the present invention there is provided an apparatus for detecting a pointer within a region of interest comprising:
at least two monochrome imaging devices having overlapping fields of view looking generally across said region of interest;
processing circuitry receiving and processing images acquired by said imaging devices to detect the existence of a pointer in said images and to determine the location of said pointer relative to said region of interest; and
at least one illumination source projecting light across said region of interest; and
at least one filter changing the frequency band of light in a cycle thereby to enable said imaging devices to capture images looking across said region of interest in different lighting conditions.
The present invention provides advantages in that in one embodiment, backlight illumination is provided across the touch surface in an effective and cost efficient manner. The present invention provides further advantages in that since images looking across the region of interest can be acquired at different frequency bands of light, in addition to determining the location of the pointer, increased pointer attribute information can be easily obtained.
Embodiments of the present invention will now be described more fully with reference to the accompanying drawings in which:
Turning now to
An infrared light source 72 is associated with and positioned adjacent each digital camera 70. Each light source 72 includes an array of infrared (IR) light emitting diodes (LEDs). The light emitting diodes project infrared lighting across the touch surface 60.
Polarizers 74 are provided in front of the digital cameras 70 and the infrared light sources 72. The polarization of the polarizers 74 at opposite corners of the touch surface 60 have opposite polarization. For example, in this embodiment, the polarizers 74 at the top and bottom left corners of the touch surface 60 have a vertical orientation and the polarizers 74 at the top and bottom right corners of the touch surface 60 have a horizontal orientation. In this manner, the polarizers 74 minimize the light projected by the diagonally opposite infrared light sources 72 that is seen by the digital cameras 70 i.e. block the diagonally opposite infrared light sources 72 from their fields of view thereby to avoid digital camera photo-saturation and other effects that reduce the effectiveness of the digital cameras 70.
One of the digital cameras 70 within a corner piece 68 is shown in
The DSP 84 provides control information to the image sensor and lens assembly 80 via the control bus. The control information allows the DSP 84 to control parameters of the image sensor and lens assembly 80 such as exposure, gain, array configuration, reset and initialization. The DSP 84 also provides clock signals to the image sensor and lens assembly 80 to control the frame rate of the image sensor and lens assembly 80.
An infrared pass filter 89 is provided on the image sensor and lens assembly 80 to blind the digital camera 70 to frequencies of light outside the infrared range.
Master controller 54 is better illustrated in
The master controller 54 and each digital camera 70 follow a communication protocol that enables bidirectional communications via a common serial cable similar to a universal serial bus (USB). Communications between the master controller 54 and the digital cameras 70 are performed as background processes in response to interrupts.
The operation of the touch system 50 will now be described. To provide appropriate lighting for the digital cameras 70, the infrared light source 72 associated with each digital camera 70 generates infrared light that is projected across the touch surface 60 covering an area at least as large as the field of view of the associated digital camera.
As mentioned previously, the polarizers 74 at opposite diagonal corners of the touch surface 60 inhibit the infrared light source 72 diagonally opposite each digital camera 70 from blinding that digital camera due to the different polarization orientations of the polarizers 74. Infrared light impinging on a polarizer 74 that is polarized in a manner different from the polarization orientation of the polarizer is blocked. In this manner, the digital camera 70 behind each polarizer 74 in effect does not see the infrared light source 72 at the diagonally opposite corner.
Each digital camera 70 acquires images looking across the touch surface 60 within the field of view of its image sensor and lens assembly 80 at a desired frame rate and processes each acquired image to determine if a pointer is in the acquired image. When a pointer is positioned within the fields of view of the digital cameras 70, the pointer is illuminated by the light projected by the infrared light sources 72. Light reflecting off of the pointer typically does not maintain its polarization and therefore is visible to the digital cameras 70. Therefore, the illuminated pointer appears as a high-contrast bright region interrupting a dark band in each captured image allowing the existence of the pointer in the captured images to be readily detected.
If a pointer is in the acquired image, the image is further processed to determine characteristics of the pointer contacting or hovering above the touch surface 60. Pointer information packets (PIPs) including pointer characteristics, status and/or diagnostic information are then generated by the digital cameras 70 and the PIPs are queued for transmission to the master controller 54.
The master controller 54 polls the digital cameras 70 for PIPs. If the PIPs include pointer characteristic information, the master controller 54 triangulates pointer characteristics in the PIPs to determine the position of the pointer relative to the touch surface 60 in Cartesian rectangular coordinates. The master controller 54 in turn transmits calculated pointer position data, status and/or diagnostic information to the computer 56. In this manner, the pointer position data transmitted to the computer 56 can be recorded as writing or drawing or can be used to control execution of an applications program executed by the computer 56. The computer 56 also updates the computer-generated image output conveyed to the plasma display 58 so that information presented on the touch surface 60 reflects the pointer activity.
Specifics concerning the processing of acquired images and the triangulation of pointer characteristics in PIPs are described in U.S. patent application Ser. No. 10/294,917 to Morrison et al., assigned to SMART Technologies Inc., assignee of the present invention, the content of which is incorporated herein by reference. Accordingly, specifics will not be described further herein.
As will be appreciated, the use of infrared light sources 72 and polarizers 74 at the corners of the touch surface 60 inhibit light sources in the fields of view of the digital cameras from blinding the digital cameras.
Turning now to
The retro-reflectors 164 are designed to maintain polarization of light impinging thereon. In the present embodiment, corner cube retroreflectors such as those manufactured by Reflexite Corporation and sold under the name Reflexite™ AP1000 that preserve polarization are used.
In this embodiment, when infrared light generated by the infrared light sources 172 travels across the touch surface and impinges on one or more retro-reflectors 164, the retro-reflectors 164 in turn reflect the infrared light back in the opposite direction while maintaining the polarization of the infrared light. Since the infrared light sources 172 are mounted adjacent the digital cameras 170, infrared light reflected by the retro-reflectors 164 is aimed back towards the digital cameras 170. As a result, each digital camera 170 sees a bright band of illumination within its field of view.
During image acquisition, when no pointer is positioned within the fields of view of the digital cameras 170, the digital cameras 170 see bright bands of illumination. When a pointer is positioned within the fields of view of the digital cameras 170, the pointer occludes the infrared illumination and therefore appears as a high-contrast dark region interrupting a bright band of illumination in each captured image allowing the existence of the pointer in the captured images to be readily detected.
The embodiments of the touch screen described above show digital cameras, infrared light sources and polarizers at each corner of the touch screen. Those of skill in the art will appreciate that only two imaging devices having overlapping fields of view are required. Also the infrared light sources need not be positioned adjacent the digital cameras. In addition other types of filters may be used to inhibit the digital cameras from being blinded by a light source within its field of view. Basically any filter type device that blocks light projected by a light source within the field of view of the digital camera based on a characteristic (i.e. polarization, frequency etc.) of the projected light may be used.
In addition, although each light source is described as including an array of IR LEDs, those of skill in the art will appreciate that other light source configurations to provide light illumination across the touch surface can be used.
Although the touch system 50 has been described as including a plasma display 58 to present images on the touch surface, those of skill in the art will appreciate that this is not required. The touch screen may be a rear or front projection display device or virtually any surface on which a computer generated image is projected. Alternatively, the touch system 50 may be a writeboard where images are not projected on the touch surface.
Also, although the touch system 50 is described as including a master controller 54 separate from the digital cameras, if desired one of the digital cameras can be conditioned to function as both a camera and the master controller and poll the other digital cameras for PIPs. In this case, the digital camera functioning as the master controller may include a faster DSP 84 than the remaining digital cameras.
Turning now to
Each illuminated bezel 262 includes an array of IR LEDs (not shown) that project light onto a diffuser (not shown). The diffuser in turn, diffuses and expands the infrared light emitted by the IR LEDs so that adequate infrared backlighting is projected across the touch surface 260. As a result, the illuminated bezels 162 appear as generally continuous bright bands of illumination to the digital cameras 270.
Rather than using monochrome digital cameras capturing infrared images, in this embodiment, the image sensors used in the digital cameras 270 are color CMOS image sensors and do not include IR pass filters.
For example, in one mode of operation when the ambient light level is sufficiently high, the illuminated bezels 262 are switched off allowing color images to be acquired by the digital cameras 270. During image processing, in addition to determining the pointer position in the manner described previously, acquired color information is used to enhance pointer recognition and scene understanding.
As will be appreciated, when an image including a pointer is captured, the foreground object i.e. the pointer, is the object of interest. During image processing, it is desired to separate the foreground object from the background. Since the optical properties of the foreground object and background are different for different wavelengths of light, the foreground object is detected easier in some light frequencies than others. For example, if the background is predominantly blue, then the foreground object such as a finger will have higher luminosity when looking through red or green filters since the blue filter does not permit blue light to pass. This effectively segments the foreground object from the background. In general, the luminosity differences between the foreground object and the background are exploited at different frequencies.
When the ambient light level drops below a threshold level, the illuminated bezels 262 are switched on. In this case, the touch screen 252 operates in an occlusion mode as described previously. Pointer data is developed from images captured by the image sensors and processed in the manner discussed above.
Although the touch screen 252 has been described as using infrared illumination to provide backlighting, those of skill in the art will appreciate that light in a different frequency range other than infrared may be used provided the image sensors in the digital cameras have sufficient quantum efficiency at that different frequency range to capture images.
Rather than exclusively using ambient light when the ambient light level is sufficiently high and infrared illumination when the ambient light level is low, infrared illumination can be multiplexed with ambient light to enable the digital cameras 270 to capture different types of images. For example, the illuminated bezels 262 can be strobed so that one or more images are captured by the digital cameras 270 in ambient light conditions and then in infrared backlighting conditions. The strobing may be achieved by shutting the illuminated bezels 262 on and off and relying on ambient light levels in the off condition.
Alternatively, rather than using colour image sensors, monochrome sensors may be used in conjunction with an illumination source that provides lighting across the touch surface that changes frequency bands allowing one or more images to be captured by the digital cameras in the different frequency bands. For example, the illumination source may include a white light source and a light filter in the form of a wheel that is rotatable in front of the light source. The wheel may include alternating infrared and clear sections. When a clear section is presented in front of the light source, white light is projected across the touch surface and when an infrared section is presented in front of the light source, infrared light is projected across the touch surface.
Other light filters can of course be used with the wheel. For example, the wheel may include infrared, blue, red and green sections arranged about the wheel. Depending on the section of the wheel positioned in front of the light source, light in a different frequency band is projected across the touch surface allowing one or more images to be captured during each type of illumination. Of course, those of skill in the art will appreciate that colour wheels may be disposed in front of the digital cameras rather than adjacent the light source.
Although embodiments of the present invention have been described, those of skill in the art will appreciate that variations and modifications may be made without departing from the spirit and scope thereof as defined by the appended claims.
Morrison, Gerald D., Worthington, Stephen, Gurtler, Patrick James
Patent | Priority | Assignee | Title |
10004985, | Oct 14 2012 | Neonode Inc. | Handheld electronic device and associated distributed multi-display system |
10007422, | Feb 15 2009 | Neonode Inc. | Light-based controls in a toroidal steering wheel |
10013631, | Aug 26 2016 | SMART Technologies ULC | Collaboration system with raster-to-vector image conversion |
10140791, | Oct 14 2012 | Neonode Inc. | Door lock user interface |
10254943, | Nov 27 2012 | Neonode Inc. | Autonomous drive user interface |
10282034, | Oct 14 2012 | Neonode Inc | Touch sensitive curved and flexible displays |
10313885, | Aug 25 2014 | SMART Technologies ULC | System and method for authentication in distributed computing environment |
10324565, | May 30 2013 | Neonode Inc | Optical proximity sensor |
10496180, | Oct 14 2012 | Neonode, Inc. | Optical proximity sensor and associated user interface |
10534479, | Oct 14 2012 | Neonode Inc. | Optical proximity sensors |
10585530, | Sep 23 2014 | Neonode Inc | Optical proximity sensor |
10719218, | Nov 27 2012 | Neonode Inc. | Vehicle user interface |
10802601, | Oct 14 2012 | Neonode Inc. | Optical proximity sensor and associated user interface |
10928957, | Oct 14 2012 | Neonode Inc. | Optical proximity sensor |
10949027, | Oct 14 2012 | Neonode Inc. | Interactive virtual display |
11073948, | Oct 14 2012 | Neonode Inc. | Optical proximity sensors |
11379048, | Oct 14 2012 | Neonode Inc. | Contactless control panel |
11429230, | Nov 28 2018 | Neonode Inc | Motorist user interface sensor |
11650727, | Nov 27 2012 | Neonode Inc. | Vehicle user interface |
11669210, | Sep 30 2020 | Neonode Inc | Optical touch sensor |
11714509, | Oct 14 2012 | Neonode Inc. | Multi-plane reflective sensor |
11733808, | Oct 14 2012 | Neonode, Inc. | Object detector based on reflected light |
11842014, | Dec 31 2019 | Neonode Inc | Contactless touch input system |
11859961, | Jan 25 2018 | Neonode Inc | Optics for vehicle occupant monitoring systems |
7359564, | Oct 29 2004 | Microsoft Technology Licensing, LLC | Method and system for cancellation of ambient light using light frequency |
7619617, | Nov 15 2002 | SMART Technologies ULC | Size/scale and orientation determination of a pointer in a camera-based touch system |
7643006, | Sep 16 2003 | PIXART IMAGING INC | Gesture recognition method and touch system incorporating the same |
7796116, | Jan 12 2005 | NINTENDO CO , LTD | Electronic equipment for handheld vision based absolute pointing system |
7852317, | Jan 12 2005 | NINTENDO CO , LTD | Handheld device for handheld vision based absolute pointing system |
7864159, | Jan 12 2005 | NINTENDO CO , LTD | Handheld vision based absolute pointing system |
7890863, | Oct 04 2006 | Immersion Corporation | Haptic effects with proximity sensing |
8055022, | Jul 05 2000 | SMART Technologies ULC | Passive touch system and method of detecting user input |
8089462, | Jan 02 2004 | SMART Technologies ULC | Pointer tracking across multiple overlapping coordinate input sub-regions defining a generally contiguous input region |
8094137, | Jul 23 2007 | SMART TECHNOLOGIES INC | System and method of detecting contact on a display |
8115753, | Apr 11 2007 | SMART Technologies ULC | Touch screen system with hover and click input methods |
8120596, | May 21 2004 | PIXART IMAGING INC | Tiled touch system |
8149221, | May 07 2004 | SMART Technologies ULC | Touch panel display system with illumination and detection provided from a single edge |
8174497, | Jan 12 2005 | Thinkoptics, Inc. | Handheld vision based absolute pointing system |
8203535, | Jul 05 2000 | SMART Technologies ULC | Passive touch system and method of detecting user input |
8228304, | Nov 15 2002 | SMART Technologies ULC | Size/scale orientation determination of a pointer in a camera-based touch system |
8269158, | Oct 10 2008 | Pixart Imaging Inc. | Sensing system and method for obtaining position of pointer thereof |
8274496, | Apr 29 2004 | PIXART IMAGING INC | Dual mode touch systems |
8289299, | Feb 14 2003 | SMART Technologies ULC | Touch screen signal processing |
8305363, | Oct 10 2008 | Pixart Imaging | Sensing system and locating method thereof |
8327287, | Apr 12 2006 | Nintendo Co., Ltd. | Character input program and character input device |
8339378, | Nov 05 2008 | PIXART IMAGING INC | Interactive input system with multi-angle reflector |
8339379, | Apr 29 2004 | Neonode Inc | Light-based touch screen |
8378986, | Jul 05 2000 | SMART Technologies ULC | Passive touch system and method of detecting user input |
8384693, | Aug 30 2007 | SMART Technologies ULC | Low profile touch panel systems |
8384694, | Nov 17 2009 | Microsoft Technology Licensing, LLC | Infrared vision with liquid crystal display device |
8405636, | Jan 07 2008 | SMART Technologies ULC | Optical position sensing system and optical position sensor assembly |
8405637, | Jan 07 2008 | SMART Technologies ULC | Optical position sensing system and optical position sensor assembly with convex imaging window |
8416206, | Jul 08 2009 | SMART Technologies ULC | Method for manipulating a graphic widget in a three-dimensional environment displayed on a touch panel of an interactive input system |
8416217, | Nov 04 2002 | Neonode Inc | Light-based finger gesture user interface |
8432377, | Aug 30 2007 | SMART Technologies ULC | Optical touchscreen with improved illumination |
8446392, | Nov 16 2009 | SMART Technologies ULC | Method for determining the location of a pointer in a pointer input region, and interactive input system executing the method |
8456418, | Oct 09 2003 | PIXART IMAGING INC | Apparatus for determining the location of a pointer within a region of interest |
8456447, | Feb 14 2003 | SMART Technologies ULC | Touch screen signal processing |
8456451, | Mar 11 2003 | SMART Technologies ULC | System and method for differentiating between pointers used to contact touch surface |
8466885, | Feb 14 2003 | SMART Technologies ULC | Touch screen signal processing |
8471830, | Jul 06 2007 | Neonode Inc | Scanning of a touch screen |
8502789, | Jan 11 2010 | SMART Technologies ULC | Method for handling user input in an interactive input system, and interactive input system executing the method |
8508508, | Feb 14 2003 | SMART Technologies ULC | Touch screen signal processing with single-point calibration |
8558817, | Mar 29 2011 | Genius Electronic Optical Co., Ltd. | Optical touch-control system |
8600107, | Mar 31 2011 | SMART Technologies ULC | Interactive input system and method |
8619027, | Feb 15 2011 | SMART Technologies ULC | Interactive input system and tool tray therefor |
8624835, | Jan 13 2010 | SMART Technologies ULC | Interactive input system and illumination system therefor |
8643628, | Oct 14 2012 | Neonode Inc | Light-based proximity detection system and user interface |
8674966, | Nov 02 2001 | Neonode Inc | ASIC controller for light-based touch screen |
8692768, | Jul 10 2009 | SMART Technologies ULC | Interactive input system |
8723122, | Nov 02 2010 | LG Display Co., Ltd. | Infrared sensor module, touch sensing method thereof, and auto calibration method applied to the same |
8740395, | Apr 01 2011 | Seiko Epson Corporation | Projection unit and method of controlling a first light source and a second light source |
8773372, | Aug 05 2010 | AU Optronics Corp. | Optical plate structure for a touch panel, and touch display panel and touch liquid crystal display panel including the same |
8775023, | Feb 15 2009 | Neonode Inc | Light-based touch controls on a steering wheel and dashboard |
8810522, | Sep 29 2008 | SMART Technologies ULC | Method for selecting and manipulating a graphical object in an interactive input system, and interactive input system executing the method |
8810551, | Nov 04 2002 | Neonode Inc. | Finger gesture user interface |
8830210, | Nov 04 2009 | Coretronic Corporation | Optical touch apparatus and drive method to control an average brightness of LEDs |
8860688, | Mar 02 2011 | SMART Technologies ULC | 3D interactive input system and method |
8872772, | Apr 01 2010 | SMART Technologies ULC | Interactive input system and pen tool therefor |
8884926, | Nov 04 2002 | Neonode Inc. | Light-based finger gesture user interface |
8898564, | Oct 04 2006 | Immersion Corporation | Haptic effects with proximity sensing |
8902193, | May 09 2008 | SMART Technologies ULC | Interactive input system and bezel therefor |
8902195, | Sep 01 2009 | SMART Technologies ULC | Interactive input system with improved signal-to-noise ratio (SNR) and image capture method |
8907889, | Jan 12 2005 | Thinkoptics, Inc. | Handheld vision based absolute pointing system |
8913003, | Jul 17 2006 | Thinkoptics, Inc.; THINKOPTICS, INC | Free-space multi-dimensional absolute pointer using a projection marker system |
8918252, | Feb 15 2009 | Neonode Inc. | Light-based touch controls on a steering wheel |
8937588, | Jun 15 2011 | SMART Technologies ULC | Interactive input system and method of operating the same |
8972891, | Apr 26 2010 | SMART Technologies ULC | Method for handling objects representing annotations on an interactive input system and interactive input system executing the method |
8982100, | Aug 31 2011 | SMART Technologies ULC | Interactive input system and panel therefor |
9001087, | Oct 14 2012 | Neonode Inc. | Light-based proximity detection system and user interface |
9035917, | Nov 02 2001 | Neonode Inc. | ASIC controller for light-based sensor |
9052777, | Nov 02 2001 | Neonode Inc | Optical elements with alternating reflective lens facets |
9092093, | Nov 27 2012 | Neonode Inc | Steering wheel user interface |
9164625, | Oct 14 2012 | Neonode Inc | Proximity sensor for determining two-dimensional coordinates of a proximal object |
9164654, | Dec 10 2002 | NEONODE SMARTPHONE LLC | User interface for mobile computer unit |
9176598, | May 08 2007 | Thinkoptics, Inc. | Free-space multi-dimensional absolute pointer with improved performance |
9189086, | Apr 01 2010 | SMART Technologies ULC | Interactive input system and information input method therefor |
9207812, | Jan 11 2012 | SMART Technologies ULC | Interactive input system and method |
9207858, | Oct 15 2009 | SMART Technologies ULC | Method and apparatus for drawing and erasing calligraphic ink objects on a display surface |
9213443, | Feb 15 2009 | Neonode Inc | Optical touch screen systems using reflected light |
9261987, | Jan 12 2011 | SMART Technologies ULC | Method of supporting multiple selections and interactive input system employing same |
9262011, | Mar 30 2011 | SMART Technologies ULC | Interactive input system and method |
9262074, | Nov 04 2002 | Neonode, Inc. | Finger gesture user interface |
9274615, | Nov 11 2011 | PIXART IMAGING INC | Interactive input system and method |
9288440, | Mar 31 2014 | SMART Technologies ULC | Method for tracking displays during a collaboration session and interactive board employing same |
9292109, | Sep 22 2011 | SMART Technologies ULC | Interactive input system and pen tool therefor |
9292129, | Oct 30 2012 | SMART Technologies ULC | Interactive input system and method therefor |
9298318, | Dec 01 2010 | SMART Technologies ULC | Interactive input system and method |
9323322, | Feb 02 2012 | SMART Technologies ULC | Interactive input system and method of detecting objects |
9323367, | Jun 22 2012 | SMART Technologies ULC | Automatic annotation de-emphasis |
9329700, | Jan 14 2010 | SMART Technologies ULC | Interactive system with successively activated illumination sources |
9360966, | Mar 30 2012 | SMART Technologies ULC | Method for generally continuously calibrating an interactive input system |
9383864, | Mar 31 2010 | SMART Technologies ULC | Illumination structure for an interactive input system |
9389710, | Feb 15 2009 | Neonode Inc. | Light-based controls on a toroidal steering wheel |
9400573, | Jul 19 2010 | LG INNOTEK CO , LTD | Optical touch screen |
9442602, | Jun 15 2011 | SMART Technologies ULC | Interactive input system and method |
9442607, | Dec 04 2006 | Smart Technologies Inc. | Interactive input system and method |
9471957, | Mar 28 2014 | SMART Technologies ULC | Method for partitioning, managing and displaying a collaboration space and interactive input system employing same |
9542040, | Mar 15 2013 | SMART Technologies ULC | Method for detection and rejection of pointer contacts in interactive input systems |
9544723, | Oct 15 2012 | SMART Technologies ULC | System and method to display content on an interactive display surface |
9582119, | Jan 11 2012 | SMART Technologies ULC | Interactive input system and method |
9588673, | Mar 31 2011 | SMART Technologies ULC | Method for manipulating a graphical object and an interactive input system employing the same |
9600075, | Oct 04 2006 | Immersion Corporation | Haptic effects with proximity sensing |
9600100, | Jan 11 2012 | SMART Technologies ULC | Interactive input system and method |
9600101, | Mar 31 2014 | SMART Technologies ULC | Interactive input system, interactive board therefor and methods |
9665258, | Feb 05 2010 | SMART Technologies ULC | Interactive input system displaying an e-book graphic object and method of manipulating a e-book graphic object |
9710144, | Nov 27 2012 | Neonode Inc. | User interface for curved input device |
9741184, | Oct 14 2012 | Neonode Inc.; Neonode Inc | Door handle with optical proximity sensors |
9778794, | Nov 04 2002 | Neonode Inc. | Light-based touch screen |
9787731, | Mar 31 2014 | SMART Technologies ULC | Dynamically determining workspace bounds during a collaboration session |
9872178, | Aug 25 2014 | SMART TECHNOLOGIES, ULC | System and method for authentication in distributed computing environments |
9921661, | Oct 14 2012 | Neonode Inc | Optical proximity sensor and associated user interface |
ER8994, | |||
RE42794, | Dec 27 1999 | SMART Technologies ULC | Information-inputting device inputting contact point of object on recording surfaces as information |
RE43084, | Oct 29 1999 | SMART Technologies ULC | Method and apparatus for inputting information including coordinate data |
Patent | Priority | Assignee | Title |
3870834, | |||
4061877, | Oct 04 1976 | Shaymar, Inc. | Speaker system |
4075438, | Dec 02 1976 | Stereo speaker system | |
4144449, | Jul 08 1977 | Sperry Rand Corporation | Position detection apparatus |
4247767, | May 05 1978 | Her Majesty the Queen in right of Canada, as represented by the Minister | Touch sensitive computer input device |
4507557, | Apr 01 1983 | Siemens Corporate Research & Support, Inc. | Non-contact X,Y digitizer using two dynamic ram imagers |
4558313, | Dec 31 1981 | International Business Machines Corporation | Indicator to data processing interface |
4597470, | Apr 22 1984 | Pioneer Electronic Corporation; Honda Giken Kogyo Kabushiki Kaisha | Car speaker system |
4696370, | Nov 30 1984 | Pioneer Electronic Corporation | Headrest-mounted acoustic device |
4737631, | May 17 1985 | ALPS Electric Co., Ltd. | Filter of photoelectric touch panel with integral spherical protrusion lens |
4742221, | May 17 1985 | ALPS Electric Co., Ltd. | Optical coordinate position input device |
4746770, | Feb 17 1987 | Sensor Frame Incorporated; SENSOR FRAME INCORPORATION | Method and apparatus for isolating and manipulating graphic objects on computer video monitor |
4782328, | Oct 02 1986 | Product Development Services, Incorporated | Ambient-light-responsive touch screen data input method and system |
4818826, | Sep 19 1986 | ALPS Electric Co., Ltd. | Coordinate input apparatus including a detection circuit to determine proper stylus position |
5097516, | Feb 28 1991 | AT&T Bell Laboratories | Technique for illuminating a surface with a gradient intensity line of light to achieve enhanced two-dimensional imaging |
5109435, | Aug 08 1988 | Hughes Aircraft Company | Segmentation method for use against moving objects |
5317140, | Nov 24 1992 | NEXT HOLDINGS, LTD | Diffusion-assisted position location particularly for visual pen detection |
5483261, | Feb 14 1992 | ORGPRO NEXUS INC | Graphical input controller and method with rear screen image detection |
5483603, | Oct 22 1992 | Advanced Interconnection Technology | System and method for automatic optical inspection |
5502568, | Mar 23 1993 | WACOM CO , LTD | Optical position detecting unit, optical coordinate input unit and optical position detecting method employing a pattern having a sequence of 1's and 0's |
5581276, | Sep 08 1992 | Kabushiki Kaisha Toshiba | 3D human interface apparatus using motion recognition based on dynamic image processing |
5638092, | Dec 20 1994 | Cursor control system | |
5737740, | Jun 27 1994 | Numonics | Apparatus and method for processing electronic documents |
5754664, | Sep 09 1993 | Prince Corporation | Vehicle audio system |
5825352, | Jan 04 1996 | ELAN MICROELECTRONICS CORP | Multiple fingers contact sensing method for emulating mouse buttons and mouse operations on a touch sensor pad |
5854847, | Feb 06 1997 | Pioneer Electronic Corp. | Speaker system for use in an automobile vehicle |
5911004, | May 08 1995 | Ricoh Company, LTD | Image processing apparatus for discriminating image characteristics using image signal information obtained in an image scanning operation |
5936615, | Sep 12 1996 | HTC Corporation | Image-based touchscreen |
5963199, | Feb 09 1996 | Kabushiki Kaisha Sega Enterprises | Image processing systems and data input devices therefor |
5982352, | Aug 15 1994 | Method for providing human input to a computer | |
5988645, | Apr 08 1994 | Moving object monitoring system | |
6002808, | Jul 26 1996 | Mitsubishi Electric Research Laboratories, Inc | Hand gesture control system |
6008798, | Jun 07 1995 | HEWLETT-PACKARD DEVELOPMENT COMPANY, L P | Method of determining an object's position and associated apparatus |
6061177, | Dec 19 1996 | Integrated computer display and graphical input apparatus and method | |
6100538, | Jun 13 1997 | Kabushikikaisha Wacom | Optical digitizer and display means for providing display of indicated position |
6161066, | Aug 18 1997 | TEXAS A&M UNIVERSITY SYSTEM, THE | Advanced law enforcement and response technology |
6191773, | Apr 28 1995 | Panasonic Intellectual Property Corporation of America | Interface apparatus |
6208330, | Mar 07 1997 | Canon Kabushiki Kaisha | Coordinate input apparatus and its control method |
6256033, | Oct 15 1997 | Microsoft Technology Licensing, LLC | Method and apparatus for real-time gesture recognition |
6262718, | Jan 19 1994 | Lenovo PC International | Touch-sensitive display apparatus |
6310610, | Dec 04 1997 | Microsoft Technology Licensing, LLC | Intelligent touch display |
6323846, | Jan 26 1998 | Apple Inc | Method and apparatus for integrating manual input |
6335724, | Jan 29 1999 | Ricoh Company, Ltd. | Method and device for inputting coordinate-position and a display board system |
6339748, | Nov 11 1997 | Seiko Epson Corporation | Coordinate input system and display apparatus |
6353434, | Sep 08 1998 | Gunze Limited | Input coordinate transformation apparatus for converting coordinates input from a coordinate input device into coordinates in a display coordinate system for displaying images on a display |
6359612, | Sep 30 1998 | Siemens Aktiengesellschaft | Imaging system for displaying image information that has been acquired by means of a medical diagnostic imaging device |
6414671, | Jun 08 1992 | Synaptics Incorporated | Object position detector with edge motion feature and gesture recognition |
6421042, | Jun 09 1998 | SMART Technologies ULC | Coordinate position inputting/detecting device, a method for inputting/detecting the coordinate position, and a display board system |
6429856, | May 11 1998 | Ricoh Company, LTD | Coordinate position inputting/detecting device, a method for inputting/detecting the coordinate position, and a display board system |
6498602, | Nov 11 1999 | MINATO ADVANCED TECHNOLOGIES INC | Optical digitizer with function to recognize kinds of pointing instruments |
6507339, | Sep 23 1999 | Ricoh Company, Ltd. | Coordinate inputting/detecting system and a calibration method therefor |
6512838, | Sep 22 1999 | Microsoft Technology Licensing, LLC | Methods for enhancing performance and data acquired from three-dimensional image systems |
6531999, | Jul 13 2000 | Koninklijke Philips Electronics N V | Pointing direction calibration in video conferencing and other camera-based system applications |
6559813, | Jul 01 1998 | Vuzix Corporation | Selective real image obstruction in a virtual reality display apparatus and method |
6563491, | Sep 10 1999 | SMART Technologies ULC | Coordinate input apparatus and the recording medium thereof |
6594023, | Sep 10 1999 | Ricoh Company, LTD | Coordinate inputting/detecting apparatus, method and computer program product designed to precisely recognize a designating state of a designating device designating a position |
6608619, | May 11 1998 | Ricoh Company, Ltd. | Coordinate position inputting/detecting device, a method for inputting/detecting the coordinate position, and a display board system |
6614910, | Nov 01 1996 | CREATIVE TECHNOLOGY LTD | Stereo sound expander |
6626718, | Oct 03 2000 | Canon Kabushiki Kaisha | Apparatus for manufacturing electron source, method for manufacturing electron source, and method for manufacturing image-forming apparatus |
6674424, | Oct 29 1999 | SMART Technologies ULC | Method and apparatus for inputting information including coordinate data |
6710770, | |||
6731765, | Sep 26 1996 | Yamaha Corporation | Loudspeaker device |
6744898, | Oct 20 1999 | Pioneer Corporation | Passenger seat with built-in speakers and audio system therefor |
6774889, | Oct 24 2000 | Microsoft Technology Licensing, LLC | System and method for transforming an ordinary computer monitor screen into a touch screen |
6803906, | Jul 05 2000 | SMART Technologies ULC | Passive touch system and method of detecting user input |
6933981, | Jun 25 1999 | Kabushiki Kaisha Toshiba | Electronic apparatus and electronic system provided with the same |
7007236, | Sep 14 2001 | Accenture Global Services Limited | Lab window collaboration |
7030861, | Feb 10 2001 | Apple Inc | System and method for packing multi-touch gestures onto a hand |
20010019325, | |||
20010022579, | |||
20010026268, | |||
20010033274, | |||
20020036617, | |||
20030001825, | |||
20030025951, | |||
20030085871, | |||
20030086572, | |||
20040021633, | |||
20040149892, | |||
20040178997, | |||
20040189720, | |||
20050052427, | |||
DE19810452, | |||
JP57211637, | |||
JP8240407, | |||
JP9091094, | |||
JP9319501, | |||
JP991094, | |||
WO9940562, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Jan 29 2004 | WORTHINGTON, STEPHEN | SMART TECHNOLOGIES INC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 014996 | /0385 | |
Jan 29 2004 | MORRISON, GERALD D | SMART TECHNOLOGIES INC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 014996 | /0385 | |
Jan 29 2004 | GURTLER, PATRICK JAMES | SMART TECHNOLOGIES INC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 014996 | /0385 | |
Feb 17 2004 | Smart Technologies Inc. | (assignment on the face of the patent) | / | |||
Jul 31 2013 | SMART Technologies ULC | MORGAN STANLEY SENIOR FUNDING INC | SECURITY AGREEMENT | 030935 | /0848 | |
Jul 31 2013 | SMART TECHNOLOGIES INC | MORGAN STANLEY SENIOR FUNDING INC | SECURITY AGREEMENT | 030935 | /0848 | |
Oct 03 2016 | MORGAN STANLEY SENIOR FUNDING, INC | SMART Technologies ULC | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 040798 | /0077 | |
Oct 03 2016 | MORGAN STANLEY SENIOR FUNDING, INC | SMART TECHNOLOGIES INC | RELEASE OF TERM LOAN SECURITY INTEREST | 040713 | /0123 | |
Oct 03 2016 | MORGAN STANLEY SENIOR FUNDING, INC | SMART Technologies ULC | RELEASE OF TERM LOAN SECURITY INTEREST | 040713 | /0123 | |
Oct 03 2016 | MORGAN STANLEY SENIOR FUNDING, INC | SMART TECHNOLOGIES INC | RELEASE OF ABL SECURITY INTEREST | 040711 | /0956 | |
Oct 03 2016 | MORGAN STANLEY SENIOR FUNDING, INC | SMART Technologies ULC | RELEASE OF ABL SECURITY INTEREST | 040711 | /0956 | |
Oct 03 2016 | MORGAN STANLEY SENIOR FUNDING, INC | SMART TECHNOLOGIES INC | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 040798 | /0077 |
Date | Maintenance Fee Events |
Nov 24 2010 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
Dec 19 2014 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
Dec 19 2018 | M1553: Payment of Maintenance Fee, 12th Year, Large Entity. |
Date | Maintenance Schedule |
Jun 19 2010 | 4 years fee payment window open |
Dec 19 2010 | 6 months grace period start (w surcharge) |
Jun 19 2011 | patent expiry (for year 4) |
Jun 19 2013 | 2 years to revive unintentionally abandoned end. (for year 4) |
Jun 19 2014 | 8 years fee payment window open |
Dec 19 2014 | 6 months grace period start (w surcharge) |
Jun 19 2015 | patent expiry (for year 8) |
Jun 19 2017 | 2 years to revive unintentionally abandoned end. (for year 8) |
Jun 19 2018 | 12 years fee payment window open |
Dec 19 2018 | 6 months grace period start (w surcharge) |
Jun 19 2019 | patent expiry (for year 12) |
Jun 19 2021 | 2 years to revive unintentionally abandoned end. (for year 12) |