According to an example embodiment, the present invention is directed to a video communication system having a user-friendly, intuitive-like control for altering the video camera view at a remote terminal. The local terminal includes a display and a movement-responsive sensor arranged to generate a direction signal in response to corresponding movement at the display. At least one of the first and second computer arrangements is configured and arranged to alter data being sent to the display in response to the direction signal from the movement-responsive sensor.
|
29. A method for communication, comprising:
gathering video data via a first communication terminal having a first computer arrangement for processing data including video data;
transferring video data over a communications channel;
receiving the video data via a second communication terminal having a display, having a second computer arrangement for processing data including video data, and coupled communicatively with the first communication terminal over the communications channel;
detecting movement of the display via a movement-responsive sensor configured and arranged to generate a direction signal in response to corresponding movement of the display;
generating a direction signal in response to the movement of the display; and
altering the video data responsive to the direction signal from the movement-responsive sensor.
33. A video communication system, comprising:
a first video communication terminal including a first computer arrangement for processing data, including video data, that is communicated over a communications channel, and including a camera configured and arranged to capture images of a view, wherein the captured images are processed as data by the first computer arrangement for transfer over the communications channel; and
a second video communication terminal including a display, means for sensing configured and arranged to generate a direction signal in response to corresponding movement of the display, and a second computer arrangement for processing data, including video data, for communicatively coupling with the first video communication terminal over the communications channel, wherein at least one of the first and second computer arrangements includes means for altering data being sent to the display in response to the direction signal.
40. For use in a video communication system having a first video communication terminal that processes data including video data, the first video communication terminal including a camera configured and arranged to capture images of a view and to transfer the captured images in the form of data over a communications channel, a second video communication terminal comprising:
means for sensing;
a display physically coupled to the means for sensing, wherein the means for sensing is configured and arranged to generate a direction signal in response to corresponding movement of the display; and
a second computer arrangement for processing data, including video data, for communicatively coupling with the first video communication terminal over the communications channel, wherein at least one of the first and second computer arrangements is configured and arranged to alter data being sent to the display in response to the direction signal from the means for sensing.
28. For use in a video communication system having a first video communication terminal that processes data including video data, the first video communication terminal including a camera configured and arranged to capture images of a view and to transfer the captured images in the form of data over a communications channel, a second video communication terminal comprising:
a movement-responsive sensor;
a display physically coupled to a movement-responsive sensor, wherein the movement-responsive sensor is configured and arranged to generate a direction signal in response to corresponding movement of the display; and
a second computer arrangement for processing data, including video data, for communicatively coupling with the first video communication terminal over the communications channel, wherein at least one of the first and second computer arrangements is configured and arranged to alter data being sent to the display in response to the direction signal from the movement-responsive sensor.
1. A video communication system, comprising:
a first video communication terminal including a first computer arrangement for processing data, including video data, that is communicated over a communications channel, and including a camera configured and arranged to capture images of a view, wherein the captured images are processed as data by the first computer arrangement for transfer over the communications channel; and
a second video communication terminal including a display, a movement-responsive sensor configured and arranged to generate a direction signal in response to corresponding movement of the display, and a second computer arrangement for processing data, including video data, for communicatively coupling with the first video communication terminal over the communications channel, wherein at least one of the first and second computer arrangements is configured and arranged to alter data being sent to the display in response to the direction signal from the movement-responsive sensor.
0. 41. A video communication system, comprising:
a first video communication terminal including a first computer arrangement for processing data, including video data, that is communicated over a communications channel, and including a camera configured and arranged to capture images of a view, wherein the captured images are processed as data by the first computer arrangement for transfer over the communications channel; and
a second video communication terminal including a display, a movement-responsive sensor configured and arranged to respond to corresponding movement of the second video communication terminal, and a second computer arrangement for processing data, including video data, for communicatively coupling with the first video communication terminal over the communications channel, wherein at least one of the first and second computer arrangements is configured and arranged to electronically alter data being sent to the display by electronically panning, tilting or zooming in response to the movement-responsive sensor.
25. A video communication system, comprising:
a first video communication terminal including a first computer arrangement for processing data, including video data, that is communicated over a communications channel, and including a camera configured and arranged to capture images of a view, wherein the captured images are processed as data by the first computer arrangement for transfer over the communications channel;
a second video communication terminal including a display, a movement-responsive sensor configured and arranged to generate direction signals in response to corresponding movement of the display, and a second computer arrangement for processing data, including video data, for communicatively coupling with the first video communication terminal over the communications channel, the second computer arrangement being configured and arranged to store video data received over the communications channel and to respond to the movement-responsive sensor by changing data being sent to the display such that only a portion of the stored video data is displayed.
0. 45. In a video communication system having a video communication terminal including a data processing arrangement for processing data, including video data, that is communicated over a communications channel, and including a camera configured and arranged to capture images of a view, wherein the captured images are processed by the data processing arrangement for transfer over the communications channel, a telephony terminal comprising:
a display;
a movement-responsive sensor configured and arranged to respond to movement of the telephony terminal; and
a computer arrangement for processing data, including a general-purpose processor and including a digital signal processor for processing video data, the computer arrangement adapted for communicatively coupling with the video communication terminal over a wireless portion of the communications channel, wherein at least one of the data processing arrangement and the computer arrangement is configured and arranged to electronically alter data being sent to the display by electronically panning, tilting or zooming in response to the movement-responsive sensor.
23. A video communication system, comprising:
a first video communication terminal including a first computer arrangement for processing data, including video data, that is communicated over a communications channel, and including a camera configured and arranged to capture images of a view, wherein the captured images are processed as data by the first computer arrangement for transfer over the communications channel, the computer arrangement being configured and arranged to transfer data, in response to a control signal received over the communications channel, representing an altered view being captured by the camera;
a second video communication terminal including a display, a movement-responsive sensor configured and arranged to generate a direction signal in response to corresponding movement of the display, and a second computer arrangement for processing data, including video data, for communicatively coupling with the first video communication terminal over the communications channel, the second computer arrangement being configured and arranged to respond to the movement-responsive sensor by sending the control signal to the first video communication terminal over the communications channel.
2. A video communication system, according to
3. A video communication system, according to
4. A video communication system, according to
5. A video communication system, according to
6. A video communication system, according to
7. A video communication system, according to
8. A video communication system, according to
9. A video communication system, according to
10. A video communication system, according to
11. A video communication system, according to
12. A video communication system, according to
13. A video communication system, according to
14. A video communication system, according to
15. A video communication system, according to
16. A video communication system, according to
17. A video communication system, according to
18. A video communication system, according to
19. A video communication system, according to
20. A video communication system, according to
21. A video communication system, according to
22. A video communications system, according to
24. A video communication system, according to the
26. A video communication system, according to
27. A video communication system, according to
30. A method for communication, according to
31. A method for communication, according to
32. A method for communication, according to
34. A video communication system, according to
35. A video communication system, according to
36. A video communication system, according to
37. A video communication system, according to
38. A video communication system, according to
39. A video communication system, according to
0. 42. The video communication system of
0. 43. The video communication system of
0. 44. The video communication system of
|
This related to “ARRANGEMENT FOR CONTROLLING THE VIEW AREA OF A VIDEO CONFERENCING DEVICE AND METHOD THEREFORE,” U.S. patent application Ser. No. 08/861,619, filed May 22, 1997, and is incorporated herein by reference in its entirety.
The present invention relates to video communication systems. More particularly, the present invention relates to configuring and controlling the displayed view of a video communication system.
An increasing number of communication applications are realizing the benefits of video-conferencing equipment. Such equipment generally includes two or more communication terminals participating in the transmission and/or reception of data representing captured video images, typically along with signals representing speech. One type of conventional video-conferencing arrangement includes at least one communication terminal set up with a camera, an image processor, and a transmission device transmitting captured video images for display at the other terminal(s).
While the benefits of video-conferencing equipment are widely recognized, extensive use of video-conferencing equipment has been inhibited largely due to cost, inconvenience and video quality. Increased video quality and convenience have proven to be costly considerations. For this reason, there have been opposing pressures to develop certain more inexpensive systems with increased video quality and convenience and certain other systems that forego the convenience and quality criteria for the sake of reducing costs. Other factors inhibiting extensive use of such equipment include equipment size and maintenance requirements.
As an example, there have been significant efforts to develop the convenience aspect of video conferencing technology by controlling a video conferencing camera for camera adjustment features, such as pan, tilt or zoom. Because the camera is at a location remote from the displayed image, controlling the camera must be coordinated between the two locations. Heretofore, controlling the camera has required methods that are non-intuitive and often difficult to learn. Consequently, the potential to expand the uses of such equipment has been impeded.
The present invention is exemplified in a number of implementations and applications, some of which are summarized below. In one example embodiment, the present invention permits a user of a local video communication (e.g., video-conferencing or video-monitoring) terminal to ostensibly or actually control the camera view at the remote terminal. This is achieved by the user physically moving (e.g., exerting a slight force to engage a pressure sensitive device or perceptibly displacing from a position for a time) the local display screen so that the displayed view changes as desired. An electromechanical device is used to sense and report the movement for subsequent video-image processing. In one more particular embodiment, the reported information is transmitted to the remote terminal and used to control the far-end camera at the remote terminal, for example, to adjust the image captured by the far-end camera and/or to maintain view of user at local terminal as viewed at the remote terminal. In another particular embodiment, this information is used at the local terminal, via digital manipulation of the received picture, to adjust the image locally and/or to transmit a different image for the remote terminal.
According to another example embodiment, the present invention is directed to a video communication system having a user-friendly control for altering video data. The system includes a first video communication terminal having a first computer arrangement for processing data including video data. The data is communicated over a communications channel. The first video communication terminal further includes a camera configured and arranged to capture images of a view. The captured images are processed as data by the first computer arrangement for transfer over the communications channel. The system further includes a second video communication terminal including a display and a movement-responsive sensor configured and arranged to generate a direction signal in response to corresponding movement of the display. The second terminal further includes a second computer arrangement for processing data, including video data, for communicatively coupling with the first video communication terminal over the communications channel. At least one of the first and second computer arrangements is configured and arranged to alter data being sent to the display in response to the direction signal from the movement-responsive sensor.
According to another example embodiment, the present invention is directed to a video communication system having a remotely-controlled camera. The system includes a first video communication terminal having a first computer arrangement for processing data including video data. The data is communicated over a communications channel. The first video communication terminal further includes a camera configured and arranged to capture images of a view. The captured images are processed as data by the first computer arrangement for transfer over the communications channel. The first computer arrangement is configured and arranged to transfer data, in response to a control signal received over the communications channel, representing an altered view being captured by the camera. The system further includes a second video communication terminal including a display and a movement-responsive sensor configured and arranged to generate a direction signal in response to corresponding movement of the display. The second terminal further includes a second computer arrangement for processing data, including video data, for communicatively coupling with the first video communication terminal over the communication channel. The second computer arrangement is configured and arranged to respond to the movement-responsive sensor by sending the control signal to the first video communication terminal over the communications channel.
According to another embodiment, the present invention is directed toward a video communication system having a camera that is ostensibly remotely controlled with data manipulation at a remote terminal. The system includes a first video communication terminal having a first computer arrangement for processing data including video data. The data is communicated over a communications channel. The first video communication terminal further includes a camera configured and arranged to capture images of a view. The captured images are processed as data by the first computer arrangement for transfer over the communication channel. The system further includes a second video communication terminal including a display and a movement-responsive sensor configured and arranged to generate a direction signal in response to corresponding movement of the display. The second terminal further includes a second computer arrangement for processing data, including video data, for communicatively coupling with the first video communication terminal over the communications channel. The second computer arrangement is configured and arranged to store video data received over the communications channel and to respond to the movement-responsive sensor by changing data being sent to the display such that only a portion of the stored video data is displayed.
According to other, more specific, example embodiments, the present invention is directed to the second video communication terminal including a movement-responsive sensor and a display physically coupled to the movement-responsive sensor. The movement-responsive sensor generates a direction signal in response to corresponding movement of the display. The second video communication terminal further includes a second computer arrangement for processing data, including video data, for communicatively coupling with the first video communication terminal over the communications channel. At least one of the first and second computer arrangements is configured and arranged to alter data being sent to the display in response to the direction signal from the movement-responsive sensor.
According to another example embodiment, the present invention is directed toward a method for communication. Video data is gathered via a first communication terminal having a first computer arrangement for processing data including video data. The video data is transferred over a communications channel. The video data is received via a second communication terminal having a display and a second computer arrangement for processing data including video data. The second communication terminal is coupled communicatively with the first communication terminal over the communications channel. Movement of the display is detected via a movement-responsive sensor configured and arranged to generate a direction signal in response to corresponding movement of the display. A direction signal is generated in response to the movement of the display. The video data is altered responsive to the direction signal from the movement-responsive sensor.
The above summary of the present invention is not intended to describe each illustrated embodiment or every implementation of the present invention. The figures and detailed description with follow more particularly exemplify these embodiments.
The invention may be more completely understood in consideration of the following detailed description of various embodiments of the invention in connection with the accompanying drawings, in which:
While the invention is amenable to various modifications and alternative forms, specifics thereof have been shown by way of example in the drawings and will be described in detail. It should be understood, however, that the intention is not to limit the invention to the particular embodiments described. On the contrary, the intention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the invention as defined by the appended claims.
The present invention is believed to be applicable to a variety of different types of video communication systems, and the invention has been found to be particularly advantageous in video communication applications requiring, or benefiting from, pan, tilt and/or zoom camera-control functions for the display of such images at a remote video communication site. In connection with the present invention, it has been discovered that users have a natural tendency to attempt to adjust the view at the remote video communication site, by moving the display at the local site. The present invention addresses such intuitive control of video images at the remote video communication site. An appreciation of various aspects of the invention is best gained through a discussion of various application examples operating in such an environment.
According to an example embodiment,
The movement-responsive senor may, for example, include a transducer, such as a position transducer or a displacement transducer. In another example embodiment, the movement-responsive sensor may include a piezoelectric crystal. In still another example embodiment, the movement-responsive sensor may include pressure-sensitive or conductive thin-film substance, modified to include direction detection such as the center of a lap-top computer's finger-controlled mouse, such as the TMS920 touchpad module available from Cirque Corp. of Salt Lake City, Utah.
The communications system 130 may include one or more communication methods. For instance, the communications system may include communication using digital or analog signals. The system may also include a wireless method of communication, such as radio frequency communications. In addition, the communications system may include a wired communication. Such communication may take place using a system such as a plain-old-telephone system (POTS), or such as an ISDN line. Another example communications system may include the Internet. According to another example embodiment of the present invention, the video data displayed is altered responsive to the direction signal. For instance, the second computer arrangement may be configured and arranged to store video data received over the communications channel. Only a portion of the video data is displayed, responsive to the direction signal. In addition, the first computer arrangement may be configured and arranged to transfer data representing an altered view being captured by the camera, in response to a control signal received over the communications channel. According to another example embodiment, the view being captured may be altered by mechanical means at the camera, responsive to the direction signal. Altering the video display may, for example, have the effect of paneling, tilting, and/or zooming (zooming in and/or zooming out).
According to another example embodiment, the movement-responsive sensor may be physically coupled to the display. The movement-responsive sensor is configured and arranged to generate a direction signal responsive to movement of the display.
In another embodiment, a supporting member is physically coupled to the display at the video communication terminal. The supporting member may, for example, include components such as suspension members, rigid members, flexible members, a display base, and multiaxis support member systems such as an articulating arm. The movement-responsive sensor is coupled to sense movement of the supporting member relative to the display. For instance, the movement-responsive sensor may be coupled to the display itself. In another instance, the movement-responsive sensor may be coupled to the supporting member.
According to another example embodiment of the present invention, the first video communication terminal further includes a display. A movement-responsive sensor is configured and arranged to generate a direction signal in response to corresponding movement of the display. The direction signal is communicatively coupled with the communications channel. In addition, the second video communications terminal may further include a camera configured and arranged for capturing images of a video, according to another example embodiment of the present invention. The captured images are processed as data by the second computer arrangement for transfer over the communications channel.
In addition to video data, and according to another example embodiment of the present invention, the first video communication terminal further includes a microphone configured and arranged to gather audio. The audio is processed as data by the first computer arrangement for transfer over the communications channel. The second computer arrangement further is configured and arranged to process audio data. Similarly, the second video communication terminal may further include a microphone configured and arranged to gather audio, according to another example embodiment. The audio is processed as data by the second computer arrangement for transfer over the communications channel. The first computer arrangement further is configured and arranged to process audio data.
In another example embodiment, the video communications system further includes a third video communication terminal. The terminal has a display and a movement-responsive sensor configured and arranged to generate a direction signal in response to corresponding movement of the display. A third computer is configured and arranged for processing data including video data, and for communicatively coupling with the first video communication terminal over the communications channel. The first computer arrangement is configured and arranged to electronically alter data being sent to the third video communication terminal in response to the direction signal from the movement-responsive sensor at the third video communications terminal. The first computer arrangement is further configured and arranged to electronically alter data being sent to the display at the second video communication terminal in response to the direction signal from the movement-responsive sensor at the second video communications terminal. For instance, electronically altering the data may include electronically altering the data in a different manner according to the direction signal received from each terminal.
In another related example embodiment, the video communications system includes the camera being integral with the display, wherein in response to the display being moved, information reported in response to the movement sensor is used by the local image processor/camera (or remote image processor/camera) to readjust the local view for the remote display. This is accomplished, of course, using one or more of the image manipulation methods discussed herein.
In certain applications, the display and the movement-responsive sensor can be configured and arranged as a single unit, such as a TouchScreen, one of which is a Pixel 13M20 CRT available from PixelTouch, Inc. of Ontario, Canada.
Referring again to
In
The example implementation of
In one implementation, the peripheral unit 170 includes a speakerphone-used directional speaker and microphone arrangement 172 and a key-based control pad 174. The speakerphone-used directional speaker and microphone arrangement can be implemented, for example, using a 1½ inch by 1¾ inch speaker (such as the NB04301-01 model available from Star Electronics, Inc.), and a 25-inch wire microphone assembly (M118HC-P81, available from MWM Acoustics, L.L.C.), with the video processor arrangement for processing the audio implemented within the housing 150. In another implementation, the peripheral unit 170 is implemented using a SP12 Speakerphone available from 8×8, Inc., and the arrangement including the housing 150 and the base unit 152 is implemented using a VC150 or VC160 ViaTV Videophone available from 8×8, Inc., with modifications to provide for the sensors described according to one of the embodiments above.
As an enhancement to the above operations, one or both of the video terminals can further include automatic adjustment capability to reposition the camera view after the local display 160 is moved with the housing 150. Moving the housing 150, (which includes both the local display and the camera 154), causes the local camera 154 to move. This, in turn, can trigger a pan movement of the display thereby causing the local camera 154 to transmit an image centered away from the user rather than centering on the user's face, as is typically desired in a single user video communication call. This problem is overcome by automatically adjusting the display viewed at the remote terminal using the previously-discussed manipulation of displaying a repositioned view of a larger view as captured and internally processed by the local or remote camera for the display at the remote terminal. Such an implementation is also advantageous as a general face-tracking feature whether the view repositioning is due to movement of the housing/display or due to the movement of the user.
For information regarding use of a peripheral device 170 for controlling the graphics and other aspects of the terminal 110′ of
Turning now to
In another implementation, also according to an example application of the present invention, the display is manipulated by rotating the display in a clockwise or counter clockwise direction to provide an image rotation view. Rotating the display, or applying a consistent pressure that is detected by the movement sensor for a predetermined period of time, permits the view to rotate a desired amount, for example, 20 degrees, 45 degrees, or even full 360 degrees.
Yet another specific embodiment, which may be used to incorporate the general operation flows described above, is directed to processor-based controller arrangement including both RISC and DSP computer architectures. Using an arrangement of this type, a more compact video communications device can be realized with a single unit combining the camera and processor-control functions, or alternatively, with a single unit combining the display, camera and all processor-control functions. Specifically, by incorporating this technology into a stand-alone unit, such as one of the ViaTV units available from 8×8, Inc., the operational flow depicted in the above-characterized embodiments can be implemented without any moving parts, except for the movement sensor that is built into the display. For more information regarding computer-architectures of this type, reference may be made to U.S. Pat. Nos. 5,379,351 and 5,339,076, and application Ser. No. 09/095,448, entitled “Videocommunicating Device with an On-Screen Telephone Keypad User-Interface Method and Arrangement,” filed on Jun. 1, 1998, each of which is incorporated herein by reference and assigned to 8×8, Inc. of Santa Clara, Calif., and to chip-set based products available from 8×8, Inc. including the VC150 or VC160 desktop (with or without the speakerphone).
While the present invention has been described with reference to several particular example embodiments, those skilled in the art will recognize that many changes may be made thereto without departing from the spirit and scope of the present invention. For example, the skilled artisan will recognize that various functional and structural combinations of the above embodiments permit various advantages; among others, such advantages include added control of image presentation and added control over which camera (local or remote) is actually causing the changed images. The scope of the invention is set forth in the following claims.
Martin, Bryan R., Barraclough, Keith
Patent | Priority | Assignee | Title |
10076109, | Feb 14 2012 | NOBLE RESEARCH INSTITUTE, LLC | Systems and methods for trapping animals |
10470454, | Feb 14 2012 | NOBLE RESEARCH INSTITUTE, LLC | Systems and methods for trapping animals |
10674900, | Mar 28 2008 | Intuitive Surgical Operations, Inc. | Display monitor control of a telesurgical tool |
11076748, | Mar 28 2008 | Intuitive Surgical Operations, Inc. | Display monitor control of a telesurgical tool |
9237743, | Apr 18 2014 | NOBLE RESEARCH INSTITUTE, LLC | Systems and methods for trapping animals |
9668467, | Apr 18 2014 | NOBLE RESEARCH INSTITUTE, LLC | Systems and methods for trapping animals |
Patent | Priority | Assignee | Title |
5339076, | Apr 27 1992 | CITICORP USA, INC , AS ADMINISTRATIVE AGENT; CITIBANK, N A , AS ADMINISTRATIVE AGENT | Data compression using content addressable memory |
5379351, | Feb 19 1992 | CITICORP USA, INC , AS ADMINISTRATIVE AGENT; CITIBANK, N A , AS ADMINISTRATIVE AGENT | Video compression/decompression processing and processors |
5657246, | Mar 07 1995 | Cisco Technology, Inc | Method and apparatus for a video conference user interface |
5745161, | Aug 30 1993 | Canon Kabushiki Kaisha | Video conference system |
6313864, | Mar 24 1997 | OLYMPUS OPTICAL CO , LTD | Image and voice communication system and videophone transfer method |
6704048, | Aug 27 1998 | Polycom, Inc | Adaptive electronic zoom control |
JP406351010, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Mar 27 2003 | 8×8, Inc. | (assignment on the face of the patent) | / |
Date | Maintenance Fee Events |
Sep 21 2012 | M1553: Payment of Maintenance Fee, 12th Year, Large Entity. |
Date | Maintenance Schedule |
Feb 09 2013 | 4 years fee payment window open |
Aug 09 2013 | 6 months grace period start (w surcharge) |
Feb 09 2014 | patent expiry (for year 4) |
Feb 09 2016 | 2 years to revive unintentionally abandoned end. (for year 4) |
Feb 09 2017 | 8 years fee payment window open |
Aug 09 2017 | 6 months grace period start (w surcharge) |
Feb 09 2018 | patent expiry (for year 8) |
Feb 09 2020 | 2 years to revive unintentionally abandoned end. (for year 8) |
Feb 09 2021 | 12 years fee payment window open |
Aug 09 2021 | 6 months grace period start (w surcharge) |
Feb 09 2022 | patent expiry (for year 12) |
Feb 09 2024 | 2 years to revive unintentionally abandoned end. (for year 12) |