A preferred embodiment of a video conferencing system that may employ a video camera capable of capturing a view approximating 360 degrees, a viewing screen positioned to allow natural eye contact between conference participants, and a processing module capable of receiving and processing multiple data streams from video and audio capturing devices as well as data streams from other sources. In some embodiments, the video camera may be mounted above or below the viewing screen to capture an approximately 360 degree view of all locally appearing participants as well as the surrounding conference environment. The video conferencing system allows multiple participants participating from a single location to communicate easily and maintain natural eye contact with one another while maintaining eye contact with persons appearing from remote locations.
|
1. A video conferencing system comprising:
a translucent viewing screen configured for positioning between at least two local participants said participants located on opposing sides of said viewing screen and further configured to show one or more videoconference images to the at least two local participants;
a portable projection apparatus configured to project the images onto the viewing screen from one of said opposing sides and wherein said videoconference images are viewable from both of said opposing sides;
a video camera or cameras having a combined viewable perspective approximating 360 degrees mounted adjacent to the viewing screen; and
a processing module configured for receiving, processing and transmitting audio and images from the 360 degree camera as well as processing audio and videoconference images received from remote locations via network or other transmission means.
10. A method for video conferencing comprising the steps of:
positioning a translucent viewing screen between participants;
positioning a 360 degree camera directly above or below the viewing screen;
capturing data from the 360 degree camera;
receiving data transmitted via network from one or more remote locations;
processing data received from the 360 degree camera and data transmitted from one or more remote locations;
displaying data images received from one or more remote locations on the viewing screen utilizing a portable projector positioned on one side of the translucent viewing screen, said projector and viewing screen configured to present the projected data image to participants located on two opposing sides of the translucent viewing screen; and
transmitting data images received from the 360 degree camera to one or more remote locations via network or other transmission means.
12. A video conferencing system comprising:
a housing confirming to the general shape of a portable computer;
a translucent display coupled to the housing and configured to simultaneously present videoconference images from a remote videoconference location to at least two local participants located on opposing sides of said display;
a video camera mounted adjacent to the display and configured to capture an approximate 360 degree view of a local conference location corresponding to the local participants;
a processing module configured for receiving, processing and transmitting audio and videoconference images from the 360 degree camera as well as processing audio and videoconference images received from remote videoconference locations via network or other transmission means; and
a portable projector apparatus configured to project onto the display videoconference images from the remote videoconference location.
2. The video conferencing system of
3. The video conferencing system of
4. The video conferencing system of
7. The video conferencing system of
8. The video conferencing system of
9. The video conferencing system of
11. The method for video conferencing of
13. The video conferencing system of
14. The videoconferencing system of
15. The videoconferencing system of
|
This invention relates to video conferencing systems and, more specifically, to a system incorporating a camera capturing a perspective view of approximating 360 degrees, as well incorporating one or more viewing screens positioned to allow a more natural eye level viewing perspective of and between video conference participants.
Video conferencing is an established method of collaboration between remotely located participants. Such systems now enable audio and/or video conferencing of multiple parties over packet-switched networks, such as the Internet. Using these systems, participants may simultaneously transmit and receive audio and/or video data streams. Typically, a conference server receives audio and/or video streams from the various participating sources (cameras, general computer devices such as pc's and laptops, as well as other sources), mixes the streams and retransmits the mixed streams to conference participants appearing from a remote location. At the same time, the conference server receives audio and/or video streams from remote sources and projects them on one or more screens for viewing by locally appearing participants. These video conferencing systems implement software along with a variety of cameras, viewing screens and other audio/video capturing devices.
Most existing video conference systems utilize standard limited perspective video cameras which provide a very narrow field of view to the remote participant. Such cameras can be used effectively for video conferences between individuals. Many systems, for example, employ laptop computers having a single narrow field video camera attached to a flat back projection screen. Each participant sees the other participant on his/her own screen. But using such standard narrow field video cameras to capture multiple participants appearing in a single location can be problematic. For example, using a single standard camera in a conference room or class room with multiple participants makes it difficult for the remote participant to see all locally appearing participants clearly. And locally appearing participants will have to turn their heads away from the camera to communicate with one another. For this reason, several applications built for multiple participants appearing together employ multiple cameras. For example, some video conferencing systems employ a separate camera for each participant. Still, positioning of multiple cameras creates difficulty for those participants appearing together to communicate effectively with one another because they often need to be positioned side-by-side in order to be facing the camera and not in the round as they would be positioned at a conference table where they can easily see one another.
Most existing video conference systems also utilize standard flat display screens for viewing. For individuals appearing remotely, for example, laptop view screens are often utilized. This works reasonably well because individual participants are only communicating with one other remote participant—they don't need to communicate with other participants in a single location. But, in larger conference room or class room settings with multiple participants appearing in a single location, large flat display screens for viewing are often employed at a single location (for example, at one end of the room) for all to see. This is problematic because it requires participants to turn away from one another and toward the display (i.e. viewing) screen to see remotely appearing participants. Dedicated video conferencing centers will often position locally appearing participants side-by-side in front of one or more larger screen displays. This way they are more easily seen by remotely appearing participants, but they tend to have difficulty communicating with one another because they have to turn their heads toward one another to talk or pick up non-verbal gestures. In all, current systems create a very unnatural setting for participants appearing together.
Current video conferencing systems try to alleviate the problems. These systems tend to be expensive because they employ multiple cameras and multiple screens and/or they are difficult to set up. And it is common for many individuals and companies to employ larger dedicated conferencing centers for remote conferencing because the equipment is too expensive to own and/or they do not have the proper space for the equipment in their own offices. Further, video conferencing among multiple participants at a single natural informal setting (such as an outdoor setting) is rarely done because equipment is too heavy to move and carry.
Attempts have been made to utilize a 360 degree camera within video conferencing systems to allow broadcast of images showing multiple participants and/or contextual information to remote participants. For example, U.S. application Ser. No. 10/223,021, discloses a video conferencing system utilizing a 360 degree camera and video controller system which automates the process of determining the current speaker in virtual video teleconference by capturing and transmitting a 360 degree view as well as data suggesting the portion of the relevant 360 degree field of the current speaker. This gives the remote participant the opportunity to choose a preferred selected portion of the 360 degree view provided. The ability to select the view is the primary idea behind that system. While the system allows participants to sit together around a conference table, it still requires that they look away from one another and the camera in order to view the display screen.
Various 360 degree cameras have been deployed to enhance the video images broadcast to the remote user. For example, an omni-directional camera design for video conferencing is disclosed in U.S. Pat. No. 7,298,392 B2. The camera allows for higher pixel resolution to produce clearer images of meeting participants sitting or standing around a conference table or positioned in distant range. The system does not, again, solve the issue of participants having to turn their heads to look at a viewing screen placed at one or other sides of the conference table or room. And the application and camera design is expensive and complex in requiring that multiple images be stitched together before it is transmitted to the remote participant(s).
Attempts have also been made to enhance eye-contact between remote participants by utilizing cameras positioned behind see-through screens to more accurately capture a participant's face and align eye contact between remotely appearing participants. For example, U.S. patent application Ser. No. 11/496,805, discloses such a system employing one or multiple cameras which capture images of a participant through a see-through screen. The system does not account for multiple participants appearing in a single location. The camera is positioned on one side of the screen and the participant on the other. And the system is designed specifically to aid alignment of eyes between remotely appearing participants. There is no accommodation for enhancing communication between multiple participants appearing at a single location.
It is desirable, therefore, to have a video conferencing system which allows the positioning of the viewing screen and video camera such that conference participants may maintain natural eye contact with one another as well as with persons appearing from remote locations.
The problem of maintaining an video conferencing environment whereby multiple participants participating from a single location can communicate easily and maintain natural eye contact with one another while maintaining eye contact with persons appearing from remote locations is solved by the present system incorporating a viewing screen positioned to allow natural eye contact between participants and a camera which captures an approximate 360 degree view of the participants and conference room environment.
A preferred embodiment employs a video camera capable of capturing a view approximating 360 degrees, a viewing screen positioned to allow natural eye contact between conference participants, and a processing module capable of receiving and processing multiple data streams from video and audio capturing devices (such as video cameras) as well as data streams from other sources (such as pc's or laptops). In some embodiments, the video camera may be mounted above or below the viewing screen to capture an approximately 360 degree view of all locally appearing participants as well as the surrounding conference environment. The viewing screen may be portable and translucent to allow viewing from all sides. The processing module may stand alone or may be contained within the camera device and capable of receiving, processing and transmitting data streams received from multiple sources including the 360 degree camera, other video/audio transmitting devices (such as other video cameras, pc's or laptops) and data streams received from remote locations via network. The processing module may also be capable of selecting and transmitting data streams to be projected onto the viewing screen as well as transmitted to remote participants via a network. In such preferred embodiment, a portable projection camera may be employed to project images onto the translucent screen which can be seen from all sides by conference participants.
The inventive conferencing system allows multiple participants appearing at a single conference location to be positioned more naturally within a conference setting, such as around a conference table, so that they may easily maintain eye contact with one another as well as with the images on the viewing screen. Images of remote participants may be received and displayed on the viewing screen near the video camera such that participants may make more natural eye contact with participants appearing remotely. Further, persons appearing remotely may be provided with a view approximating 360 degrees which includes images of conference participants as well as the conference environment.
Reference will now be made in detail to various embodiments in accordance with the invention, examples of which are illustrated in accompanying drawings. While the invention will be described in conjunction with various embodiments, it will be understood that these various embodiments are not intended to limit the invention. On the contrary, the invention is intended to cover alternatives, modifications and equivalents, which may be included within the scope of the invention as construed according to the Claims. Furthermore, in the following detailed description of various embodiments in accordance with the invention, numerous specific details are set forth in order to provide a thorough understanding of the invention. However, it will be evident to one of ordinary skill in the art that the invention may be practiced without these specific details. In other instances, well known methods, procedures, components, and circuits have not been described in detail that would unnecessarily obscure aspects of the invention.
In the embodiment demonstrated in
As shown in
As shown in
Note that in one embodiment of the system illustrated in
By utilizing a single translucent viewing screen 102, as depicted in
In alternative embodiments, the single translucent viewing screen as shown in
As previously noted, the embodiment shown in
Within the embodiment of the video system 100 as shown, it is noted that the processing module 140 is capable of performing a wide variety of functions. For example in various embodiments, the processing module 140 can determine, select and/or activate which image received from the variety of image capturing devices is projected onto the viewing screen and in which position such images appear on the screen. Furthermore, in various embodiments, the processing module 140 is capable of receiving, recording, and/or transmitting the captured audio and video streams output by each of the audio/video capturing devices (104, 108). Moreover, in various embodiments, the processing module 140 can perform operations associated with the different utilizations for the elements of the video conferencing system 100, described herein. It is appreciated that the processing module 140 can be implemented as software located on a general purpose computer (such as a pc or laptop) or implemented as a processing chip housed within the camera 104, or other device 108, but is not limited to such.
Within
Within
As shown in
The method depicted in
Specifically, the method as described by
At step 1 (see reference number 502), the viewing screen 102 is positioned between locally appearing participants 120 to allow more natural eye contact and communication. The conference can take place in a variety of settings including office settings (such as at a conference table or desk) or in outdoor settings (such as on a lawn, picnic table, or other place where people can meet together).
At step 2 (504), a plurality of video capturing devices can be established or set up at or near the viewing screen 102. However, the 360 degree camera 104 is positioned to be capable of capturing audio as well as video images of each of the one or more participants appearing together in this single location. In various embodiments, the positioning of the 360 degree camera 104 can be based on the number of participants appearing together and/or the amount of contextual information relevant to the communications between participants.
At step 3 (506), the processing module can be part of a laptop or other computing device or can be located on a chip that is part of the camera or projector, or it can be separate from any other component. The video controller receives input from the various system components as well as from the remote participant and controls output of audio, video and other images.
At step 4 (508), the audio and video images 122 received from the 360 degree camera 104 and/or other sources 108 is processed by the video controller. The locally appearing participants 120 may select the content that is to be projected onto the screen and organize the playback of sound and display of images in a way that is most effective for communication with remote participants by use of software.
At step 5 (510), the data (including images and audio) received from various sources including the 360 degree camera 104, other video and audio capturing devices 108, video and/or audio streams 132 received from remote participants 130 are processed by the audio/video processing system 140.
At step 6 (512), the images received from the 360 degree camera 104 and other sources 108 as well as the audio and video images 132 received from remote participants 130 are projected onto the viewing screen 102.
At step 7 (514), the audio and/or video images 122 captured by the 360 degree camera 102 as well as other sources 108 are transmitted to remote participants 130 using a network (such as the Internet) or other transmission means such as through phone lines or wireless means.
The foregoing descriptions of various specific embodiments in accordance with the invention have been presented for purposes of illustration and description. They are not intended to be exhaustive or to limit the invention to the precise forms disclosed, and obviously many modifications and variations are possible in light of the above teaching. The invention can be construed according to the Claims and their equivalents.
Patent | Priority | Assignee | Title |
10009389, | Jan 03 2007 | Cisco Technology, Inc. | Scalable conference bridge |
10084665, | Jul 25 2017 | Cisco Technology, Inc | Resource selection using quality prediction |
10091348, | Jul 25 2017 | Cisco Technology, Inc | Predictive model for voice/video over IP calls |
10225313, | Jul 25 2017 | Cisco Technology, Inc | Media quality prediction for collaboration services |
10291597, | Aug 14 2014 | Cisco Technology, Inc. | Sharing resources across multiple devices in online meetings |
10291762, | Dec 04 2015 | Cisco Technology, Inc. | Docking station for mobile computing devices |
10334208, | Feb 21 2017 | Cisco Technology, Inc. | Technologies for following participants in a video conference |
10375125, | Apr 27 2017 | Cisco Technology, Inc | Automatically joining devices to a video conference |
10375474, | Jun 12 2017 | Cisco Technology, Inc.; Cisco Technology, Inc | Hybrid horn microphone |
10404481, | Jun 06 2017 | Cisco Technology, Inc. | Unauthorized participant detection in multiparty conferencing by comparing a reference hash value received from a key management server with a generated roster hash value |
10440073, | Apr 11 2017 | Cisco Technology, Inc. | User interface for proximity based teleconference transfer |
10477148, | Jun 23 2017 | Cisco Technology, Inc.; Cisco Technology, Inc | Speaker anticipation |
10515117, | Feb 14 2017 | Cisco Technology, Inc. | Generating and reviewing motion metadata |
10516707, | Dec 15 2016 | Cisco Technology, Inc. | Initiating a conferencing meeting using a conference room device |
10516709, | Jun 29 2017 | Cisco Technology, Inc.; Cisco Technology, Inc | Files automatically shared at conference initiation |
10542126, | Dec 22 2014 | Cisco Technology, Inc.; Cisco Technology, Inc | Offline virtual participation in an online conference meeting |
10574609, | Jun 29 2016 | Cisco Technology, Inc | Chat room access control |
10592867, | Nov 11 2016 | Cisco Technology, Inc. | In-meeting graphical user interface display using calendar information and system |
10623576, | Apr 17 2015 | Cisco Technology, Inc. | Handling conferences using highly-distributed agents |
10706391, | Jul 13 2017 | Cisco Technology, Inc. | Protecting scheduled meeting in physical room |
10771621, | Oct 31 2017 | Cisco Technology, Inc.; Cisco Technology, Inc | Acoustic echo cancellation based sub band domain active speaker detection for audio and video conferencing applications |
10778656, | Aug 14 2014 | Cisco Technology, Inc. | Sharing resources across multiple devices in online meetings |
11019308, | Jun 23 2017 | Cisco Technology, Inc. | Speaker anticipation |
11227264, | Nov 11 2016 | Cisco Technology, Inc. | In-meeting graphical user interface display using meeting participant status |
11233833, | Dec 15 2016 | Cisco Technology, Inc. | Initiating a conferencing meeting using a conference room device |
11245788, | Oct 31 2017 | Cisco Technology, Inc. | Acoustic echo cancellation based sub band domain active speaker detection for audio and video conferencing applications |
11444900, | Jun 29 2016 | Cisco Technology, Inc. | Chat room access control |
11777797, | Jan 29 2021 | Zoom Video Communications, Inc. | Method and apparatus for device management |
9426422, | Nov 25 2014 | PayPal, Inc | Multi-display video conferencing |
9917866, | Sep 22 2013 | Cisco Technology, Inc. | Arrangement of content on a large format display |
9942519, | Feb 21 2017 | Cisco Technology, Inc. | Technologies for following participants in a video conference |
9948786, | Apr 17 2015 | Cisco Technology, Inc.; Cisco Technology, Inc | Handling conferences using highly-distributed agents |
9998508, | Sep 22 2013 | Cisco Technology, Inc. | Multi-site screen interactions |
Patent | Priority | Assignee | Title |
5953053, | Sep 02 1998 | Google Technology Holdings LLC | Teleconference system with visual display terminal |
7209160, | Sep 20 1995 | Videotronic Systems | Versatile teleconferencing eye contact terminal |
8390718, | Jan 28 2009 | Hewlett-Packard Development Company, L.P. | Methods and systems for performing visual collaboration between remotely situated participants |
8489149, | Apr 24 2007 | LG Electronics Inc. | Video communication terminal and method of displaying images |
20040257473, | |||
20090122951, | |||
20100188478, | |||
20100315481, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Sep 17 2010 | LEOW, CHON HOCK | CREATIVE TECHNOLOGY LTD | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 025085 | /0492 | |
Sep 17 2010 | BUI, THINH | CREATIVE TECHNOLOGY LTD | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 025085 | /0492 | |
Oct 01 2010 | CREATIVE TECHNOLOGY LTD | (assignment on the face of the patent) | / |
Date | Maintenance Fee Events |
Jul 28 2017 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
Jan 15 2021 | SMAL: Entity status set to Small. |
Jul 28 2021 | M2552: Payment of Maintenance Fee, 8th Yr, Small Entity. |
Date | Maintenance Schedule |
Jan 28 2017 | 4 years fee payment window open |
Jul 28 2017 | 6 months grace period start (w surcharge) |
Jan 28 2018 | patent expiry (for year 4) |
Jan 28 2020 | 2 years to revive unintentionally abandoned end. (for year 4) |
Jan 28 2021 | 8 years fee payment window open |
Jul 28 2021 | 6 months grace period start (w surcharge) |
Jan 28 2022 | patent expiry (for year 8) |
Jan 28 2024 | 2 years to revive unintentionally abandoned end. (for year 8) |
Jan 28 2025 | 12 years fee payment window open |
Jul 28 2025 | 6 months grace period start (w surcharge) |
Jan 28 2026 | patent expiry (for year 12) |
Jan 28 2028 | 2 years to revive unintentionally abandoned end. (for year 12) |