An enhanced communication and voicemail solution for mobile phones is described where still images and/or video clips are injected into the voice stream creating a “video-voice” call. When a receiving party is not available to take a video-voice call, this combined stream of voice and image information is stored at the mobile service provider in a manner similar to voice mail today. Then, stored video-voicemails may be retrieved at a later time by the receiving party. Also, realtime video-voice conversations may be recorded for later retrieval in order to document the conversation or because a party in the conversation is not able to view the images realtime.
While the sending party may use a normal size mobile phone containing a miniature digital camera, the receiving party may view video-voicemail images on a variety of devices including a wireless mobile phone or PDA, or alternately a conventional PC connected to the World Wide Web.
|
0. 34. A method, comprising:
receiving a continuous voice stream with a plurality of intermittently attached video clips at a mobile service provider by way of wireless cellular communication from a wireless communication device;
transmitting the continuous voice stream and the plurality of intermittently attached video clips from the mobile service provider for viewing;
recording the continuous voice stream and the plurality of intermittently attached video clips at the mobile service provider; and
wherein an initial position of a video clip of the plurality of intermittently attached video clips is maintained in time relative to the continuous voice stream throughout the receiving, the transmitting, and the viewing.
0. 12. A method, comprising:
receiving, from a wireless communication device at a mobile service provider by way of cellular wireless communications during a conversation, a first continuous voice stream comprising a plurality of intermittently attached video clips wherein an initial position of a video clip of the plurality of intermittently attached video clips is maintained in time relative to the first continuous voice stream;
transmitting, from the mobile service provider by way of a network, the first continuous voice stream wherein the initial position of the video clip is maintained in time relative to the first continuous voice stream; and
recording, by the mobile service provider, the first continuous voice stream.
0. 23. A system for transferring a continuous voice stream comprising:
a mobile service provider configured to:
receive a first voice stream associated with a plurality of intermittently attached video clips and a plurality of still images by way of wireless cellular communication from a wireless communication device, and
transmit the first voice stream associated with the plurality of intermittently attached video clips and the plurality of still images by way of a network;
a storage system at the mobile service provider configured to:
record the first voice stream, the plurality of intermittently attached video clips, and the plurality of still images,
maintain an initial position in time of the first voice stream, a video clip of the plurality of intermittently attached video clips, and a still image of the plurality of still images, and
delete information for a conversation; and
wherein the initial position of the video clip and still image is maintained in time relative to the first voice stream.
0. 1. A method for transferring video, voice, and still image information during a realtime conversation, wherein video clips and still images are captured by a calling party on a capturing device, said video clips and still images being interspersed in time and combined with a stream of voice information (hereinafter “the voice stream”) captured by a wireless communication device, and comprising the steps of:
capturing, from time to time during a realtime conversation, video clips and still images utilizing a digital camera contained within or attached to said wireless communication device;
transmitting said video clips and still images together with and synchronized with the voice stream such that the initial position of each video clip and still image in time relative to the voice stream is maintained;
receiving by a receiving party, on a receiving device having a display and at a remote location and in realtime, said voice stream combined with said video clips and still images, where the initial position in time of each video clip and still image relative to the voice stream is maintained; and where video clips and still images are displayed alternately on the same display; and where the displayed image of each still image or the last frame of a video clip displayed on said receiving device persists until a different still image or video clip arrives in the voice stream, or until otherwise terminated; and
storing, at a mobile service provider for retrieval at a later time, said realtime conversation including the voice stream combined with said video clips and still images, while preserving the relationship in time between voice, video and still image information.
0. 2. The method of
0. 3. The method of
0. 4. A communication system, including a calling party and a receiving party communicating via a mobile service provider, including:
at least one wireless communication device capable of bi-directional voice communication and containing a digital camera, said wireless communication device capable of capturing and transmitting from the calling party to said mobile service provider, video clips and high resolution still images together with and synchronized with a stream of voice information (hereinafter “the voice stream”), said video clips and still images being interspersed in time and where the initial position of each video clip and high resolution still image in time relative to the voice stream is maintained; and
at least one receiving device operable by said receiving party, said receiving device having a display and being capable of receiving synchronized voice, video clip, and high resolution still image information from said mobile service provider, either through a wireless connection or through the World Wide Web, and where each video clip and still image is displayed on said receiving device such that the initial position in time of each video clip and still image when displayed, is maintained relative to the voice stream; and where video clips and still images are displayed alternately on the same display; and where the most recent still image or the last frame of the most recent video clip, whichever occurred most recently, continues to be displayed on the receiving device's display until a different image or video clip arrives in the voice stream, or until otherwise terminated; and
where a realtime conversation including voice, video clip and still image information transmitted by said wireless communication device is stored at said mobile service provider in response to decision indications supplied by both the calling parting and the receiving party during said conversation, said video clip and still image information being stored together with and synchronized with the voice stream.
0. 5. A communication system for communicating between two parties via a mobile service provider, video clip and high resolution still image information together with and synchronized with a stream of voice information (hereinafter “the voice stream”), where video clips and high resolution still images are interspersed in time and where the initial position in time of each video clip and high resolution still image in the voice stream is maintained, including:
at least one communication device capable of transmitting from a calling party to said mobile service provider, voice information, video clips, and high resolution still images together with and synchronized with the voice stream; and
at least one receiving device having a display and capable of receiving at a receiving party, synchronized voice, video clip, and still image information from said mobile service provider, either through a wireless connection or through the World Wide Web; and where each video clip and still image is displayed on said receiving device such that the initial position in time of each video clip and still image when displayed is maintained relative to the voice stream and where video clips and still images are displayed alternately on the same display; and where the displayed image of each still image or the last frame of a video clip displayed on said receiving device persists until a different still image or video clip arrives in the voice stream, or until otherwise terminated; and
a storage system at said mobile service provider for storing said voice information, video clips, and high resolution still images while maintaining the initial position in time of said video clips and high resolution still images in the voice stream; and
where information communicated from a calling party is optionally recorded for retrieval at a later time if the receiving party decides, during a realtime conversation, that said information should be recorded.
0. 6. A communication system for communicating between two parties via a mobile service provider, video clip and high resolution still image information together with and synchronized with a stream of voice information (hereinafter “the voice stream”), where video clips and high resolution still images are interspersed in time and where the initial position in time of each video clip and high resolution still image in the voice stream is maintained, including:
at least one communication device capable of transmitting from a calling party to said mobile service provider, voice information, video clips, and high resolution still images together with and synchronized with the voice stream; and
at least one receiving device having a display and capable of receiving at a receiving party, synchronized voice, video clip, and still image information from said mobile service provider, either through a wireless connection or through the World Wide Web; and where each video clip and still image is displayed on said receiving device such that the initial position in time of each video clip and still image when displayed is maintained relative to the voice stream; and where video clips and still images are displayed alternately on the same display; and where the displayed image of each still image or the last frame of a video clip displayed on said receiving device persists until a different still image or video clip arrives in the voice stream, or until otherwise terminated; and
a storage system at said mobile service provider for storing said voice information, video clips, and high resolution still images while maintaining the initial position in time of said video clips and high resolution still images in the voice stream; and
where a receiving party may choose to have all incoming information recorded for retrieval at a later time, selectively deleting information for individual conversations at a later time.
0. 7. A communication system for communicating between two parties via a mobile service provider, video clip and high resolution still image information together with and synchronized with a stream of voice information (hereinafter “the voice stream”), where video clips and high resolution still images are interspersed in time and where the initial position in time of each video clip and high resolution still image in the voice stream is maintained, including:
at least one communication device capable of transmitting from a calling party to said mobile service provider, voice information, video clips, and high resolution still images together with and synchronized with the voice stream; and
at least one receiving device having a display and capable of receiving at a receiving party, synchronized voice, video clip, and still image information from said mobile service provider, either through a wireless connection or through the World Wide Web; and where each video clip and still image is displayed on said receiving device such that the initial position in time of each video clip and still image when displayed is maintained relative to the voice stream; and where video clips and still images are displayed alternately on the same display; and where the displayed image of each still image or the last frame of a video clip displayed on said receiving device persists until a different still image or video clip arrives in the voice stream, or until otherwise terminated; and
a storage system at said mobile service provider for storing said voice information, video clips, and high resolution still images while maintaining the initial position in time of said video clips and high resolution still images in the voice stream; and
where a receiving party may choose to have all incoming information from a particular calling party recorded for retrieval at a later time, selectively deleting information for individual conversations at a later time.
0. 8. A communication system for communicating between two parties via a mobile service provider, video clip and high resolution still image information together with and synchronized with a stream of voice information (hereinafter “the voice stream”), where video clips and high resolution still images are interspersed in time and where the initial position in time of each video clip and high resolution still image in the voice stream is maintained, including:
at least one communication device capable of transmitting from a calling party to said mobile service provider, voice information, video clips, and high resolution still images together with and synchronized with the voice stream; and
at least one receiving device having a display and capable of receiving at a receiving party, synchronized voice, video clip, and still image information from said mobile service provider, either through a wireless connection or through the World Wide Web; and where each video clip and still image is displayed on said receiving device such that the initial position in time of each video clip and still image when displayed is maintained relative to the voice stream; and where video clips and still images are displayed alternately on the same display; and where the displayed image of each still image or the last frame of a video clip displayed on said receiving device persists until a different still image or video clip arrives in the voice stream, or until otherwise terminated; and
a storage system at said mobile service provider for storing said voice information, video clips, and high resolution still images while maintaining the initial position in time of said video clips and high resolution still images in the voice stream; and
where a particular calling party and a particular receiving party may choose in advance to have all information, including voice, video clips and still images, exchanged between them during conversations recorded at said mobile service provider for retrieval at a later time.
0. 9. A method for transferring video, voice, and still image information during a realtime conversation, wherein video clips and still images are captured by a calling party on a capturing device, said video clips and still images being interspersed in time and combined with a stream of voice information (hereinafter “the voice stream”) captured by a wireless communication device, and comprising the steps of:
capturing, from time to time during a realtime conversation, video clips and still images utilizing a digital camera contained within or attached to said wireless communication device:
transmitting said video clips and still images together with and synchronized with the voice stream such that the initial position of each video clip and still image in time relative to the voice stream is maintained;
receiving by a receiving party, on a receiving device having a display and at a remote location and in realtime, said voice stream combined with said video clips and still images, where the initial position in time of each video clip and still image relative to the voice stream is maintained; and where video clips and still images are displayed alternately on the same display; and where the displayed image of each still image or the last frame of a video clip displayed on said receiving device persists until a different still image or video clip arrives in the voice stream, or until otherwise terminated; and
storing, at a mobile service provider for retrieval at a later time, said realtime conversation including the voice stream combined with said video clips and still images, while preserving the relationship in time between voice, video and still image information; and
where a particular calling party and a particular receiving party may choose in advance to have all information, including voice, video clips and still images, exchanged between them during conversations recorded at said mobile service provider for retrieval at a later time.
0. 10. A method for transferring video, voice, and still image information during a realtime conversation, wherein video clips and still images are captured by a calling party on a capturing device, said video clips and still images being interspersed in time and combined with a stream of voice information (hereinafter “the voice stream”) captured by a wireless communication device, and comprising the steps of: capturing, from time to time during a realtime conversation, video clips and still images utilizing a digital camera contained within or attached to said wireless communication device; and
transmitting said video clips and still images together with and synchronized with the voice stream such that the initial position of each video clip and still image in time relative to the voice stream is maintained; and
receiving, by a receiving party, on a receiving device having a display and at a remote location, either in realtime or retrieved from a video-voicemail storage system at a mobile service provider, said voice stream combined with and synchronized with said video clips and still images, where the initial position in time of each video clip and still image relative to the voice stream is maintained; and where video clips and still images are displayed alternately on the same display; and where the most recent still image or the last frame of the most recent video clip, whichever occurred most recently, continues to be displayed on the receiving device's display until a different image or video clip arrives in the voice stream, or until otherwise terminated; and
where a particular calling party and a particular receiving party may choose in advance to have all information, including voice, video clips and still images, exchanged between them during conversations recorded at said mobile service provider for retrieval at a later time.
0. 11. A communication system, including a calling party and a receiving party communicating via a mobile service provider, including:
at least one wireless communication device capable of bi-directional voice communication and containing a digital camera, said wireless communication device capable of capturing and transmitting from the calling party to said mobile service provider, video clips and high resolution still images together with and synchronized with a stream of voice information (hereinafter “the voice stream”), said video clips and still images being interspersed in time and where the initial position of each video clip and high resolution still image in time relative to the voice stream is maintained; and
at least one receiving device operable by said receiving party, said receiving device having a display and being capable of receiving synchronized voice, video clip, and high resolution still image information from said mobile service provider, either through a wireless connection or through the World Wide Web, and where each video clip and still image is displayed on said receiving device such that the initial position in time of each video clip and still image when displayed, is maintained relative to the voice stream; and where video clips and still images are displayed alternately on the same display; and where the most recent still image or the last frame of the most recent video clip, whichever occurred most recently, continues to be displayed on the receiving device's display until a different image or video clip arrives in the voice stream, or until otherwise terminated; and
where a particular calling party and a particular receiving party may choose in advance to have all information, including voice, video clips and still images, exchanged between them during conversations recorded at said mobile service provider for retrieval at a later time.
0. 13. The method of claim 12, further comprising:
receiving a second continuous voice stream by the mobile service provider by way of the network, the second continuous voice stream occurring contemporaneously with the first continuous voice stream; and
transmitting, from the mobile service provider by way of cellular wireless communications, the second continuous voice stream.
0. 14. The method of claim 13 wherein certain voice streams of the first and second continuous voice stream transferred in real time are stored in response to an agreement to store the certain voice streams.
0. 15. The method of claim 13 wherein the conversation comprising the plurality of video clips transferred in real time are stored in response to an agreement to store the conversation.
0. 16. The method of claim 13 wherein a plurality of still images are intermittently transmitted along with the first and second continuous voice stream and interspersed with the plurality of intermittently attached video clips, and
wherein certain voice streams of the first and second continuous voice stream, and the plurality of still images are transferred in real time and stored in response to an agreement to store the certain voice streams, and the plurality of still images.
0. 17. The method of claim 13 wherein a plurality of still images are intermittently transmitted along with the first and second continuous voice stream and interspersed with the plurality of intermittently attached video clips, and
wherein the conversation comprising the plurality of intermittently attached video clips and the plurality of still images are transferred in real time and stored in response to an agreement to store the conversation.
0. 18. The method of claim 12 wherein the first continuous voice stream is stored for retrieval at a later time.
0. 19. The method of claim 12 wherein the first continuous voice stream is stored in response to the first continuous voice stream not being able to be received in real time.
0. 20. The method of claim 12 wherein the first continuous voice stream further comprises a plurality of intermittently transmitted still images.
0. 21. The method of claim 20 wherein the first continuous voice stream is stored.
0. 22. The method of claim 20 wherein the first continuous voice stream is stored in response to the first continuous voice stream not being able to be received in real time.
0. 24. The system of claim 23, wherein the mobile service provider is further configured to receive a second voice stream by way of the network, the second voice stream occurring contemporaneously in time with the first voice stream; and
wherein the second voice stream is transmitted from the mobile service provider to the wireless communication device by way of cellular wireless communications.
0. 25. The system of claim 24, wherein certain voice streams of the first and second voice streams and certain video clips of the plurality of intermittently attached video clips are transferred in real time and stored in response to an agreement to store the certain voice streams and the certain video clips.
0. 26. The system of claim 24, wherein the conversation comprising the plurality of intermittently attached video clips is transferred in real time and stored in response to an agreement to store the conversation.
0. 27. The system of claim 24 wherein a plurality of still images are intermittently transmitted along with the first voice stream and interspersed with the plurality intermittently attached video clips, wherein certain voice streams of the first and second voice streams, certain video clips of the plurality intermittently attached video clips, and certain high resolution still images of the plurality of still images are transferred in real time from the wireless communication device and stored for retrieval in response to an agreement to store the certain voice streams, the certain video clips, and the certain high resolution still images.
0. 28. The system of claim 24 wherein a plurality of still images are intermittently transmitted along with the first voice stream and the plurality of intermittently attached video clips, and wherein a conversation comprising the plurality of intermittently attached video clips and the plurality of still images are transferred in real time from the wireless communication device and stored at the mobile service provider for retrieval in response to an agreement to store the conversation.
0. 29. The system of claim 23, wherein the first voice stream, the plurality of intermittently attached video clips, and the plurality of still images are stored.
0. 30. The system of claim 23, wherein the storage system is configured to store the first voice stream, the plurality of intermittently attached video clips, and the plurality of still images in response to the first voice stream, the plurality of intermittently attached video clips, and the plurality of still images not being able to be received in real time.
0. 31. The system of claim 23, wherein a plurality of still images are intermittently transmitted, along with the first voice stream and interspersed with the plurality of intermittently attached video clips from the wireless communication device.
0. 32. The system of claim 31, wherein the first voice stream and the plurality of still images are stored for retrieval.
0. 33. The system of claim 31, wherein the first voice stream and the plurality of still images are stored for retrieval in response to the first voice stream and the still images are not able to be received in real time.
0. 35. The method of claim 34 wherein the continuous voice stream and the plurality of intermittently attached video clips are stored for retrieval, and in response to the continuous voice stream and the plurality of intermittently attached video clips being retrieved, the initial position of the video clip in time relative to the continuous voice stream is maintained.
0. 36. The method of claim 34 wherein a plurality of still images are intermittently transferred and interspersed with the plurality of intermittently attached video clips, wherein an initial position of a still image of the plurality of still images and the initial position of the video clip are maintained in time relative to the continuous voice stream.
0. 37. The method of claim 36 wherein the continuous voice stream, the plurality of intermittently attached video clips, and the plurality of still images are stored for retrieval, and in response to the continuous voice stream, the video clips, and the plurality of still images being retrieved, the initial position of the video clips and the initial position of the plurality of still images are maintained in time relative to the continuous voice stream.
|
NOTICE: More than one reissue application has been filed for the reissue of U.S. Pat. No. 7,092,735. The reissue applications are: (1) this reissue application and (2) reissue application Ser. No. 12/228,650. In particular, this reissue application is a continuation reissue application of the parent reissue application Ser. No. 12/228,650 filed Aug. 13, 2008, now U.S. Pat. No. Re. 42,210.
This invention relates to the operation of mobile phone communication systems such as those including cellular phones or any form of mobile wireless communication device capable of voice communication, and in particular, enhancements to conventional realtime voice communications and voicemail storage and retrieval systems for mobile phones allowing the integration of still images and video clips.
Today, voicemail for mobile phones is simply that, storing voice messages when the receiving party is not available, to be retrieved at a later time. Essentially, voice mail for mobile phones operates in a very similar manner to voicemail for conventional office phones. To date, there has been no attempt to integrate images or video with voicemail for mobile phones or conventional office phones.
Communications between two parties where both voice and video are utilized is well known and is commonly referred to as video conferencing or teleconferencing. Sometimes this capability is also known as a “Net Meeting”. Here, a group of individuals, each having a computing device including microphone, speaker, video camera, and a connection to the World Wide Web, are able to communicate in a real-time manner through both video and voice mediums. The ultimate goal of a video conferencing system is to transmit a continuous stream of audio and video to and from each participant in the meeting or conversation, and to emulate as much as possible the interaction that would occur if all participants were in the same room. To do this, there will be compromises and limitations for many years to come relative to the desired functionality for video conferencing due to bandwidth limitations. In contrast to this goal and these compromises, the invention described herein uses existing bandwidth capabilities to selectively integrate images and video with voice communication in order to solve very specific and valuable problems. The manner in which this integration occurs has not been offered before.
The term “videomail” is often used in the industry, but in contrast to voice mail, does not refer to the storage of messages for later retrieval. Instead, it refers to attaching video clips to e-mails and a similar manner to the common practice of attaching files containing digital photographs to e-mails.
Cameras have, at times, been incorporated into mobile phones for surveillance purposes. Instead of broadcasting digital video via a data link with the mobile/cellular service provider, these phones broadcast an RF signal to a viewing receiver in the same manner as any other covert surveillance camera system.
Digital cameras are available as attachments to some PDAs (Personal Digital Assistants), some of which also are available with wireless connection to a service provider allowing accessibility to the World Wide Web. Some PDAs with wireless Web-interface capability can also function as mobile or cellular phones. Some mobile phones have added PDA capabilities, again with wireless Web-interface capability. Also, some mobile phones now have digital cameras available as options to allow pictures to be captured and attached to emails. However, none such devices offer the integration of still images or video with cellular voice communication or with voicemail for cellular phones following the existing paradigm of phone calls and voicemail messages.
A very successful capability offered by one cellular service provider (the Nextel Direct Connect® digital two-way radio service), allows frequent communications among a group of individuals who work closely together to be more convenient and less costly. As a result, this capability has been adopted by the majority of businesses that require frequent communications with individuals working at different locations in a local area, for the most part, businesses in the construction industry. This allows a manager, foreman, or responsible person to more easily keep track of the progress at a variety of locations, and more readily communicate to affect swift problem resolution. Unfortunately, these communications rely on the ability of the individuals involved to clearly describe situations and problems they observe in terms that the responsible person can understand in order to best make decisions and guide the remote workers. The ability for the responsible person to see the subject or problem area would significantly enhance the value of these communications.
A solution is needed that, given the bandwidth limitations of current and next generation cellular data transmission capability, provides an easy way for persons to communicate image and video information, while maintaining a communication paradigm that is familiar, basically the paradigm of phone calls and voicemails. Such a system would allow high resolution images to be transmitted when a high level of detailed is required, and alternately, video clips (which may be at lower resolutions) where spatial relationships and or motion information is required.
An enhanced communication and voicemail solution for mobile phones is described where still images and/or video clips are injected into the voice stream creating a “video-voice” call. When a receiving party is not available to take a video-voice call, this combined stream of voice and image information is stored at the mobile service provider in a manner similar to voice mail today. Then, stored video-voicemails may be retrieved at a later time by the receiving party. While the sending party may use a normal size mobile phone containing a miniature digital camera, the receiving party may view video-voicemail images on a variety of devices including a wireless mobile phone or PDA, or alternately a conventional PC connected to the World Wide Web.
Compared with continuous, full motion video, occasionally injecting a still image or video clip into the voice stream allows much higher resolution images to be sent given bandwidth limitations, allowing the receiving party to view a subject or situation in much greater detail. For use in business applications, conveniently viewing this more detailed information, synchronized with voice explanations, enables better decisions thereby saving time and money.
The present invention is described with respect to particular exemplary embodiments thereof and reference is accordingly made to the drawings in which:
A better way to communicate between persons operating at remote locations and a manager, advisor, or person in authority, would include interspersing images and/or video clips within the voice communication stream, whether or not it is real time or a voicemail message left for future retrieval. Such a solution utilizes video clips where they are most effective (even with reduced resolution)—conveying motion information, or alternately conveying spatial information of the subject area by way of a “Pan” motion with the camera. In addition, high resolution still images can be injected into the voicestream to allow a very detailed view of a particular subject or problem area, synchronized with a verbal description and other related discussion.
Many applications will benefit from this new capability, including the construction industry, the medical and care industry, field service and repair, building inspection, insurance adjusters, or any application where people need a convenient way to document situations at remote locations and make this information available to others. Another specific application that will benefit from video-voice communications is that of emergency situations. When someone calling 911 to report an emergency can also provide video clips and high resolution still images, a dispatcher or paramedic receiving the call can much better understand the situation and even instruct the caller in a way that may save lives.
In general, integrating this capability with the familiar paradigm of the mobile phone call and voicemail is most convenient and useful. As discussed earlier, it is known to attach digital photos and digital video clips to emails. Emails are inherently digital, so this attachment is natural. Emails are also not a realtime communications medium. However, it is not known to attach digital photos and digital video clips to voice communications, whether realtime or as stored messages.
Note that, throughout this specification, the terms “mobile phone”, “cellular phone”, and “wireless phone” are synonymous and refer to any mobile communications device capable of bi-directional voice communication.
If the receiving party is not available for realtime communications, a message may be stored at service provider 2 in database 3 designed to store voice, image, and video clip information while retaining the time relationships between the three. Per scenario 6, the retrieving party accesses previously stored voice, image, and video clip information directly from the service provider via some form of wireless phone device. Alternately, per scenario 5, the receiving party may access stored voice, image, and video clip information via the World Wide Web through either wired or wireless Web access. Although
For cellular voice communications today, real-time conversations are never recorded. Only voicemail messages are recorded. As relates to video-voice conversations, it is however useful to record real-time communications that contain either still images or video clips injected into the voice stream. This may be desired in order to document the visual information being conveyed as part of the conversation for later retrieval. It may also be desired when the receiving party answers a call and, as part of the conversation, subsequently realizes that images or video clips are being transferred, but can't properly or safely view them.
With the ability to have voicemail or video-voicemail messages stored at the mobile service provider retrieved via the World Wide Web, users can archive conversations, voicemail messages, and video-voicemail conversations and messages on their personal or business computer system. Today, there is not a convenient way to archive mobile voicemail messages.
If the receiving party is not in a position to view these images real-time, such as when driving a car, having the conversation recorded including all images will allow them to review the visual and audio information by retrieving the recorded message at a later time. Alternately, if the receiving party is driving or otherwise in a situation where viewing is inconvenient or impossible, it may be useful to have the ability to transfer a real-time conversation into video-voicemail, if the conversation reaches a point where it is meaningless to continue real-time without the receiving party being able to view the images or video clips. This capability may be implemented by always recording realtime video-voice conversations at the mobile service provider, and discarding the information at the end of the conversation if the receiving (or calling) party has not taken some action (like pressing some button) to initiate the saving of the video-voice conversation. Alternately, the user could set the default mode to be that of automatically saving conversations, deleting them later if not needed or deleting them after they have been downloaded via the Web and archived. A variation on this these would include automatically saving conversations from a particular calling party, and deleting them later if not needed or deleting them after they have been downloaded via the Web and archived. The accumulation of information resulting from these recording scenarios would require a much larger amount of memory for storing messages at the service provider, but if this is valuable, it is a service that users would be willing to pay extra for.
The scenarios just described can also be applied to recording realtime voice conversations for later retrieval and archive. Even archiving voice alone can be a powerful tool within business applications. For recording realtime conversations, the issue of permissions and privacy arises. One easy to handle the granting of “permission to be recorded” would be that permission is deemed to be given to record conversations from or to a particular phone number by calling from that particular phone number and taking a prescribed action which could include entering a specified code. It may instead be desired to record only video-voice conversations and not voice-only conversations, again with permissions having been given.
Although the essence and value of a video-voice conversation as described herein is bi-directional for voice communication, but mostly or solely unidirectional with regard to the transmission of video clips and still images, the methods described may in certain circumstances, be valuable in a bi-directional manner. For instance, a worker at a jobsite may send images to a supervisor at a remote location, and the supervisor may, in return, send an image of a portion of a blueprint while pointing out some specific details to resolve certain issues. Of course, this requires that the worker have a device with a display capable of presenting the blueprint image with enough resolution to properly discriminate the necessary information.
Another purpose for recording video-voice messages involves a reverse scenario where the supervisor/foreman/responsible party may wish to record information and instructions concerning a particular job site, such that the information and instructions may be viewed by workers at a later time before commencing work or as part of problem resolution during the job.
Notice in
If the integral camera and associated electronics are designed to allow either still images or video clips to be captured and transmitted, there are at least two methods of utilizing shutter button 8 to easily support both. In the first method, the button may be pressed briefly and released to record a still image, or pressed and held for a longer duration to enable a video clip to be transmitted during the duration of time for which the button is held. In the second method, button 8 may be partially depressed to capture a still image or fully depressed to capture a video clip. Alternately for each of the above methods, which button action captures still images and which captures video clips may be reversed. In addition to the methods just described for determining when video-clips are captured as opposed to still images, a more conventional method can always be utilized where the desired mode of capture is first selected through a key or combination of key presses on the phone's keypad, followed by pressing a “shutter” button.
Although this specification refers to transmitting both still images and video clips, an implementation may only deal with one of the two. If the bandwidth limitations are severe, occasionally injecting high resolution still images into the voicestream is probably more valuable than video clips. Eventually, when the available bandwidth is at a level where high resolution video clips can be easily sent via mobile communications, sending only video clips will be appropriate. In the interim, the combination of high resolution still images and lower resolution video clips may be the best overall compromise.
Since the user of the phone/camera will be holding the device in front of them, they will not be able to talk directly into a normal microphone. Hence, it is necessary to have either a speaker phone capability, or some form of wired or wireless headset to allow bi-directional voice communication while the camera function is being utilized.
Looking again at
In
Where, according to this invention, video clips or high-resolution still images are injected into the voice stream, the last image to be captured according to the action of shutter button 8 will typically be maintained on the display of the capturing phone for a predetermined time period after button 8 is released, or until otherwise terminated by a subsequent action of the sending party. Also, when button 8 is released, normal phone display information may optionally again be superimposed on the displayed image if desired.
Since it is desired that the party capturing and sending images can clearly and easily observe what images are being captured, it may be necessary to add some form of sun-shade to allow clear observation of an LCD “viewfinder” display on the phone/camera. Alternately, or in addition, it may be useful to add a polarizing filter over an LCD display for better viewing in bright sunlight. Other display technologies, more easily viewed in direct sunlight, may be utilized. It may also be useful to add an optical viewfinder such as those found in many conventional digital cameras.
Therefore, a methods and apparatus for implementing a combination video/voicemail system especially useful in the construction industry and other industries requiring remote viewing with guidance and supervision, has been described
It should be understood that the particular embodiments described above are only illustrative of the principles of the present invention, and various modifications could be made by those skilled in the art without departing from the scope and spirit of the invention. Thus, the scope of the present invention is limited only by the claims that follow.
Patent | Priority | Assignee | Title |
11539838, | Apr 28 2021 | ZOOM COMMUNICATIONS, INC | Video voicemail recording system |
12137184, | Apr 28 2021 | ZOOM COMMUNICATIONS, INC | Recording a message using a software platform service |
Patent | Priority | Assignee | Title |
5963245, | Sep 24 1997 | Video telephone | |
6069648, | Aug 22 1997 | MAXELL, LTD | Information communication terminal device |
6380975, | Nov 06 1995 | Ricoh Company, Ltd. | Digital still video camera having voice data generation |
6424843, | Apr 22 1997 | RPX Corporation | Multi-function telecommunication device |
6751473, | May 17 1996 | IDPA HOLDINGS, INC | Wireless communication terminal having a video image capability |
6812954, | May 08 1998 | Orange | Mobile communications |
6882864, | Mar 28 2001 | Mitsubishi Denki Kabushiki Kaisha | Cellular phone with imaging device |
6906741, | Jan 29 2002 | Qualcomm Incorporated | System for and method of conferencing with a handheld computer using multiple media types |
6950119, | Apr 15 2002 | SUMITOMO ELECTRIC INDUSTRIES, LTD | Videoconference system, terminal equipment included therein and data delivery method |
7092735, | Mar 22 2002 | Citrix Systems, Inc | Video-voicemail solution for wireless communication devices |
7233345, | May 13 2003 | NEC Corporation | Communication apparatus and method |
7251500, | Mar 28 2003 | Renesas Electronics Corporation; NEC Electronics Corporation | Microprocessor and mobile communication terminal |
7265782, | Apr 04 2002 | BEJING XIAOMI MOBILE SOFTWARE CO ,LTD ; BEIJING XIAOMI MOBILE SOFTWARE CO ,LTD | Image recording device with a post-recording function |
7355619, | Jan 21 2003 | LENOVO INNOVATIONS LIMITED HONG KONG | Mobile videophone terminal |
7424310, | Aug 26 2004 | Sprint Spectrum L.P. | System, method, and apparatus for automatic transmission of recently captured images |
7636586, | Oct 12 2005 | CONVERSANT WIRELESS LICENSING S A R L | Mobile communication terminal |
7640037, | May 18 2005 | FLINT MOBILE, INC | System and method for capturing and processing business data |
7839984, | Mar 12 1993 | Telebuyer, LLC | Commercial product routing system with video vending capability |
7907638, | Jun 19 2003 | Sony Corporation | Media stream mixing |
7962854, | Oct 19 2004 | Sony Ericsson Mobile Communications AB | Systems, methods and computer program products for displaying content on multiple display screens using handheld wireless communicators |
8046414, | Oct 21 2003 | General Motors LLC | Method for accessing email attachments from a mobile vehicle |
20010032335, | |||
20010050977, | |||
20020051181, | |||
20020130956, | |||
20020147661, | |||
20020171673, | |||
20030090571, | |||
20030185356, | |||
20040014456, | |||
20040114032, | |||
20040117859, | |||
20050083642, | |||
20060114314, | |||
20060133513, | |||
20060229114, | |||
20070126859, | |||
20080085742, | |||
20080291905, | |||
20110102142, | |||
20120064947, | |||
RE38759, | Nov 06 1995 | Ricoh Company Limited | DIGITAL STILL VIDEO CAMERA, IMAGE DATA OUTPUT SYSTEM FOR DIGITAL STILL VIDEO CAMERA, FRAME FOR DATA RELAY FOR DIGITAL STILL VIDEO CAMERA, DATA TRANSFER SYSTEM FOR DIGITAL STILL VIDEO CAMERA, AND IMAGE REGENERATING APPARATUS |
RE42210, | Mar 22 2002 | Citrix Systems, Inc | Video-voicemail solution for wireless communication devices |
RE43648, | Feb 28 2005 | LG Electronics Inc. | Method and communication system for identifying calling/called party |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Jan 31 2011 | Foremost Technologies LLC | (assignment on the face of the patent) | / | |||
Feb 15 2011 | OSANN, ROBERT, JR | Foremost Technologies LLC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 027552 | /0872 | |
Aug 26 2015 | Foremost Technologies LLC | NYTELL SOFTWARE LLC | MERGER SEE DOCUMENT FOR DETAILS | 037392 | /0895 | |
May 10 2019 | NYTELL SOFTWARE LLC | INTELLECTUAL VENTURES ASSETS 126 LLC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 049215 | /0454 | |
May 15 2019 | INTELLECTUAL VENTURES ASSETS 126 LLC | Citrix Systems, Inc | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 049242 | /0668 | |
Sep 30 2022 | TIBCO SOFTWARE INC | GOLDMAN SACHS BANK USA, AS COLLATERAL AGENT | SECOND LIEN PATENT SECURITY AGREEMENT | 062113 | /0001 | |
Sep 30 2022 | Citrix Systems, Inc | WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT | PATENT SECURITY AGREEMENT | 062113 | /0470 | |
Sep 30 2022 | TIBCO SOFTWARE INC | WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT | PATENT SECURITY AGREEMENT | 062113 | /0470 | |
Sep 30 2022 | Citrix Systems, Inc | BANK OF AMERICA, N A , AS COLLATERAL AGENT | PATENT SECURITY AGREEMENT | 062112 | /0262 | |
Sep 30 2022 | TIBCO SOFTWARE INC | BANK OF AMERICA, N A , AS COLLATERAL AGENT | PATENT SECURITY AGREEMENT | 062112 | /0262 | |
Sep 30 2022 | Citrix Systems, Inc | WILMINGTON TRUST, NATIONAL ASSOCIATION | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 062079 | /0001 | |
Sep 30 2022 | Citrix Systems, Inc | GOLDMAN SACHS BANK USA, AS COLLATERAL AGENT | SECOND LIEN PATENT SECURITY AGREEMENT | 062113 | /0001 | |
Apr 10 2023 | GOLDMAN SACHS BANK USA, AS COLLATERAL AGENT | CLOUD SOFTWARE GROUP, INC F K A TIBCO SOFTWARE INC | RELEASE AND REASSIGNMENT OF SECURITY INTEREST IN PATENT REEL FRAME 062113 0001 | 063339 | /0525 | |
Apr 10 2023 | GOLDMAN SACHS BANK USA, AS COLLATERAL AGENT | Citrix Systems, Inc | RELEASE AND REASSIGNMENT OF SECURITY INTEREST IN PATENT REEL FRAME 062113 0001 | 063339 | /0525 | |
Apr 10 2023 | Citrix Systems, Inc | WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT | PATENT SECURITY AGREEMENT | 063340 | /0164 | |
Apr 10 2023 | CLOUD SOFTWARE GROUP, INC F K A TIBCO SOFTWARE INC | WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT | PATENT SECURITY AGREEMENT | 063340 | /0164 |
Date | Maintenance Fee Events |
Feb 10 2014 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
Jan 17 2018 | M1553: Payment of Maintenance Fee, 12th Year, Large Entity. |
Date | Maintenance Schedule |
Jan 28 2017 | 4 years fee payment window open |
Jul 28 2017 | 6 months grace period start (w surcharge) |
Jan 28 2018 | patent expiry (for year 4) |
Jan 28 2020 | 2 years to revive unintentionally abandoned end. (for year 4) |
Jan 28 2021 | 8 years fee payment window open |
Jul 28 2021 | 6 months grace period start (w surcharge) |
Jan 28 2022 | patent expiry (for year 8) |
Jan 28 2024 | 2 years to revive unintentionally abandoned end. (for year 8) |
Jan 28 2025 | 12 years fee payment window open |
Jul 28 2025 | 6 months grace period start (w surcharge) |
Jan 28 2026 | patent expiry (for year 12) |
Jan 28 2028 | 2 years to revive unintentionally abandoned end. (for year 12) |