multimedia data having a first resolution is transmitted and supplemental data is separately transmitted. When combined with the multimedia data having a first resolution, the supplemental data provides the multimedia content at a second resolution that is higher than the first resolution. The multimedia data having a first resolution is received and the supplemental data is separately received. The multimedia data having a first resolution and the supplemental data are combined, to provide the multimedia content at a second resolution that is higher than the first resolution. The multimedia data having a first resolution may be transmitted, received and played using streaming, while the supplemental data may be transmitted, received and played by downloading. Digital rights management schemes may be applied to the multimedia data having a first resolution and/or to the supplemental data.
|
15. A multimedia playing method comprising:
receiving by a receiver multimedia data having a first resolution;
separately receiving by a receiver supplemental data, which, when combined with the multimedia data having a first resolution, provides multimedia content at a second resolution that is higher than the first resolution;
combining by a programmed computer processor the multimedia data having a first resolution and the supplemental data to provide the multimedia content at a second resolution that is higher than the first resolution; and
playing the multimedia content at a second resolution that is higher than the first resolution,
wherein receiving multimedia data is performed in real or near real-time, and
wherein separately receiving supplemental data is not performed in real or near real-time.
34. A multimedia distribution system comprising:
an encoder that is responsive to input multimedia content and that is configured to encode the input multimedia content at a first resolution and to generate supplemental data, which, when combined with the input multimedia content that is encoded at a first resolution, provides the input multimedia content encoded at a second resolution that is higher than the first resolution; and
a transmitter that is responsive to the encoder and that is configured to separately transmit the input multimedia content that is encoded at a first resolution and the supplemental data,
wherein the transmitter is configured to transmit the input multimedia content that is encoded at a first resolution in real or near real-time and to separately transmit the supplemental data in other than real or near real-time.
44. A multimedia playing system comprising:
a receiver that is configured to receive multimedia data having a first resolution and to separately receive supplemental data, which, when combined with the multimedia data having a first resolution, provides multimedia content at a second resolution that is higher than the first resolution;
a processor that is configured to combine the multimedia data having a first resolution and the supplemental data to provide the multimedia content at a second resolution that is higher than the first resolution; and
a multimedia transducer that is configured to play the multimedia content at a second resolution that is higher than the first resolution,
wherein the receiver is configured to receive the input multimedia content that is encoded at a first resolution in real or near real-time and to separately receive the supplemental data in other than real or near real-time.
1. A multimedia distributing method comprising:
transmitting by a transmitter multimedia data having a first resolution; and
separately transmitting by a transmitter supplemental data, which, when combined by a programmed computer processor with the multimedia data having a first resolution, provides multimedia content at a second resolution that is higher than the first resolution,
wherein transmitting multimedia data is performed in real or near real-time, and
wherein separately transmitting supplemental data is not performed in real or near real-time;
wherein the first resolution comprises a first sampling frequency, a first compression ratio, a first frequency range, a first number of bits of resolution, a first distortion level, a first number of pixels, a first frame rate, a first number of colors and/or a first coding rate; and
wherein the second resolution comprises, respectively, a second sampling frequency that is higher than the first sampling frequency, a second compression ratio that is lower than the first compression ratio, a second frequency range that is wider than the first frequency range, a second number of bits of resolution that is greater than the first number of bits of resolution, a second distortion level that is lower than the first distortion level, a second number of pixels that is greater than the first number of pixels, a second frame rate that is greater than the first frame rate, a second number of colors that is greater than the first number of colors and/or a second coding rate that is higher than the first coding rate.
9. A method of transmitting a multimedia work comprising:
streaming by a computer network a first portion of the multimedia work; and
downloading by a computer network a second portion of the multimedia work, wherein the first and second portions when combined together comprise the multimedia work;
wherein streaming comprises streaming multimedia data at a first resolution;
wherein downloading comprises downloading supplemental data, which, when combined with the multimedia data at a first resolution, provides the multimedia work at a second resolution that is higher than the first resolution;
wherein the first resolution comprises a first sampling frequency, a first compression ratio, a first frequency range, a first number of bits of resolution, a first distortion level, a first number of pixels, a first frame rate, a first number of colors, a first number of channels and/or a first coding rate; and
wherein the second resolution comprises, respectively, a second sampling frequency that is higher than the first sampling frequency, a second compression ratio that is lower than the first compression ratio, a second frequency range that is wider than the first frequency range, a second number of bits of resolution that is greater than the first number of bits of resolution, a second distortion level that is lower than the first distortion level, a second number of pixels that is greater than the first number of pixels, a second frame rate that is greater than the first frame rate, a second number of colors that is greater than the first number of colors, a second number of channels that is greater than the first number of channels and/or a second coding rate that is higher than the first coding rate.
41. A system for transmitting a multimedia work comprising:
a streaming server that is configured to transmit a first portion of the multimedia work; and
a downloading server that is configured to transmit a second portion of the multimedia work, wherein the first and second portions together comprise the multimedia work;
wherein the streaming server is configured to stream multimedia data at a first resolution;
wherein the downloading supplemental mental data which, when combined with the multimedia data at a first resolution, provides the multimedia work at a second resolution that is higher than the first resolution;
wherein the first resolution comprises a first sampling frequency, a first compression ratio, a first frequency range, a first number of bits of resolution, a first distortion level, a first number of pixels, a first frame rate, a first number of colors, a first number of channels colors and/or a first coding rate; and
wherein the second resolution comprises, respectively, a second sampling frequency that is higher than the first sampling frequency, a second compression ratio that is lower than the first compression ratio, a second frequency range that is wider than the first frequency range, a second number of bits of resolution that is greater than the first number of bits of resolution, a second distortion level that is lower than the first distortion level, a second number of pixels that is greater than the first number of pixels, a second frame rate that is greater than the first frame rate, a second number of colors that is greater than the first number of colors, a second number of channels that is greater than the first number of channels and/or a second coding rate that is higher than the first coding rate.
26. A method of playing a multimedia work comprising:
streaming by a computer network a first portion of the multimedia work;
downloading by a computer network a second portion of the multimedia work;
combining by a programmed computer processor the first and second portions of the multimedia work to generate the multimedia work; and
playing the multimedia work that is generated;
wherein streaming comprises streaming the multimedia work at a first resolution;
wherein downloading comprises downloading supplemental data, which, when combined with the multimedia work at a first resolution, provides the multimedia work at a second resolution that is higher than the first resolution;
wherein the combining comprises combining the multimedia work at a first resolution and the supplemental data to generate the multimedia work at the second resolution;
wherein playing comprises playing the multimedia work at the second resolution;
wherein the first resolution comprises a first sampling frequency, a first compression ratio, a first frequency range, a first number of bits of resolution, a first distortion level, a first number of pixels, a first frame rate, a first number of colors, a first number of channels and/or a first coding rate; and
wherein the second resolution comprises, respectively, a second sampling frequency that is higher than the first sampling frequency, a second compression ratio that is lower than the first compression ratio, a second frequency range that is wider than the first frequency range, a second number of bits of resolution that is greater than the first number of bits of resolution, a second distortion level that is lower than the first distortion level, a second number of pixels that is greater than the first number of pixels, a second frame rate that is greater than the first frame rate, a second number of colors that is greater than the first number of colors, a second number of channels that is greater than the first number of channels and/or a second coding rate that is higher than the first coding rate.
51. A system for playing a multimedia work comprising:
a receiver that is configured to stream a first portion of the multimedia work and to download a second portion of the multimedia work;
a processor that is configured to combine the first and second portions of the multimedia work to generate the multimedia work; and
a multimedia transducer that is configured to play the multimedia work that is generated;
wherein the receiver is configured to stream the multimedia work at a first resolution and to download the second portion as supplemental data, which, when combined with the first portion, provides the multimedia work at a second resolution that is higher than the first resolution;
wherein the processor is configured to combine the multimedia work at a first resolution and the supplemental data to generate the multimedia work at the second resolution;
wherein the multimedia transducer is configured to play the multimedia work at the second resolution;
wherein the first resolution comprises a first sampling frequency, a first compression ratio, a first frequency range, a first number of bits of resolution, a first distortion level, a first number of pixels, a first frame rate, a first number of colors, a first number of channels colors and/or a first coding rate; and
wherein the second resolution comprises, respectively, a second sampling frequency that is higher than the first sampling frequency, a second compression ratio that is lower than the first compression ratio, a second frequency range that is wider than the first frequency range, a second number of bits of resolution that is greater than the first number of bits of resolution, a second distortion level that is lower than the first distortion level, a second number of pixels that is greater than the first number of pixels, a second frame rate that is greater than the first frame rate, a second number of colors that is greater than the first number of colors, a second number of channels that is greater than the first number of channels and/or a second coding rate that is higher than the first coding rate.
2. A method according to
3. A method according to
wherein transmitting multimedia data comprises streaming multimedia data having a first resolution; and
wherein separately transmitting supplemental data comprises downloading supplemental data, which, when combined with the multimedia data having a first resolution, provides the multimedia content at a second resolution that is higher than the first resolution.
4. A method according to
5. A method according to
wherein transmitting multimedia data is subject to a first digital rights management scheme; and
wherein separately transmitting supplemental data is subject to a second digital rights management scheme that is different from the first digital rights management scheme.
6. A method according to
wherein separately transmitting supplemental data is preceded by receiving payment for the supplemental data that is greater than payment that is received for the multimedia data having a first resolution.
7. A method according to
wherein transmitting multimedia data is performed from a first multimedia server; and
wherein separately transmitting supplemental data is performed from a second multimedia server that is different from the first multimedia server.
8. A method according to
wherein transmitting multimedia data is performed using a wireless network; and
wherein separately transmitting supplemental data is performed using a wired network.
10. A method according to
11. A method according to
wherein streaming is subject to a first digital rights management scheme; and
wherein downloading is subject to a second digital rights management scheme that is different from the first digital rights management scheme.
12. A method according to
wherein downloading is preceded by receiving payment for the supplemental data that is greater than payment that is received for the streaming.
13. A method according to
wherein streaming is performed from a first multimedia server; and
wherein downloading is performed from a second multimedia server that is different from the first multimedia server.
14. A method according to
wherein streaming is performed using a wireless network; and
wherein downloading is performed using a wired network.
16. A method according to
playing the multimedia data at the first resolution.
17. A method according to
18. A method according to
19. A method according to
20. A method according to
wherein receiving multimedia data comprises receiving streaming multimedia data having a first resolution; and
wherein separately receiving supplemental data comprises downloading supplemental data, which, when combined with the multimedia data having a first resolution, provides the multimedia content at a second resolution that is higher than the first resolution.
21. A method according to
wherein the first resolution comprises a first sampling frequency, a first compression ratio, a first frequency range, a first number of bits of resolution, a first distortion level, a first number of pixels, a first frame rate, a first number of colors and/or a first coding rate; and
wherein the second resolution comprises, respectively, a second sampling frequency that is higher than the first sampling frequency, a second compression ratio that is lower than the first compression ratio, a second frequency range that is wider than the first frequency range, a second number of bits of resolution that is greater than the first number of bits of resolution, a second distortion level that is lower than the first distortion level, a second number of pixels that is greater than the first number of pixels, a second frame rate that is greater than the first frame rate, a second number of colors that is greater than the first number of colors and/or a second coding rate that is higher than the first coding rate.
22. A method according to
23. A method according to
wherein receiving multimedia data is subject to a first digital rights management scheme; and
wherein separately receiving supplemental data is subject to a second digital rights management scheme that is different from the first digital rights management scheme.
24. A method according to
wherein separately receiving supplemental data is preceded by providing payment for the supplemental data that is greater than payment that is provided for the multimedia data having a first resolution.
25. A method according to
wherein receiving multimedia data is performed using a wireless network; and
wherein separately receiving supplemental data is performed using a wired network.
27. A method according to
playing the multimedia work at the first resolution.
28. A method according to
29. A method according to
30. A method according to
31. A method according to
wherein streaming is subject to a first digital rights management scheme; and
wherein downloading is subject to a second digital rights management scheme that is different from the first digital rights management scheme.
32. A method according to
wherein downloading is preceded by providing payment for the second portion that is greater than payment that is provided for the first portion.
33. A method according to
wherein streaming is performed using a wireless network; and
wherein downloading is performed using a wired network.
35. The system according to
36. A system according to
37. A system according to
wherein the first resolution comprises a first sampling frequency, a first compression ratio, a first frequency range, a first number of bits of resolution, a first distortion level, a first number of pixels, a first frame rate, a first number of colors and/or a first coding rate; and
wherein the second resolution comprises, respectively, a second sampling frequency that is higher than the first sampling frequency, a second compression ratio that is lower than the first compression ratio, a second frequency range that is wider than the first frequency range, a second number of bits of resolution that is greater than the first number of bits of resolution, a second distortion level that is lower than the first distortion level, a second number of pixels that is greater than the first number of pixels, a second frame rate that is greater than the first frame rate, a second number of colors that is greater than the first number of colors and/or a second coding rate that is higher than the first coding rate.
38. A system according to
39. A system according to
40. A system according to
a first multimedia server that is configured to transmit the input multimedia content that is encoded at a first resolution; and
a second multimedia server that is configured to transmit the supplemental data.
42. A system according to
wherein the streaming server is configured to transmit the first portion of the multimedia work subject to a first digital rights management scheme; and
wherein the downloading server is configured to transmit the second portion of the multimedia work subject to a second digital rights management scheme that is different from the first digital rights management scheme.
43. A system according to
wherein the downloading server is configured to transmit the second portion of the multimedia work subject to receiving payment for the second portion that is greater than payment that is received for the first portion.
45. A system according to
46. A system according to
47. A system according to
wherein the receiver is further configured to stream the multimedia data having a first resolution and download the supplemental data.
48. A system according to
wherein the first resolution comprises a first sampling frequency, a first compression ratio, a first frequency range, a first number of bits of resolution, a first distortion level, a first number of pixels, a first frame rate, a first number of colors and/or a first coding rate; and
wherein the second resolution comprises, respectively, a second sampling frequency that is higher than the first sampling frequency, a second compression ratio that is lower than the first compression ratio, a second frequency range that is wider than the first frequency range, a second number of bits of resolution that is greater than the first number of bits of resolution, a second distortion level that is lower than the first distortion level, a second number of pixels that is greater than the first number of pixels, a second frame rate that is greater than the first frame rate, a second number of colors that is greater than the first number of colors and/or a second coding rate that is higher than the first coding rate.
49. A system according to
wherein the receiver is further configured to receive the multimedia data having a first resolution subject to a first digital rights management scheme and to separately receive the supplemental data subject to a second digital rights management scheme that is different from the first digital rights management scheme.
50. A system according to
wherein the receiver is configured to separately receive the supplemental data subject to providing payment for the supplemental data that is greater than payment that is provided for the multimedia data having a first resolution.
52. A system according to
53. A system according to
54. A system according to
55. A system according to
wherein the receiver is configured to stream the first portion subject to a first digital rights management scheme; and
wherein the receiver is configured to download the second portion subject to a second digital rights management scheme that is different from the first digital rights management scheme.
56. A system according to
wherein the receiver is configured to download the second portion subject to payment for the second portion that is greater than payment that is provided for the first portion.
|
This invention relates to communications systems and methods, and more particularly to systems and methods for distributing and/or playing multimedia content.
With the advent of large-scale wired and wireless communications networks, such as the Internet and cellular networks, the distribution of multimedia content over these networks may increase. As used herein, the term “multimedia” content includes analog or digital audio, analog or digital image and/or analog or digital video content.
There are generally two techniques for multimedia distribution over networks: streaming and downloading. In streaming, the multimedia content is sent to a user in a continuous stream, and is played as it arrives. In contrast, downloading transmits the data as a computer file, which is then stored at the user device and may be played back after the entire file is downloaded. Often, streaming may be limited in resolution due to potential bandwidth limitations of the network through which the streaming multimedia content is transmitted. However, real-time or near real-time playback may be provided. Downloaded multimedia content may be higher in resolution, but there may be a large playback latency time while the file is being downloaded.
Some embodiments of the present invention provide multimedia distributing methods wherein multimedia data having a first resolution is transmitted, and supplemental data is separately transmitted. In some embodiments, the separately transmitted supplemental data is at least partially separated from the multimedia data having a first resolution in transmission time, space, channel and/or medium. When combined with the multimedia data having a first resolution, the supplemental data provides multimedia content at a second resolution that is higher than the first resolution.
Multimedia playing methods according to some embodiments of the present invention receive the multimedia data having a first resolution, and may play the multimedia data at the first resolution. The supplemental data is also separately received. The multimedia data having a first resolution and the supplemental data are combined to provide the multimedia content at a second resolution that is higher than the first resolution. The multimedia content at the second resolution may be played as well.
Some embodiments of the present invention can allow multimedia data having a first resolution to be transmitted, received and played, for example using streaming. The supplemental data can be transmitted, for example by downloading, and combined with the multimedia data having a first resolution to provide multimedia content at a second resolution that is higher than the first resolution.
Many techniques for separately transmitting the multimedia data having a first resolution and the supplemental data may be provided according to various embodiments of the invention. In particular, in some embodiments of the present invention, the multimedia data having a first resolution and the supplemental data may be transmitted during offset and/or at least partially overlapping time intervals. In some embodiments, the multimedia data having a first resolution may be transmitted in real-time or near real-time, and the supplemental data is not transmitted in real-time or near real-time. In some embodiments, the multimedia data having a first resolution and the supplemental data are transmitted from different multimedia servers. However, in other embodiments, the same server may be used. Similarly, in some embodiments, the multimedia data having a first resolution and the supplemental data may be transmitted using different transmission channels such as different networks, carrier frequencies, time slots and/or spreading codes. However, in other embodiments, the same channel may be used. In still other embodiments, the multimedia data having a first resolution and/or supplemental data may be transmitted using separate physical media, such as magnetic and/or optical disks and/or solid state memory modules. However, in other embodiments, the same media may be used. Moreover, in some embodiments, the multimedia content having a first resolution may be subject to a first digital rights management scheme and the supplemental data may be subject to a second digital rights management scheme that is different from the first digital rights management scheme.
It will be understood by those having skill in the art that, as used herein, the first resolution and the second resolution that is higher than the first resolution may be defined in terms of sampling frequency, compression ratio, frequency range, number of bits, distortion levels, number of pixels, frame rate, number of colors, coding rates, number of channels and/or other parameters. The differences in resolution may generally provide differences in quality of the multimedia content that is played. It will also be understood that embodiments of the present invention have been described above primarily with respect to multimedia distributing methods and multimedia playing methods. However, multimedia distributing systems and multimedia playing systems also may be provided according to various embodiments of the present invention.
The present invention now will be described more fully hereinafter with reference to the accompanying figures, in which embodiments of the invention are shown. This invention may, however, be embodied in many alternate forms and should not be construed as limited to the embodiments set forth herein.
Accordingly, while the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail. It should be understood, however, that there is no intent to limit the invention to the particular forms disclosed, but on the contrary, the invention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the invention as defined by the claims. Like numbers refer to like elements throughout the description of the figures.
The present invention is described below with reference to block diagrams and/or flowchart illustrations of methods, apparatus (systems) and/or computer program products according to embodiments of the invention. It is understood that a block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, and/or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer and/or other programmable data processing apparatus, create means for implementing the functions/acts specified in the block diagrams and/or flowchart block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instructions which implement the function/act specified in the block diagrams and/or flowchart block or blocks.
The computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions/acts specified in the block diagrams and/or flowchart block or blocks.
As will be appreciated by one of skill in the art, the present invention may be embodied as a method, data processing system and/or computer program product. Thus, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects, which may be collectively referred to herein as a “circuit” or “module”.
It should also be noted that in some alternate implementations, the functions/acts noted in the blocks may occur out of the order noted in the flowcharts. For example, two blocks shown in succession may in fact be executed substantially concurrently or the blocks may sometimes be executed in the reverse order, depending upon the functionality/acts involved.
In some embodiments, “separately” designates at least partially separated in time, space, channel (including carrier or subcarrier frequency, time slot and/or spreading code) and/or medium. In some embodiments, the first resolution comprises a first sampling frequency, a first compression ratio, a first frequency range, a first number of bits of resolution, a first distortion level, a first number of pixels; a first frame rate, a first number of colors, a first number of channels and/or a first coding rate. The second resolution comprises, respectively, a second sampling frequency that is higher than the first sampling frequency, a second compression ratio that is lower than the first compression ratio, a second frequency range that is wider than the first frequency range, a second number of bits of resolution that is greater than the first number of bits of resolution, a second distortion level that is lower than the first distortion level, a second number of pixels that is greater than the first number of pixels, a second frame rate that is greater than the first frame rate, a second number of colors that is greater than the first number of colors, a second number of channels that is greater than the first number of channels and/or a second coding rate that is higher than the first coding rate. It also will be understood that the low resolution multimedia data 130 and the supplemental data 140 need not be generated separately by the encoder 110 in some embodiments of the invention, if they are transmitted separately by a transmitter, as described in connection with
It also will be understood by those having skill in the art that the term “transmitter” is used herein to generically refer to any transmission system and/or method for multimedia data between two separate devices, including wireless, wired and/or distribution of physical media. In some embodiments, the low resolution multimedia data 220 and the supplemental data 230 are transmitted using the same multimedia server and transmission channel, but offset in time. However, in other embodiments, different multimedia servers and/or transmission channels may be used for simultaneous or overlapping transmissions. Thus, for example, in some embodiments, the low resolution multimedia data 220 is streamed from a streaming server via a wire and/or wireless network, whereas the supplemental data is downloaded from a downloading server via a wire and/or wireless network. In still other embodiments, the low resolution multimedia data 220 may be transmitted by streaming, and the supplemental data 230 may be transmitted on a physical media, such as a magnetic, optical and/or solid state nonvolatile memory device. In still other embodiments, the low resolution multimedia data 220 is transmitted in real-time or near real-time, and the supplemental data 230 is not transmitted in real-time or near real-time. However, in other embodiments, the separate transmission of the encoded multimedia data 220 and the supplemental data 230 may be performed simultaneously, in overlapping time periods or in non-overlapping time periods. In some embodiments, the low resolution multimedia data 220 is transmitted prior to the supplemental data 230. However, in other embodiments, the supplemental data 230 may be transmitted simultaneously with or prior to the low resolution multimedia data 220.
In some embodiments, the switch 410 may be controlled under user control. However, in other embodiments of the present invention, as will be described below, digital rights management systems and/or methods also may be used at least partially to control the switch 410. Thus, in some embodiments of the present invention, the low resolution multimedia data 420 may be subject to a first digital rights management scheme and the high resolution multimedia content 330 may be subject to a second digital rights management scheme that is different from the first digital rights management scheme. In some embodiments, the first digital rights management scheme may allow free (no fee) streaming audio and/or video at the first resolution, but may only allow the supplemental data to be downloaded, upon payment of a prescribed fee. Accordingly, users may pay fees or additional fees to play the high resolution multimedia content.
Still referring to
In some embodiments, the user devices 820/830 may include digital rights management systems to govern which content they are capable of receiving. In other embodiments, the transmitter 810 may selectively transmit the data streams based on the telephone number, IP address and/or other identifier of the user device 820 or 830. It will be understood by those having skill in the art that the wireless user devices 820 or 830 may be embodied as multimedia players, cellular and/or satellite radiotelephones, Personal Communications System (PCS) terminals that may combine a cellular radiotelephone with data processing, facsimile and/or data communications capabilities, Personal Digital Assistants (PDA) that can include a radio frequency transceiver and a pager, Internet/intranet access, Web browser, organizer, calendar and/or a global positioning system (GPS) receiver, and/or conventional laptop and/or palmtop computers or other appliances, which include a radio frequency receiver.
It will be understood by those having skill in the art that combinations and subcombinations of the block diagrams of
Referring to
Still referring to
Still referring to
Additional discussion of embodiments of the invention now will be provided. The deployment of wide-area wireless data infrastructure, such as Generalized Packet Radio Service (GPRS) can allow for the possibility of streamed multimedia to wireless devices, including mobile terminals. One potential problem with this type of application is the potentially limited capacity of these data networks. Widespread use of audio streaming over GPRS, for example, may quickly use up the available GPRS capacity. While this situation may improve over time, wireless data network operators may not see the excess capacity presently observed in today's wired Internet, due to the inherent radio bandwidth limits and power constraints of wireless communications.
Despite these potential limits, commercial attempts at distributing multimedia over wireless networks may be made. One approach to the potential bandwidth limitations is simply to reduce the quality of the distributed music, such as has been done with streamed audio on the wired network (e.g. RealAudio). This approach may reduce the data size of the content, which may also reduce the audio quality. Various coding schemes (MP3, ATRAC3) exist for efficiently converting recorded music into data streams. At sufficiently high data rates (e.g. about 128 kbps for MP3), the decoded audio may be virtually indistinguishable from the high-quality original recording. The data rate can be reduced, but generally with a corresponding reduction in audio quality. A number of advanced coding schemes continue to emerge (e.g. MP3Pro, ATRAC5), which can further reduce the data stream size, but significant reductions in data size may lower the quality of the decoded audio.
There are presently several approaches for providing recorded multimedia content over a wireless network. One approach is via streaming, whereby the digital data representing the multimedia content is provided in near real-time. In this approach, the average data throughput of the wireless connection generally is at least equal to the coded data rate of the multimedia content. For example, if encoding music results in 64 kbits of data per second of music, then the user's wireless data connection may need to have at least 64 kbits of average throughput. Streaming, at least when the throughput capability of the connection is not much higher than the provided data stream, also may assume that there is not a great deal of variable latency in the network, i.e., that the instantaneous throughput at any given time does not fall significantly below the average.
A typical streaming application may deal with these assumptions by reducing the data size of the streamed content (and hence the perceived quality of the decoded content) so that it can fit comfortably within the throughput capacity of the data channel, and/or by buffering the stream to mitigate the effects of variable latency. Buffering can involve initiating the data stream and storing some portion of the data in memory before decoding and generating the multimedia content signal. A typical streaming application might buffer five seconds of content before initiating near real-time playback. In this manner, the decoder can provide decoded multimedia content at a constant rate, despite the fact that the incoming data stream is arriving at a variable rate. As long as this variability is not too great, the user should not experience substantial interruptions in the decoded audio, and near real-time playback may be achieved.
Another approach for distributing multimedia content over a wireless network is the download approach. In this case, the encoded multimedia content is downloaded to the end user device as quickly as the network allows. The encoded multimedia content is stored as a file, and may be decoded and played for the user only after the download is complete. This may be the only practical approach when the encoded data stream rate exceeds the available capacity of the wireless data connection. It may also be a desired approach when providing multimedia content to a user for storage in a personal library for later access, especially since in this case the user may desire a higher quality encoding format, which may use more data than a streaming application might use. In the streaming case, the data is typically used only for the near real-time playback, and generally is not saved.
One potential problem with the download approach is that it may deny the user “instant gratification”. The user typically waits until the download is completed. This process might take several minutes for a single song on a bandwidth-limited data connection. In contrast, some embodiments of the invention may allow benefits of both techniques to be combined. For example, in some embodiments, the user can quickly listen to a streamed version of the audio content, at less than perfect fidelity, and then later have access to a higher-quality version of the same content for repeated playback, without the need to completely retransmit the higher quality version.
Some embodiments of the invention employ a media encoding or compression algorithm that permits a relatively low-resolution (which can be smaller in terms of total data) version of the original multimedia content to be augmented with supplemental data in order to create a higher resolution version. One example is MP3Pro. MP3Pro files are inherently backwards compatible with MP3 decoders, since the improved resolution is provided by supplemental data in the MP3Pro datastream, which can be ignored by an MP3-only decoder that receives the MP3Pro datastream. In contrast, an MP3Pro player will use the supplemental data in the MP3Pro datastream, to provide improved sound quality.
In the MP3 example, substantial improvements in resolution and quality can result from a relatively small additional data. According to the Thomson website at mp3licensing.com, an MP3Pro file coded at 64 kbps is comparable in audio quality to a conventional MP3 file coded at >100 kbps. At the same time, that 64 kbps MP3Pro file can be decoded by a conventional MP3 decoder, albeit at significantly reduced quality. The exact figures may not be readily available, but it appears that the 64 kbps MP3Pro file includes a 56 kbps MP3 file, with the remaining 8 kbps used by the MP3Pro decoder to improve the resolution, and thereby improve the sound quality.
Other examples of coding schemes with this general property either exist, can be adapted from existing compression algorithms and/or can be developed. These coding schemes provide at least two different resolutions. For example, at least two different coding rates (i.e., compression ratios) may be provided in some embodiments, with the higher rate (lower compression) producing higher quality playback. Moreover, a higher quality file may be generated by combining a lower-quality file with supplemental data. The combination may take place by adding the additional data (in the appropriate data format), as in the MP3Pro case, or may use a more sophisticated process.
In some embodiments, the amount of additional data to convert the lower-quality file to a higher-quality version is less (and may be significantly less) than the total amount of data contained in the final higher-quality version. In the MP3Pro example from above this is clearly true: the additional 8 kbps, which is added to the original 56 kbps file, is significantly smaller than the final 64 kbps.
A digital media transmitter according to some embodiments of the invention transmits two separate sets (files or data streams) of output, the first output of which can be decoded to produce a relatively low- or moderate-quality output, the second output of which can be combined with the first output to produce a higher-quality output. A server according to some embodiments of the invention streams or downloads the first output to a network-connected user device. In some embodiments, the user device includes memory for storing the received first output and a decoder capable of decoding the first output to produce an output signal. In some embodiments, a networked user device is further capable of receiving the second output from a server, which may be the same server that provided the first output, with the decoder further capable of combining the first and second outputs, decoding, and producing an output signal of higher resolution than in the case where only the first output is decoded.
Some embodiments of the invention can provide a streaming service based on a low- to moderate-quality encoding rate appropriate for the network bandwidth. The streamed data can be decoded immediately for a near real-time experience, and can be simultaneously (or alternatively) stored in the user device's memory. In some embodiments, at some other time, the additional data can be downloaded into the device, making available a higher-quality version of the original media. The additional data can be received from the same server as the original data and/or from an alternative source. In some embodiments, the additional data can be delivered when the network capacity is available, and may be delivered in a manner that is invisible to the user. In some embodiments, with appropriate hardware and/or software, the additional data can be delivered in several portions, thus allowing the network operator to manage the delivery in accordance with network capacity constraints.
Some embodiments of the invention may provide digital-rights management schemes that can enable a variety of business models for delivering multimedia content to consumers. For example, a consumer might “buy” a music file from a service provider. In some embodiments of the invention, a moderate-quality version of the music file can be available “immediately” over a wireless connection (for example). A higher-quality version (which a typical consumer might demand) of the music file is created later, when network capacity permits.
For the MP3Pro example given above, there may be only a minimal saving of network bandwidth resulting from delivering a 56 kbps file versus the final 64 kbps version. For other schemes, the potential bandwidth savings may be larger. For example, 128 kbps MP3 may be viewed as CD-transparent quality, and may be suitable for playback in high-quality audio systems. However, 64 kbps MP3 (approximately the quality of FM radio) may be quite suitable for initial user playback, especially on a portable device. Presuming that a 128 kbps version can be created from a 64 kbps version by later adding something on the order of 64 kbps, there can be potential advantages in deferring a portion of the data transmission in a bandwidth-limited network.
It will be understood that, as used herein, the term “decoder” is not limited to the conversion of a coded media file to an output signal, but may include file management, the ability to combine the two sets of data described herein, the ability to manage streaming and/or playback of stored files, etc. Also, as used herein, the term “server” is not limited to a personal computer or similar device connected to a network at a fixed location. The playing devices described herein might also be equipped with a “server” function, which can permit a distributed or peer-to-peer topology for the distribution of the files described herein.
In the drawings and specification, there have been disclosed embodiments of the invention and, although specific terms are employed, they are used in a generic and descriptive sense only and not for purposes of limitation, the scope of the invention being set forth in the following claims.
Patent | Priority | Assignee | Title |
9426506, | Aug 22 2012 | UNIVERSITY-INDUSTRY COOPERATION GROUP OF KYUNG HEE UNIVERSITY; Electronics and Telecommunications Research Institute | Apparatuses for providing and receiving augmented broadcasting service in hybrid broadcasting environment |
Patent | Priority | Assignee | Title |
5629866, | Mar 18 1994 | Adrea, LLC | Audio-visual presentation system |
6057884, | Jun 05 1997 | Google Technology Holdings LLC | Temporal and spatial scaleable coding for video object planes |
6266817, | Apr 18 1995 | Sun Microsystems, Inc. | Decoder for a software-implemented end-to-end scalable video delivery system |
6564262, | Sep 16 1996 | Microsoft Technology Licensing, LLC | Multiple multicasting of multimedia streams |
6637031, | Dec 04 1998 | Microsoft Technology Licensing, LLC | Multimedia presentation latency minimization |
6639943, | Nov 23 1999 | LG Electronics Inc | Hybrid temporal-SNR fine granular scalability video coding |
7031016, | May 26 2000 | Kabushiki Kaisha Toshiba; Toshiba Tec Kabushiki Kaisha | System for controlling images according to applications |
7243153, | Jun 26 2001 | Monument Peak Ventures, LLC | System and method for managing images over a communication network |
20020051581, | |||
20040081198, | |||
EP696121, | |||
EP1217841, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Jan 12 2004 | HOMILLER, DANIEL P | Sony Ericsson Mobile Communications AB | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 014895 | /0661 | |
Jan 14 2004 | Sony Ericsson Mobile Communications AB | (assignment on the face of the patent) | / | |||
Feb 21 2012 | Sony Ericsson Mobile Communications AB | Sony Mobile Communications AB | CHANGE OF NAME SEE DOCUMENT FOR DETAILS | 048690 | /0974 | |
Apr 05 2019 | Sony Mobile Communications AB | Sony Corporation | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 048825 | /0737 |
Date | Maintenance Fee Events |
Dec 13 2010 | ASPN: Payor Number Assigned. |
Dec 13 2010 | RMPN: Payer Number De-assigned. |
Apr 22 2014 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
Apr 24 2018 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
Jun 27 2022 | REM: Maintenance Fee Reminder Mailed. |
Dec 12 2022 | EXP: Patent Expired for Failure to Pay Maintenance Fees. |
Date | Maintenance Schedule |
Nov 09 2013 | 4 years fee payment window open |
May 09 2014 | 6 months grace period start (w surcharge) |
Nov 09 2014 | patent expiry (for year 4) |
Nov 09 2016 | 2 years to revive unintentionally abandoned end. (for year 4) |
Nov 09 2017 | 8 years fee payment window open |
May 09 2018 | 6 months grace period start (w surcharge) |
Nov 09 2018 | patent expiry (for year 8) |
Nov 09 2020 | 2 years to revive unintentionally abandoned end. (for year 8) |
Nov 09 2021 | 12 years fee payment window open |
May 09 2022 | 6 months grace period start (w surcharge) |
Nov 09 2022 | patent expiry (for year 12) |
Nov 09 2024 | 2 years to revive unintentionally abandoned end. (for year 12) |