A video decoding apparatus capable of controlling presentation of sub-pictures includes a first decoder, a second decoder, a first scaler, a second scaler and a combiner. The first decoder and the second decoder respectively decode a digital audio/video signal to generate a decoded video and a decoded sub-picture. In accordance with an output picture size, the decoded video size, the decoded sub-picture size and a sub-picture aspect ratio, the first scaler and the second scaler generate a first scaling factor and a second scaling factor. The combiner combines the decoded video and the decoded sub-picture according to the first scaling factor and the second scaling factor and outputs the combination thereof. A video decoding method and a digital audio/video playback system capable of controlling presentation of sub-pictures are also disclosed.
|
0. 21. A video decoding apparatus capable of controlling presentation of sub-pictures, which is for decoding a digital audio/video signal and outputting an output picture through a video output device, the video decoding apparatus comprising:
a first decoder programmed to receive a video bit stream and to decode the video bit stream to generate a decoded video;
a second decoder programmed to receive a sub-picture bit stream and to decode the sub-picture bit stream to generate at least one decoded sub-picture;
a first scaler programmed to generate a first scaling factor according to a size of the decoded video and a size of the output picture;
a second scaler programmed to generate a second scaling factor according to the first scaling factor; and
a combiner programmed to scale the decoded video according to the first scaling factor, to scale the at least one decoded sub-picture according to the second scaling factor, to combine the scaled decoded video and the at least one scaled decoded sub-picture into a combined picture, and to output the combined picture to the video output device.
0. 26. A video decoding apparatus capable of controlling presentation of sub-pictures, which is for decoding a digital audio/video signal and outputting an output picture through a video output device, wherein the digital audio/video signal includes a video bit stream and a sub-picture bit stream, the video decoding apparatus comprising:
a first decoder programmed to receive the video bit stream and decodes the video bit stream to generate a decoded video;
a second decoder programmed to receive the sub-picture bit stream and to decode the sub-picture bit stream to generate at least one decoded sub-picture;
a first scaler programmed to generate a first scaling factor according to a size of the decoded video and a size of the output picture;
a second scaler programmed to generate a second scaling factor for scaling the at least one decoded sub-picture; and
a combiner programmed to scale the decoded video according to the first scaling factor, to scale the at least one decoded sub-picture according to the second scaling factor, and to combine the scaled decoded video and the scaled decoded sub-picture to generate a combined picture, and to output the combined picture to the video output device,
wherein during the scaling of the at least one decoded sub-picture, the combiner is further programmed to determine whether the decoded sub-picture exceeds a border of the output picture to obtain a first determining result, to determine whether the decoded sub-picture covers a central area of the decoded video to obtain a second determining result, and to set a displayed size and a position of the decoded sub-picture according to the first determining result and the second determining result,
wherein if it is determined that the decoded sub-picture covers the central area of the decoded video, the combiner is further programmed to re-set the displayed size and position of the decoded sub-picture, if it is determined that the decoded sub-picture does not cover the central area of the decoded video, the combiner proceeds to set the displayed size and the position of the decoded sub-picture according to the first determining result and the second determining result.
0. 1. A video decoding apparatus capable of controlling presentation of sub-pictures, which is for decoding a digital audio/video signal and outputting an output picture through a video output device, wherein the digital audio/video signal includes a video bit stream and a sub-picture bit stream, the video decoding apparatus comprising:
a first decoder which receives the video bit stream and decodes the video bit stream to generate a decoded video;
a second decoder which receives the sub-picture bit stream and decodes the sub-picture bit stream to generate at least one decoded sub-picture;
a first scaler which captures the size of the decoded video and generates a first scaling factor according to the size of the output picture and the size of the decoded video;
a second scaler which captures the size and the position of the decoded sub-picture and generates a second scaling factor according to the size of the output picture, the size of the decoded sub-picture, and a sub-picture aspect ratio; and
a combiner which sets the size of the decoded video according to the first scaling factor, sets the size and the position of the decoded sub-picture according to the second scaling factor, combines the decoded video and the decoded sub-picture, and outputs the combined picture to the video output device.
0. 2. The video decoding apparatus as specified in
the first scaling factor comprises a first horizontal scaling factor and a first vertical scaling factor, in which the first horizontal scaling factor is equal to the horizontal width of the output picture divided by the horizontal width of the decoded video, and the first vertical scaling factor is equal to the vertical height of the output picture divided by the vertical height of the decoded video; and
the second scaling factor comprises a second horizontal scaling factor and a second vertical scaling factor while the sub-picture aspect ratio includes a horizontal aspect ratio and a vertical aspect ratio, in which the second horizontal scaling factor is equal to the first horizontal scaling factor divided by the horizontal aspect ratio of the sub-picture aspect ratio, and the second scaling factor is equal to the first vertical scaling factor divided by the vertical aspect ratio of the sub-picture aspect ratio.
0. 3. The video decoding apparatus as specified in
0. 4. The video decoding apparatus as specified in
0. 5. The video decoding apparatus as specified in
0. 6. The video decoding apparatus as specified in
0. 7. A digital audio/video playback system capable of controlling presentation of sub-pictures, which is for decoding a digital audio/video signal, outputting an output picture through a video output device, and outputting a decoded audio through an audio output device, the digital audio/video playback system comprising:
a signal loader which receives the digital audio/video signal;
a signal parser which divides the digital audio/video signal into a video bit stream, a sub-picture bit stream, and an audio bit stream;
an audio decoder which receives the audio bit stream, decodes the audio bit stream to a decoded audio, and outputs the decoded audio to the audio output device; and
a video decoding apparatus, including:
a first decoder which receives the video bit stream and decodes the video bit stream to generate a decoded video;
a second decoder which receives the sub-picture bit stream and decodes the sub-picture bit stream to generate at least one decoded sub-picture;
a first scaler which captures the size of the decoded video and generates a first scaling factor according to the size of the output picture and the size of the decoded video;
a second scaler which captures the size and the position of the decoded sub-picture and generates a second scaling factor according to the size of the output picture, the size of the decoded sub-picture, and a sub-picture aspect ratio; and
a combiner which sets the size of the decoded video according to the first scaling factor, sets the size and the position of the sub-picture according the second scaling factor, combines the decoded video and the decoded sub-picture, and outputs the combined picture to the video output device.
0. 8. The digital audio/video playback system as specified in
the first scaling factor comprises a first horizontal scaling factor and a first vertical scaling factor, in which the first horizontal scaling factor is equal to the horizontal width of the output picture divided by the horizontal width of the decoded video, the first vertical scaling factor is equal to the vertical height of the output picture divided by the vertical height of the decoded video; and
the second scaling factor comprises a second horizontal scaling factor and a second vertical scaling factor while the sub-picture aspect ratio includes a horizontal aspect ratio and a vertical aspect ratio, in which the second horizontal scaling factor is equal to the first horizontal scaling factor divided by the vertical aspect ratio of the sub-picture aspect ratio, and the second vertical scaling factor is equal to the first vertical scaling factor divided by the vertical aspect ratio of the sub-picture aspect ratio.
0. 9. The digital audio/video playback system as specified in
0. 10. The digital audio/video playback system as specified in
0. 11. The digital audio/video playback system as specified in
0. 12. The digital audio/video playback system as specified in
0. 13. The digital audio/video playback system as specified in
0. 14. A video decoding method capable of controlling presentation of sub-pictures, which is for decoding a digital audio/video signal, outputting an output picture through a video output device, wherein the digital audio/video signal includes a video bit stream and a sub-picture bit stream, the video decoding method comprising the steps of:
receiving the video bit stream and decoding the video bit stream to generate a decoded video;
receiving the sub-picture bit stream and decoding the sub-picture bit stream to generate at least one decoded sub-picture;
capturing the size of the decoded video, and generating a first scaling factor according to the size of the output picture and the size of the decoded video;
capturing the size and the position of the decoded sub-picture, and generating a second scaling factor according to the size of the output picture, the size of the decoded sub-picture and a sub-picture aspect ratio; and
setting the size of the decoded video according to the first scaling factor, setting the size and the position of the decoded sub-picture according to the second scaling factor, combining the decoded video and the decoded sub-picture, and outputting the combined picture to the video output device.
0. 15. The video decoding method as specified in
the first scaling factor comprises a first horizontal scaling factor and a first vertical scaling factor, in which the first horizontal scaling factor is equal to the horizontal width of the output picture divided by the horizontal width of the decoded video, and the first vertical scaling factor is equal to the vertical height of the output picture divided by the vertical height of the decoded video; and
the second scaling factor comprises a second horizontal scaling factor and a second vertical scaling factor while the sub-picture aspect ratio includes a horizontal aspect ratio and a vertical aspect ratio, in which the second horizontal scaling factor is equal to the first horizontal scaling factor divided by the horizontal aspect ratio of the sub-picture aspect ratio, and the second scaling factor is equal to the first vertical scaling factor divided by the vertical aspect ratio of the sub-picture aspect ratio.
0. 16. The video decoding method as specified in
0. 17. The video decoding method as specified in
0. 18. The video decoding method as specified in
0. 19. A video decoding method as specified in
0. 20. The video decoding method as specified in
0. 22. The video decoding apparatus as specified in claim 21, wherein:
the first scaling factor comprises a first horizontal scaling factor and a first vertical scaling factor, in which the first horizontal scaling factor is equal to the horizontal width of the output picture divided by the horizontal width of the decoded video, and the first vertical scaling factor is equal to the vertical height of the output picture divided by the vertical height of the decoded video.
0. 23. The video decoding apparatus as specified in claim 21, wherein the second scaling factor is determined according to the first scaling factor and a sub-picture aspect ratio.
0. 24. The video decoding apparatus as specified in claim 23, wherein the second scaling factor comprises a second horizontal scaling factor and a second vertical scaling factor while the sub-picture aspect ratio includes a horizontal aspect ratio and a vertical aspect ratio, in which the second horizontal scaling factor is equal to the first horizontal scaling factor divided by the horizontal aspect ratio of the sub-picture aspect ratio, and the second vertical scaling factor is equal to the first vertical scaling factor divided by the vertical aspect ratio of the sub-picture aspect ratio.
0. 25. The video decoding apparatus as specified in claim 22, wherein the horizontal width of the output picture is the product of the horizontal width of an active display area of the video output device and a horizontal aspect ratio of a video aspect ratio, and the vertical height of the output picture is the product of the vertical height of the active display area of the video output device and a vertical aspect ratio of the video aspect ratio.
|
This application is a continuation reissue of application Ser. No. 13/689,769, filed on Nov. 30, 2012, which is an application for reissue of U.S. Pat. No. 7,844,168, filed on Jun. 20, 2006 and issued on Nov. 30, 2010, which claims the priority of the prior-filed Taiwan patent application No. 94122087, filed on Jun. 30, 2005. The entirety of each of the above-mentioned applications and patents is hereby incorporated by reference and made a part of this specification.
a) Field of the Invention
The invention relates to a video decoding apparatus, a video decoding method and a digital audio/video playback system and, more particularly, to a video decoding apparatus, a video decoding method and a digital audio/video playback system capable of controlling presentation of sub-pictures.
b) Description of the Related Art
Due to the advance of information technology, both audio and video data can be stored, transmitted and played back in digital format. Besides providing movies of better quality, audio and video data in digital format offers many additional functions. Take the digital versatile disc (DVD) for instance, not only can the DVD store high-quality movies, but the DVD can also store multilingual audio tracks and multiple sub-pictures for users to choose from during playback. One of the major functions of sub-pictures is to act as subtitles, for example, an English film can include therein English and Chinese audio tracks, and English and Chinese subtitles, and during playback, users can choose the English audio track with Chinese subtitle, or the English audio track with English subtitle, as well as the Chinese audio track with English or Chinese subtitles. Therefore, this function facilitates internationalization of films.
As common practice, even though the DVD contains multiple subtitles, the DVD is usually played back with only one subtitle displayed. If two or more subtitles are displayed simultaneously, there can be overlay among the subtitles, making them difficult to read, or only one of the subtitles is displayed in the overlaid region such that other subtitles cannot be completely displayed.
Furthermore, differently formatted DVD films can cause incomplete display of the subtitle during playback. For example, in Phase Alternate Line (PAL) standard adopted by most European countries and Australia, the resolution of the DVD film is 720×576 pixels. In National Television System Committee (NTSC) standard adopted by North America and Japan, the resolution of the DVD film is 720×480 pixels. Therefore, when a DVD film recorded according to PAL standard is played back in a playback system compliant with NTSC standard, there is a possibility that the subtitle at the lower end of the picture is cut off and cannot be displayed completely. In addition, similar problems exist when playback systems with different formats, namely 4:3 or 16:9, are used to play differently formatted DVD films.
In summary, it would be desirable if the sub-pictures can be completely displayed and overlay among multiple sub-pictures can be avoided during playback of a digital film.
In view of the problems mentioned above, an object of the invention is to provide a video decoding apparatus, a video decoding method and a digital audio/video system capable of controlling presentation of sub-pictures, and the apparatus, method and system are able to control the aspect ratio and the position of the sub-pictures so that the sub-pictures can be completely displayed and any overlay among multiple sub-pictures is avoided.
To achieve the object mentioned above, the digital audio/video playback system capable of controlling presentation of sub-pictures of the invention decodes a digital audio/video signal, and to playback an output picture and a decoded audio through a video output device and an audio output device. The digital audio/video playback system includes a signal loader, a signal parser, a video decoding apparatus and an audio decoder. The signal loader is utilized to receive the digital audio/video signal. The signal parser is utilized to divide the digital audio/video signal into a video bit stream, a sub-picture bit stream and an audio bit stream. The audio decoder receives the audio bit stream, decodes it to a decoded audio, and outputs the decoded audio to the audio output device. The video decoding apparatus receives the video bit stream and the sub-picture bit stream, decodes and combines them into a picture, and outputs the combined picture to the video output device to playback.
The abovementioned video decoding apparatus includes: a first decoder which receives the video bit stream and decodes it in order to generate a decoded video; a second decoder which receives the sub-picture bit stream and decodes it in order to generate at least one decoded sub-picture; a first scaler which captures the size of the decoded video and generates a first scaling factor according to the size of the output picture and the size of the decoded video; a second scaler which captures the size and the position of the decoded sub-picture and generates a second scaling factor according to the size of the output picture, the size of the decoded sub-picture and a sub-picture aspect ratio; and a combiner which sets the size of the decoded video according to the first scaling factor, sets the size and the position of the decoded sub-picture according to the second scaling factor, combines the decoded video and the decoded sub-picture, and outputs the combined picture to the video output device.
The invention also discloses a video decoding method capable of controlling presentation of sub-pictures, which is utilized to decode a digital audio/video signal and to playback an output picture through a video output device. The video decoding method includes: receiving a video bit stream and decoding it to generate a decoded video; receiving a sub-picture bit stream and decoding it to generate at least one decoded sub-picture; capturing the size of the decoded video and generating a first scaling factor according to the size of the output picture and the size of the decoded video; capturing the size and the position of the decoded sub-picture, and generating a second scaling factor according to the size of the output picture, the size of the decoded sub-picture and a sub-picture aspect ratio; and setting the size of the decoded video according to the first scaling factor, setting the size and the position of the decoded sub-picture according to the second scaling factor, combining the decoded video and the decoded sub-picture, and outputting the combined picture to the video output device.
The video decoding apparatus, method and the digital audio/video playback system capable of controlling presentation of sub-pictures according to the invention are able to control the aspect ratio and the position of sub-pictures in order to completely display sub-pictures. At the same time, when a single sub-picture or a plurality of sub-pictures are displayed, there is no overlay on the main video region and overlay among the sub-pictures is avoided effectively so that each of the sub-pictures is completely displayed.
The video decoding apparatus, video decoding method and digital audio/video playback system capable of controlling presentation of sub-pictures according to preferred embodiments of the invention will be explained below with reference to the drawings, wherein the like numerals denote the like components.
Referring to
The signal loader 11 is utilized to receive DAVS. Take a DVD player for instance, the signal loader 11 may include elements like a control unit, a loading unit, a signal processing unit and more. As for Digital Video Broadcasting (DVB), the signal loader 11 may include elements like a control unit, an antenna, a signal processing unit and more. Therefore, in correspondence to different requirements, the signal loader 11 can be realized through different designs by a person skilled in the art, and thus the signal loader 11 is not explained in further detail.
The signal parser 12 is utilized to divide the loaded DAVS into a VBS, a SPBS and an ABS. The audio decoder 14 is utilized to receive the ABS and to decode it into a decoded audio (DA) for the audio output device to playback.
The video decoding apparatus 13 is utilized to receive and decode the VBS and the SPBS, and then the video decoding apparatus 13 combines the two into a picture for the video output device 21 to playback. The video decoding apparatus 13 includes: a first decoder 131, a second decoder 133, a first scaler 132, a second scaler 134 and a combiner 135. The first decoder 131 receives the VBS, decodes the VBS and outputs a decoded video (DV). The second decoder 133 receives the SPBS, decodes the SPBS and outputs at least one decoded sub-picture (DSP) under the control of the user's choice; for example, the second decoder 133 can output one or a plurality of DSPs. The first decoder can be an MPEG decoder, while the second decoder can be a run-length decoder.
The first scaler 132 is utilized to capture the size of the DV, such as the horizontal width and the vertical height, and to generate a first scaling factor according to the size of the output picture and the size of the DV. The second scaler 134 is utilized to capture the size and the position of the DSP, such as the horizontal coordinate and the vertical coordinate, and to generate a second scaling factor according to the size of the output picture, the size of the DSP and a sub-picture aspect ratio. The combiner 135 sets the size of the DV according to the first scaling factor, sets the size and the position of the DSP according to the second scaling factor, combines the DV and the DSP, and outputs the combined picture to the video output device 21 to playback. The procedures for generating the first scaling factor and the second scaling factor, and for combining the DV and the DSP will be described later.
Referring to
Referring to
Referring to
Referring to
Referring to
The flow of combining the DV and the DSP is depicted in
Regardless of what the modes the film to be displayed supports and what standards the display system complies with, the video decoding apparatus, video decoding method and digital audio/video system capable of controlling the presentation of the sub-pictures according to the invention are able to control the aspect ratio and the position of the sub-pictures so as to completely display the sub-pictures. Additionally, when a single sub-picture is displayed, the main video region is not covered, and when a plurality of sub-pictures are displayed, overlay among the plurality of sub-pictures is avoided to completely display all the sub-pictures.
While the invention has been described by way of example and in terms of the preferred embodiment, it is to be understood that the invention is not limited to the disclosed embodiments. To the contrary, it is intended to cover various modifications and similar arrangements apparent to those skilled in the art. For example, in the DVB system, the size and the coordinates of each object can be captured, and the size and the position of each object can be properly set for it to function properly. Therefore, the scope of the appended claims should be accorded the broadest interpretation so as to encompass all such modifications and similar arrangements.
Patent | Priority | Assignee | Title |
Patent | Priority | Assignee | Title |
4998171, | Jul 05 1988 | Samsung Electronics Co., Ltd. | Automatic shift circuit for a sub-picture screen for picture-in-picture feature |
5912710, | Dec 18 1996 | Kabushiki Kaisha Toshiba | System and method for controlling a display of graphics data pixels on a video monitor having a different display aspect ratio than the pixel aspect ratio |
6678006, | Jan 07 1998 | ATI Technologies ULC | Method and apparatus for video processing that includes sub-picture scaling |
6775467, | May 26 2000 | Cyberlink Corporation | DVD playback system capable of playing two subtitles at the same time |
7062153, | Sep 19 2000 | Kabushiki Kaisha Toshiba | Reproducing apparatus with sub-picture processing function |
20020034252, | |||
20030113102, | |||
20040223745, | |||
20050169608, | |||
20060158557, | |||
20060188229, | |||
20070030392, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Aug 27 2014 | Novatek Microelectronics Corp. | (assignment on the face of the patent) | / |
Date | Maintenance Fee Events |
May 17 2018 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
May 18 2022 | M1553: Payment of Maintenance Fee, 12th Year, Large Entity. |
Date | Maintenance Schedule |
Jun 13 2020 | 4 years fee payment window open |
Dec 13 2020 | 6 months grace period start (w surcharge) |
Jun 13 2021 | patent expiry (for year 4) |
Jun 13 2023 | 2 years to revive unintentionally abandoned end. (for year 4) |
Jun 13 2024 | 8 years fee payment window open |
Dec 13 2024 | 6 months grace period start (w surcharge) |
Jun 13 2025 | patent expiry (for year 8) |
Jun 13 2027 | 2 years to revive unintentionally abandoned end. (for year 8) |
Jun 13 2028 | 12 years fee payment window open |
Dec 13 2028 | 6 months grace period start (w surcharge) |
Jun 13 2029 | patent expiry (for year 12) |
Jun 13 2031 | 2 years to revive unintentionally abandoned end. (for year 12) |