A video decoding apparatus capable of controlling presentation of sub-pictures includes a first decoder, a second decoder, a first scaler, a second scaler and a combiner. The first decoder and the second decoder respectively decode a digital audio/video signal to generate a decoded video and a decoded sub-picture. In accordance with an output picture size, the decoded video size, the decoded sub-picture size and a sub-picture aspect ratio, the first scaler and the second scaler generate a first scaling factor and a second scaling factor. The combiner combines the decoded video and the decoded sub-picture according to the first scaling factor and the second scaling factor and outputs the combination thereof. A video decoding method and a digital audio/video playback system capable of controlling presentation of sub-pictures are also disclosed.

Patent
   RE45909
Priority
Jun 30 2005
Filed
Nov 30 2012
Issued
Mar 01 2016
Expiry
Jun 20 2026

TERM.DISCL.
Assg.orig
Entity
Large
0
46
all paid
0. 27. A digital audio/video playback system capable of controlling presentation of sub-pictures, which is for decoding a digital audio/video signal, outputting an output picture through a video output device, and outputting a decoded audio through an audio output device, the digital audio/video playback system comprising:
a signal loader which receives the digital audio/video signal;
a signal parser which divides the digital audio/video signal into a video bit stream, a sub-picture bit stream, and an audio bit stream;
an audio decoder which receives the audio bit stream, decodes the audio bit stream to a decoded audio, and outputs the decoded audio to the audio output device; and
a video decoding apparatus of claim 21.
0. 28. A video decoding method capable of controlling presentation of sub-pictures, which is for decoding a digital audio/video signal, outputting an output picture through a video output device, wherein the digital audio/video signal includes a video bit stream and a sub-picture bit stream, the video decoding method comprising the steps of:
receiving the video bit stream and decoding the video bit stream to generate a decoded video;
receiving the sub-picture bit stream and decoding the sub-picture bit stream to generate a decoded sub-picture;
generating a first scaling factor according to the size of the output picture and the size of the decoded video;
generating a second scaling factor according to a ratio of the first scaling factor and a sub-picture aspect ratio; and
setting a displayed size of the decoded video according to the first scaling factor, setting a displayed size and a position of the decoded sub-picture according to the second scaling factor, combining the decoded video and the decoded sub-picture, and outputting the combined picture to the video output device.
0. 21. A video decoding apparatus capable of controlling presentation of sub-pictures, which is for decoding a digital audio/video signal and outputting an output picture through a video output device, wherein the digital audio/video signal includes a video bit stream and a sub-picture bit stream, the video decoding apparatus comprising:
a first decoder which receives the video bit stream and decodes the video bit stream to generate a decoded video;
a second decoder which receives the sub-picture bit stream and decodes the sub-picture bit stream to generate a decoded sub-picture;
a first scaler which generates a first scaling factor according to the size of the output picture and the size of the decoded video;
a second scaler which generates a second scaling factor according to a ratio of the first scaling factor and a sub-picture aspect ratio; and
a combiner which sets a displayed size of the decoded video according to the first scaling factor, sets a displayed size and a position of the decoded sub-picture according to the second scaling factor, combines the decoded video and the decoded sub-picture, and outputs the combined picture to the video output device.
14. A video decoding method capable of controlling presentation of sub-pictures, which is for decoding a digital audio/video signal, outputting an output picture through a video output device, wherein the digital audio/video signal includes a video bit stream and a sub-picture bit stream, the video decoding method comprising the steps of:
receiving the video bit stream and decoding the video bit stream to generate a decoded video;
receiving the sub-picture bit stream and decoding the sub-picture bit stream to generate at least one decoded sub-picture;
capturing the size of the decoded video, and generating a first scaling factor according to the size of the output picture and the size of the decoded video;
capturing the size and the position of the decoded sub-picture, and generating a second scaling factor according to the size of the output picture, the size of the decoded sub-picture and a sub-picture aspect ratio; and
setting the size of the decoded video according to the first scaling factor, setting the size and the position of the decoded sub-picture according to the second scaling factor, combining the decoded video and the decoded sub-picture, and outputting the combined picture to the video output device.
0. 35. A video decoding apparatus capable of controlling presentation of sub-pictures, which is for decoding a digital audio/video signal and outputting an output picture through a video output device, wherein the digital audio/video signal includes a video bit stream and a sub-picture bit stream, the video decoding apparatus comprising:
a first decoder which receives the video bit stream and decodes the video bit stream to generate a decoded video;
a second decoder which receives the sub-picture bit stream and decodes the sub-picture bit stream to generate at least one decoded sub-picture;
a first scaler which generates a first scaling factor for scaling the decoded video;
a second scaler which generates a second scaling factor for scaling the decoded sub-picture, wherein the generation of the second scaling factor comprises determining the second scaling factor at least via a calculation that uses the first scaling factor; and
a combiner which sets a displayed size of the decoded video according to the first scaling factor, sets a displayed size and a position of the decoded sub-picture according to the second scaling factor, combines the decoded video and the decoded sub-picture, and outputs the combined picture to the video output device.
1. A video decoding apparatus capable of controlling presentation of sub-pictures, which is for decoding a digital audio/video signal and outputting an output picture through a video output device, wherein the digital audio/video signal includes a video bit stream and a sub-picture bit stream, the video decoding apparatus comprising:
a first decoder which receives the video bit stream and decodes the video bit stream to generate a decoded video;
a second decoder which receives the sub-picture bit stream and decodes the sub-picture bit stream to generate at least one decoded sub-picture;
a first scaler which captures the size of the decoded video and generates a first scaling factor according to the size of the output picture and the size of the decoded video;
a second scaler which captures the size and the position of the decoded sub-picture and generates a second scaling factor according to the size of the output picture, the size of the decoded sub-picture, and a sub-picture aspect ratio; and
a combiner which sets the size of the decoded video according to the first scaling factor, sets the size and the position of the decoded sub-picture according to the second scaling factor, combines the decoded video and the decoded sub-picture, and outputs the combined picture to the video output device.
7. A digital audio/video playback system capable of controlling presentation of sub-pictures, which is for decoding a digital audio/video signal, outputting an output picture through a video output device, and outputting a decoded audio through an audio output device, the digital audio/video playback system comprising:
a signal loader which receives the digital audio/video signal;
a signal parser which divides the digital audio/video signal into a video bit stream, a sub-picture bit stream, and an audio bit stream;
an audio decoder which receives the audio bit stream, decodes the audio bit stream to a decoded audio, and outputs the decoded audio to the audio output device; and
a video decoding apparatus, including:
a first decoder which receives the video bit stream and decodes the video bit stream to generate a decoded video;
a second decoder which receives the sub-picture bit stream and decodes the sub-picture bit stream to generate at least one decoded sub-picture;
a first scaler which captures the size of the decoded video and generates a first scaling factor according to the size of the output picture and the size of the decoded video;
a second scaler which captures the size and the position of the decoded sub-picture and generates a second scaling factor according to the size of the output picture, the size of the decoded sub-picture, and a sub-picture aspect ratio; and
a combiner which sets the size of the decoded video according to the first scaling factor, sets the size and the position of the sub-picture according the second scaling factor, combines the decoded video and the decoded sub-picture, and outputs the combined picture to the video output device.
2. The video decoding apparatus as specified in claim 1, wherein:
the first scaling factor comprises a first horizontal scaling factor and a first vertical scaling factor, in which the first horizontal scaling factor is equal to the horizontal width of the output picture divided by the horizontal width of the decoded video, and the first vertical scaling factor is equal to the vertical height of the output picture divided by the vertical height of the decoded video; and
the second scaling factor comprises a second horizontal scaling factor and a second vertical scaling factor while the sub-picture aspect ratio includes a horizontal aspect ratio and a vertical aspect ratio, in which the second horizontal scaling factor is equal to the first horizontal scaling factor divided by the horizontal aspect ratio of the sub-picture aspect ratio, and the second scaling factor is equal to the first vertical scaling factor divided by the vertical aspect ratio of the sub-picture aspect ratio.
3. The video decoding apparatus as specified in claim 2, wherein the horizontal width of the output picture is the product of the horizontal width of the active display area of the video output device and a horizontal aspect ratio of a video aspect ratio, and the vertical height of the output picture is the product of the vertical height of the active display of the video output device and a vertical aspect ratio of the video aspect ratio.
4. The video decoding apparatus as specified in claim 1, wherein if the decoded sub-picture is for the purpose of visual effect, the combiner only sets the size of the decoded video and the size of the decoded sub-picture when combining the decoded video and the decoded sub-picture.
5. The video decoding apparatus as specified in claim 1, wherein when the decoding of the sub-picture bit stream generates a plurality of decoded sub-pictures, the combiner further sets the positions of the plurality of decoded sub-pictures so as to avoid overlay among the plurality of decoded sub-pictures.
6. The video decoding apparatus as specified in claim 1, wherein the first decoder is an MPEG decoder and the second decoder is a run-length decoder.
8. The digital audio/video playback system as specified in claim 7, wherein:
the first scaling factor comprises a first horizontal scaling factor and a first vertical scaling factor, in which the first horizontal scaling factor is equal to the horizontal width of the output picture divided by the horizontal width of the decoded video, the first vertical scaling factor is equal to the vertical height of the output picture divided by the vertical height of the decoded video; and
the second scaling factor comprises a second horizontal scaling factor and a second vertical scaling factor while the sub-picture aspect ratio includes a horizontal aspect ratio and a vertical aspect ratio, in which the second horizontal scaling factor is equal to the first horizontal scaling factor divided by the vertical aspect ratio of the sub-picture aspect ratio, and the second vertical scaling factor is equal to the first vertical scaling factor divided by the vertical aspect ratio of the sub-picture aspect ratio.
9. The digital audio/video playback system as specified in claim 8, wherein the horizontal width of the output picture is the product of the horizontal width of the active display area of the video output device and a horizontal aspect ratio of a video aspect ratio, and the vertical height of the output picture is the product of the height of the active display area of the video output device and a vertical aspect ratio of the video aspect ratio.
10. The digital audio/video playback system as specified in claim 7, wherein if the decoded sub-picture is for the purpose of visual effect, the combiner only sets the size of the decoded video and the size of the decoded sub-picture when combining the decoded video and the decoded sub-picture.
11. The digital audio/video playback system as specified in claim 7, wherein when the decoding of the sub-picture bit stream generates a plurality of decoded sub-pictures, the combiner further sets the positions of the plurality of decoded sub-pictures so as to avoid overlay among the plurality of decoded sub-pictures.
12. The digital audio/video playback system as specified in claim 7, wherein the first decoder is an MPEG decoder, and the second decoder is a run-length decoder.
13. The digital audio/video playback system as specified in claim 7, wherein the digital audio/video playback system is a DVD playback system or a digital video broadcasting playback system.
15. The video decoding method as specified in claim 14, wherein:
the first scaling factor comprises a first horizontal scaling factor and a first vertical scaling factor, in which the first horizontal scaling factor is equal to the horizontal width of the output picture divided by the horizontal width of the decoded video, and the first vertical scaling factor is equal to the vertical height of the output picture divided by the vertical height of the decoded video; and
the second scaling factor comprises a second horizontal scaling factor and a second vertical scaling factor while the sub-picture aspect ratio includes a horizontal aspect ratio and a vertical aspect ratio, in which the second horizontal scaling factor is equal to the first horizontal scaling factor divided by the horizontal aspect ratio of the sub-picture aspect ratio, and the second scaling factor is equal to the first vertical scaling factor divided by the vertical aspect ratio of the sub-picture aspect ratio.
16. The video decoding method as specified in claim 15, wherein the horizontal width of the output picture is the product of the horizontal width of the active display area of the video output device and a horizontal aspect ratio of a video aspect ratio, and the vertical height of the output picture is the product of the vertical height of the active display of the video output device and a vertical aspect ratio of the video aspect ratio.
17. The video decoding method as specified in claim 14, wherein if the decoded sub-picture is for the purpose of visual effect, only the size of the decoded video and the size of the decoded sub-picture are set when combining the decoded video and the decoded sub-picture.
18. The video decoding method as specified in claim 14, wherein the decoded sub-picture is prevented from exceeding the border of the output picture and covering the main region of the decoded video when combining the decoded video and the decoded sub-picture.
19. A video decoding method as specified in claim 14, wherein when the decoding of the sub-picture bit stream generates a plurality of decoded sub-pictures, overlay among the plurality of decoded sub-pictures is prevented when combining the decoded video and the decoded sub-pictures.
20. The video decoding method as specified in claim 14, wherein the first decoder is an MPEG decoder, and the second decoder is a run-length decoder.
0. 22. The video decoding apparatus as specified in claim 21, wherein:
the first scaling factor comprises a first horizontal scaling factor and a first vertical scaling factor, in which the first horizontal scaling factor is equal to the horizontal width of the output picture divided by the horizontal width of the decoded video, and the first vertical scaling factor is equal to the vertical height of the output picture divided by the vertical height of the decoded video.
0. 23. The video decoding apparatus as specified in claim 22, wherein the second scaling factor comprises a second horizontal scaling factor and a second vertical scaling factor while the sub-picture aspect ratio includes a horizontal ratio and a vertical ratio, in which the second horizontal scaling factor is equal to the first horizontal scaling factor divided by the horizontal ratio of the sub-picture aspect ratio, and the second vertical scaling factor is equal to the first vertical scaling factor divided by the vertical ratio of the sub-picture aspect ratio.
0. 24. The video decoding apparatus as specified in claim 22, wherein the horizontal width of the output picture is the product of the horizontal width of the active display area of the video output device and a horizontal ratio of a video aspect ratio, and the vertical height of the output picture is the product of the vertical height of the active display area of the video output device and a vertical ratio of the video aspect ratio.
0. 25. The video decoding apparatus as specified in claim 21, wherein if the decoded sub-picture is for the purpose of visual effect, the combiner sets the displayed size of the decoded sub-picture according to the first scaling factor when combining the decoded video and the decoded sub-picture.
0. 26. The video decoding apparatus as specified in claim 21, wherein when the decoding of the sub-picture bit stream generates a plurality of decoded sub-pictures, the combiner further sets the positions of the plurality of decoded sub-pictures so as to avoid overlay among the plurality of decoded sub-pictures.
0. 29. The video decoding method as specified in claim 28, wherein:
the first scaling factor comprises a first horizontal scaling factor and a first vertical scaling factor, in which the first horizontal scaling factor is equal to the horizontal width of the output picture divided by the horizontal width of the decoded video, and the first vertical scaling factor is equal to the vertical height of the output picture divided by the vertical height of the decoded video.
0. 30. The video decoding method as specified in claim 29, wherein the second scaling factor comprises a second horizontal scaling factor and a second vertical scaling factor while the sub-picture aspect ratio includes a horizontal ratio and a vertical ratio, in which the second horizontal scaling factor is equal to the first horizontal scaling factor divided by the horizontal ratio of the sub-picture aspect ratio, and the second vertical scaling factor is equal to the first vertical scaling factor divided by the vertical ratio of the sub-picture aspect ratio.
0. 31. The video decoding method as specified in claim 29, wherein the horizontal width of the output picture is the product of the horizontal width of the active display area of the video output device and a horizontal ratio of a video aspect ratio, and the vertical height of the output picture is the product of the vertical height of the active display area of the video output device and a vertical ratio of the video aspect ratio.
0. 32. The video decoding method as specified in claim 28, wherein if the decoded sub-picture is for the purpose of visual effect, the displayed size of the decoded sub-picture is set according to the first scaling factor when combining the decoded video and the decoded sub-picture.
0. 33. The video decoding method as specified in claim 28, wherein the decoded sub-picture is prevented from exceeding the border of the output picture and covering the main region of the decoded video when combining the decoded video and the decoded sub-picture.
0. 34. The video decoding method as specified in claim 28, wherein when the decoding of the sub-picture bit stream generates a plurality of decoded sub-pictures, overlay among the plurality of decoded sub-pictures is prevented when combining the decoded video and the decoded sub-pictures.
0. 36. The video decoding apparatus as specified in claim 21, wherein the combiner sets the displayed size and the position of the decoded sub-picture further according to a relative position relationship between at least two of the decoded video and the at least one decoded sub-picture.
0. 37. The video decoding method as specified in claim 28, wherein in the step of setting the displayed size and the position of the decoded sub-picture according to the second scaling factor, the displayed size and the position of the at least one decoded sub-picture are set further according to a relative position relationship between at least two of the decoded video and the at least one decoded sub-picture.

a) Field of the Invention

The invention relates to a video decoding apparatus, a video decoding method and a digital audio/video playback system and, more particularly, to a video decoding apparatus, a video decoding method and a digital audio/video playback system capable of controlling presentation of sub-pictures.

b) Description of the Related Art

Due to the advance of information technology, both audio and video data can be stored, transmitted and played back in digital format. Besides providing movies of better quality, audio and video data in digital format offers many additional functions. Take the digital versatile disc (DVD) for instance, not only can the DVD store high-quality movies, but the DVD can also store multilingual audio tracks and multiple sub-pictures for users to choose from during playback. One of the major functions of sub-pictures is to act as subtitles, for example, an English film can include therein English and Chinese audio tracks, and English and Chinese subtitles, and during playback, users can choose the English audio track with Chinese subtitle, or the English audio track with English subtitle, as well as the Chinese audio track with English or Chinese subtitles. Therefore, this function facilitates internationalization of films.

As common practice, even though the DVD contains multiple subtitles, the DVD is usually played back with only one subtitle displayed. If two or more subtitles are displayed simultaneously, there can be overlay among the subtitles, making them difficult to read, or only one of the subtitles is displayed in the overlaid region such that other subtitles cannot be completely displayed.

Furthermore, differently formatted DVD films can cause incomplete display of the subtitle during playback. For example, in Phase Alternate Line (PAL) standard adopted by most European countries and Australia, the resolution of the DVD film is 720×576 pixels. In National Television System Committee (NTSC) standard adopted by North America and Japan, the resolution of the DVD film is 720×480 pixels. Therefore, when a DVD film recorded according to PAL standard is played back in a playback system compliant with NTSC standard, there is a possibility that the subtitle at the lower end of the picture is cut off and cannot be displayed completely. In addition, similar problems exist when playback systems with different formats, namely 4:3 or 16:9, are used to play differently formatted DVD films.

In summary, it would be desirable if the sub-pictures can be completely displayed and overlay among multiple sub-pictures can be avoided during playback of a digital film.

In view of the problems mentioned above, an object of the invention is to provide a video decoding apparatus, a video decoding method and a digital audio/video system capable of controlling presentation of sub-pictures, and the apparatus, method and system are able to control the aspect ratio and the position of the sub-pictures so that the sub-pictures can be completely displayed and any overlay among multiple sub-pictures is avoided.

To achieve the object mentioned above, the digital audio/video playback system capable of controlling presentation of sub-pictures of the invention decodes a digital audio/video signal, and to playback an output picture and a decoded audio through a video output device and an audio output device. The digital audio/video playback system includes a signal loader, a signal parser, a video decoding apparatus and an audio decoder. The signal loader is utilized to receive the digital audio/video signal. The signal parser is utilized to divide the digital audio/video signal into a video bit stream, a sub-picture bit stream and an audio bit stream. The audio decoder receives the audio bit stream, decodes it to a decoded audio, and outputs the decoded audio to the audio output device. The video decoding apparatus receives the video bit stream and the sub-picture bit stream, decodes and combines them into a picture, and outputs the combined picture to the video output device to playback.

The abovementioned video decoding apparatus includes: a first decoder which receives the video bit stream and decodes it in order to generate a decoded video; a second decoder which receives the sub-picture bit stream and decodes it in order to generate at least one decoded sub-picture; a first scaler which captures the size of the decoded video and generates a first scaling factor according to the size of the output picture and the size of the decoded video; a second scaler which captures the size and the position of the decoded sub-picture and generates a second scaling factor according to the size of the output picture, the size of the decoded sub-picture and a sub-picture aspect ratio; and a combiner which sets the size of the decoded video according to the first scaling factor, sets the size and the position of the decoded sub-picture according to the second scaling factor, combines the decoded video and the decoded sub-picture, and outputs the combined picture to the video output device.

The invention also discloses a video decoding method capable of controlling presentation of sub-pictures, which is utilized to decode a digital audio/video signal and to playback an output picture through a video output device. The video decoding method includes: receiving a video bit stream and decoding it to generate a decoded video; receiving a sub-picture bit stream and decoding it to generate at least one decoded sub-picture; capturing the size of the decoded video and generating a first scaling factor according to the size of the output picture and the size of the decoded video; capturing the size and the position of the decoded sub-picture, and generating a second scaling factor according to the size of the output picture, the size of the decoded sub-picture and a sub-picture aspect ratio; and setting the size of the decoded video according to the first scaling factor, setting the size and the position of the decoded sub-picture according to the second scaling factor, combining the decoded video and the decoded sub-picture, and outputting the combined picture to the video output device.

The video decoding apparatus, method and the digital audio/video playback system capable of controlling presentation of sub-pictures according to the invention are able to control the aspect ratio and the position of sub-pictures in order to completely display sub-pictures. At the same time, when a single sub-picture or a plurality of sub-pictures are displayed, there is no overlay on the main video region and overlay among the sub-pictures is avoided effectively so that each of the sub-pictures is completely displayed.

FIG. 1 shows a block diagram of a digital audio/video playback system capable of controlling presentation of sub-pictures according to a preferred embodiment of the invention.

FIG. 2 shows a video decoding method capable of controlling presentation of sub-pictures according to a preferred embodiment of the invention.

FIG. 3 shows a flow chart of a first scaler generating a first scaling factor.

FIG. 4 shows a flow chart of a second scaler generating a second scaling factor; and

FIG. 5 shows a flow chart of a combiner combining the decoded video and the decoded sub-picture.

The video decoding apparatus, video decoding method and digital audio/video playback system capable of controlling presentation of sub-pictures according to preferred embodiments of the invention will be explained below with reference to the drawings, wherein the like numerals denote the like components.

Referring to FIG. 1, a digital audio/video playback system 1 capable of controlling presentation of sub-pictures according to a preferred embodiment of the invention is utilized to decode a digital audio/video signal (DAVS) and to playback an output picture and a decoded audio through a video output device 21 and an audio output device 22, wherein the DAVS includes a video bit stream (VBS), a sub-picture bit stream (SPBS) and an audio bit stream (ABS). The digital audio/video playback system 1 includes a signal loader 11, a signal parser 12, a video decoding apparatus 13 and an audio decoder 14.

The signal loader 11 is utilized to receive DAVS. Take a DVD player for instance, the signal loader 11 may include elements like a control unit, a loading unit, a signal processing unit and more. As for Digital Video Broadcasting (DVB), the signal loader 11 may include elements like a control unit, an antenna, a signal processing unit and more. Therefore, in correspondence to different requirements, the signal loader 11 can be realized through different designs by a person skilled in the art, and thus the signal loader 11 is not explained in further detail.

The signal parser 12 is utilized to divide the loaded DAVS into a VBS, a SPBS and an ABS. The audio decoder 14 is utilized to receive the ABS and to decode it into a decoded audio (DA) for the audio output device to playback.

The video decoding apparatus 13 is utilized to receive and decode the VBS and the SPBS, and then the video decoding apparatus 13 combines the two into a picture for the video output device 21 to playback. The video decoding apparatus 13 includes: a first decoder 131, a second decoder 133, a first scaler 132, a second scaler 134 and a combiner 135. The first decoder 131 receives the VBS, decodes the VBS and outputs a decoded video (DV). The second decoder 133 receives the SPBS, decodes the SPBS and outputs at least one decoded sub-picture (DSP) under the control of the user's choice; for example, the second decoder 133 can output one or a plurality of DSPs. The first decoder can be an MPEG decoder, while the second decoder can be a run-length decoder.

The first scaler 132 is utilized to capture the size of the DV, such as the horizontal width and the vertical height, and to generate a first scaling factor according to the size of the output picture and the size of the DV. The second scaler 134 is utilized to capture the size and the position of the DSP, such as the horizontal coordinate and the vertical coordinate, and to generate a second scaling factor according to the size of the output picture, the size of the DSP and a sub-picture aspect ratio. The combiner 135 sets the size of the DV according to the first scaling factor, sets the size and the position of the DSP according to the second scaling factor, combines the DV and the DSP, and outputs the combined picture to the video output device 21 to playback. The procedures for generating the first scaling factor and the second scaling factor, and for combining the DV and the DSP will be described later.

Referring to FIG. 2, a video decoding method capable of controlling presentation of sub-pictures according to a preferred embodiment of the invention is described. First, a VBS is received and decoded to generate a DV (S31), and then a SPBS is received and decoded to generate at least one DSP (S32). Next, the size of the DV is captured, and a first scaling factor is generated according to the size of an output picture and the size of the DV (S33).

Referring to FIG. 3, the procedure for generating the first scaling factor is described. First, the size of the DV, namely its horizontal width Vh and its vertical height Vv, is obtained (S331), and the size of the active display area of a video output device 21, namely its horizontal width Dh and its vertical height Dv, is obtained (S332). The next step is to determine whether or not a film to be played supports specific video aspect ratios (S333), for example the aspect ratios of modes such as letterbox or pan & scan. If the film to be played does not support a specific display mode, the size of the output picture is equal to the size of the active display area of the video output device 21, namely the horizontal width OVh of the output picture is equal to the horizontal width Dh of the active display area of the video output device 21, and the vertical height OVv of the output picture is equal to the vertical height Dv of the active display of the video output device 21 (S335). If the film to be played supports a specific display mode, and the user chooses the specific display mode for playback, the horizontal width OVh of the output picture is the product of the horizontal width Dh of the active display area of the video output device 21 and a horizontal aspect ratio VARh of the video aspect ratio, and the vertical height OVv of the output picture is the product of the vertical height Dv of the active display area of the video output device 21 and a vertical aspect ratio VARv of the video aspect ratio (S334). Finally, the first scaling factor is calculated according to the size of the output picture and the size of the DV, and the first scaling factor includes a first horizontal scaling factor (SF1h) and a first vertical scaling factor (SF1v). The SF1h is equal to the horizontal width OVh of the output picture divided by the horizontal width Vh of the DV. The SF1v is equal to the vertical height OVv of the output picture divided by the vertical height Vv of the DV.

Referring to FIG. 2 again, the step S34 is to capture the size and the position of the DSP, and to generate a second scaling factor according to the size of the output picture, the size of the DSP and a sub-picture aspect ratio.

Referring to FIG. 4, the procedure for generating the second scaling factor is described. First, the size and the position of the DSP, namely its horizontal width SPh, its vertical height SPv, its horizontal coordinate, and its vertical coordinate, are obtained (S341). Then, the sub-picture aspect ratio of the DSP, which includes a horizontal aspect ratio (SPARh) and a vertical aspect ratio (SPARv), is obtained (S342). The next step is to determine whether the film to be played permits sub-picture scaling (S343); scaling the sub-picture can result in a blurred sub-picture during playback, thus restriction on sub-picture scaling may have been added when the film was recorded. If sub-picture scaling is prohibited, a second horizontal scaling factor (SF2h) and a second vertical scaling factor (SF2v) of the second scaling factor are both 1 (S345), namely the sub-picture is not scaled. If the sub-picture scaling is allowed for playback, the SF2h is equal to the SF1h divided by the SPARh of the sub-picture aspect ratio, and the SF2v is equal to the SF1v divided by the SPARv of the sub-picture aspect ratio.

Referring to FIG. 2 again, finally, the size of the DV is set according to the first scaling factor, the size and the position of the DSP is set according to the second scaling factor, the DV and the DSP are combined, and the combined picture is output to the video output device 21 to playback (S35).

The flow of combining the DV and the DSP is depicted in FIG. 5. Firstly, determine whether the DSP is for the purpose of visual effect instead of being as the sub-title (S351). If yes, the relative positions between the DSP and the DV should be fixed to retain the intended visual effect, thus, the size of the DSP is set so as to precisely achieve the purpose of visual effect. If the DSP is for the purpose other than visual effect, for example as the sub-title, the size and the position of the DSP are set (S353). Next, whether the DSP exceeds the border of the picture is determined (S354); if yes, the size and the position of the DSP are re-set (S353). Then, whether the DSP covers the main region of the DV is determined (S355). For example, generally the central area of a DV is the main region, thus efforts should be made to prevent DSP from covering the central area of the DV as much as possible. If the main region of the DV is covered, the size and the position of the DSP are re-set as well (S353). If the user chooses to display a plurality of DSPs, it is necessary to further determine whether there is overlay among the plurality of DSPs (S356) when combining the DV and the DSPs. And if there is overlay among the plurality of DSPs, go back to step S353 to re-set the sizes and the positions of the plurality of DSPs. After the sizes and the positions of all the DSPs are set (S357), combine the DV and the DSP, and output the combined picture to the video output device 21 for playback (S358).

Regardless of what the modes the film to be displayed supports and what standards the display system complies with, the video decoding apparatus, video decoding method and digital audio/video system capable of controlling the presentation of the sub-pictures according to the invention are able to control the aspect ratio and the position of the sub-pictures so as to completely display the sub-pictures. Additionally, when a single sub-picture is displayed, the main video region is not covered, and when a plurality of sub-pictures are displayed, overlay among the plurality of sub-pictures is avoided to completely display all the sub-pictures.

While the invention has been described by way of example and in terms of the preferred embodiment, it is to be understood that the invention is not limited to the disclosed embodiments. To the contrary, it is intended to cover various modifications and similar arrangements apparent to those skilled in the art. For example, in the DVB system, the size and the coordinates of each object can be captured, and the size and the position of each object can be properly set for it to function properly. Therefore, the scope of the appended claims should be accorded the broadest interpretation so as to encompass all such modifications and similar arrangements.

Hsu, Jung-Fu, Tsou, Meng-Nan

Patent Priority Assignee Title
Patent Priority Assignee Title
4998171, Jul 05 1988 Samsung Electronics Co., Ltd. Automatic shift circuit for a sub-picture screen for picture-in-picture feature
5467142, Apr 24 1992 JVC Kenwood Corporation Television receiver for reproducing video images having different aspect ratios and characters transmitted with video images
5570126, May 03 1993 THE CHASE MANHATTAN BANK, AS COLLATERAL AGENT System for composing multimedia signals for interactive television services
5912710, Dec 18 1996 Kabushiki Kaisha Toshiba System and method for controlling a display of graphics data pixels on a video monitor having a different display aspect ratio than the pixel aspect ratio
5963221, Oct 16 1995 DEUTSCHE BANK AG NEW YORK BRANCH, AS COLLATERAL AGENT Device for writing and reading of size reduced video on a video screen by fixing read and write of alternating field memories during resize operation
6147712, May 27 1996 Mitsubishi Denki Kabushiki Kaisha Format conversion circuit and television receiver provided therewith and method of converting video signals
6204887, Dec 11 1998 Hitachi America, Ltd. Methods and apparatus for decoding and displaying multiple images using a common processor
6310656, Nov 17 1997 Sony Corporation Television apparatus, display method of television apparatus and picture plane control apparatus, and method
6678006, Jan 07 1998 ATI Technologies ULC Method and apparatus for video processing that includes sub-picture scaling
6707504, Jan 24 2000 LG Electronics Inc. Caption display method of digital television
6727958, Aug 20 1999 Winbond Electronics Corp. Method and apparatus for displaying resized pictures on an interlaced target display system
6775467, May 26 2000 Cyberlink Corporation DVD playback system capable of playing two subtitles at the same time
6912350, Dec 08 1999 Intel Corporation DVD subpicture rendering without loss of color resolution
7006156, Oct 19 2000 Sanyo Electric Co., Ltd. Image data output device and receiving device
7042511, Dec 13 2001 XUESHAN TECHNOLOGIES INC Apparatus and method for video data processing in digital video decoding
7062153, Sep 19 2000 Kabushiki Kaisha Toshiba Reproducing apparatus with sub-picture processing function
7196733, Jan 28 2002 Canon Kabushiki Kaisha Apparatus for receiving broadcast data, method for displaying broadcast program, and computer program
7212218, Nov 29 2002 MATSUSHITA ELECTRIC INDUSTRIAL CO , LTD Video display apparatus and video display method
7365757, Dec 17 1998 ATI Technologies ULC Method and apparatus for independent video and graphics scaling in a video graphics system
7616264, Dec 06 2004 Pixelworks, Inc. Cropped and scaled picture-in-picture system and method
7911536, Sep 23 2004 Intel Corporation Screen filled display of digital video content
7936360, Jan 04 2005 HISENSE VISUAL TECHNOLOGY CO , LTD Reproducing apparatus capable of reproducing picture data
8279938, Dec 02 2004 SONY NETWORK ENTERTAINMENT PLATFORM INC ; Sony Computer Entertainment Inc Encoding device and method, decoding device and method, program, recording medium, and data structure
20020034252,
20020089523,
20030113102,
20040179824,
20040223745,
20050001931,
20050012862,
20050068346,
20050128349,
20050169608,
20060188229,
20070030392,
20070097261,
CN1466849,
JP10215409,
JP2002016884,
JP2003037792,
JP2004208014,
JP2004320324,
JP402223286,
JP9294250,
WO2004057532,
WO2004051992,
/
Executed onAssignorAssigneeConveyanceFrameReelDoc
Nov 30 2012Novatek Microelectronics Corp.(assignment on the face of the patent)
Date Maintenance Fee Events
May 17 2018M1552: Payment of Maintenance Fee, 8th Year, Large Entity.
May 18 2022M1553: Payment of Maintenance Fee, 12th Year, Large Entity.


Date Maintenance Schedule
Mar 01 20194 years fee payment window open
Sep 01 20196 months grace period start (w surcharge)
Mar 01 2020patent expiry (for year 4)
Mar 01 20222 years to revive unintentionally abandoned end. (for year 4)
Mar 01 20238 years fee payment window open
Sep 01 20236 months grace period start (w surcharge)
Mar 01 2024patent expiry (for year 8)
Mar 01 20262 years to revive unintentionally abandoned end. (for year 8)
Mar 01 202712 years fee payment window open
Sep 01 20276 months grace period start (w surcharge)
Mar 01 2028patent expiry (for year 12)
Mar 01 20302 years to revive unintentionally abandoned end. (for year 12)