An apparatus and method for injecting synchronized stream data into a Motion Picture Experts Group 2 (MPEG-2) video/audio transport stream for a digital data broadcasting service. The apparatus and method for injecting synchronized stream data calculate the injection time point of data access unit (dau) that forms the synchronized stream data and injects dau into the MPEG-2 video/audio transport stream based on the calculated injection time point so that the synchronized stream data could be presented smoothly in a receiver. The synchronized stream data injecting apparatus includes: an additional data storing unit, a synchronized stream data selection/establishment unit, a synchronized stream data analyzing unit, a transport stream analyzing unit, a synchronized stream data injection/management unit, a presentation time stamp re-stamping unit and a multiplexing unit.

Patent
   RE44192
Priority
Oct 26 2002
Filed
Jul 29 2010
Issued
Apr 30 2013
Expiry
Oct 23 2023
Assg.orig
Entity
Small
0
9
EXPIRED
0. 63. A method for injecting synchronized stream data into a transport stream, the method comprising:
selecting synchronized stream data corresponding to the transport stream;
analyzing the selected synchronized stream data and generating information related to the synchronized stream data;
analyzing the transport stream and generating information related to the transport stream;
determining whether to inject the selected synchronized stream data based on the information related to the synchronized stream data and the information related to the transport stream;
outputting the corresponding synchronized stream data based on the determination; and
re-stamping the synchronized stream data outputted with a new presentation time stamp.
0. 43. A method for injecting synchronized stream data into a transport stream, the method comprising:
selecting synchronized stream data corresponding to the transport stream;
analyzing the selected synchronized stream data and generating information related to the synchronized stream data;
analyzing the transport stream and generating information related to the transport stream;
determining whether to inject the selected synchronized stream data based on the information related to the synchronized stream data and the information related to the transport stream:
outputting the corresponding synchronized stream data based on the determination;
re-stamping the synchronized stream data outputted with a new presentation time stamp; and
multiplexing the transport stream and the synchronized stream data.
0. 62. An apparatus configured to inject synchronized stream data into a transport stream, the apparatus comprising:
a synchronized stream data selection/establishment unit configured to select synchronized stream data corresponding to the transport stream;
a synchronized stream data analyzing unit configured to analyze the selected synchronized stream data and generate information related to the synchronized stream data;
a transport stream analyzing unit configured to analyze the transport stream and generate information related to the transport stream;
a synchronized stream data injection/management unit configured to determine whether to inject the selected synchronized stream data based on the information related to the synchronized stream data and the information related to the transport stream, and control the data storing unit to output the corresponding synchronized stream data based on the determination; and
a presentation time stamp re-stamping unit configured to re-stamp the synchronized stream data outputted from the data storing unit with a new presentation time stamp.
0. 23. An apparatus configured to inject synchronized stream data into a transport stream, the apparatus comprising:
a data storing unit configured to store synchronized stream data;
a synchronized stream data selection/establishment unit configured to select synchronized stream data corresponding to the transport stream;
a synchronized stream data analyzing unit configured to analyze the selected synchronized stream data and generate information related to the synchronized stream data;
a transport stream analyzing unit configured to analyze the transport stream and generate information related to the transport stream;
a synchronized stream data injection/management unit configured to determine whether to inject the selected synchronized stream data based on the information related to the synchronized stream data and the information related to the transport stream, and control the data storing unit to output the corresponding synchronized stream data based on the determination;
a presentation time stamp re-stamping unit configured to re-stamp the synchronized stream data outputted from the data storing unit with a new presentation time stamp; and
a multiplexing unit configured to multiplex the transport stream and the synchronized stream data.
0. 21. An apparatus for injecting synchronized stream data for a digital data broadcasting service, comprising:
an additional data storing unit that stores, manages, and outputs additional data used for the digital data broadcasting service;
a synchronized stream data selection/establishment unit that selects synchronized stream data to be multiplexed with a video/audio transport stream, which is inputted from the outside, among the additional data stored in the additional data storing unit, and establishes parameter values necessary to multiplex the selected synchronized stream data and the video/audio transport stream;
a synchronized stream data analyzing unit that analyzes the selected synchronized stream data periodically based on the parameter values established in the synchronized stream data selection/establishment unit, and generates information related to the transport stream of the synchronized stream data;
a transport stream analyzing unit that analyzes the video/audio transport stream periodically, and generates information related to the video/audio transport stream;
a synchronized stream data injection/management unit that determines whether to inject a data access unit (dau) that forms the synchronized stream data or not based on the information related to the synchronized stream data transport stream generated in the synchronized stream data analyzing unit and the information related to the video/audio transport stream generated in the transport stream analyzing unit, and controls the output of the dau that forms the synchronized stream data which are stored in the additional data storing unit;
a presentation time stamp re-stamping unit that re-stamps the presentation time stamp of the synchronized stream data which are outputted from the additional data storing unit based on the parameter values established in the synchronized stream data selection/establishment unit; and
a multiplexing unit that multiplexes and outputs the video/audio transport stream and the synchronized stream data outputted from the presentation time stamp re-stamping unit.
0. 22. A method for injecting synchronized stream data for a digital data broadcasting service, comprising the steps of:
a) selecting synchronized stream data that are synchronized with a video/audio transport stream supplied from the outside among additional data used for the digital data broadcasting service, and establishing an injection period which is a time interval for analyzing the video/audio transport stream and the synchronized stream data and injecting the synchronized stream data, the number of analyzed daus which is the largest number of daus that can be injected into the video/audio transport stream during the above established injection period, and a new presentation time stamp of a first data access unit (dau) of the synchronized stream data;
b) obtaining the presentation time stamp of a corresponding dau and the number of transport stream packets by analyzing the selected synchronized stream data periodically based on the injection period and the number of analyzed dau which are established in the step a), and obtaining as many as daus as the analyzed daus;
c) obtaining pcr information of the video/audio transport stream within an analyzing section by analyzing the video/audio transport stream periodically;
d) determining whether to inject the dau of the synchronized stream data into the video/audio transport stream within the analyzing section or not based on the new presentation time stamp of the first dau of the synchronized stream data, presentation time stamp of dau of the synchronized stream data and the pcr information of the video/audio transport stream;
e) if the dau of the synchronized stream data is to be injected into the video/audio transport stream within the analyzing section, re-stamping the presentation time stamp of dau of the synchronized stream data by using the new presentation time stamp of the first dau of the synchronized stream data; and
f) injecting the dau of the synchronized stream data whose presentation time stamp is re-stamped newly into the video/audio transport stream and outputting the video/audio transport stream with the dau.
12. A method for injecting synchronized stream data for a digital data broadcasting service, comprising the steps of:
a) selecting synchronized stream data that are synchronized with a video/audio transport stream supplied from the outside among additional data used for the digital data broadcasting service, and establishing an injection period which is a time interval for analyzing the video/audio transport stream and the synchronized stream data and injecting the synchronized stream data, the number of analyzed daus which is the largest number of daus that can be injected into the video/audio transport stream during the above established injection period, and a new presentation time stamp of a first data access unit (dau) of the synchronized stream data;
b) obtaining the presentation time stamp of a corresponding dau and the number of transport stream packets by analyzing the selected synchronized stream data periodically based on the injection period and the number of analyzed dau which are established in the step a), and obtaining as many as daus as the analyzed daus;
c) obtaining pcr information of the video/audio transport stream within an analyzing section by analyzing the video/audio transport stream periodically based on the injection period determined in the step a);
d) determining whether to inject the dau of the synchronized stream data into the video/audio transport stream within the analyzing section or not based on the new presentation time stamp of the first dau of the synchronized stream data, presentation time stamp of dau of the synchronized stream data and the pcr information of the video/audio transport stream;
e) if the dau of the synchronized stream data is to be injected into the video/audio transport stream within the analyzing section, re-stamping the presentation time stamp of dau of the synchronized stream data by using the new presentation time stamp of the first dau of the synchronized stream data; and
f) injecting the dau of the synchronized stream data whose presentation time stamp is re-stamped newly into the video/audio transport stream and outputting the video/audio transport stream with the dau.
1. An apparatus for injecting synchronized stream data for a digital data broadcasting service, comprising:
an additional data storing means for storing, managing and outputting additional data used for the digital data broadcasting service;
a synchronized stream data selection/establishment means for selecting synchronized stream data to be multiplexed with a video/audio transport stream, which is inputted from the outside, among the additional data stored in the additional data storing means, and establishing parameter values necessary to multiplex the selected synchronized stream data and the video/audio transport stream;
a synchronized stream data analyzing means for analyzing the selected synchronized stream data periodically based on the parameter values established in the synchronized stream data selection/establishment means, and generating information related to the transport stream of the synchronized stream data;
a transport stream analyzing means for analyzing the video/audio transport stream periodically based on the parameter values established in the synchronized stream data selection/establishment means, and generating information related to the video/audio transport stream;
a synchronized stream data injection/management means for determining whether to inject a data access unit (dau) that forms the synchronized stream data or not based on the information related to the synchronized stream data transport stream generated in the synchronized stream data analyzing means and the information related to the video/audio transport stream generated in the transport stream analyzing means, and controlling the output of the dau that forms the synchronized stream data which are stored in the additional data storing means;
a presentation time stamp re-stamping means for re-stamping the presentation time stamp of the synchronized stream data which are outputted from the additional data storing means based on the parameter values established in the synchronized stream data selection/establishment means; and
a multiplexing means for multiplexing and outputting the video/audio transport stream and the synchronized stream data outputted from the presentation time stamp re-stamping means.
2. The apparatus as recited in claim 1, wherein the parameter values established in the synchronized stream data selection/establishment means include at least any one selected from a group having a new presentation time stamp of a first dau of the synchronized stream data;
an injection period, which is a time interval for analyzing the video/audio transport stream and synchronized stream data and injecting the synchronized stream data to the video/audio transport stream; and
the number of analyzed daus within the analyzed synchronized stream data during the above established injection period.
3. The apparatus as recited in claim 1, wherein if the number of analyzed daus is not established in the synchronized stream data selection/establishment means, the synchronized stream data selection/establishment means calculates the number of analyzed daus by multiplying the largest value (59.94 or 60) of the number of frequency of dau generation to the established injection period, and if the injection period and the number of analyzed daus are not established in the synchronized stream data selection/establishment means, the injection period and the number of dau to be injected are determined to be 50 msec and 3, respectively.
4. The apparatus as recited in claim 1, wherein if synchronized stream data synchronized with the video/audio transport stream are not stored in the additional data storing means, the synchronized stream data selection/establishment means receives the synchronized stream data from the outside and stores the synchronized stream data in the additional data storing means.
5. The apparatus as recited in claim 1, wherein the synchronized stream data analyzing means obtains many as daus as the analyzed dau by analyzing the synchronized stream data selected in the synchronized stream data selection/establishment means based on an injection period and the number of analyzed daus established in the synchronized stream data selection/establishment means, and obtains the presentation time stamp of a corresponding dau and the number of transport stream packets.
6. The apparatus as recited in claim 1, wherein the transport stream analyzing means analyzes the video/audio transport stream periodically based on an injection period established in the synchronized stream data selection/establishment means, and obtains the program clock references (pcrs) of a beginning part and a final part of an analyzing section of the video/audio transport stream analyzed during one injection period.
7. The apparatus as recited in claim 1, wherein in order to calculate pcr of the transport stream, the transport stream analyzing means directly obtains a pcr value from a transport stream including pcr within an analyzing section, obtains pcr from the transport stream packets including pcr among an inputted MPEG-2 transport streams by calculating the pcr for another transport stream packet using an output rate of the MPEG-2 transport stream, or by having a reference clock that increases at 27 MHz which is a per-second increase of pcr of the transport stream analyzing means, and obtains the pcr value by establishing the value of the reference clock with the same value as the obtained pcr and then obtaining the value of the reference clock at a moment when the pcr value is needed.
8. The apparatus as recited in claim 1, wherein the synchronized stream data injection/management means calculates the presentation time offset value by using the difference between the new presentation time stamp of a first dau of the synchronized stream data established in the synchronized stream data selection/establishment means and the presentation time stamp of the first dau of the synchronized stream data obtained in the synchronized stream data analyzing means, calculates a new presentation time stamp of dau of the synchronized stream data by adding the presentation time offset value to the presentation time stamp of dau of the synchronized stream data obtained periodically in the synchronized stream data analyzing means, compares the calculated new presentation time stamp with the pcr generated periodically based on an injection period, which is established in the synchronized stream data selection/establishment means, in the transport stream analyzing means, and if the new presentation time stamp of dau is larger than the pcr in the final part of the video/audio transport stream currently analyzed and smaller than the summation of the pcr increase during one period and the pcr of the final part, determines to inject the corresponding dau, and controls the additional data storing means to output the corresponding dau.
9. The apparatus as recited in claim 1, wherein if a new presentation time stamp for an first dau is stamped in the synchronized stream data selection/establishment means, the presentation time stamp re-stamping means receives synchronized stream data outputted from the additional data storing means, re-stamps the presentation time stamp of a dau that forms the synchronized stream data by referring to the presentation time stamp newly stamped in the synchronized stream data selection/establishment means, and outputs the re-stamped presentation time stamp of the dau to the multiplexing means, and wherein, to re-stamp the presentation time stamp of all daus that form the synchronized stream data, the presentation time stamp re-stamping means calculates a presentation time offset value by using the difference between the presentation time stamp of the first dau of the synchronized stream data and the new presentation time stamp stamped in the synchronized stream data selection/establishment means, and re-stamps the presentation time stamp of all daus that form the synchronized stream data by adding the presentation time offset value to the presentation time stamp of all daus that form the synchronized stream data.
10. The apparatus as recited in claim 1, wherein the multiplexing means injects the dau of the synchronized stream data outputted from the presentation time stamp re-staming means into the places of null packets in the video/audio transport stream within a section analyzed in the transport stream analyzing means, instead of the null packets.
11. The apparatus as recited in claim 1, wherein if the number of daus multiplexed in the video/audio transport stream analyzed in the transport stream analyzing means is more than two, the multiplexing means injects the daus into the video/audio transport stream in the order of quick presentation time stamp, and the locations for dau to be injected into are moved from a part where pcr of the analyzed video/audio transport stream is small to a part where pcr of the analyzed video/audio transport stream is large.
13. The method as recited in claim 12, further comprising the step of:
g) going back to the step b) if the analyzing section does not satisfy the condition for injecting the dau.
14. The method as recited in claim 12, further comprising the step of:
h) determining whether all of the daus of synchronized stream data are injected or not, and going back to the step b) if there remain any of the daus to be injected, otherwise, ending the method.
15. The method as recited in claim 12, wherein the step a) includes the steps of:
a1) if the number of analyzed dau is not established, calculating the number of analyzed dau by multiplying the largest value (59.94 or 60) of the number of frequency of dau generation to the injection period established above; and
a2) if the injection period and the number of analyzed dau are not established, determining the injection period and the number of analyzed dau to be 50 msec and 3, respectively.
16. The method as recited in claim 12, wherein the pcrs of the beginning part and the final part of the analyzing section of the video/audio transport stream analyzed during one injection period are obtained by analyzing the video/audio transport stream periodically based on the injection period.
17. The method as recited in claim 12, wherein said step d) includes the steps of:
d1) calculating a new presentation time stamp one of the daus based on the new presentation time stamp of a first dau of the synchronized stream data established in the step a) and the presentation time stamp of dau of the synchronized stream data which are obtained periodically at the step b);
d2) comparing the new presentation time stamp of the dau with the pcr information of the video/audio transport stream obtained in the step c);
d3) if the new substantial presentation time stamp of the dau is larger than a base value PCR_base of the pcr of the video/audio transport stream and smaller than a summation value of increase of the base value PCR_base during one injection period and the base value PCR_base of the pcr of the video/audio transport stream, deciding a time to inject the dau of the synchronized stream data into the video/audio transport stream.
18. The method as recited in claim 17, wherein the step d1) includes the steps of:
d1-1) calculating a presentation time offset value by using the difference between the new presentation time stamp of the first dau of the synchronized stream data established in the step a) and the presentation time stamp of the first dau of the synchronized stream data obtained in the step b); and
d1-2) calculating the new presentation time stamp of the dau of the synchronized stream data by adding the presentation time offset value to the presentation time stamp of dau of the synchronized stream data.
19. The method as recited in claim 12, wherein the step e) includes the steps of:
e1) checking if a new presentation time stamp for the first dau of the selected synchronized stream data is established;
e2) if a new presentation time stamp for the first dau of the selected synchronized stream data is established, calculating a presentation time offset value by subtracting the presentation time stamp of the first dau of the actual synchronized stream data from the new presentation time stamp, or otherwise, terminating the process of re-stamping the presentation time stamp; and
e3) adding the calculated presentation time offset value to the actual presentation time stamp of all daus of the inputted synchronized stream data.
20. The method as recited in claim 19, wherein the step e) further includes the step of:
if a new presentation time stamp for the first dau of the selected synchronized stream data is not established, returning to the step f).
0. 24. The apparatus as recited in claim 23, wherein the synchronized stream data is encapsulated in a MPEG-2 transport stream form.
0. 25. The apparatus as recited in claim 23, wherein if the additional data storing unit does not store the synchronized stream data corresponding to the transport stream, the synchronized stream data selection/establishment unit is further configured to receive the synchronized stream data from outside and store the received synchronized stream data in the data storing unit.
0. 26. The apparatus as recited in claim 23, wherein the synchronized stream data selection/establishment unit is further configured to establish parameter values.
0. 27. The apparatus as recited in claim 26, wherein the parameter values comprise:
a new presentation time stamp of a first data access unit (dau) of the selected synchronized stream data:
an injection period, wherein the injection period is a time interval for injecting the synchronized stream data into the transport stream; and
a maximum number of daus of the synchronized stream data that can be injected in one injection period.
0. 28. The apparatus as recited in claim 27, wherein the synchronized stream data analyzing unit is further configured to obtain as many daus as the maximum number of the daus by analyzing the selected synchronized stream data based on the parameter values.
0. 29. The apparatus as recited in claim 27, wherein the transport stream analyzing unit is further configured to periodically analyze the transport stream based on the parameter values.
0. 30. The apparatus as recited in claim 23, wherein the information related to the synchronized stream data comprises:
a presentation time stamp of a corresponding dau; and
a number of transport stream packets.
0. 31. The apparatus as recited in claim 30, wherein the synchronized stream data injection/management unit is further configured to calculate a presentation time offset by using a difference between the new presentation time stamp of a first data access unit (dau) of the selected synchronized stream data and a presentation time stamp of a corresponding dau generated from the synchronized stream data analyzing unit.
0. 32. The apparatus as recited in claim 31, wherein the synchronized stream data injection/management unit is further configured to calculate a new presentation time stamp of dau of the synchronized stream data by adding the presentation time offset to the presentation time stamp of a corresponding dau.
0. 33. The apparatus as recited in claim 32, wherein the synchronized stream data injection/management unit is further configured to compare the new presentation time stamp of dau with the presentation time stamp of a corresponding dau generated in the transport analyzing unit.
0. 34. The apparatus as recited in claim 33, wherein if the new presentation time stamp of dau is larger than the pcr in the final part of the video/audio transport stream currently analyzed and smaller than the summation of the pcr increase during one period and the pcr of the final part, the synchronized stream data injection/management unit is further configured to determine to inject the corresponding dau, and control the data storing unit to output the corresponding dau.
0. 35. The apparatus as recited in claim 23, wherein the information related to the transport stream is a program clock reference (pcr) of the transport stream.
0. 36. The apparatus as recited in claim 35, wherein the transport stream analyzing unit is further configured to obtain the pcr directly from the transport stream including pcr within an analyzing section, and calculate pcr for another transport stream packet based on an output rate of the transport stream.
0. 37. The apparatus as recited in claim 35, wherein the transport stream analyzing unit is further configured to obtain the pcr by putting a reference clock that increases as 27 MHz, wherein the 27 MHz is a per-second increase of pcr of the transport stream analyzing unit.
0. 38. The apparatus as recited in claim 35, wherein the transport stream analyzing unit is further configured to obtain the pcr by establishing a value of the reference clock with the same value as the obtained pcr and obtain the value of the reference clock at a moment when the pcr value is needed.
0. 39. The apparatus as recited in claim 23, wherein if a new presentation time stamp for a first dau is stamped in the synchronized stream data selection/establishment unit, the presentation time stamp re-stamping unit is further configured to:
receive the synchronized stream data outputted from the data storing unit;
re-stamp the presentation time stamp of a dau by referring to the presentation time stamp newly stamped in the synchronized stream data selection/establishment unit; and
output the re-stamped presentation time stamp of the dau to the multiplexing unit.
0. 40. The apparatus as recited in claim 39, wherein the presentation time stamp re-stamping unit is further configured to:
calculate a presentation time offset value by using the difference between the presentation time stamp of the first dau of the synchronized stream data and the new presentation time stamp stamped in the synchronized stream data selection/establishment unit; and
re-stamp the presentation time stamp of all daus by adding the presentation time offset value to the presentation time stamp of all daus.
0. 41. The apparatus as recited in claim 23, wherein the multiplexing unit is further configured to inject daus of the synchronized stream data outputted from the presentation time stamp re-stamping unit into the places of null packets in the transport stream within a section analyzed in the transport stream analyzing unit, instead of the null packets.
0. 42. The apparatus as recited in claim 23, wherein if a number of daus of the synchronized stream data multiplexed in the transport stream analyzed in the transport stream analyzing unit is more than two, the multiplexing unit is further configured to inject the daus into the transport stream in the order of quick presentation time stamp, and the locations for dau to be injected into are moved from a part where pcr of the analyzed transport stream is small to a part where pcr of the analyzed transport stream is large.
0. 44. The method as recited in claim 43, wherein the synchronized stream data is encapsulated in a MPEG-2 transport stream form.
0. 45. The method as recited in claim 43, wherein the method further comprises a step of establishing parameter values.
0. 46. The method as recited in claim 45, wherein the parameter values comprise:
the new presentation time stamp of a first data access unit (dau) of the selected synchronized stream data;
an injection period, wherein the injection period is a time interval for injecting the synchronized stream data into the transport stream; and
a maximum number of daus of the synchronized stream data that can be injected in one injection period.
0. 47. The method as recited in claim 46, wherein the method further comprises a step of obtaining as many daus as the maximum number of the daus by analyzing the selected synchronized stream data based on the parameter values.
0. 48. The method as recited in claim 46, wherein the step of analyzing the transport stream further comprises a step of periodically analyzing the transport stream based on the parameter values.
0. 49. The method as recited in claim 43, wherein the information related to the synchronized stream data comprises:
a presentation time stamp of a corresponding dau; and
a number of transport stream packets.
0. 50. The method as recited in claim 49, wherein the method further comprises a step of calculating a presentation time offset by using a difference between the new presentation time stamp of a first data access unit (dau) of the selected synchronized stream data and a presentation time stamp of a corresponding dau generated from the synchronized stream data analyzing unit.
0. 51. The method as recited in claim 50, wherein the method further comprises a step of calculating a new presentation time stamp of dau of the synchronized stream data by adding the presentation time offset to the presentation time stamp of a corresponding dau.
0. 52. The method as recited in claim 51, wherein the method further comprises of a step of comparing the new presentation time stamp of dau with the presentation time stamp of a corresponding dau generated in the transport analyzing unit.
0. 53. The method as recited in claim 52, wherein the corresponding synchronized stream data is outputted if the new presentation time stamp of dau is larger than the pcr in the final part of the video/audio transport stream currently analyzed and smaller than the summation of the pcr increase during one period and the pcr of the final part.
0. 54. The method as recited in claim 43, wherein the information related to the transport stream is a program clock reference (pcr) of the transport stream.
0. 55. The method as recited in claim 43, wherein the step of analyzing the transport stream further comprises a step of obtaining a pcr directly from the transport stream including pcr within an analyzing section, and calculating pcr for another transport stream packet based on an output rate of the transport stream.
0. 56. The method as recited in claim 43, wherein the step of analyzing the transport stream further comprises a step of obtaining the pcr by putting a reference clock that increases as 27 MHz, wherein the 27 MHz is a per-second increase of pcr of the transport stream analyzing unit.
0. 57. The method as recited in claim 43, wherein the step of analyzing the transport stream further comprises a step of obtaining the pcr by establishing a value of the reference clock with the same value as the obtained pcr and obtaining the value of the reference clock at a moment when the pcr value is needed.
0. 58. The method as recited in claim 43, wherein if a new presentation time stamp for a first dau is stamped in the synchronized stream data selection/establishment unit, the step of re-stamping comprises a step of:
receiving the outputted synchronized stream data;
re-stamping the presentation time stamp of a dau by referring to the newly stamped presentation time stamp; and
outputting the re-stamped presentation time stamp of the dau.
0. 59. The method as recited in claim 58, wherein the step of re-stamping further comprises of a step of:
calculating a presentation time offset value by using the difference between the presentation time stamp of the first dau of the synchronized stream data and the new presentation time stamp stamped; and
re-stamping the presentation time stamp of all daus by adding the presentation time offset value to the presentation time stamp of all daus.
0. 60. The method as recited in claim 43, wherein the step of multiplexing comprises a step of injecting daus of the outputted synchronized stream data into the places of null packets in the transport stream within a section analyzed, instead of the null packets.
0. 61. The method as recited in claim 43, wherein if a number of daus of the synchronized stream data multiplexed in the transport stream analyzed is more than two, the step of multiplexing further comprises a step of injecting the daus into the transport stream in the order of quick presentation time stamp, and the locations for dau to be injected into are moved from a part where pcr of the analyzed transport stream is small to a part where pcr of the analyzed transport stream is large.

When a new presentation time stamp is stamped for the synchronized stream data in the synchronized stream data selection/establishment unit 410, the presentation time stamp re-stamping unit 460 re-stamps the presentation time stamp of the synchronized stream data into the new presentation time stamp.

The multiplexing unit 470 injects DAU of the synchronized stream data, which are outputted from the presentation time stamp re-stamping unit 460, into the video/audio transport stream outputted from the transport stream analyzing unit 450.

Referring to FIG. 3, the operation of the synchronized stream data injecting block 400 having the above-described structure will be described hereinafter.

FIG. 3 is a flow chart describing a synchronized stream data injecting process of the synchronized stream data injecting block 400 in accordance with an embodiment of the present invention. As illustrated in the drawing, at step S310, the synchronized stream data selection/establishment unit 410 of the synchronized stream data injecting block 400 selects synchronized stream data that are synchronized with the video/audio transport stream inputted from the outside among the additional data stored in the additional data storing unit 440.

Also, it establishes the values of parameters, such as an injection period, which is time interval for injecting synchronized stream data into a video/audio transport stream, a new presentation time stamp of a first DAU of the above-selected synchronized stream data, and the number of analyzed DAU, which means the maximum number of DAU of synchronized stream data that can be injected in one injection period. Here, if the number of analyzed DAU is not established, it is calculated by multiplying the largest value (59.94 or 60) of the number of frequency of DAU generation to the established injection period. If both injection period and the number of analyzed DAU are not established, the injection period is set to be 50 msec and the number of analyzed DAU is determined to be 3.

Subsequently, at step S320, the synchronized stream data analyzing unit 430 analyzes the synchronized stream data selected in the additional data selection/establishment unit 410 based on the injection period and the number of analyzed DAU, which are established in the additional data selection/establishment unit 410, periodically to obtain as many DAU as the number of analyzed DAU, and generates information related to synchronized stream data, such as presentation time stamp of a corresponding DAU, the number transport stream packets.

Subsequently, at step S330, the transport stream analyzing unit 450 periodically analyzes the video/audio transport stream inputted from the outside in real-time based on the injection period established in the additional data selection/establishment unit 410, and generates information needed to inject the synchronized stream data, such as PCR of the video/audio transport stream within the analysis section.

Subsequently, at step S340, it is determined whether it is a section for injecting DAUs of a synchronized stream data. The synchronized stream data injection/management unit 420 calculates a presentation time offset by using the difference between a new presentation time stamp of a first DAU of the synchronized stream data established in the additional data selection/establishment unit 410 and the presentation time stamp of a first DAU of the synchronized stream data obtained in the synchronized stream data analyzing unit 430.

Then, the synchronized stream data injection/management unit 420 calculates a new presentation time stamp of DAU of the synchronized stream data obtained in the synchronized stream data analyzing unit 430. It determines whether to inject DAU of the synchronized stream data into the video/audio transport stream within the analysis section by comparing the new presentation time stamp calculated above with PCR obtained from the analysis of the video/audio transport stream. If the DAU of the synchronized stream data is determined for injection, synchronized stream data injection/management unit 420 controls the additional data storing unit 440 to output corresponding DAU.

Subsequently, at step S350, if a new presentation time stamp is established with respect to a first DAU of synchronized stream data in the synchronized stream data selection/establishment unit 410, the presentation time stamp re-stamping unit 460 re-stamps the presentation time stamp of DAU that forms synchronized stream data outputted from the additional data storing unit 440 based on the control of the synchronized stream data injection/management unit 420, by referring to the presentation time stamp newly stamped in the synchronized stream data selection/establishment unit 410. If the DAU of the synchronized stream data is not injected, process goes back to the step S320.

Here, to re-stamp the presentation time stamp of all DAU that form synchronized stream data, a presentation time offset value is calculated by using the difference between the presentation time stamp of the first DAU of the synchronized stream data and the new presentation time stamp stamped in the synchronized stream data selection/establishment unit 410. Here, the summation of the presentation time stamp of the first DAU of the synchronized stream data and the calculated presentation time offset value should be equal to the new presentation time stamp.

The presentation time stamp of all DAU that forms the synchronized stream data is re-stamped by adding the presentation time offset value to the presentation time stamp of all DAU of the synchronized stream data.

Subsequently, at step S360, the multiplexing unit 470 injects the DAU of the synchronized stream data outputted from the presentation time stamp re-stamping unit 460 into the video/audio transport stream outputted from the transport stream analyzing unit 450 and outputs one transport stream.

At step 370, it is determined whether all of DAUs are injected or not. If all of DAUs are not injected, i.e., is there any DAU to be injected, process continues to the step S320.

FIG. 4 is a flow chart further describing a process (S350) for re-stamping the presentation time stamp of additional data in the synchronized stream data injecting process in accordance with an embodiment of the present invention.

First, to re-stamp the presentation time stamp of DAU that forms synchronized stream data, at step S351, it is checked if a new presentation time stamp of a first DAU of synchronized stream data is stamped through the synchronized stream data selection/establishment unit 410.

If a new presentation time stamp of the first DAU of the synchronized stream data is not stamped, the presentation time stamp re-stamping process is terminated, and if a new presentation time stamp is stamped, at step S352, the presentation time offset value is calculated. The presentation time offset value of the synchronized stream data can be obtained by subtracting the actual presentation time stamp the first DAU of the synchronized stream data from the newly stamped presentation time stamp of the first DAU of the synchronized stream data, as shown in below Equation 2.

presentation time offset ( PTS off ) = new presentation time stamp - presentation time stamp of a first DAU Eq . 2

When the presentation time offset of the synchronized stream data is calculated, at step S353, the re-stamped presentation time stamp of each DAU that forms the synchronized stream data is calculated and re-stamped. The re-stamped presentation time stamp of DAU that forms synchronized stream data can be calculated by adding the presentation time offset to the presentation time stamp of all DAU that form the synchronized stream data, as shown in Equation 3.
Re-stamped presentation time stamp of DAU=Presentation time stamp of a DAU+PTSoff   Eq. 3

As described above, the present invention discloses an apparatus for injecting synchronized stream data, which is a stream data synchronized with audio/video data temporally, into an MPEG-2 video/audio transport stream. This technology can be used to establish a digital data broadcasting system that can provide a synchronized stream data service, which is capable of providing more diverse data service to viewers.

While the present invention has been described with respect to certain preferred embodiments, it will be apparent to those skilled in the art that various changes and modifications may be made without departing from the scope of the invention as defined in the following claims.

Choi, Jin Soo, Kim, Jin Woong, Lee, Yong Ju, Choi, Ji-hoon, Park, Min-sik

Patent Priority Assignee Title
Patent Priority Assignee Title
5774548, Sep 05 1995 Hitachi Maxell, Ltd Digital broadcast transmitting and receiving system and transmitting and receiving apparatus thereof
6266483, Oct 12 1998 Panasonic Corporation Information recording medium, apparatus and method for recording or reproducing data thereof
6611537, May 30 1997 HAIKU ACQUISITION CORPORATION; CENTILLIUM COMMUNICATIONS, INC Synchronous network for digital media streams
6993789, Apr 23 1999 Sharp Kabushiki Kaisha DTV data service application and receiver mechanism
KR101998069058,
KR1020010010109,
KR1020010090979,
KR20020066260,
KR20030078354,
/
Executed onAssignorAssigneeConveyanceFrameReelDoc
Jul 29 2010Electronics and Telecommunications Research Institute(assignment on the face of the patent)
Date Maintenance Fee Events
Mar 11 2016REM: Maintenance Fee Reminder Mailed.
Jul 29 2016EXP: Patent Expired for Failure to Pay Maintenance Fees.


Date Maintenance Schedule
Apr 30 20164 years fee payment window open
Oct 30 20166 months grace period start (w surcharge)
Apr 30 2017patent expiry (for year 4)
Apr 30 20192 years to revive unintentionally abandoned end. (for year 4)
Apr 30 20208 years fee payment window open
Oct 30 20206 months grace period start (w surcharge)
Apr 30 2021patent expiry (for year 8)
Apr 30 20232 years to revive unintentionally abandoned end. (for year 8)
Apr 30 202412 years fee payment window open
Oct 30 20246 months grace period start (w surcharge)
Apr 30 2025patent expiry (for year 12)
Apr 30 20272 years to revive unintentionally abandoned end. (for year 12)