A hypothetical reference decoder.

PTO Wrapper PDF
Dossier Espace Google
Patent
   RE48953
Priority
Mar 31 2003
Filed
Dec 15 2015
Issued
Mar 01 2022
Expiry
Mar 31 2023

TERM.DISCL.
Inventors
Deshpande,…
Assg.orig
SHARP LABO…
Assg.curr
Dolby Labo…
Entity
unknown
Referenced by
0
References
54
Maint.:
currently ok
Limitations of Previ…
Generalized Hypothet…
BRIEF DESCRIPTION OF…
DETAILED DESCRIPTION…
1. A method comprising:
(a) defining receiving a first set of at least one value multiple values, each value in the first set being characteristic of a transmission bit rate for a first segment access point at a start of a video having an associated first segment presentation start time and an associated first segment presentation end time sequence;
(b) defining receiving a second set of at least one value multiple values each characteristic of a buffer size for said first segment access point;
(c) defining receiving a third set of at least one value multiple values each characteristic of an initial decoder buffer fullness for said first segment delay for said first access point;
(d) wherein each value within said first set, said second set, and said third set, respectively, is defined so that data received by a decoder for constructing a plurality of video frames of said first segment is free from an underflow state in a buffer of said decoder when said constructing begins at said first segment presentation start time receiving a fourth set of multiple values characteristic of an initial delay for other access points of the video sequence, the other access points being distinct access points from the first access point;
wherein
(e) defining a fourth set of at least one value characteristic of said transmission bit rate for a second segment of said video having an associated second segment presentation start time and an associated second segment presentation end time, said second segment presentation start time being later than first segment presentation start time and said second segment presentation end time being the same as, or earlier, than said first segment presentation end time the values within said first set, said second set, and said third set, respectively, are defined so that data received by a decoder for constructing a plurality of video frames is free from an overflow state for said first access point;
(f) defining a fifth set of at least one value characteristic of said buffer size for said second segment; the values within said first set, said second set, and said fourth set, respectively, are defined so that data received by a decoder for constructing a plurality of video frames is free from an overflow state for each of said other access points
(g) defining a sixth set of at least one value characteristic of said initial decoder buffer fullness for said second segment;
(h) wherein each value within said fourth set, said fifth set, and said sixth set, respectively, is defined so that data received by said decoder for constructing a plurality of video frames of said second segment is free from an underflow state in said buffer of said decoder when said constructing begins at said second segment presentation start time; and
(i) allowing a user to begin presentation at a user-selected one of said first segment presentation start time, and said second segment presentation start time associated with said second segment.
2. The method of claim 1 wherein said first set, second set, and third set of respective values together define at least one leaky bucket model for a buffer of a hypothetical reference decoder.
0. 3. The method of claim 1 wherein said second segment presentation start time corresponds to a local maximum buffer fullness state of a said leaky bucket model constructed using values defined for said first segment of said video.
4. The method of claim 2 wherein said at least one leaky bucket model uses a fixed transmission bit rate.
5. The method if claim 2 wherein said at least one leaky bucket model uses a variable transmission bit rate.
0. 6. The method of claim 1 including defining further respective sets of at least one value characteristic of a transmission bit rate, a buffer size, and an initial buffer fullness, respectively, each respective further set associated with another respective segment of said video having a presentation start time later than said second segment presentation start time, and a presentation end time the same as, or earlier, than said first segment presentation end time.
7. The method of claim 1 wherein steps (a) through (h f) are performed at an encoder having a buffer fullness state complementary to said a buffer of said a corresponding decoder.
0. 8. The method of claim 2 wherein said sixth set of at least one value is at least 90% of the buffer size of said at least one leaky bucket model.
0. 9. The method of claim 1 wherein said fourth set of at least one value equals said first set of at least one value.
0. 10. The method of claim 1 wherein said fifth set of at least one value equals said second set of at least one value.
0. 11. The method of claim 1 wherein said sixth set of at least one value equals said third set of at least one value.
0. 12. The method of claim 1 wherein at least one of said first access point or said other access points correspond to a local maximum buffer fullness state of at least one leaky bucket model for a buffer of a hypothetical reference decoder.
0. 13. The method of claim 1 wherein at least one of said first access point or said other access points correspond to a local minimum buffer fullness state of at least one leaky bucket model for a buffer of a hypothetical reference decoder.

Bi+1=min (B, Bi−bi+R(ti+1−ti)), i=0, 1, 2, . . .   (1)

Typically, ti+1−ti=1/M seconds, where M is the frame rate (normally in frames/sec) for the bit stream.

A leaky bucket model with parameters (R, B, F) contains a bit stream if there is no underflow of the decoder buffer. Because the encoder and decoder buffer fullness are complements of each other this is equivalent to no overflow of the encoder buffer. However, the encoder buffer (the leaky bucket) is allowed to become empty, or equivalently the decoder buffer may become full, at which point no further bits are transmitted from the encoder buffer to the decoder buffer. Thus, the decoder buffer stops receiving bits when it is full, which is why the min operator in equation (1) is included. A full decoder buffer simply means that the encoder buffer is empty.

The following observations may be made:

    • A given video stream can be contained in many leaky buckets. For example, if a video stream is contained in a leaky bucket with parameters (R, B, F), it will also be contained in a leaky bucket with a larger buffer (R, B′, F), B′>B, or in a leaky bucket with a higher peak transmission rate (R′, B, F), R′>R.
    • For any bit rate R′, the system can always find a buffer size that will contain the (time-limited) video bit stream. In the worst case (R′ approaches 0), the buffer size will need to be as large as the bit stream itself. Put another way, a video bit stream can be transmitted at any rate (regardless of the average bit rate of the clip) as long as the buffer size is large enough.

Assume that the system fixes F=aB for all leaky buckets, where a is some desired fraction of the initial buffer fullness. For each value of the peak bit rate R, the system can find the minimum buffer size Bmin that will contain the bit stream using equation (1). The plot of the curve of R-B values, is shown in FIG. 2.

By observation, the curve of (Rmin, Bmin) pairs for any bit stream (such as the one in FIG. 2) is piecewise linear and convex. Hence, if N points of the curve are provided, the decoder can linearly interpolate the values to arrive at some points (Rinterp, Binterp) that are slightly but safely larger than (Rmin, Bmin). In this way, one is able to reduce the buffer size, and consequently also the delay, by an order of magnitude, relative to a single leaky bucket containing the bit stream at its average rate. Alternatively, for the same delay, one is able to reduce the peak transmission rate by a factor of four, or possibly even improve the signal-to-noise ratio by several dB.
MPEG Video Buffering Verifier (VBV)

The MPEG video buffering verifier (VBV) can operate in two modes: constant bit rate (CBR) and variable bit rate (VBR). MPEG-1 only supports the CBR mode, while MPEG-2 supports both modes.

The VBV operates in CBR mode when the bit stream is contained in a leaky bucket model of parameters (R, B, F) and:
R=Rmax=the average bit rate of the stream.

    • The value of B is stored in the syntax parameter vbv_buffer_size using a special size unit (i.e., 16×1024 bit units).
    • The value of F/R is stored in the syntax element vbv_delay associated to the first video frame in the sequence using a special time unit (i.e., number of periods of a 90 KHz clock).
    • The decoder buffer fullness follows the following equations:
      B0=F
      Bi+1=Bi−bi+Rmax/M, i=0, 1, 2, . . .   (2)
    • The encoder must ensure that Bi−bi is always greater than or equal to zero while Bi is always less than or equal to B. In other words, the encoder ensures that the decoder buffer does not underflow or overflow.

The VBV operates in VBR mode when the bit stream is constrained in a leaky bucket model of parameters (R, B, F) and:
R=Rmax=the peak or maximum rate. Rmax is higher than the average rate of the bit stream.

    • F=B, i.e., the buffer fills up initially.
    • The value of B is represented in the syntax parameter vbv_buffer_size, as in the CBR case.

The decoder buffer fullness follows the following equations:
B0=B
Bi+1=min (B, Bi−bi+Rmax/M), i=0, 1, 2, . . .   (3)

The encoder ensures that Bi−bi is always greater than or equal to zero. That is, the encoder must ensure that the decoder buffer does not underflow. However, in this VBR case the encoder does not need to ensure that the decoder buffer does not overflow. If the decoder buffer becomes full, then it is assumed that the encoder buffer is empty and hence no further bits are transmitted from the encoder buffer to the decoder buffer.

The VBR mode is useful for devices that can read data up to the peak rate Rmax. For example, a DVD includes VBR clips where Rmax is about 10 Mbits/sec, which corresponds to the maximum reading speed of the disk drive, even though the average rate of the DVD video stream is only about 4 Mbits/sec.

Referring to FIG. 3A and 3B, plots of decoder buffer fullness for some bit streams operating in CBR and VBR modes, respectively, are shown.

Broadly speaking, the CBR mode can be considered a special case of VBR where Rmax happens to be the average rate of the clip.
H.263's Hypothetical Reference Decoder (HRD)

The hypothetic reference model for H.263 is similar to the CBR mode of MPEG's VBV previously discussed, except for the following:

    • The decoder inspects the buffer fullness at some time intervals and decodes a frame as soon as all the bits for the frame are available. This approach results in a couple of benefits: (a) the delay is minimized because F is usually just slightly larger than the number of bits for the first frame, and (b) if frame skipping is common, the decoder simply waits until the next available frame. The latter is enabled in the low-delay mode of MPEG's VBV as well.
    • The check for buffer overflow is done after the bits for a frame are removed from the buffer. This relaxes the constraint for sending large I frames once in awhile, but there is a maximum value for the largest frame.
      H.263's HRD can essentially be mapped to a type of low delay leaky bucket model.

Limitations of Previous Hypothetical Reference Decoders

Previously existing hypothetical reference decoders operate at only one point (R, B) of the curve in FIG. 2. As a result these decoders have the following drawbacks:

    • If the bit rate available in the channel R′ is lower than R (e.g., this is common for Internet streaming and progressive download, or when an MPEG VBR clip needs to be transmitted at a rate lower than the peak), strictly speaking, the hypothetical decoder would not be able to decode the bit stream.
    • If the available bandwidth R′ is larger than R (e.g., this is also common for Internet streaming, as well as for local playback), the previous hypothetical decoders could operate in the VBR mode and decode the bit stream. However, if more information on the Rate-Buffer curve were available, the buffer size and associated start-up delay required to decode the bit stream could be significantly reduced.
    • If the physical buffer size in a decoder device is smaller than B, the device will not be able to decode that bit stream.
    • If the buffer size is larger than B, the device will be able to decode the bit stream but the start-up delay will be the same.
    • More generally, a bit stream that was generated according to a leaky bucket (R, B, F) will not usually be able to be distributed through different networks of bit rate smaller than R, and to a variety of devices with buffer sizes smaller than B. Also, the start-up delay will not be minimized.

Generalized Hypothetical Reference Decoder (GHRD)

A generalized hypothetical reference decoder (GHRD) can operate given the information of N leaky bucket models,
(R1, B1, F1), (R2, B2, F2), . . . , (RN, BN, RN),  (4)
each of which contains the bit stream. Without loss of generality, let us assume that these leaky buckets are ordered from smallest to largest bit rate, i.e., Ri<Ri+1. Lets also assume that the encoder computes these leaky buckets models correctly and hence Bi<Bi+1.

The desired value of N can be selected by the encoder. If N=1, the GHRD is essentially equivalent to MPEG's VBV. The encoder can choose to: (a) pre-select the leaky bucket values and encode the bit stream with a rate control that makes sure that all of the leaky bucket constraints are met, (b) encode the bit stream and then use equation (1) to compute a set of leaky buckets containing the bit stream at N different values of R, or (c) do both. The first approach (a) can be applied to live or on-demand transmission, while (b) and (c) only apply to on-demand.

The number of leaky buckets N and the leaky bucket parameters (4) are inserted into the bit stream. In this way, the decoder can determine which leaky bucket it wishes to use, knowing the peak bit rate available to it and/or its physical buffer size. The leaky bucket models in (4) as well as all the linearly interpolated or extrapolated models are available for use. FIG. 4 illustrates a set of N leaky bucket models and their interpolated or extrapolated (R, B) values.

The interpolated buffer size B between points k and k+1 follow the straight line:
B={(Rk+1−R)/(Rk+1−Rk)}Bk+{(R−Rk)/(Rk+1−Rk)}Bk+1 Rk<R<Rk+1
Likewise, the initial decoder buffer fullness F can be linearly interpolated:
F={(Rk+1−R)/(Rk+1−Rk)}Fk+{(R−Rk)/(Rk+1−Rk)}Fk+1 Rk<R<Rk+1

The resulting leaky bucket with parameters (R, B, F) contains the bit stream, because the minimum buffer size Bmin is convex in both R and F, that is, the minimum buffer size Bmin corresponding to any convex combination (R, F)=a(Rk, Fk)+(1−a)(Rk+1, Fk+1), 0<a<1, is less than or equal to B=aBk+(1−a)Bk+1.

It is observed that if R is larger than RN, the leaky bucket (R, BN, FN) will also contain the bit stream, and hence BN and FN are the buffer size and initial decoder buffer fullness recommended when R>=RN. If R is smaller than R., the upper bound B=B1+(R1−R)T can be caused (and once can set F=B), where T is the time length of the stream in seconds. These (R, B) values outside the range of the N points are also shown in FIG. 4.

The Joint Video Team of ISO/IEC MPEG and ITU-T VCEG Working Draft Number 2, Revision 0 (WD-2) incorporated many of the concepts of the hypothetical reference decoder proposed by Jordi Ribas-Cobera, et al. of Microsoft Corporation, incorporated by reference herein. The WD-2 document is similar to the decoder proposed by Jordi Ribas-Cobera, et al. of Microsoft Corporation, though the syntax is somewhat modified. In addition, WD-2 describes an example algorithm to compute B, and F for a given rate R.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates decoder buffer fullness.

FIG. 2 illustrates a R-B curve.

FIGS. 3A and 3B illustrate plots of decoder buffer fullness for some bit streams operating in CBR and VBR modes, respectively.

FIG. 4 illustrates a set of N leaky bucket models and their interpolated or extrapolated (R, B) values.

FIG. 5 illustrates initial buffering Bi for any point of the decoder the user seeks to when the rate is Rj.

FIG. 6 illustrates sets of (R, B, F) defined in a forward looking fashion for the particular video stream.

FIG. 7 illustrates the initial buffer fullness (in bits) for a video segment.

FIG. 8 illustrates the selection criteria of a set of 10 points for FIG. 7.

FIG. 9 illustrates selection criteria.

FIG. 10 illustrates delay reductions.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT

As previously described, the JVT standard (WD-2) allows the storing of (N>=1) leaky buckets, (R1, B1, F1), . . . , (RN, BN, FN) values which are contained in the bit stream. These values may be stored in the header. Using Fi as the initial buffer fullness and Bi as the buffer size, guarantees that the decoder buffer will not underflow when the input stream comes in at the rate Ri. This will be the case if the user desires to present the encoded video from start to end. In a typical video-on-demand application the user may want to seek to different portions of the video stream. The point that the user desires to seek to may be referred to as the access point. During the process of receiving video data and constructing video frames the amount of data in the buffer fluctuates. After consideration, the present inventor came to the realization that if the Fi value of the initial buffer fullness (when the channel rate is Ri) is used before starting to decode the video from the access point, then it is possible that the decoder will have an underflow. For example, at the access point or sometime thereafter the amount of bits necessary for video reconstruction may be greater than the bits currently in the buffer, resulting in underflow and inability to present video frames in a timely manner. It can likewise be shown that in a video stream the value of initial buffer fullness required to make sure there in no underflow at the decoder varies based on the point at which the user seeks to. This value is bounded by the Bi. Accordingly, the combination of B and F provided for the entire video sequence, if used for an intermediate point in the video will not likely be appropriate, resulting in an underflow, and thus freezing frames.

Based upon this previously unrealized underflow potential, the present inventor then came to the realization that if only a set of R, B, and F values are defined for an entire video segment, then the system should wait until the buffer B for the corresponding rate R is full or substantially full (or greater than 90% full) to start decoding frames when a user jumps to an access point. In this manner, the initial fullness of the buffer will be at a maximum and thus there is no potential of underflow during subsequent decoding starting from the access point. This may be achieved without any additional changes to the existing bit stream, thus not impacting existing systems. Accordingly, the decoder would use the value of initial buffering Bj for any point the user seeks to when the rate is Rj, as shown in FIG. 5. However, this unfortunately sometimes results in a significant delay until video frames are presented after selecting a different location (e.g., access point) from which to present video.

The initial buffer fullness (F) may likewise be characterized as a delay until the video sequence is presented (e.g., initial_cpb_removal_delay). The delay is temporal in nature being related to the time necessary to achieve initial buffer fullness (F). The delay and/or F may be associated with the entire video or the access points. It is likewise to be understood that delay may be substituted for F in all embodiments described herein (e.g., (R,B,delay)). One particular value for the delay may be calculated as delay=F/R, using a special time unit (units of 90 KHz Clock).

To reduce the potential delay the present inventor came to the realization that sets of (R, B, F) may be defined for a particular video stream at each access point. Referring to FIG. 6, these sets of (R, B, F) are preferably defined in a forward looking fashion for the particular video stream. For example set of (R, B, F) values may be computed in the previously existing manner for the video stream as a whole, in addition, a set of F values for the same (R, B) values as those for the whole video stream may be computed in the previously existing manner for the video stream with respect to the video stream from position “2” looking forward, etc. The same process may be used for the remaining access points. The access points may be any frame within the video sequence, I frames of the sequence, B frames of the sequence, or P frames of the sequence (I, B, and P frames are typically used in MPEG based video encoding). Accordingly, the user may select one of the access points and thereafter use the respective Fij for the desired initial fullness (assuming that the buffer Bj and rate Rj remain unchanged) or otherwise a set of two or more of Ri, Bi, Fij.

The sets of R, B, F values for each access point may be located at any suitable location, such as for example, at the start of the video sequence together with sets of (R, B, F) values for the entire video stream or before each access point which avoids the need for an index; or stored in a manner external to the video stream itself which is especially suitable for a server/client environment.

This technique may be characterized by the following model:
(R1, B1, F1, M1, f11, t11, . . . , fM11, tM11) . . . , (RN, BN, FN, MN, f1N, t1N, . . . , fMNN, tMNN),
where fkj denotes the initial buffer fullness value at rate Rj at access point tkj (time stamp). The values of Mj may be provided as an input parameter or may be automatically selected.
For example, Mj may include the following options:

    • (a) Mj may be set equal to the number of access points. In this manner the values of fkj may be stored for each access point at each rate Rj (either at the start of the video stream, within the video stream, distributed through the video stream, or otherwise in any location).
    • (b) Mj may be set equal to zero if no seekability support is desired.
    • (c) Mj values for each rate Rj may be automatically selected (described later).

The system may, for a given Rj, use an initial buffer fullness equal to fjk if the user seeks an access point tkj. This occurs when the user selects to start at an access point, or otherwise the system adjusts the user's selection to one of the access points.

It is noted that in the case that a variable bit rate (in bit stream) is used the initial buffer fullness value (or delay) is preferably different than the buffer size, albeit it may be the same. In the case of variable bit rate in MPEG-2 VBV buffer is filled till it is full, i.e. F=B (value of B is represented by vbv_buffer_size).

If the system permits the user to jump to any frame of the video in the manner of an access point, then the decoding data set would need to be provided for each and every frame. While permissible, the resulting data set would be excessively large and consume a significant amount of the bitrate available for the data. A more reasonable approach would be to limit the user to specific access points within the video stream, such as every second, 10 seconds, 1 minute, etc. While an improvement, the resulting data set may still be somewhat extensive resulting in excessive data for limited bandwidth devices, such as mobile communication devices.

In the event that the user selects a position that is not one of the access points with an associated data set, then the initial buffer fullness may be equal to max(fkj, f(k+1)j) for a time between tkj and t(k+1)j, especially if the access points are properly selected. In this manner, the system is guaranteed of having a set of values that will be free from resulting in an underflow condition, or otherwise reduce the likelihood of an underflow condition, as explained below.

To select a set of values that will ensure no underflow condition (or otherwise reduce) when the above-referenced selection criteria is used, reference is made to FIG. 7. FIG. 7 illustrates the initial buffer fullness (in bits) for a video segment, where the forwarding looking initial buffer fullness is calculated for 10 second increments. Then the system preferably selects an access point at the start of the video sequence and an access point at the end of the video segment. Between the start and the end of the video segment, the system selects the local maximums to include as access points. Also, the system may select the local minimums to include as access points. Preferably, if a limited set of access points are desired the system first selects the local maximums, then the local minimums, which helps to ensure no underflow. Thereafter, the system may further select intermediate points, as desired.

Based upon the selection criteria a set of 10 points for FIG. 7 may be selected as indicated in FIG. 8. Referring to FIG. 9, the 10 selected points are shown by the dashed curve. The resulting initial buffer fullness values at all access points are shown by the solid curve. The solid curve illustrates a “safe” set of values for all points in the video so that the decoder buffer will not underflow. If extreme fluctuations occurred in the bit rate of the actual bit stream that were not detected in the processing, such as a sharp spike, then it is possible to result in an underflow, through normally unlikely. The optimal initial buffer fullness values at all access points are shown by the dash-dotted curve. A significant reduction in the buffering time delay is achieved, in contrast to requiring a full buffer when accessing an access point, as illustrated in FIG. 10.

In addition, if the bit rate and the buffer size remain the same while selecting a different access point, then merely the modified buffer fullness, F, needs to be provided or otherwise determined.

All the references cited herein are incorporated by reference.

The terms and expressions that have been employed in the foregoing specification are used as terms of description and not of limitation, and there is no intention, in the use of such terms and expressions, of excluding equivalents of the features shown and described or portions thereof, it being recognized that the scope of the invention is defined and limited only by the claims that follow.

INVENTORS:

Deshpande, Sachin G.

THIS PATENT IS REFERENCED BY THESE PATENTS:
Patent Priority Assignee Title
THIS PATENT REFERENCES THESE PATENTS:
Patent Priority Assignee Title
5159447, May 23 1991 American Telephone and Telegraph Company Buffer control for variable bit-rate channel
5287182, Jul 02 1992 Agere Systems, INC Timing recovery for variable bit-rate video on asynchronous transfer mode (ATM) networks
5365552, Nov 16 1992 Intel Corporation Buffer fullness indicator
5398072, Oct 25 1993 AVAGO TECHNOLOGIES GENERAL IP SINGAPORE PTE LTD Management of channel buffer in video decoders
5481543, Mar 16 1993 Sony Corporation Rational input buffer arrangements for auxiliary information in video and audio signal processing systems
5534944, Jul 15 1994 Panasonic Corporation of North America Method of splicing MPEG encoded video
5537408, Feb 03 1995 International Business Machines Corporation apparatus and method for segmentation and time synchronization of the transmission of multimedia data
5543853, Jan 19 1995 THE CHASE MANHATTAN BANK, AS COLLATERAL AGENT Encoder/decoder buffer control for variable bit-rate channel
5565924, Jan 19 1995 THE CHASE MANHATTAN BANK, AS COLLATERAL AGENT Encoder/decoder buffer control for variable bit-rate channel
5619341, Feb 23 1995 Motorola, Inc. Method and apparatus for preventing overflow and underflow of an encoder buffer in a video compression system
5629736, Nov 01 1994 THE CHASE MANHATTAN BANK, AS COLLATERAL AGENT Coded domain picture composition for multimedia communications systems
5652749, Feb 03 1995 International Business Machines Corporation Apparatus and method for segmentation and time synchronization of the transmission of a multiple program multimedia data stream
5663962, Sep 29 1994 Cselt- Centro Studi E Laboratori Telecomunicazioni S.p.A. Method of multiplexing streams of audio-visual signals coded according to standard MPEG1
5668841, May 27 1994 Lucent Technologies Inc Timing recovery for variable bit-rate video on asynchronous transfer mode (ATM) networks
5831688, Oct 31 1994 Mitsubishi Denki Kabushiki Kaisha Image coded data re-encoding apparatus
5877812, Nov 21 1995 Google Technology Holdings LLC Method and apparatus for increasing channel utilization for digital video transmission
5982436, Mar 28 1997 Pendragon Wireless LLC Method for seamless splicing in a video encoder
5995151, Dec 04 1995 France Brevets Bit rate control mechanism for digital image and video data compression
6023296, Jul 10 1997 MEDIATEK, INC Apparatus and method for object based rate control in a coding system
6055270, Apr 20 1994 Thomson Cosumer Electronics, Inc. Multiplexer system using constant bit rate encoders
6085221, Jan 08 1996 Cisco Technology, Inc File server for multimedia file distribution
6188703, Aug 01 1997 IBM Corporation Multiplexer for multiple media streams
6269120, Mar 23 1998 International Business Machines Corporation Method of precise buffer management for MPEG video splicing
6272566, Nov 18 1998 Level 3 Communications, LLC System for maintaining proper buffering within video play list
6301428, Dec 09 1997 AVAGO TECHNOLOGIES GENERAL IP SINGAPORE PTE LTD Compressed video editor with transition buffer matcher
6366704, Dec 01 1997 Sharp Laboratories of America, Inc. Method and apparatus for a delay-adaptive rate control scheme for the frame layer
6381254, Nov 08 1996 MATSUSHITA ELECTRIC INDUSTRIAL CO , LTD Moving image encoding device/method, moving image multiplexing device/method, and image transmission device
6389072, Dec 23 1998 UNILOC 2017 LLC Motion analysis based buffer regulation scheme
6397251, Sep 02 1997 Cisco Technology, Inc File server for multimedia file distribution
6542549, Oct 13 1998 MATSUSHITA ELECTRIC INDUSTRIAL CO , LTD Method and model for regulating the computational and memory requirements of a compressed bitstream in a video decoder
6587506, Nov 02 1999 Sovereign Peak Ventures, LLC Video editing apparatus, video editing method, and data storage medium for a video editing program
6637031, Dec 04 1998 Microsoft Technology Licensing, LLC Multimedia presentation latency minimization
6907481, Mar 06 2001 AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE LIMITED System for bit-rate controlled digital stream playback and method thereof
6909743, Apr 14 1999 MEDIATEK INC Method for generating and processing transition streams
6912251, Sep 25 1998 Mediatek USA Inc Frame-accurate seamless splicing of information streams
7079581, Apr 18 2002 Samsung Electronics Co., Ltd. Apparatus and method for controlling variable bit rate in real time
7088771, Apr 06 1999 AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE LIMITED Video encoding and video/audio/data multiplexing device
7257162, Jul 02 2002 Synaptics Incorporated Hypothetical reference decoder for compressed image and video
7646816, Sep 19 2001 Microsoft Technology Licensing, LLC Generalized reference decoder for image or video processing
9654533, Jan 17 2013 Electronics and Telecommunications Research Institute Method of adaptively delivering media based on reception status information from media client and apparatus using the same
20020037161,
20020067768,
20020085634,
20030053416,
20040190606,
20040255063,
20050074061,
20050084007,
EP930786,
JP2000124958,
JP2002112183,
JP200392752,
JP2272851,
JP7107429,
ASSIGNMENT RECORDS    Assignment records on the USPTO
/////
Executed onAssignorAssigneeConveyanceFrameReelDoc
Mar 28 2003DESHPANDE, SACHIN G SHARP LABORAORIES OF AMERICAASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS 0381820361 pdf
Apr 28 2008Sharp Laboratories of America, IncSharp Kabushiki KaishaASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS 0504070100 pdf
Sep 29 2015Sharp Kabushi KaishaDolby Laboratories Licensing CorporationASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS 0504070176 pdf
Sep 29 2015Sharp Kabushiki KaishaDolby Laboratories Licensing CorporationASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS 0381820555 pdf
Dec 15 2015Dolby Laboratories Licensing Corporation(assignment on the face of the patent)
MAINTENANCE FEES AND DATES:    Maintenance records on the USPTO
Date Maintenance Fee Events


Date Maintenance Schedule
Mar 01 20254 years fee payment window open
Sep 01 20256 months grace period start (w surcharge)
Mar 01 2026patent expiry (for year 4)
Mar 01 20282 years to revive unintentionally abandoned end. (for year 4)
Mar 01 20298 years fee payment window open
Sep 01 20296 months grace period start (w surcharge)
Mar 01 2030patent expiry (for year 8)
Mar 01 20322 years to revive unintentionally abandoned end. (for year 8)
Mar 01 203312 years fee payment window open
Sep 01 20336 months grace period start (w surcharge)
Mar 01 2034patent expiry (for year 12)
Mar 01 20362 years to revive unintentionally abandoned end. (for year 12)