A video transmitter comprising a plurality of encoders may be operable to determine, for a transport stream, a constant overall number of bits per time interval corresponding to a frame in the transport stream. For each time interval corresponding to a start and an end of encoding of each of frames using each of the encoders, the video transmitter may allocate a target number of bits to each of the frames to achieve the constant overall number of bits. The allocation of the target number of bits may be based on frame types of the frames and CODEC types of the encoders, where the allocated target number of bits for each of the frames meets buffer overflow/underflow requirements associated with each of the encoders. A quantization parameter (QP) may be calculated and adjusted at each of one or more layers for generating an actual number of bits during encoding.
|
1. A method comprising:
determining an overall number of bits per time interval that corresponds to transferring a frame in a transport stream, the transport stream including a plurality of streams each generated according to a different encoding standard; and
allocating, by circuitry, a target number of bits to each of a plurality of frames of the plurality of streams to achieve the overall number of bits for the transport stream based on a frame type of each of the plurality of frames and the different encoding standards according to which each of the plurality of streams is generated.
10. A system comprising:
circuitry configured to
determine an overall number of bits per time interval that corresponds to transferring a frame in a transport stream, the transport stream including a plurality of streams each generated according to a different encoding standard; and
allocate a target number of bits to each of a plurality of frames of the plurality of streams to achieve the overall number of bits for the transport stream based on a frame type of each of the plurality of frames and the different encoding standards according to which each of the plurality of streams is generated.
20. A non-transitory computer-readable medium including computer program instructions, which when executed by circuitry, causes the circuitry to:
determine an overall number of bits per time interval that corresponds to transferring a frame in a transport stream, the transport stream including a plurality of streams each generated according to a different encoding standard; and
allocate a target number of bits to each of a plurality of frames of the plurality of streams to achieve the overall number of bits for the transport stream based on a frame type of each of the plurality of frames and the different encoding standards according to which each of the plurality of streams is generated.
2. The method of
determining a target number of bits for a macroblock of each of the plurality of frames based on the target number of bits allocated to each of the plurality of frames.
3. The method of
calculating a quantization parameter for the macroblock based on the target number of bits determined for the macroblock.
4. The method of
determining rate control information associated with the macroblock at each of one or more layers of each of the plurality of streams.
5. The method of
adjusting the quantization parameter calculated for each of the one or more layers based on the rate control information at each of the one or more layers to generate a final quantization parameter.
6. The method of
the rate control information at a layer comprises a bit error that corresponds to a difference between an actual number of bits generated during encoding for the layer and a target number of bits corresponding to the actual number of bits for the layer.
7. The method of
adjusting the quantization parameter based on a proportional value, an integral value or a derivative value of the bit error at each of the one or more layers.
8. The method of
at least one of the one or more layers includes a multi-group of pictures, a group of pictures, a frame, a multi-macroblock or a macroblock.
9. The method of
adjusting a total number of frames in a group of pictures for each of one or more of the plurality of streams for the allocation of the target number of bits to each of the plurality of frames.
11. The system of
the circuitry is configured to determine a target number of bits for a macroblock of each of the plurality of frames based on the target number of bits allocated to each of the plurality of frames.
12. The system of
the circuitry is configured to calculate a quantization parameter for the macroblock based on the target number of bits determined for the macroblock.
13. The system of
the circuitry is configured to determine rate control information associated with the macroblock at each of one or more layers of each of the plurality of streams.
14. The system of
the circuitry is configured to adjust the quantization parameter calculated for each of the one or more layers based on the rate control information at each of the one or more layers to generate a final quantization parameter.
15. The system of
the rate control information at a layer comprises a bit error that corresponds to a difference between an actual number of bits generated during encoding for the layer and a target number of bits corresponding to the actual number of bits for the layer.
16. The system of
the circuitry is configured to adjust the quantization parameter based on a proportional value, an integral value or a derivative value of the bit error at one or more layers of each of the plurality of streams.
17. The system of
at least one of the one or more layers includes a multi-group of pictures, a group of pictures, a frame, a multi-macroblock or a macroblock.
18. The system of
the circuitry is configured to adjust a total number of frames in a group of pictures for each of one or more of the plurality of streams for the allocation of the target number of bits to each of the plurality of frames.
|
|||||||||||||||||||||||||||||
This application is a continuation of and is based upon and claims the benefit of priority under 35 U.S.C. §120 for U.S. Ser. No. 12/845,498, filed Jul. 28, 2010, and makes reference to, claims priority to, and claims benefit from U.S. Provisional Application Ser. No. 61/360,730, which was filed on Jul. 1, 2010.
The above stated application is hereby incorporated herein by reference in its entirety.
Certain embodiments of the invention relate to video processing. More specifically, certain embodiments of the invention relate to a method and system for multi-layer rate control for a multi-codec system.
Digital video capabilities may be incorporated into a wide range of devices such as, for example, digital televisions, digital direct broadcast systems, digital recording devices, and the like. Digital video devices may provide significant improvements over conventional analog video systems in processing and transmitting video sequences with increased bandwidth efficiency.
Various video encoding standards, for example, MPEG-1, MPEG-2, MPEG-4, H.263, advanced video coding (AVC) and VC-1, have been established for encoding digital video sequences in a compressed manner. A frame in a compressed video may be coded in three possible frame or picture types, namely, I-frame (or I-picture), P-frame (or P-picture) and B-frame (or B-picture). I-frames are the least compressible but don't require other video frames to decode. P-frames may use data from previous frames to decompress or decode and are more compressible than I-frames. B-frames may use both previous and forward frames for data reference to get the highest amount of data compression. The I-frames are the largest in terms of bits per frame, the P-frames have fewer bits than the I-frames and the B-frames have even fewer bits than the P-frames.
Further limitations and disadvantages of conventional and traditional approaches will become apparent to one of skill in the art, through comparison of such systems with the present invention as set forth in the remainder of the present application with reference to the drawings.
A system and/or method for multi-layer rate control for a multi-codec system, substantially as shown in and/or described in connection with at least one of the figures, as set forth more completely in the claims.
Various advantages, aspects and novel features of the present invention, as well as details of an illustrated embodiment thereof, will be more fully understood from the following description and drawings.
Certain embodiments of the invention can be found in a method and system for multi-layer rate control for a multi-codec system. In various embodiments of the invention, a video transmitter, which may comprise a plurality of encoders with different CODECs, may be operable to determine, for a transport stream, a constant overall number of bits per time interval that corresponds to transferring a frame in the transport stream. The transport stream may comprise a plurality of video streams that are concurrently generated from two or more of the plurality of encoders. For each time interval that corresponds to a start and an end of encoding of each of a plurality of frames using each of the two or more of the plurality of encoders, the video transmitter may be operable to allocate a target number of bits to each of the plurality of frames to achieve the constant overall number of bits. The allocation of the target number of bits may be based on a frame type of each of the plurality of frames and a CODEC type of each of the two or more of the plurality of encoders, where the allocated target number of bits for each of the plurality of frames meets buffer overflow/underflow requirements associated with each of the two or more of the plurality of encoders. In this regard, a target number of bits may be determined for a macroblock (MB) of each of the plurality of frames in each of the plurality of video streams based on the allocated target number of bits of the frame. Accordingly, a quantization parameter (QP) for the macroblock (MB) may be calculated by the video transmitter based on the determined target number of bits of the macroblock (MB).
In an exemplary embodiment of the invention, the video transmitter may be operable to determine rate control information associated with the macroblock (MB) at each of one or more layers of the video stream. A layer may comprise a multi-group of pictures (multi-GOP), a group of pictures (GOP), a frame, a multi-macroblock (multi-MB) and/or a macroblock (MB). The calculated quantization parameter (QP) may be adjusted at each of the one or more layers based on the rate control information at each of the one or more layers so as to generate a final quantization parameter (QP). An actual number of bits may be generated by the video transmitter during encoding of the macroblock (MB) utilizing the final quantization parameter (QP). In this regard, for example, the rate control information at a layer may comprise a bit error. The bit error is a difference between an actual number of bits generated during encoding for the layer and a target number of bits corresponding to the actual number of bits for the layer. In an exemplary embodiment of the invention, the video transmitter may be operable to adjust the calculated quantization parameter (QP) based on a proportional value, an integral value and/or a derivative value of the bit error at each of the one or more layers. In an exemplary embodiment of the invention, the video transmitter may be operable to adjust a total number of frames in a group of pictures (GOP) for each of one or more of the plurality of video streams to flexibly enable the allocation of the target number of bits to each of the plurality of frames.
The video transmitter 110 may comprise suitable logic, circuitry, interfaces and/or code that may be operable to distribute encoded or compressed video content to the video receiver 130 via a bitstream such as the transport stream 120. The video transmitter 110, such as, for example, a headend system may be operable to provide various services such as, for example, distribution, multicast, and/or quality of service necessary for a reliable and timely transmission of the compressed video content to the video receiver 130. The video transmitter 110 may utilize, for example, a cable TV network, a satellite broadcasting network, the Internet protocol (IP) data network such as the Internet, and/or a wireless communication network for delivery of services or the compressed video content to the video receiver 130.
In an exemplary embodiment of the invention, the video transmitter 110 may comprise a plurality of encoders with different CODECs. For example, an encoder may comprise a MPEG-2 encoder, a MPEG-4 encoder, an AVC encoder and/or a VC-1 encoder. The transport stream 120 may comprise a plurality of video streams which may be concurrently generated from the plurality of encoders.
A video stream may be organized in a layered structure in which a syntactic structure may comprise one or more subordinate structures. In this instance, for example, a video stream may comprise a series of multi-GOPs. For example, a multi-GOP may be a video sequence, and may comprise a plurality of GOPs. Each of the plurality of GOPs may comprise one I-frame, several P-frames and/or several B-frames. A frame may comprise a series of multi-MBs. For example, a multi-MB may be a slice of a frame. A multi-MB may comprise a plurality of MBs that are subsequent in time. The MB is the lowest layer or level in the layered structure.
The video receiver 130 may comprise suitable logic, circuitry, interfaces and/or code that may be operable to receive the compressed video via the transport stream 120 from the video transmitter 120. The video receiver 130 such as, for example, a set-top box (STB) may be operable to decode or decompress the received compressed video. In an exemplary embodiment of the invention, the video receiver 130 may comprise a plurality of decoders with different CODECs. For example, a decoder may comprise a MPEG-2 decoder, a MPEG-4 decoder, an AVC decoder and/or a VC-1 decoder.
In operation, a video transmitter 110, which may comprise a plurality of encoders with different CODECs, may be operable to determine, for a transport stream 120, a constant overall number of bits per time interval that corresponds to transferring a frame in the transport stream 120. The transport stream 120 may comprise a plurality of video streams that are concurrently generated from two or more of the plurality of encoders. For each time interval that corresponds to a start and an end of encoding of each of a plurality of frames using each of the two or more of the plurality of encoders, the video transmitter 110 may be operable to allocate a target number of bits to each of the plurality of frames to achieve the constant overall number of bits. The allocation of the target number of bits may be based on a frame type of each of the plurality of frames and a CODEC type of each of the two or more of the plurality of encoders, while the allocated target number of bits for each of the plurality of frames may still need to meet buffer overflow/underflow requirements associated with each of the two or more of the plurality of encoders.
Based on a hypothetical reference decoder (HRD) model associated with a rate control operation, a decoder buffer in the video receiver 130 may overflow in instances when the decoder buffer becomes full and more compressed bits are arriving from the transport stream 120. The decoder buffer may underflow in instances when the removal time for a frame for decoding occurs before all compressed bits representing the frame have arrived. Similarly, an encoder buffer in the video transmitter 110 may overflow in instances when the encoder buffer becomes full and more compressed bits are arriving from a corresponding encoder. The encoder buffer may underflow in instances when the removal time for a frame for transmission to the video receiver 130 via the transport stream 120 occurs before all compressed bits representing the frame have arrived at the encoder buffer from the corresponding encoder. A purpose of any rate control operation is to generate the number of bits representing a frame such that both the encoder buffer and the decoder buffer do not overflow and do not underflow. Accordingly, while the allocation of the target number of bits to a frame may be based on a frame type of each of the plurality of frames and a CODEC type of each of the two or more of the plurality of encoders, the allocated target number of bits for each of the plurality of frames may still need to satisfy the buffer overflow/underflow conditions associated with each of the two or more of the plurality of encoders.
In an exemplary embodiment of the invention, stuffing bits may be inserted into the transport stream 120 so that the constant overall numbers of bits may be achieved as well as the buffer overflow/underflow requirements may be met. The stuffing bits are inserted code-words that will be discarded in the decoding process in the video receiver 130.
A target number of bits may be determined for a macroblock (MB) of each of the plurality of frames in each of the plurality of video streams based on the allocated target number of bits of the frame. For example, I-frames are the largest in terms of bits per frame, P-frames have fewer bits than I-frames and B-frames have even fewer bits than P-frames. In instances when the next frame to be encoded is an I-frame, which may require a larger number of bits, the video transmitter 110 may allocate the particular bit rate for the I-frame to be larger so that a larger size in bits for the I-frame may be made possible. For example, a VC-1 encoded B-frame may comprise significantly smaller number of bits when compared to a P-frame due to the fact that B-frames in the VC-1 encoding may allow bi-directional prediction. An AVC encoded B-frame may comprise a number or quantity of bits which may not be that different from a P-frame due to the fact that P-frames in the AVC encoding may also allow bi-direction prediction.
A quantization parameter (QP) for the macroblock (MB) may be calculated by the video transmitter 110 based on the determined target number of bits of the macroblock (MB). The quantization parameter (QP) such as, for example, a quantization level (QL) may be derived for the purpose of actually producing bits in a video stream in the transport stream 120.
In an exemplary embodiment of the invention, the video transmitter 110 may be operable to determine rate control information associated with the macroblock (MB) at each of one or more layers of the video stream. For example, a layer may comprise a multi-GOP, a GOP, a frame, a multi-MB and/or a macroblock (MB). The calculated quantization parameter (QP) may be adjusted at each of the one or more layers based on the rate control information at each of the one or more layers so as to generate a final quantization parameter (QP). For example, the rate control information at a layer may comprise a bit error. The bit error is the difference between an actual number of bits generated during encoding for the layer and a target number of bits corresponding to the actual number of bits for the layer. In an exemplary embodiment of the invention, the video transmitter 110 may be operable to adjust the calculated quantization parameter (QP) based on a proportional value, an integral value and/or a derivative value of the bit error at each of the one or more layers.
In reference to a proportional integral derivative (PID) control system, the proportional value or term of the bit error may represent the actual error or offset. The proportional value may determine a rate control action based on current error. The integral value or term of the bit error examines a history of the bit error and may represent the past aspect of the bit error. The integral value may determine a rate control action based on a sum of recent errors. The derivative value or term of the bit error detects rapid changes of the bit error and may represent the future aspect of the bit error. The derivative value may determine a rate control action based on a rate at which the error has been changing.
An actual number of bits may be generated by the video transmitter 110 during encoding of the macroblock (MB) utilizing the final quantization parameter (QP). Accordingly, a video stream for each of the plurality of encoders may be produced as a result of a multi-layer rate control. While more than one video streams are concurrently produced at different number of bits per frame, which may also be variable over time, the sum of these numbers of bits per frame may still be constant as imposed in the transport stream 120.
In an exemplary embodiment of the invention, the video transmitter 110 may be operable to adjust a total number of frames in a group of pictures (GOP) for each of one or more of the plurality of video streams so as to flexibly enable the allocation of the target number of bits to each of the plurality of frames. For example, the total numbers of frames in the GOPs of some video streams may be increased and/or the total numbers of frames in the GOPs of some video streams may be decreased so as to avoid I-frames occurring at the same time. In instances when it is hard to allocate the target number of bits to frames so as to achieve the constant overall number of bits, due to the requirement of satisfying the buffer overflow/underflow conditions, the total number of frames in the GOP of a video stream may be increased to provide flexibility for bits allocation, for example.
Although in
The rate control module 202 may comprise suitable logic, circuitry, interfaces and/or code that may be operable to perform a rate control for each of the plurality of encoders 204. In an exemplary embodiment of the invention, the rate control module 202 may be operable to allocate, for each time interval that corresponds to a start and an end of encoding of a frame, a particular bit rate for a video stream for each of the plurality of encoders 204, based on a constant overall bit rate for a transport stream such as the transport stream 120. The rate control module 202 may be operable to perform the rate control by taking actions at multiple layers of the video stream for each of the plurality of encoders 204.
Each of the plurality of encoders 204 such as the encoder 204a may comprise suitable logic, circuitry, interfaces and/or code that may be operable to encode video content to generate a video stream. The encoder 204a may be operable to produce bits for each macroblock (MB) of each of frames in the video stream using a finally adjusted quantization parameter (QP) such as, for example, a finally adjusted quantization level (QL), which may be generated by the rate control module 202. The encoder 204a may comprise a MPEG-2 encoder 204e, a MPEG-4 encoder 204f, an AVC encoder 204g, and/or a VC-1 encoder 204h, for example.
The transport multiplexer 208 may comprise suitable logic, circuitry, interfaces and/or code that may be operable to merge a plurality of video streams which may be generated by one or more of the plurality of encoders 204 into a combined bitstream for transmitting to a video receiver such as the video receiver 130.
The processor 210 may comprise suitable logic, circuitry, interfaces and/or code that may be operable to communicate with the rate control module 202, the plurality of encoders 204 and the transport multiplexer 208 to perform various functions of the video transmitter 200 such as the multi-layer rate control function.
The memory 212 may comprise suitable logic, circuitry, interfaces and/or code that may be operable to store information such as executable instructions and data that may be utilized by the processor 210, the rate control module 202, the plurality of encoders 204 and/or the transport multiplexer 208 to perform various functions of the video transmitter 200.
In operation, a rate control module 202 may be operable to determine, for a transport stream 120, a constant overall number of bits per time interval that corresponds to transferring a frame in the transport stream such as the transport stream 120. The transport stream 120 may comprise a plurality of video streams that are concurrently generated from two or more of the plurality of encoders 204. For each time interval that corresponds to a start and an end of encoding of each of a plurality of frames using each of the two or more of the plurality of encoders 204, the rate control module 202 may be operable to allocate a target number of bits to each of the plurality of frames so as to achieve the constant overall number of bits. The allocation of the target number of bits may be based on a frame type of each of the plurality of frames and a CODEC type of each of the two or more of the plurality of encoders 204, where the allocated target number of bits for each of the plurality of frames meets buffer overflow/underflow requirements associated with each of the two or more of the plurality of encoders 204.
A target number of bits may be determined for a macroblock (MB) of each of the plurality of frames in each of the plurality of video streams based on the determined target number of bits of the frame. A quantization parameter (QP) for the macroblock (MB) may be calculated by the rate control module 202 based on the determined target number of bits of the macroblock (MB).
In an exemplary embodiment of the invention, the rate control module 202 may be operable to determine rate control information associated with the macroblock (MB) at each of one or more layers of the video stream. For example, a layer may comprise a multi-GOP, a GOP, a frame, a multi-MB and/or a macroblock (MB). The calculated quantization parameter (QP) may be adjusted at each of the one or more layers based on the rate control information at each of the one or more layers so as to generate a final quantization parameter (QP). For example, the rate control information at a layer may comprise a bit error. The bit error is the difference between an actual number of bits generated during encoding for the layer and a target number of bits corresponding to the actual number of bits for the layer. In an exemplary embodiment of the invention, the rate control module 202 may be operable to adjust the calculated quantization parameter (QP) based on a proportional value, an integral value and/or a derivative value of the bit error at each of the one or more layers.
An encoder such as the encoder 204a may be operable to generate an actual number of bits during encoding of the macroblock (MB) utilizing the associated final quantization parameter (QP). Accordingly, a video stream for each of the plurality of encoders 204 may be produced as a result of a multi-layer rate control. While more than one video streams are concurrently produced at different number of bits per frame, that may also be variable over time, the sum of these numbers of bits per frame may still be constant as imposed in the transport stream 120.
During a rate control operation, the rate control module 202 may be operable to increase or decrease a total number of frames in a group of pictures (GOP) for each of one or more of the plurality of video streams so as to flexibly enable the allocation of the target number of bits to each of the plurality of frames.
In an exemplary embodiment of the invention, the times when the frames arrive at the plurality of encoders 240 may not coincide. In this instance, the rate control module 202 may be operable to perform the rate control for each time interval between two arrived frames. In this regard, the time intervals perceived by the rate control module 202 may not be constant time intervals, for example.
In an exemplary embodiment of the invention, the rate control module 202 in the video transmitter 200 may be operable to determine rate control information associated with a MB such as the MB 350a at each of one or more layers such as the multi-GOP 310a, the GOP 320a, the frame 330a, the multi-MB 340a and/or the MB 350a. For example, the rate control module 202 may track bit errors at the multi-GOP 310a, the GOP 320a, the frame 330a, the multi-MB 340a and/or the MB 350a, and to take appropriate actions to minimize the bit errors at all of the layers. In addition to the bit error, the rate control information may comprise, for example, an actual number of bits generated from multiple GOPs at multi-GOP 310a, a frame type structure of the GOP 320a, a frame type of the frame 330a, an average number of bits generated per multi-MB in the frame 330a, a total number of MBs in the multi-MB 340a and/or a variance of luminance pixels in the MB 350a.
In step 404, a target number of bits for a macroblock (MB) of a frame may be determined by the rate control module 202 based on the allocated target number of bits of the frame. In step 405, a quantization parameter (QP) for the macroblock (MB) may be calculated by the rate control module 202 based on the determined target number of bits of the macroblock (MB). In step 406, the rate control module 202 may be operable to determine rate control information associated with the macroblock (MB) at each of one or more layers of the video stream. In step 407, the rate control module 202 may be operable to adjust the calculated quantization parameter (QP) at each of the one or more layers based on the rate control information at each of the one or more layers to generate a final quantization parameter (QP). In step 408, one of the encoders 204 may be operable to generate an actual number of bits during encoding of the macroblock (MB) utilizing the final quantization parameter (QP). The exemplary steps may proceed to the end step 409.
In various embodiments of the invention, a video transmitter 200 may comprise a rate control module 202 and a plurality of encoders 204 with different CODECs. The rate control module 202 may be operable to determine, for a transport stream 120, a constant overall number of bits per time interval that corresponds to transferring a frame in the transport stream 120. The transport stream 120 may comprise a plurality of video streams that are concurrently generated from two or more of the plurality of encoders 204. For each time interval that corresponds to a start and an end of encoding of each of a plurality of frames using each of the two or more of the plurality of encoders 204, the rate control module 202 may be operable to allocate a target number of bits to each of the plurality of frames to achieve the constant overall number of bits. The allocation of the target number of bits may be based on a frame type of each of the plurality of frames and a CODEC type of each of the two or more of the plurality of encoders 204, where the allocated target number of bits for each of the plurality of frames meets buffer overflow/underflow requirements associated with each of the two or more of the plurality of encoders 204. In this regard, a target number of bits may be determined for a macroblock (MB) of each of the plurality of frames in each of the plurality of video streams based on the allocated target number of bits of the frame. Accordingly, a quantization parameter (QP) for the macroblock (MB) may be calculated by the rate control module 202 based on the determined target number of bits of the macroblock (MB).
In an exemplary embodiment of the invention, the rate control module 202 may be operable to determine rate control information associated with the macroblock (MB) at each of one or more layers of the video stream. A layer may comprise a multi-GOP, a GOP, a frame, a multi-MB and/or a MB. The calculated quantization parameter (QP) may be adjusted at each of the one or more layers based on the rate control information at each of the one or more layers so as to generate a final quantization parameter (QP). An actual number of bits may be generated by the corresponding encoder such as the encoder 204a during encoding of the macroblock (MB) utilizing the final quantization parameter (QP). In this regard, for example, the rate control information at a layer may comprise a bit error. The bit error is the difference between an actual number of bits generated during encoding for the layer and a target number of bits corresponding to the actual number of bits for the layer. In an exemplary embodiment of the invention, the rate control module 202 may be operable to adjust the calculated quantization parameter (QP) based on a proportional value, an integral value and/or a derivative value of the bit error at each of the one or more layers.
In an exemplary embodiment of the invention, the rate control module 202 may be operable to adjust a total number of frames in a group of pictures (GOP) for each of one or more of the plurality of video streams so as to flexibly enable the allocation of the target number of bits to each of the plurality of frames.
Other embodiments of the invention may provide a non-transitory computer readable medium and/or storage medium, and/or a non-transitory machine readable medium and/or storage medium, having stored thereon, a machine code and/or a computer program having at least one code section executable by a machine and/or a computer, thereby causing the machine and/or computer to perform the steps as described herein for multi-layer rate control for a multi-codec system.
Accordingly, the present invention may be realized in hardware, software, or a combination of hardware and software. The present invention may be realized in a centralized fashion in at least one computer system or in a distributed fashion where different elements are spread across several interconnected computer systems. Any kind of computer system or other apparatus adapted for carrying out the methods described herein is suited. A typical combination of hardware and software may be a general-purpose computer system with a computer program that, when being loaded and executed, controls the computer system such that it carries out the methods described herein.
The present invention may also be embedded in a computer program product, which comprises all the features enabling the implementation of the methods described herein, and which when loaded in a computer system is able to carry out these methods. Computer program in the present context means any expression, in any language, code or notation, of a set of instructions intended to cause a system having an information processing capability to perform a particular function either directly or after either or both of the following: a) conversion to another language, code or notation; b) reproduction in a different material form.
While the present invention has been described with reference to certain embodiments, it will be understood by those skilled in the art that various changes may be made and equivalents may be substituted without departing from the scope of the present invention. In addition, many modifications may be made to adapt a particular situation or material to the teachings of the present invention without departing from its scope. Therefore, it is intended that the present invention not be limited to the particular embodiment disclosed, but that the present invention will include all embodiments falling within the scope of the appended claims.
Chen, Xuemin, Berbecel, Gheorghe
| Patent | Priority | Assignee | Title |
| 10482594, | Sep 23 2016 | Apple Inc | Multi-perspective imaging system and method |
| Patent | Priority | Assignee | Title |
| 5457495, | May 25 1994 | AT&T IPM Corp | Adaptive video coder with dynamic bit allocation |
| 6160846, | Oct 25 1995 | MEDIATEK, INC | Apparatus and method for optimizing the rate control in a coding system |
| 6480539, | Sep 10 1999 | INTERDIGITAL MADISON PATENT HOLDINGS | Video encoding method and apparatus |
| 20040202248, | |||
| 20070206674, | |||
| 20090041118, | |||
| 20110122224, |
| Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
| Feb 21 2014 | Broadcom Corporation | (assignment on the face of the patent) | / | |||
| Feb 25 2014 | CHEN, XUEMIN | Broadcom Corporation | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 032313 | /0290 | |
| Feb 26 2014 | BERBECEL, GHEORGHE | Broadcom Corporation | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 032313 | /0290 | |
| Feb 01 2016 | Broadcom Corporation | BANK OF AMERICA, N A , AS COLLATERAL AGENT | PATENT SECURITY AGREEMENT | 037806 | /0001 | |
| Jan 19 2017 | BANK OF AMERICA, N A , AS COLLATERAL AGENT | Broadcom Corporation | TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS | 041712 | /0001 | |
| Jan 20 2017 | Broadcom Corporation | AVAGO TECHNOLOGIES GENERAL IP SINGAPORE PTE LTD | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 041706 | /0001 | |
| May 09 2018 | AVAGO TECHNOLOGIES GENERAL IP SINGAPORE PTE LTD | AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE LIMITED | MERGER SEE DOCUMENT FOR DETAILS | 047229 | /0408 | |
| Sep 05 2018 | AVAGO TECHNOLOGIES GENERAL IP SINGAPORE PTE LTD | AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE LIMITED | CORRECTIVE ASSIGNMENT TO CORRECT THE PATENT NUMBER 9,385,856 TO 9,385,756 PREVIOUSLY RECORDED AT REEL: 47349 FRAME: 001 ASSIGNOR S HEREBY CONFIRMS THE MERGER | 051144 | /0648 | |
| Sep 05 2018 | AVAGO TECHNOLOGIES GENERAL IP SINGAPORE PTE LTD | AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE LIMITED | CORRECTIVE ASSIGNMENT TO CORRECT THE EFFECTIVE DATE PREVIOUSLY RECORDED ON REEL 047229 FRAME 0408 ASSIGNOR S HEREBY CONFIRMS THE THE EFFECTIVE DATE IS 09 05 2018 | 047349 | /0001 |
| Date | Maintenance Fee Events |
| May 24 2019 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
| May 17 2023 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
| Date | Maintenance Schedule |
| Nov 24 2018 | 4 years fee payment window open |
| May 24 2019 | 6 months grace period start (w surcharge) |
| Nov 24 2019 | patent expiry (for year 4) |
| Nov 24 2021 | 2 years to revive unintentionally abandoned end. (for year 4) |
| Nov 24 2022 | 8 years fee payment window open |
| May 24 2023 | 6 months grace period start (w surcharge) |
| Nov 24 2023 | patent expiry (for year 8) |
| Nov 24 2025 | 2 years to revive unintentionally abandoned end. (for year 8) |
| Nov 24 2026 | 12 years fee payment window open |
| May 24 2027 | 6 months grace period start (w surcharge) |
| Nov 24 2027 | patent expiry (for year 12) |
| Nov 24 2029 | 2 years to revive unintentionally abandoned end. (for year 12) |