A moving image signal encoding apparatus includes: a frame decimating circuit for extracting encoded frames from an input moving image signal at specified intervals; a frame interpolating circuit for obtaining an interpolated frame between the encoded extracted frames, and a circuit for obtaining an error formed by frame interpolation. A moving image signal decoding apparatus includes: a receiving circuit for extracting a frame code from an inputted signal; a frame decoding circuit for decoding the frame code to obtain a reproduced frame, and a frame interpolating circuit for obtaining an interpolated frame between the reproduced frames. By transmitting an error of the interpolated frame from the encoding apparatus to the decoding apparatus and correcting the error of the interpolated frame with the decoding apparatus, the error of the interpolated frame is eliminated. Alternatively, depending on the value of the error of the interpolated frame obtained with the encoding apparatus, a circuit determines the operation mode as to whether the frame interpolating circuit of the decoder carries out frame interpolation or preceding value holding and sends a flag to show the operation mode to the decoder, so that improvement occurs when the error of the interpolated frame is large.
|
1. A moving image signal encoding apparatus comprising: a frame decimator for extracting the encoded frame from an input moving image signal at specified intervals; a frame encoder for encoding said encoded frames extracted by said decimator to obtain frame codes; a frame interpolator for producing interpolated frames positioned between said encoded extracted frames from said frame codes; an error evaluator for evaluating errors of said interpolated frames, and a transmitter for transmitting said frame codes and output signals of said error evaluator as an output of the moving image signal encoding apparatus.
2. A moving image signal encoding apparatus comprising: a frame decimator for extracting encoded frames from an input moving image signal at specified intervals; a frame encoder for encoding said frames extracted by said decimator to obtain frame codes; a decoder for decoding said frame codes to obtain reproduced frames; a frame interpolator for producing interpolated frames positioned between said reproduced frames; and an interpolated frame encoder for encoding errors of said interpolated frames to obtain interpolated frame codes,; and a transmitter for transmitting said frame codes and said interpolated frame codes as an output of the moving image signal encoding apparatus.
8. A moving image signal encoding apparatus comprising: a frame decimator for extracting encoded frames from an input moving signal at specified intervals; a motion estimator for obtaining motion vectors between said encoded extracted frames; a frame encoder for encoding said encoded extracted frames to obtain frame codes; a frame interpolator for producing interpolated frames positioned between said encoded extracted frames from said frame codes; aan error calculator for obtaining errors of said interpolated frames; a selector for selecting whether to output said motor motion vectors or to output a flag to indicate not to output said motion vectors by using the errors obtained by said error calculator, and a means for outputting said frame codes and an output of said selector.
7. A moving image signal decoding apparatus for decoding a signal produced by a moving image signal encoding apparatus comprising: a frame decimator for extracting encoded frames from an input moving image signal at specified intervals; a frame encoder for encoding said encoded frames to obtain frame codes; a decoder for decoding said frame codes to obtain reproduced frames, a frame interpolator for producing interpolated frames positioned between said reproduced frames; an interpolated frame encoder for encoding errors of said interpolated frames to obtain interpolated frame codes, and a transmitter for transmitting said frame codes and said interpolated frame codes; containing frame codes which have been produced by encoding frames extracted from a moving image signal at specified intervals and interpolated frame codes which have been produced by encoding errors of interpolated frames positioned between the extract frames; said decoding apparatus comprising: a receiver for extracting said frame code codes and said interpolated frame code codes from an input signal; a decoder for decoding said frame code codes to obtain the reproduced frame frames; a frame interpolator for producing the interpolated frame frames positioned between said reproduced frames; an error corrector for correcting an error of each of said interpolated frame frames, and a means for producing a moving image signal from said reproduced frame frames and an output of said error corrector.
9. A moving image signal decoding apparatus for decoding the a signal produced by a moving image signal encoding apparatus comprising: a frame decimator for extracting encoded frames from an input moving image signal at specified intervals; a motion estimator for obtaining motion vectors between said encoded frames; a frame encoder for encoding said encoded frames to obtain frame codes; a frame interpolator for producing interpolated frames positioned between said encoded frames from said frame codes; an error calculator for obtaining errors of said interpolated frames; a selector for selecting whether to output said motion vectors or the output a flag to indicate not to output said motion vectors by using the errors obtained by said error calculator, a means for outputting said frame codes and an output of said selector containing frame codes which have been produced by encoding frames extracted from a moving image signal at specified intervals and interpolated frame codes which have been produced by encoding errors of interpolated frames positioned between the extracted frames and one of either a motion vector between said extracted frames and a flag indicating the absence of a motion vector between said extracted frames; said decoding apparatus comprising: a receiver for extracting the frame codes and said interpolated frame codes from an inputted signal; a frame decoder for decoding said frame codes to obtain reproduced frames, and a frame interpolator for producing an interpolated frames frame positioned between said reproduced frames or holding a preceding reproduced frame, wherein, when said receiver outputs a said motion vector, said frame interpolator produces an said interpolated frame, and when said receiver receives a said flag, said frame interpolator holds the preceding reproduced frame.
3. A moving image signal encoding apparatus according to
4. A moving image signal encoding apparatus according to
5. A moving image signal encoding apparatus according to
6. A moving image signal encoding apparatus according to
|
|||||||||||||||||||||
1. Field of the Invention
The present invention relates to a moving image signal encoding apparatus for performing compression encoding of a moving image signal for transmission of the moving image signal or recording of the same on a recording medium and a decoding apparatus for decoding the codes which have been transmitted or reproduced from a recording medium to obtain a reproduced image.
2. Description of Prior Art
Recently, in the moving image signal encoding apparatus and decoding apparatus, in consequence of the developments of television telephones and television conference systems, various compression encoding systems have been in practical use. As a procedure for curtailing the information amount to be used in these encoding systems there is a frame decimation. This is to curtail the information amount by decimating selected frames of the moving image signal in encoding. Since the movements of the reproduced images become unnatural by decimating the frames, frame interpolation is carried out in the decoding apparatus to obtain the reproduced images having smooth movements.
As one of the precedents to carry out frame interpolation with a moving image signal decoding apparatus there is a construction shown in U.S. Pat. No. 4,727,422. Hereinafter, the construction of the conventional moving image signal encoding apparatus and decoding apparatus is described.
The input of the moving image signal encoding apparatus is a moving image signal of 30 frames/sec. The inputted moving image signal, after decimation of the number of frames to 1/2, becomes a moving image signal of 15 frames/sec. These remaining frames of the moving image signal will be encoded. In the description hereinafter, these frames are called "encoded frames". Interframe motion vectors are obtained from the encoded frames. The motion vectors are obtained on a block by block basis. The motion vectors are used for frame interpolation in the decoding apparatus. The encoded frames and the motion vectors are respectively encoded, after which additional information is incorporated to obtain an output signal of the moving image signal encoding apparatus. The output signal is sent out to a transmission channel or recorded on a recording medium.
The moving image signal decoding apparatus is to decode the signal encoded by the moving image signal encoding apparatus and reproduce the moving image signal. By a signal receiving circuit, each code is received from the transmission channel or read out from the recording medium. The codes are decoded by respective decoding circuits to become the reproduced frames and the motion vectors. The frequency of the reproduced frames is 15 frames/sec. A frame interpolation circuit obtains interpolated frames each positioned between two reproduced frames. The frame interpolation is a motion compensating frame interpolation using a motion vector between the frames. By alternately outputting the interpolated frames and the reproduced frames, an output image signal of 30 frames/sec is obtained.
However, the above construction involves the problem to cause errors to the interpolated frames because there are no correct motion vectors in such cases that: (1) there are objects which move in different directions from each other in a block; (2) the background appears from the shade of a moving object or the background is hidden by a moving object; (3) the moving object changes in shape; and (4) there is a movement accompanied with rotation.
An object of the present invention is to realize reduction in interpolation errors of frames in a moving image signal encoding apparatus which decimates frames in encoding and a moving image signal decoding apparatus which interpolates frames in decoding.
To achieve this object, a moving image signal encoding apparatus of the present invention comprises a frame decimator for extracting view to explainencoded frame to obtain a frame code 1038. The frame decoder 104 decodes the frame code to obtain a reproduced frame 1046. The frame interpolator 105 synthesizes interpolated frames 1051 each positioned between two reproduced frames. The relationship between the reproduced frames and the interpolated frames is explained in FIG. 2(b). A' and C' are the reproduced frames, and these correspond to the encoded frames A and C. The encoded frames A and C are encoded by the frame encoder 103 and then decoded by the frame decoder 104 to be the reproduced frames A' and C'. Bi and Di are the interpolated frames outputted by the frame interpolator 105. The error evaluator and coder 106 encodes an error of each interpolator frame obtained as a difference between the interpolated frame and a corresponding frame of the input moving image signal, and outputs it as an interpolated frame code 1066. The multiplexer and transmitter 107 multiplexes the frame codes and the interpolated frame codes, and outputs the multiplexed result as an output signal 108 of the moving image signal encoding apparatus.
Next, the operations of the moving image signal decoding apparatus 2 are explained. The moving image signal decoding apparatus 2 is to decode the inputted signal 201 and output a reproduced moving image signal. The inputted signal 201 is the output signal 108 of the moving image signal encoding apparatus 1. The receiver and demultiplexer 202 extracts the frame codes 2021 and the interpolated frame codes 2022 from the inputted signal. These codes are respectively equal to the frame codes 1038 and the interpolated frame codes 1066 of the moving image signal encoding apparatus 1. The frame decoder 203 decodes the frame codes and outputs reproduced frames 2036. The frame interpolator 204 synthesizes interpolated frames 2041 each positioned between two reproduced frames. The relationship between the reproduced frames and the interpolated frames is the same as in the case of the moving image signal encoding apparatus 1 as shown in FIG. 2(b). The error corrector 205 corrects the errors of the interpolated frames by using the interpolated frame codes 2022. The selector 206 alternately selects the reproduced frames 2036 and the error-corrected interpolated frames 2037 to obtain the output signal 207 of the moving image signal encoding apparatus. A display apparatus 208 displays the reproduced image based on the output signal 207 of the moving image signal encoding apparatus 2.
FIG. 3 shows a block diagram of a moving image signal encoding apparatus in accordance with a second embodiment of the present invention. In FIG. 3, element 101 is an input moving image signal; element 102 is a frame decimator; element 103 is a frame encoder; element 1033 is a subtraction circuit; element 1035 is a DCT (discrete cosine transform) operation circuit; element 1037 is a quantizer; element 104 is a local frame decoder; element 1041 is a dequantizer; element 1043 is an inverse DCT (IDCT) operation circuit; element 1045 is an addition circuit; element 1047 is a frame memory; element 1048 is a motion compensator; element 105 is a frame interpolator; element 106 is an error evaluator and coder; element 1061 is a subtraction circuit; element 1063 is a DCT operation circuit, 1065 is a quantizer; element 107 is a multiplexer and transmitter; element 108 is an output signal of the moving image signal encoding apparatus, and element 1091 is a motion estimator.
The operations of the moving image signal encoding apparatus constituted as above are explained by way of FIG. 3.
The motion estimator 1091 estimates the motion of the input moving image signal 101 and outputs a motion vector 1092.
The frame decimator 102 decimates the frames of the input moving image signal by one-half. The operation of the frame decimator 102 is the same as that of the first embodiment.
The frame encoder 103 encodes the encoded frames 1031 to obtain frame codes 1038. The encoding method is an interframe coding. The subtraction circuit 1033 obtains a predicted error signal 1034 which is a differential value between the encoded frame 1031 and a predicted frame 1032 formed by the later-described local decoder 104 The DCT operation circuit 1035 transforms the predicted error signal 1034 to a DCT coefficient 1036. The quantizer 1037 quantizes the DCT coefficient 1036 to obtain the frame code 1038.
The local decoder 104 decodes the frame code 1038 to obtain a reproduced frame 1046 and the predicted frame 1032. The dequantizer 1041 dequantizes the frame code 1038 to obtain a reproduced DCT coefficient 1042. The inverse DCT operation circuit 1043 inverse discrete cosine transforms the reproduced DCT coefficient 1042 to obtain a reproduced predicted error signal 1044. The addition circuit 1045 adds the reproduced predicted error signal 1044 and the predicted frame 1032 to obtain the reproduced frame 1046. The frame memory 1047 stores the reproduced frame 1046. The motion compensator 1048 carries out a motion compensation of the reproduced frame read out from the frame memory 1047 according to the motion vector 1092 to obtain the predicted frame 1032.
The frame interpolator 105 synthesizes an interpolated frame 1051 from the motion vector 1092 and the reproduced frame 1046. The relationship between the reproduced frames and the interpolated frames is the same as that explained in the first embodiment.
The error evaluator and coder 106 encodes the error of the interpolated frame 1051 to obtain an interpolated frame code 1066. The subtraction circuit 1061 calculates a differential value between the interpolated frame 1051 and a corresponding frame of the input moving image signal 101 to obtain an interpolated frame error signal 1062. The DCT (Discrete Cosine Transform) operation circuit 1063 transforms the interpolated frame error signal 1062 to a DCT coefficient 1064. The quantizer 1065 quantizes the DCT coefficient 1064 to obtain the interpolated frame code 1066.
The multiplexer and transmitter 107 multiplexes and outputs the frame code 1038, the motion vector 1092, and the interpolated frame code 1066 as the output signal 108 of the moving image signal encoding apparatus.
FIG. 4 shows a block diagram of a moving image signal decoding apparatus in accordance with the second embodiment of the present invention. In FIG. 4, element 201 is an input signal of the moving image signal decoding apparatus; element 202 is a receiver and multiplexer; element 203 is a frame decoder; element 2031 is a dequantizer; element 2033 is an inverse DCT operation circuit,; element 2035 is an addition circuit,; element 2037 is a frame memory,; element 2038 is a motion compensator; element 204 is a frame interpolator; element 205 is an error corrector; element 2051 is a dequantizer; element 2053 is an inverse DCT operation circuit; element 2055 is an addition circuit; element 206 is a selector, and element 207 is an output signal of the moving image signal decoding circuit.
The operations of the moving image signal decoding apparatus constituted as above are explained by way of FIG. 4.
The input signal 201 is an output signal of the moving image signal encoding apparatus of FIG. 3. The receiver and demultiplexer 202 extracts a frame code 2021, an interpolated frame code 2022, and a motion vector 2023 from the input signal 201. These codes are equal to the frame code 1038, the interpolated frame code 1066, and the motion vector 1092, respectively, of the moving image signal encoding apparatus in FIG. 3.
The frame decoder 203 decodes the frame code 2021 to obtain a reproduced frame 2036. The dequantizer 2031 dequantizes the frame code 2031 to obtain a reproduced DCT coefficient 2032. The inverse DCT operation circuit 2035 inverse discrete cosine transforms the reproduced DCT coefficient 2032 to obtain a reproduced predicted error signal 2034. The addition circuit 2035 adds the reproduced predicted error signal 2034 and a predicted frame 2039 formed by the later-described motion compensator 2038 and to obtain the reproduced frame 2036. The frame memory 2037 stores the reproduced frame 2036. The motion compensator 2032 carries out a motion compensation of the reproduced frame read out from the frame memory 2037 according to the motion vector 2023 to obtain the predicted frame 2039.
The frame interpolator 204 synthesizes an interpolated frame 2041 from the motion vector 2023 and the reproduced frame 2036. The relationship between the reproduced frame and the interpolated frame is the same as explained in the first embodiment.
The error corrector 205 corrects the error of the interpolated frame 2041 by using the interpolated frame code 2022. The dequantizer 2051 dequantizes the interpolated frame code 2022 to obtain a reproduced DCT coefficient 2052. The inverse DCT operation circuit 2053 inversely discrete cosine transforms the reproduced DCT coefficient 2052 to obtain an interpolated frame error signal 2054. The addition circuit 2055 adds the reproduced interpolated frame error signal 2054 and the interpolated frame 2041 to obtain a reproduced interpolated frame 2056. The selector 206 alternately selects the reproduced frames 2036 and the reproduced interpolated frames 2056 to obtain the output signal 207 of the moving image signal decoding apparatus and supplies the output signal 207 to the display apparatus 208.
FIG. 5 shows a block diagram of an error evaluator and coder of a moving image signal encoding apparatus in accordance with a third embodiment of the present invention. The constructions of the other parts are the same as those in the second embodiment shown in FIG. 3. In FIG. 5, element 1051 is an input interpolated frame; element 101 is an input moving image signal of the moving image signal encoding apparatus; element 1061 is a subtraction circuit; element 1063 is a DCT operation circuit; element 1065 is a quantizer; element 1068 is an error calculator; element 10611 is a comparator, element 10610 is a reference level; element 10613 is a switch, and element 1066 is an interpolated frame code.
The operations of the error evaluator and coder circuit constituted as above are explained by way of FIG. 5. The subtraction circuit 1061 obtains an interpolated frame error signal 1062 which is a differential value between the input interpolated frame 1051 and the input moving image signal 101. The DCT operation circuit 1063 transforms the interpolated frame error signal 1062 to a DCT coefficient 1064. The quantizer 1065 quantizes the DCT coefficient 1064 to obtain a code 10614. The error calculator 1068 obtains the value of the interpolated frame error signal 1062 on a block by block by block basis to obtain an error value 1069. This block is explained with reference to FIG. 6. In FIG. 6, element 3001 is interpolated frame, and element 3002 is a block in this frame. The interpolated frame is divided at intervals of 8 image elements both vertically and horizontally to obtain each block. The comparator 1061 compares the error value 1069 with a specified reference level 10610, and closes the switch 1061 when the error value 1069 exceeds the reference level 10610. When the switch is closed, the output code 10614 of the quantizer 1065 becomes the interpolated frame code 1066 which is an output of the interpolated frame encoding circuit.
FIG. 7 shows a block diagram of a moving image signal encoding apparatus in accordance with a fourth embodiment of the present invention. In FIG. 7, element 101 is an input moving image signal; element 102 is a frame decimator; element 103 is a frame encoder; element 104 is a frame decoder; element 105 is a frame interpolator; element 107 is a transmitter and multiplexer; element 108 is an output signal of the moving image signal encoding apparatus; element 1091 is a motion estimator; element 1093 is an error evaluator, and element 1094 is a selector.
The operations of the moving image signal encoding apparatus constituted as above are explained by way of FIG. 7.
The frame decimator 102 decimates the frames of the input moving image signal 101 by one-half. The operation of the frame decimator 102 is the same as that of the first embodiment.
The frame encoder 103 encodes the encoded frame to obtain the frame code 1038. The frame decoder 104 decodes the encoded frame code to obtain the reproduced frame 1046. The frame interpolator 105 produces the interpolated frame 1051 from the motion vector 1092 and the reproduced frame 1046. The relationship between the reproduced frame and the interpolated frame is the same as that explained in the first embodiment.
The error evaluator 1093 obtains the error of the interpolated frame 1051 and outputs a mode selection signal 10931. When the error of the interpolated frame is smaller than a predetermined reference level, the mode selector signal becomes a code indicating a frame interpolation mode. When the error is larger than the reference level, the mode selection signal becomes a code indicating a previous value retaining mode. The selector 1094 outputs as its output 1096 the motion vector 1092 when the mode selection signal indicates the frame interpolation mode, and outputs a flag signal when the mode selection signal indicates the previous value retaining mode.
The multiplexer and transmitter 107 multiplexes and outputs the frame code 1038 and the output 1096 of the selector 1094 as the output signal 108 of the moving image signal encoding apparatus.
FIG. 8 shows a block diagram of the decoding apparatus in accordance with the fourth embodiment of the present invention. In FIG. 8, element 201 is an input signal of the moving image signal decoding apparatus,; element 202 is a receiver and demultiplexer,; element 203 is a frame decoder,; element 204 is a frame interpolator,; element 206 is a selector, and element 207 is an output signal of the moving image signal decoding apparatus.
The operations of the moving image signal decoding apparatus constituted as above are explained by way of FIG. 8.
The moving image signal decoding apparatus 2 is to decode the inputted signal 201 and output the moving image signal 207. The inputted signal 201 is the output signal 108 of the moving image signal encoding apparatus of FIG. 6. The receiver and demultiplexer 202 extracts from the inputted signal 201 a frame code 2021 and a signal 2024 which is the motion vector or the flag signal.
When the motion vector is extracted from the receiver and demultiplexer 202, the operation sequence is as follows. The frame decoder 203 decodes the frame code 2021 to obtain the reproduced frame 2036. The frame interpolator 204 interpolates a frame between the reproduced frames. The selector 206 alternately selects the reproduced frames 2036 and the interpolated frames 2087 to obtain the output signal 207 of the moving image signal decoding apparatus. In FIG. 9(a) the output signal of the moving image signal decoding apparatus is shown, in which A' and C' are the reproduced frames, and Bi' and Di' are the interpolated frames.
Further, when the flag signal is extracted as the output 2024 of the receiver and demultiplexer 202, the operation sequence is as follows. The frame decoder 203 decodes the frame code 2021 to obtain the reproduced frame 2036. The frame interpolator 204 obtains the frame positioned between the reproduced frames by holding the preceding frame. The held previous reproduced frame is outputted as the output frame 2087. This operation is shown in FIG. 9(b). The frames A' and C' at the time t0 and t2 are the reproduced frames, and the frames A' and C' at the time t1 and t3 are those in which the frames A' and C' at the time t0 and t2 are respectively held for 1 frame period of time, i.e; the reproduced frames A' and C' are repeated. The selector 206 alternately selects the reproduced frames 2036 and the output frames 2087 of the from interpolator 204 to obtain the output signal 207 of the moving image signal decoding apparatus. The output signal 207 is displayed as a reproduced image by the display apparatus 208.
Nagata, Atsushi, Takahashi, Kenichi, Takeguchi, Nobuyasu
| Patent | Priority | Assignee | Title |
| 10063863, | Jul 18 2003 | Microsoft Technology Licensing, LLC | DC coefficient signaling at small quantization step sizes |
| 10116959, | Jun 03 2002 | Microsoft Technology Licesning, LLC | Spatiotemporal prediction for bidirectionally predictive (B) pictures and motion vector prediction for multi-picture reference motion compensation |
| 10250905, | Aug 25 2008 | Microsoft Technology Licensing, LLC | Conversion operations in scalable video encoding and decoding |
| 10284843, | Jan 25 2002 | Microsoft Technology Licensing, LLC | Video coding |
| 10554985, | Jul 18 2003 | Microsoft Technology Licensing, LLC | DC coefficient signaling at small quantization step sizes |
| 10659793, | Jul 18 2003 | Microsoft Technology Licensing, LLC | DC coefficient signaling at small quantization step sizes |
| 6351545, | Dec 14 1999 | NIO INC | Motion picture enhancing system |
| 6618439, | Jul 06 1999 | Mstar Semiconductor, Inc | Fast motion-compensated video frame interpolator |
| 7280700, | Jul 05 2002 | Microsoft Technology Licensing, LLC | Optimization techniques for data compression |
| 7317839, | Sep 07 2003 | Microsoft Technology Licensing, LLC | Chroma motion vector derivation for interlaced forward-predicted fields |
| 7352905, | Sep 07 2003 | Microsoft Technology Licensing, LLC | Chroma motion vector derivation |
| 7379496, | Sep 04 2002 | Microsoft Technology Licensing, LLC | Multi-resolution video coding and decoding |
| 7408986, | Jun 13 2003 | Microsoft Technology Licensing, LLC | Increasing motion smoothness using frame interpolation with motion analysis |
| 7408990, | Nov 30 1998 | Microsoft Technology Licensing, LLC | Efficient motion vector coding for video compression |
| 7421129, | Sep 04 2002 | Microsoft Technology Licensing, LLC | Image compression and synthesis for video effects |
| 7426308, | Jul 18 2003 | Microsoft Technology Licensing, LLC | Intraframe and interframe interlace coding and decoding |
| 7499495, | Jul 18 2003 | Microsoft Technology Licensing, LLC | Extended range motion vectors |
| 7529302, | Sep 07 2003 | Microsoft Technology Licensing, LLC | Four motion vector coding and decoding in bi-directionally predicted interlaced pictures |
| 7548245, | Mar 10 2004 | Microsoft Technology Licensing, LLC | Image formats for video capture, processing and display |
| 7558320, | Jun 13 2003 | Microsoft Technology Licensing, LLC | Quality control in frame interpolation with motion analysis |
| 7567617, | Sep 07 2003 | Microsoft Technology Licensing, LLC | Predicting motion vectors for fields of forward-predicted interlaced video frames |
| 7577200, | Sep 07 2003 | Microsoft Technology Licensing, LLC | Extended range variable length coding/decoding of differential motion vector information |
| 7590179, | Sep 07 2003 | Microsoft Technology Licensing, LLC | Bitplane coding of prediction mode information in bi-directionally predicted interlaced pictures |
| 7599438, | Sep 07 2003 | Microsoft Technology Licensing, LLC | Motion vector block pattern coding and decoding |
| 7609763, | Jul 18 2003 | Microsoft Technology Licensing, LLC | Advanced bi-directional predictive coding of video frames |
| 7616692, | Sep 07 2003 | Microsoft Technology Licensing, LLC | Hybrid motion vector prediction for interlaced forward-predicted fields |
| 7620106, | Sep 07 2003 | Microsoft Technology Licensing, LLC | Joint coding and decoding of a reference field selection and differential motion vector information |
| 7623574, | Sep 07 2003 | Microsoft Technology Licensing, LLC | Selecting between dominant and non-dominant motion vector predictor polarities |
| 7630438, | Sep 07 2003 | Microsoft Technology Licensing, LLC | Direct mode motion vectors for Bi-directionally predicted interlaced pictures |
| 7639265, | Mar 10 2004 | Microsoft Technology Licensing, LLC | Image formats for video capture, processing and display |
| 7646810, | Jan 25 2002 | Microsoft Technology Licensing, LLC | Video coding |
| 7649539, | Mar 10 2004 | Microsoft Technology Licensing, LLC | Image formats for video capture, processing and display |
| 7664177, | Sep 07 2003 | Microsoft Technology Licensing, LLC | Intra-coded fields for bi-directional frames |
| 7680185, | Sep 07 2003 | Microsoft Technology Licensing, LLC | Self-referencing bi-directionally predicted frames |
| 7738554, | Jul 18 2003 | Microsoft Technology Licensing, LLC | DC coefficient signaling at small quantization step sizes |
| 7822123, | Oct 06 2004 | Microsoft Technology Licensing, LLC | Efficient repeat padding for hybrid video sequence with arbitrary video resolution |
| 7839933, | Oct 06 2004 | Microsoft Technology Licensing, LLC | Adaptive vertical macroblock alignment for mixed frame video sequences |
| 7852936, | Sep 07 2003 | Microsoft Technology Licensing, LLC | Motion vector prediction in bi-directionally predicted interlaced field-coded pictures |
| 7924920, | Sep 07 2003 | Microsoft Technology Licensing, LLC | Motion vector coding and decoding in interlaced frame coded pictures |
| 7925774, | May 30 2008 | ZHIGU HOLDINGS LIMITED | Media streaming using an index file |
| 7949775, | May 30 2008 | ZHIGU HOLDINGS LIMITED | Stream selection for enhanced media streaming |
| 7956930, | Jan 06 2006 | Microsoft Technology Licensing, LLC | Resampling and picture resizing operations for multi-resolution video coding and decoding |
| 8054886, | Feb 21 2007 | Microsoft Technology Licensing, LLC | Signaling and use of chroma sample positioning information |
| 8064520, | Sep 07 2003 | Microsoft Technology Licensing, LLC | Advanced bi-directional predictive coding of interlaced video |
| 8107571, | Mar 20 2007 | Microsoft Technology Licensing, LLC | Parameterized filters and signaling techniques |
| 8189666, | Feb 02 2009 | Microsoft Technology Licensing, LLC | Local picture identifier and computation of co-located information |
| 8213503, | Sep 05 2008 | Microsoft Technology Licensing, LLC | Skip modes for inter-layer residual video coding and decoding |
| 8243820, | Oct 06 2004 | Microsoft Technology Licensing, LLC | Decoding variable coded resolution video with native range/resolution post-processing operation |
| 8254455, | Jun 30 2007 | Microsoft Technology Licensing, LLC | Computing collocated macroblock information for direct mode macroblocks |
| 8340177, | Jul 12 2004 | Microsoft Technology Licensing, LLC | Embedded base layer codec for 3D sub-band coding |
| 8370887, | May 30 2008 | ZHIGU HOLDINGS LIMITED | Media streaming with enhanced seek operation |
| 8374238, | Jul 13 2004 | Microsoft Technology Licensing, LLC | Spatial scalability in 3D sub-band decoding of SDMCTF-encoded video |
| 8374245, | Jun 03 2002 | Microsoft Technology Licensing, LLC | Spatiotemporal prediction for bidirectionally predictive(B) pictures and motion vector prediction for multi-picture reference motion compensation |
| 8379722, | Jul 19 2002 | Microsoft Technology Licensing, LLC | Timestamp-independent motion vector prediction for predictive (P) and bidirectionally predictive (B) pictures |
| 8406300, | Jan 25 2002 | Microsoft Technology Licensing, LLC | Video coding |
| 8442108, | Jul 12 2004 | Microsoft Technology Licensing, LLC | Adaptive updates in motion-compensated temporal filtering |
| 8493513, | Jan 06 2006 | Microsoft Technology Licensing, LLC | Resampling and picture resizing operations for multi-resolution video coding and decoding |
| 8625669, | Sep 07 2003 | Microsoft Technology Licensing, LLC | Predicting motion vectors for fields of forward-predicted interlaced video frames |
| 8638853, | Jan 25 2002 | Microsoft Technology Licensing, LLC | Video coding |
| 8687697, | Jul 18 2003 | Microsoft Technology Licensing, LLC | Coding of motion vector information |
| 8711948, | Mar 21 2008 | Microsoft Technology Licensing, LLC | Motion-compensated prediction of inter-layer residuals |
| 8774280, | Jul 19 2002 | Microsoft Technology Licensing, LLC | Timestamp-independent motion vector prediction for predictive (P) and bidirectionally predictive (B) pictures |
| 8780272, | Jan 06 2006 | Microsoft Technology Licensing, LLC | Resampling and picture resizing operations for multi-resolution video coding and decoding |
| 8819754, | May 30 2008 | ZHIGU HOLDINGS LIMITED | Media streaming with enhanced seek operation |
| 8873630, | Jun 03 2002 | Microsoft Technology Licensing, LLC | Spatiotemporal prediction for bidirectionally predictive (B) pictures and motion vector prediction for multi-picture reference motion compensation |
| 8880571, | May 05 2006 | Microsoft Technology Licensing, LLC | High dynamic range data format conversions for digital media |
| 8917768, | Jul 18 2003 | Microsoft Technology Licensing, LLC | Coding of motion vector information |
| 8953673, | Feb 29 2008 | Microsoft Technology Licensing, LLC | Scalable video coding and decoding with sample bit depth and chroma high-pass residual layers |
| 8964854, | Mar 21 2008 | Microsoft Technology Licensing, LLC | Motion-compensated prediction of inter-layer residuals |
| 9071847, | Oct 06 2004 | Microsoft Technology Licensing, LLC | Variable coding resolution in video codec |
| 9077960, | Aug 12 2005 | Microsoft Technology Licensing, LLC | Non-zero coefficient block pattern coding |
| 9148668, | Jul 18 2003 | Microsoft Technology Licensing, LLC | Coding of motion vector information |
| 9185427, | Jun 03 2002 | Microsoft Technology Licensing, LLC | Spatiotemporal prediction for bidirectionally predictive (B) pictures and motion vector prediction for multi-picture reference motion compensation |
| 9313509, | Jul 18 2003 | Microsoft Technology Licensing, LLC | DC coefficient signaling at small quantization step sizes |
| 9319729, | Jan 06 2006 | Microsoft Technology Licensing, LLC | Resampling and picture resizing operations for multi-resolution video coding and decoding |
| 9479796, | Oct 06 2004 | Microsoft Technology Licensing, LLC | Variable coding resolution in video codec |
| 9571854, | Jun 03 2002 | Microsoft Technology Licensing, LLC | Spatiotemporal prediction for bidirectionally predictive (B) pictures and motion vector prediction for multi-picture reference motion compensation |
| 9571856, | Aug 25 2008 | Microsoft Technology Licensing, LLC | Conversion operations in scalable video encoding and decoding |
| 9888237, | Jan 25 2002 | Microsoft Technology Licensing, LLC | Video coding |
| Patent | Priority | Assignee | Title |
| 4383272, | Apr 13 1981 | MULTIMEDIA PATENT TRUST C O | Video signal interpolation using motion estimation |
| 4575756, | Jul 26 1983 | NEC Corporation | Decoder for a frame or field skipped TV signal with a representative movement vector used for individual vectors |
| 4727422, | Jun 03 1985 | Polycom, Inc | Method and apparatus for efficiently communicating image sequence having improved motion compensation |
| 4958226, | Sep 27 1989 | MULTIMEDIA PATENT TRUST C O | Conditional motion compensated interpolation of digital motion video |
| 4982285, | Apr 27 1989 | Victor Company of Japan, LTD | Apparatus for adaptive inter-frame predictive encoding of video signal |
| JP58190184, | |||
| JP59123383, | |||
| JP5970378, | |||
| JP60229494, | |||
| JP6028392, | |||
| JP63122387, |
| Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
| May 12 1994 | Matsushita Electric Industrial Co., Ltd. | (assignment on the face of the patent) | / |
| Date | Maintenance Fee Events |
| Aug 09 1999 | ASPN: Payor Number Assigned. |
| Nov 01 1999 | M184: Payment of Maintenance Fee, 8th Year, Large Entity. |
| Oct 15 2003 | M1553: Payment of Maintenance Fee, 12th Year, Large Entity. |
| Date | Maintenance Schedule |
| Sep 29 2001 | 4 years fee payment window open |
| Mar 29 2002 | 6 months grace period start (w surcharge) |
| Sep 29 2002 | patent expiry (for year 4) |
| Sep 29 2004 | 2 years to revive unintentionally abandoned end. (for year 4) |
| Sep 29 2005 | 8 years fee payment window open |
| Mar 29 2006 | 6 months grace period start (w surcharge) |
| Sep 29 2006 | patent expiry (for year 8) |
| Sep 29 2008 | 2 years to revive unintentionally abandoned end. (for year 8) |
| Sep 29 2009 | 12 years fee payment window open |
| Mar 29 2010 | 6 months grace period start (w surcharge) |
| Sep 29 2010 | patent expiry (for year 12) |
| Sep 29 2012 | 2 years to revive unintentionally abandoned end. (for year 12) |