A data transform processing apparatus comprising a first lossless transform circuit to perform two step ladder operation processings of receiving unweighted normalized data then outputting weighted nonnormalized rotation-transformed data, and a second lossless transform circuit to perform two step ladder operation processings of receiving the weighted nonnormalized rotation-transformed data from the first lossless transform circuit then performing inverse weighting and outputting unweighted normalized rotation-transformed data, wherein the outputs from the first lossless transform circuit are interchanged and supplied to the second lossless transform circuit.
|
3. A data transform apparatus for converting four items of input data X0, X1, X2 and X3 into four items of data in a frequency space, wherein the input data X0, X1, X2 and X3 are integers, the apparatus comprising:
a first calculator configured to add the input data X3 to the input data X2;
a second calculator configured to subtract the input data X1 from the input data X0;
a rounding processor configured to obtain difference data between an output of said first calculator and an output of said second calculator, to multiply the difference data by a coefficient and to perform rounding processing on the result of multiplication of the difference data by the coefficient;
a third calculator configured to add the input data X1 to an output of said rounding processor;
a fourth calculator configured to add the input data X2 to the output of said rounding processor;
a fifth calculator configured to subtract an output of said fourth calculator from an output of said second calculator; and
a sixth calculator configured to add an output of said first calculator to an output of said third calculator,
wherein the outputs of said third, fourth, fifth and sixth calculators are output as the four items of data in a frequency space.
0. 5. A data transform method of converting four items of input data X0, X1, X2 and X3 into four items of data in a frequency space, wherein the input data X0, X1, X2 and X3 are integers, the method comprising:
a first calculating step of adding the input data X3 to the input data X2;
a second calculating step of subtracting the input data X1 from the input data X0;
a rounding step of obtaining difference data between an output of the first calculating step and an output of the second calculating step, to multiply the difference data by a coefficient and performing rounding processing on the result of multiplication of the difference data by the coefficient;
a third calculating step of adding the input data X1 to an output of the rounding step;
a fourth calculating step of adding the input data X2 to the output of the rounding step;
a fifth calculating step of subtracting an output of the fourth calculating step from an output of the second calculating step; and
a sixth calculating step of adding an output of the first calculating step to an output of the third calculating step;
wherein calculation results in the third, fourth, fifth and sixth calculating steps are output as the four items of data in a frequency space.
0. 8. A data transform apparatus for converting four items of input data X0, X1 X2 and X3 into four items of data in a frequency space, wherein the input data X0, X1, X2 and X3 are integers, the apparatus comprising:
a first calculator configured to add the input data X3 to the input data X2;
a second calculator configured to subtract the input data X1 from the input data X0;
a rounding processor configured to obtain difference data between an output of the first calculator and an output of the second calculator, and output an integer value corresponding to a value that is obtained by multiplying the difference data by 1/2;
a third calculator configured to at least one of add and subtract using the input data X1 and an output of the rounding processor;
a fourth calculator configured to at least one of add and subtract using the input data X2 and the output of the rounding processor;
a fifth calculator configured to at least one of add and subtract using an output of the fourth calculator and an output of the second calculator; and
a sixth calculator configured to at least one of add and subtract using an output of the first calculator and an output of the third calculator;
wherein the outputs of the third, fourth, fifth and sixth calculators are output as the four items of data in a frequency space.
0. 6. A data transform apparatus for converting four items of input data X0, X1, X2 and X3 into four items of data in a frequency space, wherein the input data X0, X1, X2 and X3 are integers, the apparatus comprising:
a first calculator configured to add the input data X3 to the input data X2;
a second calculator configured to subtract the input data X1 from the input data X0;
a rounding processor configured to obtain difference data between an output of said first calculator and an output of the second calculator to multiply the difference data by a coefficient and to perform rounding processing on the result of multiplication of the difference data by the coefficient;
a third calculator configured to at least one of add and subtract the input data X1 and an output of the rounding processor;
a fourth calculator configured to at least one of add and subtract the input data X2 and the output of said rounding processor;
a fifth calculator configured to at least one of add and subtract an output of the fourth calculator and an output of the second calculator; and
a sixth calculator configured to at least one of add and subtract an output of the first calculator and an output of the third calculator;
wherein the outputs of the third, fourth, fifth and sixth calculators are output as the four items of data in a frequency space.
0. 9. A data transform method of converting four items of input data X0, X1, X2 and X3 into four items of data in a frequency space, wherein the input data X0, X1, X2 and X3 are integers, the method comprising:
a first calculating step of adding the input data X3 to the input data X2;
a second calculating step of subtracting the input data X1 from the input data X0;
a rounding step of obtaining difference data between an output of the first calculating step and an output of the second calculating step, and outputting an integer value corresponding to a value that is obtained by multiplying the difference data by 1/2;
a third calculating step of calculating using the input data X1 and an output of the rounding processor;
a fourth calculating step of calculating using the input data X2 and the output of the rounding processor;
a fifth calculating step of calculating using an output of the fourth calculator and an output of the second calculator; and
a sixth calculating step of calculating using an output of the first calculator and an output of the third calculator;
wherein each step of calculating in the third, fourth, fifth and sixth calculation steps includes at least one of adding and subtracting, and
wherein the calculation results in the third, fourth, fifth and sixth calculation steps are output as the four items of data in a frequency space.
0. 7. A data transform method of converting four items of input data X0, X1, X2 and X3 into four items of data in a frequency space, wherein the input data X0, X1, X2 and X3 are integers, the method comprising:
a first calculation step of adding the input data X3 to the input data X2;
a second calculation step of subtracting the input data X1 from the input data X0;
a rounding step of obtaining difference data between an output of the first calculation step and an output of the second calculation step to multiply the difference data by a coefficient and performing rounding processing on the result of multiplication of the difference data by the coefficient;
a third calculation step of calculating the input data X1 and an output of the rounding step;
a fourth calculation step of calculating the input data X2 and the output of the rounding step;
a fifth calculation step of calculating an output of the fourth calculation step and an output of the second calculation step; and
a sixth calculation step of calculating an output of the first calculation step and an output of the third calculation step;
wherein each step of calculating in the third, fourth, fifth and sixth calculation steps includes at least one of adding and subtracting, and
wherein the calculation results in the third, fourth, fifth and sixth calculation steps are output as the four items of data in a frequency space.
1. A data transform apparatus for converting four items of input data X0, X1, X2 and X3 into four items of data in a frequency space, wherein the input data X0, X1, X2 and X3 are integers, the apparatus comprising:
a first multiplier configured to multiply the input data X1 by a first coefficient;
a second multiplier configured to multiply the input data X2 by a second coefficient;
a first rounding processor configured to perform rounding processing on an output of said first multiplier;
a second rounding processor configured to perform rounding processing on an output of said second multiplier;
a first calculator configured to add an output of said first rounding processor to the input data X0;
a second calculator configured to add an output of said second rounding processor to the input data X3;
a third rounding processor configured to obtain difference data between an output of said first calculator and an output of said second calculator, to multiply the difference data by a third coefficient and to perform rounding processing on the result of multiplication of the difference data by the third coefficient;
a third calculator configured to add an output of said third rounding processor to the input data X1;
a fourth calculator configured to add an output of said third rounding processor to the input data X2;
a fourth multiplier configured to multiply an output of said third calculator by the second coefficient;
a fifth multiplier configured to multiply an output of said fourth calculator by the first coefficient;
a fourth rounding processor configured to perform rounding processing on an output of said fourth multiplier;
a fifth rounding processor configured to perform rounding processing on an output of said fifth multiplier;
a fifth calculator configured to add an output of said fourth rounding processor to an output of said second calculator; and
a sixth calculator configured to add an output of said fifth rounding processor to an output of said first calculator,
wherein the outputs of said third, fourth, fifth and sixth calculators are output as the four items of data in the frequency space.
2. A data transform method of converting four items of input data X0, X1, X2 and X3 into four items of data in a frequency space, wherein the input data X0, X1, X2 and X3 are integers, the method comprising:
a first multiplying step of multiplying the input data X1 by a first coefficient;
a second multiplying step of multiplying the input data X2 by a second coefficient;
a first rounding step of performing rounding processing on an output obtained in said first multiplying step;
a second rounding step of performing rounding processing on an output obtained in said second multiplying step;
a first calculating step of adding an output obtained in said first rounding step to the input data X0;
a second calculating step of adding an output obtained in said second rounding step to the input data X3;
a third rounding step of obtaining difference data between an output obtained in said first calculating step and an output obtained in said second calculating step, multiplying the difference data by a third coefficient and performing rounding processing on the result of multiplication of the difference data by the third coefficient;
a third calculating step of adding an output obtained in said third rounding step to the input data X1;
a fourth calculating step of adding an output obtained in said third rounding step to the input data X2;
a fourth multiplying step of multiplying an output obtained in said third calculating step by the second coefficient;
a fifth multiplying step of multiplying an output obtained in said fourth calculating step by the first coefficient;
a fourth rounding step of performing rounding processing on an output obtained in said fourth multiplying step;
a fifth rounding step of performing rounding processing on an output obtained in said fifth multiplying step;
a fifth calculating step of adding an output obtained in said fourth rounding step to an output obtained in said second calculating step; and
a sixth calculating step of adding an output obtained in said fifth rounding step to an output obtained in said first calculating step,
wherein the outputs obtained in said third, fourth, fifth and sixth calculating steps are output as the four items of data in the frequency space.
4. An apparatus according to
|
Y1=(aX0−a2X1+X2−aX3)/(1+a2)
Y2=(aX0+X1−a2X2−aX3)/(1+a2)
Y3=(a2X0+aX1+aX2+X3)/(1+a2) [Expression 1]
Assuming that the multiplication coefficients for the input data are vectors, all the four vectors corresponding to the four transform expressions are orthogonal to each other (the inner product is “0”). Further, as the absolute vector value is “1”, a 4-point normal orthogonal transform is realized.
In the conventional 4-point normal orthogonal transform using four rotation processings, even if the four rotation processings have the same rotational angle, the respective rotation processings are replaced with three-step ladder operations, so that the transform is realized by total 12 ladder operations. However, in the present embodiment, the transform can be realized by eight step ladder operations.
In the conventional lossless transform, as rounding processing is performed in each ladder operation, 12 rounding processings are necessary. On the other hand, according to the second embodiment, only 8 rounding processings are performed as shown in
The two lossless 2-point transforms may be those in
The modification means that the lossless 4-point orthogonal transform can be realized with two lossless 2-point transforms having inverse rotational directions.
The transform expressions of the 4-point orthogonal transform obtained by the structure in
Y0=(X0−aX1−aX2+a2X3)/(1+a2)
Y1=(aX0−a2X1+X2−aX3)/(1+a2)
Y2=(a2X0+aX1+aX2+X3)/(1+a2)
Y3=(aX0+X1−a2X2−aX3)/(1+a2) [Expression 2]
Further, in a case where the structure in
In
Further, the rounding processing in the second step ladder operation in the transform 503 and the rounding processing in the first step ladder operation in the transform 502 in
Next, the integrated rounding processing is shifted to a position after the third addition processing in the ladder operation.
round (R)+N=round (R+N) [Expression 3]
Note that the left side corresponds to the rounding before the shift, and the right side, to the rounding after the shift. The expression 3 indicates that the result of rounding processing performed after addition of a real number to an integer is the same as that of rounding processing performed before addition of rounded result to the integer. The real number corresponds to the sum of the results of multiplications in the second step and third step ladder operation respectively, before the new rounding processors 801 and 803. Note that the rounding processing of the embodiment may be a most general rounding off (to the nearest whole number), or may be rounding up or rounding down.
The structure in
In
The feature of the structure in
In the case of the modification in
A normal ladder operation is a 1-input 1-output operation, however, in this modification, the structure in
By introducing this expanded ladder operation, it can be said that the structure in
In a case where the rounding processings are removed from the structure in
As the structure in
Further, in
Generally, upon Hadamard transform, input data are rearranged (for example, a butterfly operation is performed between X0 and X3), however, the input data rearrangement is not performed but the output data are rearranged.
In the structure in
In a case where the multiplication coefficient in the ladder operation is an integer value, as the value below decimal point is “0”, the rounding processing is not necessary, therefore the number of rounding processings is reduced. Further, as the multiplication coefficient (½) can be realized only by bit shift, the multiplier can be omitted.
The structure in
In the structure in
On the other hand, the following document 2 shows the structure of lossless 4-point Hadamard transform. In the document 2, to realize the lossless transform, a 4-point Hadamard matrix is divided into triangular matrices and replaced with ladder operations. In this complicated structure, the number of addition processings is larger than that in the structure in
(Document 2) Shinji Fukuma, Kohichi Ohyama, Masahiro Iwahashi and Nori Kanbayashi, “Lossless 8-Point High-Speed Discrete Cosine Transform Utilizing Lossless Hadamard Transform”, Singaku Gihou, IE99-65, pp. 37-44, October 1999
In the 4-point DCT operation shown in
In the expression 4, components X11, X12, X21, and X22 are data in the middle of operation. If the left side transform matrix is subjected to the horizontal processing, the right side transform matrix corresponds to the vertical processing. Both transform matrices express rotation processing at (3π/8). In a linear transform, any of the transform processings can be performed first (at this time, as rounding processing for lossless transform is not inserted, the transform is not a lossless transform but a linear transform), however, in this example, the left transform matrix is first subjected to processing.
More specifically, the rotation processing at (3π/8) is performed on two pairs of data, (X11, X21) and (X12, X22), then the results of transform is transposed, for example, a part of the data are interchanged and the rotation processing at (3π/8) is performed again. This processing is realized as a lossless transform in the structures in
In this embodiment, orthogonal transform processing capable of selection between the 2-point orthogonal transform and the 4-point orthogonal transform is provided by using the structures in
In this structure, a new constituent element is a data selector 1201. If the data flow is changed by the data selector 1201, the lossless 4-point orthogonal transform is realized, whereas if the data flow is not changed by the data selector 1201, the two lossless 2-point orthogonal transforms are realized.
In the above-described second embodiment, the structure in
In
In this embodiment, image data or the like is encoded by quantizing and Huffman coding the DCT coefficients, obtained by the lossless two-dimensional DCT transform to which the above-described ladder operation is applied.
Generally, an 8×8 block sized two-dimensional DCT in JPEG compression or the like is used, however, in this example, a 4×4 lossless two-dimensional DCT transform is-used. The 4×4 two-dimensional DCT can be expanded to an 8×8 two-dimensional DCT by a well-known technique.
The 4-point DCT transform matrix Mdct is expressed as follows.
Assuming that the original 4×4 data are represented as d00, d01, d02, . . . , d32 and d33, the 4×4 two-dimensional DCT is expressed as follows.
In the above expression, the components x00x01, x02, . . . , x32 and X33 indicate data obtained by a two-dimensional Hadamard transform on original data.
The horizontal lossless rotational transform and the vertical lossless rotational transform performed on the data resulted from the lossless two-dimensional Hadamard transform equals a lossless two-dimensional DCT transform. The horizontal lossless rotational transform is performed on four pairs of data, x01 and x03, x11 and x13, x21 and x23, and x31 and x33, while the vertical lossless rotational transform is performed on the four pairs of data, x10 and x30, x11 and X31, x12 and x32, and x13 and X33, which are results from horizontal transform.
In
The horizontal or vertical lossless rotational transforms 1601 to 1604 are realized with a conventional three step ladder operation as shown in
First, a lossless two-dimensional DCT transform processing 1701 as shown in
Accordingly, by setting the quantization steps upon coding processing, the quality of compressed/decompressed image can be continuously controlled by lossless coding to nonlossless (lossy) high-efficiency compression with degradation.
Further, the object of the present invention can also be achieved by providing a storage medium holding software program code for performing the aforesaid processes to a system or an apparatus, reading the program code with a computer (e.g., CPU, MPU) of the system or apparatus from the storage medium, then executing the program. In this case, the program code read from the storage medium realizes the functions according to the embodiments, and the storage medium holding the program code constitutes the invention. Further, the storage medium, such as a floppy disk (registered trademark), a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a DVD, a magnetic tape, a non-volatile type memory card, and ROM can be used for providing the program code.
Furthermore, besides aforesaid functions according to the above embodiments are realized by executing the program code which is read by a computer, the present invention includes a case where an OS (operating system) or the like working on the computer performs a part or entire actual processing in accordance with designations of the program code and realizes functions according to the above embodiments.
Furthermore, the present invention also includes a case where, after the program code read from the storage medium is written in a function expansion card which is inserted into the computer or in a memory provided in a function expansion unit which is connected to the computer, CPU or the like contained in the function expansion card or unit performs a part or entire process in accordance with designations of the program code and realizes functions of the above embodiments.
As described above, the present invention provides lossless 4-point orthogonal transform processing and apparatus capable of transformation with a reduced amount of operation and with high transform accuracy. More particularly, a lossless 4-point orthogonal transform can be realized as five multiplications and five rounding processings with an optimized structure.
Further, the number of multiplications can be reduced to ⅓ of a conventional case where twelve multiplications and twelve rounding processings or fifteen multiplications and five rounding processings are required, even with approximately the same transform accuracy (with the same number of rounding processings).
The present invention is not limited to the above embodiments and various changes and modifications can be made within the spirit and scope of the present invention. Therefore, to appraise the public of the scope of the present invention, the following claims are made.
Patent | Priority | Assignee | Title |
8107767, | Nov 13 2007 | Canon Kabushiki Kaisha | Data transform apparatus and control method thereof |
Patent | Priority | Assignee | Title |
5581373, | Jun 19 1992 | Canon Kabushiki Kaisha | Image communication apparatus having a communication error check function |
5801650, | Nov 29 1994 | Canon Kabushiki Kaisha | Decoding apparatus and method |
5818970, | Apr 26 1991 | Canon Kabushiki Kaisha | Image encoding apparatus |
5841381, | Dec 20 1993 | Canon Kabushiki Kaisha | Huffman coding/decoding using an intermediate code number |
5986594, | Sep 11 1996 | Canon Kabushiki Kaisha | Image compression by arithmetic coding with learning limit |
6301602, | Mar 08 1996 | Kabushiki Kaisha Toshiba | Priority information display system |
6408102, | Dec 20 1993 | Canon Kabushiki Kaisha | Encoding/decoding device |
6549676, | Oct 06 1998 | Canon Kabushiki Kaisha | Encoding device |
6553143, | Jun 30 1992 | Canon Kabushiki Kaisha | Image encoding method and apparatus |
6560365, | Oct 06 1998 | Canon Kabushiki Kaisha | Decoding apparatus and method |
6567562, | Oct 06 1998 | Canon Kabushiki Kaisha | Encoding apparatus and method |
6711295, | Oct 06 1998 | Canon Kabushiki Kaisha | Encoding apparatus and method, and storage medium |
6865299, | Jul 27 1999 | Canon Kabushiki Kaisha | Coding apparatus and method |
6898310, | Jul 03 1998 | Image signal processing method, image signal processing system, storage medium, and image sensing apparatus | |
6996593, | Oct 23 2000 | Canon Kabushiki Kaisha | Filter processing apparatus and its control method, program, and storage medium |
7188132, | Dec 25 2001 | Canon Kabushiki Kaisha | Hadamard transformation method and apparatus |
7295609, | Nov 30 2001 | Sony Corporation | Method and apparatus for coding image information, method and apparatus for decoding image information, method and apparatus for coding and decoding image information, and system of coding and transmitting image information |
20030002743, | |||
20030043905, | |||
20030043907, | |||
20030086127, | |||
20030086597, | |||
20030088598, | |||
20030194138, | |||
20030228063, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Apr 21 2010 | Canon Kabushiki Kaisha | (assignment on the face of the patent) | / |
Date | Maintenance Fee Events |
May 02 2012 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
May 19 2016 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
May 21 2020 | M1553: Payment of Maintenance Fee, 12th Year, Large Entity. |
Date | Maintenance Schedule |
Mar 01 2014 | 4 years fee payment window open |
Sep 01 2014 | 6 months grace period start (w surcharge) |
Mar 01 2015 | patent expiry (for year 4) |
Mar 01 2017 | 2 years to revive unintentionally abandoned end. (for year 4) |
Mar 01 2018 | 8 years fee payment window open |
Sep 01 2018 | 6 months grace period start (w surcharge) |
Mar 01 2019 | patent expiry (for year 8) |
Mar 01 2021 | 2 years to revive unintentionally abandoned end. (for year 8) |
Mar 01 2022 | 12 years fee payment window open |
Sep 01 2022 | 6 months grace period start (w surcharge) |
Mar 01 2023 | patent expiry (for year 12) |
Mar 01 2025 | 2 years to revive unintentionally abandoned end. (for year 12) |