A method and apparatus to remove a block effect and a ring effect appearing in a compression-coded image is disclosed. The present invention is especially applicable to an image compression-coded at a low bit rate. In particular, the present invention includes a variety of masks for the removal of the block/ring effect. Thus, one mask is select for a pixel to be filtered. Moreover, candidate pixels to be averaged with the pixel to be filtered is selected from the pixels of the selected mask to better maintain the details of the image, and a weight is applied to improve the calculation speed of the averaging operation. More particularly, the masks according to the present invention have longer tabs toward adjacent blocks at boundaries of the given block to remove the block and ring effect. In the method, a pixel of an image is filtered according to a filtering methodology. The filtering methodology includes more than one comparison, and each comparison compares a respective determined value and a respective threshold. At least one of the respective thresholds may be based on quantization information of at least a portion of the image including the pixel. Each respective determined value may be based on a respective difference value, and each respective difference value may be based on a different difference. At least one the difference values may be based on the pixel being filtered and another pixel.

Patent
   RE40178
Priority
Aug 31 1998
Filed
Apr 11 2005
Issued
Mar 25 2008
Expiry
Aug 24 2019
Assg.orig
Entity
Large
12
27
EXPIRED
0. 21. A method of filtering an image, comprising:
filtering a pixel of an image according to a filtering methodology, the filtering methodology including more than one comparison, each comparison comparing a respective determined value and a respective threshold, at least one respective threshold being based on quantization information of at least a portion of the image including the pixel, each respective determined value being based on a respective difference value, and more than one of the respective difference values being based on the pixel being filtered and another pixel.
0. 1. A filtering method for a pixel P of a block B in a reconstructed image, comprising:
selecting one of a plurality of filtering masks based upon a position of said pixel P in said block B; and
averaging said pixel P and candidate pixels within the selected filtering mask.
0. 2. A method of claim 1, wherein each of the plurality of filtering masks has 8 tabs.
0. 3. A method of claim 1, wherein a filtering mask with more tabs toward a block adjacent said block B is selected.
0. 4. A method of claim 1, further comprising selecting a pixel within the selected filtering mask Pm as a candidate pixel if the value of the pixel Pm meets a predetermined condition.
0. 5. A method of claim 4, wherein the pixel Pm is selected as a candidate pixel if the absolute value of the difference between said pixel P and pixel Pm is less than a threshold value.
0. 6. A method of claim 5, wherein the threshold value is calculated by an equation below,

δ=k×q
where k is a constant and q is a quantization step interval of said block B.
0. 7. A method of claim 6, wherein the value of k is 1.0 for filtering boundary pixels of said block B and 0.6 for filtering pixels within the boundary pixels of said block B.
0. 8. A method of claim 4, further comprising adding a weight value to said pixel P prior to the averaging, wherein said weight value is based upon a number of pixels Pm not selected as candidate pixels.
0. 9. A method of claim 8, wherein said weight value is the number of pixels Pm not selected multiplied by the value of said pixel P.
0. 10. A filtering apparatus to filter a pixel P of a block B in a reconstructed image, comprising:
a filtering masking unit selecting one of a plurality filtering masks based upon a position of said pixel P in said block B; and
an averaging unit averaging said pixel P and candidate pixels within the selected mask.
0. 11. An apparatus of claim 10, wherein each of the plurality of filtering masks has 8 tabs.
0. 12. An apparatus of claim 11, wherein the plurality of filtereing masks are modified 3×3 mask forms including:
a filtering mask in which eight tabs are selected from the 3×3 mask form, discarding one corner tab;
a filtering mask in which more tabs are selected in a vertical direction than a horizontal direction, and more vertical lower tabs are selected than vertical upper tabs;
a filtering mask in which more tabs are selected in the vertical direction than the horizontal direction, and more vertical upper tabs are selected than vertical lower tabs;
a filtering mask in which more tabs are selected in the horizontal direction than the vertical direction, and more horizontal left tabs are selected than horizontal right tabs; and
a filtering mask in which more tabs are selected in the horizontal direction than the vertical direction, and more horizontal right tabs are selected than horizontal left tabs.
0. 13. An apparatus of claim 10, wherein a filtering mask with more tabs toward a block adjacent said block B is selected.
0. 14. An apparatus of claim 10, further comprising:
a comparison unit selecting a pixel within the selected mask Pm as a candidate pixel if the value of the pixel Pm meets a predetermined condition.
0. 15. An apparatus of claim 14, wherein the pixel Pm is selected as a candidate pixel if the absolute value of the difference between said pixel P and pixel Pm is less than a threshold value.
0. 16. An apparatus of claim 15, wherein the threshold value is calculated by an equation below,

δ=k×q
where k is a constant and q is a quantization step interval of said block B.
0. 17. An apparatus of claim 16, wherein the value of k is 1.0 for filtering boundary pixels of said block B and 0.6 for filtering pixels within the boundary pixels of said block.
0. 18. An apparatus of claim 14, wherein the averaging unit adds a weight value to said pixel P prior to the averaging, wherein said weight value is based upon a number of pixels Pm not selected as candidate pixels.
0. 19. An apparatus of claim 18, wherein said weight value is the number of pixels Pm not selected multiplied by the value of said pixel P.
0. 20. A coding and decoding method comprising:
a discrete cosine transform (DCT) unit performing a DCT operation with respect to divided blocks of an image to generate DCT coefficients;
a quantization unit quantizing the DCT coefficients and transmitting the DCT coefficients in a form of a bit stream through a transmission channel;
a dequantization unit dequantizing the DCT coefficients received through the transmission channel;
an inverse DCT unit performing an inverse DCT operation with respect to the dequantized DCT coefficients to form a reconstructed image, and
a filtering process unit filtering each pixel of each block of the reconstructed image by selecting one of a plurality of filtering masks based upon a position of said pixel in said block; and averaging said pixel and candidate pixels within the selected filtering mask.
0. 22. The method of claim 21, wherein at least one the another pixels is in a neighborhood of the pixel being filtered.
0. 23. The method of claim 22, wherein at least one of the another pixels is adjacent to the pixel being filtered.
0. 24. The method of claim 23, wherein at least one of the respective difference values is based on a difference between the pixel being filtered and the adjacent pixel.
0. 25. The method of claim 22, wherein at least one of the respective difference values is based on a difference between the pixel being filtered and the neighborhood pixel.
0. 26. The method of claim 25, wherein at least one of the respective difference values is an absolute value of the difference between the pixel being filtered and the neighborhood pixel.
0. 27. The method of claim 25, wherein at least one of the determined values is an absolute value.
0. 28. The method of claim 21, wherein at least one of the difference values is an absolute value of the difference between the pixel being filtered and another pixel.
0. 29. The method of claim 21, wherein the filtering methodology filters the pixel based on a result of at least one of the comparisons.
0. 30. The method of claim 29, wherein the filtering methodology filters the pixel using the pixel being filtered and another pixel based on a result of at least one of the comparisons.
0. 31. The method of claim 21, wherein if each of the comparisons results in a determination that the respective determined value is greater than or equal to the respective threshold, the filtering methodology does not filter the pixel.
0. 32. The method of claim 21, wherein the filtering methodology filters the pixel if each of the comparisons results in a determination that the respective determined value is less than the respective threshold.
0. 33. The method of claim 32, wherein if each of the comparisons results in a determination that the respective determined value is greater than or equal to the respective threshold, the filtering methodology does not filter the pixel.
0. 34. The method of claim 21, wherein each respective difference value is based on a different difference.
0. 35. The method of claim 21, wherein at least one of the respective difference values is an absolute value.
0. 36. The method of claim 21, wherein at least one of the respective determined values is the difference value.
0. 37. The method of claim 21, wherein at least one of the respective determined values is an absolute value.
0. 38. The method of claim 21, wherein at least two of the comparisons use a same respective threshold.
0. 39. The method of claim 21, wherein the quantization information is a quantization parameter.
0. 40. The method of claim 21, wherein each of the respective thresholds is based on quantization information of at least a portion of the image including the pixel.

predetermined
where, k is a constant and q is the quantization step interval of a block.

In claims invention. Many alternatives, modifications, and variations will be apparent to those skilled in the art.

Kim, Jae Min

Patent Priority Assignee Title
10027972, Apr 13 2010 Samsung Electronics Co., Ltd. Video encoding method and video encoding apparatus and video decoding method and video decoding apparatus, which perform deblocking filtering based on tree-structure encoding units
10306262, Apr 13 2010 Samsung Electronics Co., Ltd. Video encoding method and video encoding apparatus and video decoding method and video decoding apparatus, which perform deblocking filtering based on tree-structure encoding units
10412411, Apr 13 2010 Samsung Electronics Co., Ltd. Video-encoding method and video-encoding apparatus using prediction units based on encoding units determined in accordance with a tree structure, and video-decoding method and video-decoding apparatus using prediction units based on encoding units determined in accordance with a tree structure
10432965, Apr 13 2010 Samsung Electronics Co., Ltd. Video-encoding method and video-encoding apparatus based on encoding units determined in accordance with a tree structure, and video-decoding method and video-decoding apparatus based on encoding units determined in accordance with a tree structure
9247247, Apr 13 2010 SAMSUNG ELECTRONICS CO , LTD Video-encoding method and video-encoding apparatus using prediction units based on encoding units determined in accordance with a tree structure, and video-decoding method and video-decoding apparatus using prediction units based on encoding units determined in accordance with a tree structure
9485511, Apr 13 2010 SAMSUNG ELECTRONICS CO , LTD Video-encoding method and video-encoding apparatus based on encoding units determined in accordance with a tree structure, and video-decoding method and video-decoding apparatus based on encoding units determined in accordance with a tree structure
9565438, Apr 13 2010 Samsung Electronics Co., Ltd. Video-encoding method and video-encoding apparatus using prediction units based on encoding units determined in accordance with a tree structure, and video-decoding method and video-decoding apparatus using prediction units based on encoding units determined in accordance with a tree structure
9654790, Apr 13 2010 Samsung Electronics Co., Ltd. Video-encoding method and video-encoding apparatus based on encoding units determined in accordance with a tree structure, and video-decoding method and video-decoding apparatus based on encoding units determined in accordance with a tree structure
9712822, Apr 13 2010 SAMSUNG ELECTRONICS CO , LTD Video encoding method and video encoding apparatus and video decoding method and video decoding apparatus, which perform deblocking filtering based on tree-structure encoding units
9712823, Apr 13 2010 Samsung Electronics Co., Ltd. Video-encoding method and video-encoding apparatus using prediction units based on encoding units determined in accordance with a tree structure, and video-decoding method and video-decoding apparatus using prediction units based on encoding units determined in accordance with a tree structure
9936216, Apr 13 2010 Samsung Electronics Co., Ltd. Video-encoding method and video-encoding apparatus using prediction units based on encoding units determined in accordance with a tree structure, and video-decoding method and video-decoding apparatus using prediction units based on encoding units determined in accordance with a tree structure
9942564, Apr 13 2010 Samsung Electronics Co., Ltd. Video-encoding method and video-encoding apparatus based on encoding units determined in accordance with a tree structure, and video-decoding method and video-decoding apparatus based on encoding units determined in accordance with a tree structure
Patent Priority Assignee Title
5283646, Apr 09 1992 Polycom, Inc Quantizer control method and apparatus
5488570, Nov 24 1993 Intel Corporation Encoding and decoding video signals using adaptive filter switching criteria
5563813, Jun 01 1994 Industrial Technology Research Institute Area/time-efficient motion estimation micro core
5611000, Feb 22 1994 HEWLETT-PACKARD DEVELOPMENT COMPANY, L P Spline-based image registration
5748795, Feb 07 1995 Canon Kabushiki Kaisha Image decoder using adjustable filtering
5790131, May 15 1996 HEWLETT-PACKARD DEVELOPMENT COMPANY, L P System and method for lossy compression of data with output file size control
5878166, Dec 26 1995 AVAGO TECHNOLOGIES GENERAL IP SINGAPORE PTE LTD Field frame macroblock encoding decision
5933541, Aug 17 1995 Siemens Aktiengesellschaft Method for processing decoded picture blocks in a block-based method of picture coding
5940536, Sep 05 1995 Matsushita Electric Industrial Co., Ltd. Ringing detector and filter
6041145, Nov 02 1995 MATSUSHITA ELECTRIC INDUSTRIAL CO , LTD Device and method for smoothing picture signal, device and method for encoding picture and device and method for decoding picture
6058210, Sep 15 1997 Xerox Corporation Using encoding cost data for segmentation of compressed image sequences
6108455, May 29 1998 STMicroelectronics, Inc. Non-linear image filter for filtering noise
6167164, Mar 10 1997 SAMSUNG ELECTRONICS CO , LTD One-dimensional signal adaptive filter for reducing blocking effect and filtering method
6178205, Dec 12 1997 Cisco Technology, Inc Video postfiltering with motion-compensated temporal filtering and/or spatial-adaptive filtering
6195632, Nov 25 1998 Panasonic Intellectual Property Corporation of America Extracting formant-based source-filter data for coding and synthesis employing cost function and inverse filtering
6226050, Apr 04 1997 SAMSUNG ELECTRONICS CO , LTD Signal adaptive filtering method for reducing ringing noise and signal adaptive filter
6259823, Feb 15 1997 SAMSUNG ELECTRONICS CO,, LTD Signal adaptive filtering method and signal adaptive filter for reducing blocking effect and ringing noise
6385245, Sep 23 1997 NXP B V Motion estimation and motion-compensated interpolition
6529638, Feb 01 1999 RAKUTEN, INC Block boundary artifact reduction for block-based image compression
6535643, Nov 03 1998 LG Electronics Inc. Method for recovering compressed motion picture for eliminating blocking artifacts and ring effects and apparatus therefor
6631162, Jul 16 1997 SAMSUNG ELECTRONICS CO , LTD Signal adaptive filtering method, signal adaptive filter and computer readable medium for storing program therefor
6665346, Aug 01 1998 SAMSUNG ELECTRONICS CO , LTD ; Korea Advanced Institute of Science and Technology Loop-filtering method for image data and apparatus therefor
20050147319,
20050201633,
JP1070719,
JP9326024,
WO9904497,
/
Executed onAssignorAssigneeConveyanceFrameReelDoc
Apr 11 2005LG Electronics Inc.(assignment on the face of the patent)
Date Maintenance Fee Events
Jul 22 2008ASPN: Payor Number Assigned.
Jul 14 2010RMPN: Payer Number De-assigned.
Jul 15 2010ASPN: Payor Number Assigned.
Dec 27 2010M1552: Payment of Maintenance Fee, 8th Year, Large Entity.


Date Maintenance Schedule
Mar 25 20114 years fee payment window open
Sep 25 20116 months grace period start (w surcharge)
Mar 25 2012patent expiry (for year 4)
Mar 25 20142 years to revive unintentionally abandoned end. (for year 4)
Mar 25 20158 years fee payment window open
Sep 25 20156 months grace period start (w surcharge)
Mar 25 2016patent expiry (for year 8)
Mar 25 20182 years to revive unintentionally abandoned end. (for year 8)
Mar 25 201912 years fee payment window open
Sep 25 20196 months grace period start (w surcharge)
Mar 25 2020patent expiry (for year 12)
Mar 25 20222 years to revive unintentionally abandoned end. (for year 12)