The present invention provides a noise reduction method for use in reducing noise of a digital image, the method comprising steps of: providing a plurality of luminance threshold values; determining a plurality of luminance feature values according to the luminance value of a target pixel and the luminance values of neighboring pixels of the target pixel; determining whether the target pixel is a noise point based on the comparison between each of the luminance feature values and each of the luminance threshold values corresponding thereto, respectively; and adjusting the luminance value, a first chrominance value and a second chrominance value of the target pixel if the target pixel is determined as a noise point. Using the noise reduction method of the present invention, not only noise of a digital image can be identified, but also the degradation caused by the noise can be reduced and thus the overall picture quality can be improved.
|
14. A noise reduction apparatus, applied in a display, for use in reducing noise of a digital image, the apparatus comprising:
a calculating unit, for determining a plurality of luminance feature values according to a luminance value of a target pixel of the digital image and luminance values of neighboring pixels of the target pixel;
a comparing unit, for determining whether the target pixel is a noise point based on the comparison between each of the luminance feature values and each of luminance threshold values corresponding thereto, respectively; and
an adjusting unit, adjusting the luminance value of the target pixel when the target pixel is determined as the noise point;
wherein a first luminance feature value of the luminance feature values is determined by the luminance value of the target pixel and the luminance values of first four neighboring pixels, and the target pixel and the first four neighboring pixels form a cross shape;
wherein a second luminance feature value of the luminance feature values is determined by the luminance value of the target pixel and the luminance values of second four neighboring pixels, and the target pixel and the second four neighboring pixels form an x shape;
wherein the first luminance feature value is expressed as:
CV1=abs[Yr1+Yr2+Yr3+Yr4−K1×Yt], wherein CV1 is the first luminance feature value, Yt is the luminance value of the target pixel, Yr1, Yr2, Yr3, Yr4 are respectively the luminance values of the first four neighboring pixels that form the cross shape with the target pixel, K1 is a constant and abs is an absolute value operator.
1. A noise reduction method, applied in a display, for use in reducing noise of a digital image, the method comprising steps of:
providing a plurality of luminance threshold values;
determining a plurality of luminance feature values according to a luminance value of a target pixel and luminance values of neighboring pixels of the target pixel by a calculating unit of the display;
determining whether the target pixel is a noise point, by a comparing unit of the display, based on the comparison between each of the luminance feature values and each of the luminance threshold values corresponding thereto, respectively; and
adjusting the luminance value of the target pixel, by an adjusting unit of the display, when the target pixel is determined as the noise point;
wherein a first luminance feature value of the luminance feature values is determined by the luminance value of the target pixel and the luminance values of first four neighboring pixels, and the target pixel and the first four neighboring pixels form a cross shape;
wherein a second luminance feature value of the luminance feature values is determined by the luminance value of the target pixel and the luminance values of second four neighboring pixels, and the target pixel and the second four neighboring pixels form an x shape;
wherein the first luminance feature value is expressed as:
CV1=abs[Yr1+Yr2+Yr3+Yr4−K1×Yt], wherein CV1 is the first luminance feature value, Yt is the luminance value of the target pixel, Yr1, Yr2, Yr3, Yr4 are respectively the luminance values of the first four neighboring pixels that form the cross shape with the target pixel, K1 is a constant and abs is an absolute value operator.
2. The noise reduction method as recited in
a third luminance feature value determined by the luminance values of the neighboring pixels; and
a fourth luminance feature value determined by the luminance value of the target pixel and a mean luminance value of the neighboring pixels.
3. The noise reduction method as recited in
4. The noise reduction method as recited in
5. The noise reduction method as recited in
6. The noise reduction method as recited in
adjusting a chrominance value of the target pixel if the target pixel is determined as the noise point.
7. The noise reduction method as recited in
selecting a luminance median from a series including the luminance value of the target pixel and the luminance values of the neighboring pixels; and
performing a luminance weighting calculation so as to adjust the luminance value of the target pixel according to the luminance median.
8. The noise reduction method as recited in
Yt_new=(1−W1)×Yt+W1×Y_median wherein Yt_new is an adjusted luminance value of the target pixel, W1 is a weighting value, Yt is the luminance value of the target pixel and Y_median is the luminance median.
9. The noise reduction method as recited in
CV2=abs[Yd1+Yd2+Yd3+Yd4−K2×Yt] wherein CV2 is the second luminance feature value, Yt is the luminance value of the target pixel, Yd1, Yd2, Yd3, Yd4 are respectively the luminance values of the second four neighboring pixels that form the x shape with the target pixel, K2 is a constant and abs is an absolute value operator.
10. The noise reduction method as recited in
CV3=abs[(Yd1+Yd2+Yd3+Yd4)−(Yr1+Yr2+Yr3+Yr4)] wherein CV3 is the third luminance feature value, Yd1, Yd2, Yd3, Yd4 are respectively the luminance values of the first four neighboring pixels that form the x shape with the target pixel, Yr1, Yr2, Yr3, Yr4 are respectively the luminance values of the second four neighboring pixels that form the cross shape with the target pixel, and abs is an absolute value operator.
11. The noise reduction method as recited in
CV4=abs[Yt−Y_mean]×K4 wherein CV4 is the fourth luminance feature value, Yt is the luminance value of the target pixel, Y_mean is the mean luminance value of the neighboring pixels of the target pixel, K4 is a constant and abs is an absolute value operator.
12. The noise reduction method as recited in
Th4=abs[Yr1−Y_mean]+abs[Yr2−Y_mean]+abs[Yr3−Y_mean]+abs[Yr4−Y_mean]+abs[Yd1−Y_mean]+abs[Yd2−Y_mean]+abs[Yd3−Y_mean]+abs[Yr4−Y_mean] wherein Th4 is the fourth luminance threshold value, Yd1, Yd2, Yd3, Yd4 are respectively the luminance values of the second four neighboring pixels that form the x shape with the target pixel, Yr1, Yr2, Yr3, Yr4 are respectively the luminance values of the first four neighboring pixels that form the cross shape with the target pixel, Y_mean is the mean luminance value of the neighboring pixels of the target pixel and abs is an absolute value operator.
13. The noise reduction method as recited in
15. The noise reduction apparatus as recited in
a third luminance feature value determined by the luminance values of the neighboring pixels; and
a fourth luminance feature value determined by the luminance value of the target pixel and a mean luminance value of the neighboring pixels.
16. The noise reduction apparatus as recited in
17. The noise reduction apparatus as recited in
18. The noise reduction apparatus as recited in
|
|||||||||||||||||||||||||
1. Field of the Invention
The present invention generally relates to a noise reduction method and apparatus and, more particularly, to a noise reduction method and apparatus using a luminance value of a target pixel and luminance values of neighboring pixels of the target pixel so as to identify and eliminate a noise point of a digital image.
2. Description of the Prior Art
In digital image processing, the most generally used method to reduce noise is to directly process the pixels related to the image. For example, averaging filters and sequence statistical filters are used according to respective requirements.
Conventionally, impulse noise is eliminated using a median filter, which is a non-linear spatial filter operating corresponding to the pixel values in a neighboring region of a target pixel so as to sort the pixel values and then make the median pixel replace the target pixel. However, the median filter performs pixel adjustment for the entire image including some non-noise portions. Therefore, the noise reduction process using the median filter may lead to undesirable distortion of the image because it cannot identify where noise occurs. Moreover, since the pixel is adjusted according to the pixel values of the neighboring pixels, the adjusted image shows unnaturalness in luminance and chrominance.
Accordingly, the present invention provides a noise reduction method not only to identify noise of a digital image, but also to reduce noise by adjusting the luminance value and the chrominance value to avoid image distortion.
Compared to the prior art, the noise reduction method of the present invention exhibits excellent performance in noise reduction while remaining the original colors in the region where there is no noise determined.
It is a primary object of the present invention to provide a noise reduction method so as to identify noise in a digital image and adjust the luminance value and the chrominance values of a pixel that is determined a noise point so that the image quality is improved and the image distortion is avoided.
In order to achieve the foregoing object, the present invention provides a noise reduction method, comprising steps of: providing a plurality of luminance threshold values; determining a plurality of luminance feature values according to a luminance value of a target pixel and luminance values of neighboring pixels of the target pixel by a calculating unit of the display; determining whether the target pixel is a noise point, by a comparing unit of the display, based on the comparison between each of the luminance feature values and each of the luminance threshold values corresponding thereto, respectively; and adjusting the luminance value of the target pixel, by an adjusting unit of the display, when the target pixel is determined as the noise point.
The luminance feature values are determined by: (1) the luminance value of the target pixel and the luminance values of four neighboring pixels, the target pixel and the four neighboring pixels forming a cross shape; (2) the luminance value of the target pixel and the luminance values of four neighboring pixels, the target pixel and the four neighboring pixels forming an X shape; (3) the luminance values of the neighboring pixels; or (4) the luminance value of the target pixel and a mean luminance value of the neighboring pixels.
Preferably, the luminance feature value comprises a first luminance feature value, a second luminance feature value, a third luminance feature value and a fourth luminance feature value. The first luminance feature value is determined by the luminance value of the target pixel and the luminance values of four neighboring pixels, the target pixel and the four neighboring pixels forming a cross shape. The second luminance feature value is determined by the luminance value of the target pixel and the luminance values of four neighboring pixels, the target pixel and the four neighboring pixels forming an X shape. The third luminance feature value is determined by the luminance values of the neighboring pixels. The fourth luminance feature value is determined by the luminance value of the target pixel and a mean luminance value of the neighboring pixels.
Preferably, the luminance threshold value comprises: a first luminance threshold value, a second luminance threshold value, a third luminance threshold value and a fourth luminance threshold value. The first luminance threshold value, the second luminance threshold value and the third luminance threshold value are pre-determined. The fourth luminance threshold value is determined by the luminance values of the neighboring pixels of the target pixel and the mean luminance value of the neighboring pixels of the target pixel.
Preferably, the first luminance feature value is larger than the first luminance threshold value, the second luminance feature value is larger than the second luminance threshold value, the third luminance feature value is smaller than the third luminance threshold value and the fourth luminance feature value is larger than the fourth luminance threshold value, so that the target pixel is determined a noise point.
The step of adjusting the luminance value of the target pixel comprises steps of: selecting a luminance median from a series including the luminance value of the target pixel and the luminance values of the neighboring pixels; and performing a luminance weighting calculation so as to adjust the luminance value of the target pixel according to the luminance median.
The step of adjusting the chrominance value of the target pixel comprises steps of: selecting a chrominance median from a series including the chrominance value of the target pixel and chrominance values of the neighboring pixels; and performing a chrominance weighting calculation so as to adjust the chrominance value of the target pixel according to the chrominance median.
In order to achieve the foregoing object, the present invention provides a noise reduction apparatus, comprising: a calculating unit, for determining a plurality of luminance feature values according to a luminance value of a target pixel of the digital image and luminance values of neighboring pixels of the target pixel; a comparing unit, for determining whether the target pixel is a noise point based on the comparison between each of the luminance feature values and each of luminance threshold values corresponding thereto, respectively; and an adjusting unit, adjusting the luminance value of the target pixel when the target pixel is determined as the noise point.
Accordingly, the present invention provides a noise reduction method using the luminance profile of the target pixel and its neighboring pixels to determine a plurality of luminance feature values to be compared with a plurality of luminance threshold values so as to determine whether the target pixel is infected with noise, which is to be eliminated by adjusting the luminance value and the chrominance value of the target pixel.
The objects, spirits and advantages of the preferred embodiment of the present invention will be readily understood by the accompanying drawings and detailed descriptions, wherein:
The present invention providing a noise reduction method and a noise reduction apparatus can be exemplified by the preferred embodiment as described hereinafter.
The noise reduction method provided by the present invention can be applied in an image display such as TVs or monitors. Please refer to
Then, in Step S102, four luminance feature values are determined according to a luminance value of the target pixel and the luminance values of neighboring pixels of the target pixel. The first luminance feature value is determined by the luminance value of the target pixel and the luminance values of four neighboring pixels, the target pixel and the four neighboring pixels forming a cross shape. The second luminance feature value is determined by the luminance value of the target pixel and the luminance values of four neighboring pixels, the target pixel and the four neighboring pixels forming an X shape. The third luminance feature value is determined by the luminance values of the neighboring pixels. The fourth luminance feature value is determined by the luminance value of the target pixel and a mean luminance value of the neighboring pixels. In one embodiment, the Step S102 can be performed by a calculating unit of a display when the noise reduction method is applied in the display.
In Step S103, each luminance feature value and each luminance threshold value are compared so as to determine whether the target pixel is a noise point. The first luminance feature value is larger than the first luminance threshold value, the second luminance feature value is larger than the second luminance threshold value, the third luminance feature value is smaller than the third luminance threshold value and the fourth luminance feature value is larger than the fourth luminance threshold value, so that the target pixel is determined a noise point. In one embodiment, the Step S103 can be performed by a comparing unit of the display.
Finally, in Step 104, the luminance value and the chrominance value of the target pixel is adjusted if the target pixel is determined a noise point. The step of adjusting the luminance value of the target pixel comprises steps of: selecting a luminance median from a series including the luminance value of the target pixel and the luminance values of the neighboring pixels; and performing a luminance weighting calculation so as to adjust the luminance value of the target pixel according to the luminance median. The step of adjusting the chrominance value of the target pixel comprises steps of: selecting a chrominance median from a series including the chrominance value of the target pixel and chrominance values of the neighboring pixels; and performing a chrominance weighting calculation so as to adjust the chrominance value of the target pixel according to the chrominance median. In one embodiment, the Step S104 can be performed by an adjusting unit of the display.
Please refer to
Please refer to
Then, in Step 310, the first luminance feature value CV1, the second luminance feature value CV2, the third luminance feature value CV3, and the fourth luminance feature value CV4 are calculated. CV1, CV2, CV3, and CV4 are expressed as:
CV1=abs[Yr1+Yr2+Yr3+Yr4−K1×Yt]
CV2=abs[Yd1+Yd2+Yd3+Yd4−K2×Yt]
CV3=abs[(Yd1+Yd2+Yd3+Yd4)−(Yr1+Yr2+Yr3+Yr4)]
CV4=abs[Yt−Y_mean]×K4
where K1, K2, K3, K4 are constants, Y_mean is a mean value of Yr1, Yr2, Yr3, Yr4, Yd1, Yd2, Yd3, Yd4 and abs is an absolute value operator.
Later in Step 320, the first luminance threshold value Th1, the second luminance threshold value Th2, the third luminance threshold value Th3, and the fourth luminance threshold value Th4 are calculated. Th1, Th2, Th3, and Th4 are luminance threshold values corresponding to CV1, CV2, CV3, and CV4, respectively. The first luminance threshold value Th1, the second luminance threshold value Th2 and the third luminance threshold value Th3 are pre-determined. The fourth luminance threshold value Th4 is expressed as:
Th4=abs[Yr1−Y_mean]
+abs[Yr2−Y_mean]
+abs[Yr3−Y_mean]
+abs[Yr4−Y_mean]
+abs[Yd1−Y_mean]
+abs[Yd2−Y_mean]
+abs[Yd3−Y_mean]
+abs[Yr4−Y_mean]
The Step S310 and the Step S320 are in no particular order. In other words, the luminance threshold values can be calculated prior to the calculation of the luminance feature values. After the luminance threshold values and the luminance feature values are obtained, in Step S330, a comparison is made between each luminance threshold value and each luminance feature value so as to determine whether CV1, CV2, CV3 and CV4 are larger than, smaller than or equal to the corresponding Th1, Th2, Th3, and Th4, respectively. The comparison is to determine whether the following statement is true:
[(CV1≧Th1) & (CV2≧Th2) & (CV3≦Th3) & (CV4≧Th4)]
The target pixel Pt is determined a noise point if the statement is true; otherwise, the target pixel Pt is determined a non-noise point.
Finally, in Step 340, the luminance value, a first chrominance value and a second chrominance value of the target pixel Pt are adjusted if the target pixel Pt is determined a noise point. The adjusted luminance value, first chrominance value and second chrominance value are expressed as:
Yt_new=(1−W1)×Yt+W1×Y_median
Cbt_new=(1−W2)×Cbt+W2×Cb_median
Crt_new=(1−W3)×Crt+W3×Cr_median
where Yt_new, Cbt_new, Crt_new are the adjusted luminance value, first chrominance value and second chrominance value of the target pixel Pt, respectively; Ybt, Cbt and Crt are the original luminance value, first chrominance value and second chrominance value of the target pixel Pt, respectively; W1W2 and W3 are weighting values; and Y_median, Cb_median and Cr_median are respectively a luminance median, a first chrominance median and a second chrominance median of a series [Pt, Pd1, Pd2, Pd3, Pd4, Pr1, Pr2, Pr3, Pr4].
In Step S350, the luminance value, first chrominance value and second chrominance value of the target pixel Pt are remained if the target pixel Pt is determined a non-noise point.
After Step 340 or Step 350, another pixel is selected as a new target pixel, as described in Step 360.
Accordingly, through the afore-mentioned steps, the noise point in the digital image 22 can not only be identified, but also be eliminated by adjusting the luminance value and the chrominance values.
Please refer to
The comparing unit 420 compares the first, second, third, and fourth luminance feature values with the first, second, third, and fourth luminance threshold values (Th1˜Th4), respectively, so as to determine whether the target pixel is a noise point. When the first luminance feature value is larger than the first luminance threshold value, the second luminance feature value is larger than the second luminance threshold value, the third luminance feature value is smaller than the third luminance threshold value and the fourth luminance feature value is larger than the fourth luminance threshold value, so that the target pixel is determined as a noise point.
When the target pixel is determined as a noise point, the adjusting unit 430 adjusts the luminance value and the chrominance value of the target pixel. The adjusting unit 430 adjusts the luminance value of the target pixel according to a luminance median by performing a luminance weighting calculation, and the luminance median is selected from a series including the luminance value of the target pixel and the luminance values of the neighboring pixels. The detailed adjusting method of the adjusting unit 430 can be the same as mentioned above.
According to the above discussion, it is apparent that the present invention discloses a noise reduction method and apparatus so as to identify noise in a digital image and adjust the luminance value and the chrominance values of a pixel that is determined a noise point so that the image quality is improved and the image distortion is avoided.
Although this invention has been disclosed and illustrated with reference to particular embodiments, the principles involved are susceptible for use in numerous other embodiments that will be apparent to persons skilled in the art. This invention is, therefore, to be limited only as indicated by the scope of the appended claims.
| Patent | Priority | Assignee | Title |
| 11087681, | Sep 08 2015 | Samsung Display Co., Ltd. | Display device and method of compensating pixel degradation of the same |
| 8526758, | Dec 24 2009 | Canon Kabushiki Kaisha | Image processing apparatus, image processing method, and program |
| Patent | Priority | Assignee | Title |
| 5522022, | Nov 24 1993 | Xerox Corporation | Analyzing an image showing a node-link structure |
| 5903681, | Jul 24 1996 | Eastman Kodak Company | Reducing edge artifacts on a digital printer |
| 6026190, | Oct 31 1994 | Intel Corporation | Image signal encoding with variable low-pass filter |
| 6108455, | May 29 1998 | STMicroelectronics, Inc. | Non-linear image filter for filtering noise |
| 6415062, | Mar 05 1998 | TAIWAN SEMICONDUCTOR MANUFACTURING CO , LTD | System and process for repairing a binary image containing discontinuous segments of a character |
| 6718068, | Mar 10 2000 | Monument Peak Ventures, LLC | Noise reduction method utilizing statistical weighting, apparatus, and program for digital image processing |
| 6807300, | Jul 20 2000 | Monument Peak Ventures, LLC | Noise reduction method utilizing color information, apparatus, and program for digital image processing |
| 6904169, | Nov 13 2001 | RPX Corporation | Method and system for improving color images |
| 6950547, | Feb 12 2001 | 3M Innovative Properties Company | Web inspection method and device |
| 6970587, | Aug 28 1997 | ICAD, INC | Use of computer-aided detection system outputs in clinical practice |
| 6983078, | May 01 2001 | HEWLETT-PACKARD DEVELOPMENT COMPANY L P | System and method for improving image quality in processed images |
| 7171045, | Dec 28 2001 | CA, INC | System and method for determining a natural color depth of a digital image |
| 7176982, | Sep 09 2003 | ZHANGJIAGANG KANGDE XIN OPTRONICS MATERIAL CO LTD | Recursive noise reduction with still pixel detection |
| 7623723, | Nov 26 2003 | GE Medical Systems Global Technology Com. | Method for random point and patterned noise reduction in digital images |
| 7756658, | May 14 2008 | KLA-Tencor Corp. | Systems and methods for detecting defects on a wafer and generating inspection results for the wafer |
| 20020001409, | |||
| 20020110269, | |||
| 20030007699, | |||
| 20030099287, | |||
| 20030189655, | |||
| 20030228067, | |||
| 20040196408, | |||
| 20040208395, | |||
| 20040233334, | |||
| 20040246378, | |||
| 20050078222, | |||
| 20050123211, | |||
| 20050276510, | |||
| 20060193010, | |||
| 20060245002, | |||
| 20070103594, | |||
| JP2000217039, | |||
| WO2004062275, |
| Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
| Aug 05 2009 | SHEN, YUN-HUNG | Mstar Semiconductor, Inc | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 023125 | /0276 | |
| Aug 06 2009 | LEE, WEI-KUO | Mstar Semiconductor, Inc | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 023125 | /0276 | |
| Aug 20 2009 | Mstar Semiconductor, Inc. | (assignment on the face of the patent) | / | |||
| Jan 15 2019 | Mstar Semiconductor, Inc | MEDIATEK INC | MERGER SEE DOCUMENT FOR DETAILS | 052931 | /0468 | |
| Dec 23 2020 | MEDIATEK INC | XUESHAN TECHNOLOGIES INC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 055443 | /0818 |
| Date | Maintenance Fee Events |
| Jan 21 2011 | ASPN: Payor Number Assigned. |
| Jul 28 2014 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
| Jun 13 2018 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
| Sep 26 2022 | REM: Maintenance Fee Reminder Mailed. |
| Mar 13 2023 | EXP: Patent Expired for Failure to Pay Maintenance Fees. |
| Date | Maintenance Schedule |
| Feb 08 2014 | 4 years fee payment window open |
| Aug 08 2014 | 6 months grace period start (w surcharge) |
| Feb 08 2015 | patent expiry (for year 4) |
| Feb 08 2017 | 2 years to revive unintentionally abandoned end. (for year 4) |
| Feb 08 2018 | 8 years fee payment window open |
| Aug 08 2018 | 6 months grace period start (w surcharge) |
| Feb 08 2019 | patent expiry (for year 8) |
| Feb 08 2021 | 2 years to revive unintentionally abandoned end. (for year 8) |
| Feb 08 2022 | 12 years fee payment window open |
| Aug 08 2022 | 6 months grace period start (w surcharge) |
| Feb 08 2023 | patent expiry (for year 12) |
| Feb 08 2025 | 2 years to revive unintentionally abandoned end. (for year 12) |