An edge enhancing apparatus includes: an edge detector, for determining an edge direction of an image region corresponding to a target pixel; and a pixel value determining module, coupled to the edge detector, for obtaining a plurality of pixel values of a plurality of pixels and an initial pixel value of the target pixel according to the edge direction, and performing a calculation on the plurality of pixel values and the initial pixel value to generate a calibrated pixel value.
|
8. An edge enhancing method comprising: using a processor to perform:
determining an edge direction of an image region corresponding to a target pixel, wherein the image region constitutes by a pre-determined number of pixels surrounding the target pixel;
obtaining an original pixel value of the target pixel according to the position of the target pixel and a plurality of reference pixel values of a plurality of reference pixels for enhancing the edge according to the single edge direction; and
performing a weighted average operation to multiply the plurality of reference pixel values and the original pixel value by different weights separately to generate a high-frequency information of the target pixel, and generate an adjusted pixel value of the target pixel according to the high-frequency information and the original pixel value.
1. An edge enhancing device applying to an image processing device, comprising:
an edge detector, disposed within the image processing device, for determining aft single edge direction of an image region corresponding to a target pixel, wherein the image region constitutes by a pre-determined number of pixels surrounding the target pixel; and
a pixel value determining module, disposed within the image processing device, coupled to the edge detector, to obtain an original pixel value of the target pixel according to the position of the target pixel and a plurality of reference pixel values of a plurality of reference pixels for enhancing the edge according to the single edge direction, and performing a weighted average operation to multiply the original pixel value and the plurality of reference pixel values by different weights separately to generate a high-frequency information of the target pixel, and generate an adjusted pixel value of the target pixel according to the high-frequency information and the original pixel value;
wherein the image processing device is used for executing image processing processes.
2. The edge enhancing device of
3. The edge enhancing device of
a high-pass filter, coupled to the edge detector, for performing a high-pass filtering operation on the plurality of pixels reference values of the plurality of reference pixels and the original pixel value of the target pixel to generate a filtered pixel value; and
an arithmetic module, coupled to the high-pass filter, for generating the adjusted pixel value according to the filtered pixel value and the original pixel value;
wherein the high-frequency information comprises the filtered pixel value.
4. The edge enhancing device of
an adder, for adding the filtered pixel value to the original pixel value to generate the adjusted pixel value.
5. The edge enhancing device of
a gain controller, coupled to the edge detector, for adjusting a gain of the filtered pixel value according to the edge direction.
6. The edge enhancing device of
an interpolator, for performing an interpolating operation on pixels of the image region to generate the original pixel value of the target pixel and the plurality of reference pixel values of the plurality of reference pixels.
9. The edge enhancing method of
10. The edge enhancing method of
performing a high pass filtering operation on the original pixel value of the target pixel and the plurality of reference pixel values of the plurality of reference pixels to generate a filtered pixel value; and
performing a calculation on the filtered pixel value and the original pixel value to generate an adjusted pixel value.
11. The edge enhancing method of
adding the filtered pixel value to the original pixel value to generate the adjusted pixel value.
12. The edge enhancing method of
adjusting a gain of the filtered pixel value according to the edge direction.
13. The edge enhancing method of
performing an interpolating operation on pixels of the image region to generate the plurality of pixel values of the plurality of pixels and the original pixel value of the target pixel.
|
1. Field of the Invention
The present invention relates to an image processing device and related image processing method thereof, and more particularly, to an edge enhancing device and related edge enhancing method thereof.
2. Description of the Related Art
In the process of scaling an image, new scan lines of the scaled image are generated by interpolating original scan lines. Unfortunately, the above-mentioned interpolation may affect the edge of the image, and blur the edge of the image.
Therefore, when an image is being scaled, edge enhancement, or peaking, is performed to prevent the image from blurring. Traditionally, the edge enhancement is performed as follows: first, a high-pass filtering operation is performed on the image to obtain high-frequency information of the image, and then the high-frequency information is added back to the original image. After the above-mentioned operations, the high-frequency information is enhanced, and the edges are enhanced accordingly.
However, the above-mentioned edge enhancement is focused on all of the high-frequency information of the image, but is not able to distinguish the edges of the image from other high-frequency components. For example, in addition to the edges, noises may have high-frequency characteristics. Therefore, if the enhancement operation is performed on high-frequency information of the image, not only the edges are enhanced, the noises are also enhanced, which, obviously, reduces the display quality of the image.
In view of the above-mentioned problems, an object of the invention is to provide a more reliable and more precise edge enhancing device and related edge enhancing method thereof.
According to an embodiment of the present invention, an edge enhancing device is disclosed. The edge enhancing device comprises: an edge detector, for determining an edge direction of an image region corresponding to a target pixel; and a pixel value determining module, coupled to the edge detector, for obtain an original pixel value of the target pixel and a plurality of pixel values of a plurality of pixels according to the edge direction, and performing a calculation on the original pixel value and the plurality of pixel values to generate an adjusted pixel value.
According to another embodiment of the present invention, an edge enhancing method is disclosed. The edge enhancing method comprises: determining an edge direction of an image region corresponding to a target pixel; obtaining an original pixel value of the target pixel and a plurality of pixel values of a plurality of pixels according to the edge direction; and performing a calculation on the plurality of pixel values and the original pixel value to generate an adjusted pixel value.
The present invention performs the edge enhancement according to the edge direction of the image. Therefore, the present invention can prevent from enhancing the noises. In other words, the present invention can increase the edge effect of the image such that the display quality of the image can be improved.
Please refer to
In the following disclosure, the operation and function of the edge enhancing device 100 are clearly illustrated. First, when the edge enhancing device 100 starts to process a target pixel, the edge enhancing device 100 first obtains image data of an image region corresponding to the target pixel. Please refer to
And then, the edge detector 110 detects an edge direction of the image region 200 according to the 4 pixels*4 pixels image region 200. Please note that, in this embodiment, the edge detector 110 can be implemented as an edge detector 110, which adopts a classification algorithm in detecting the edge direction. The operation and function of such an edge detector 110 has been disclosed in U.S. patent application Ser. No. 11/616,844, whose content is incorporated herein by reference, and thus detailed description is herein omitted. However, please note that, the edge detecting technique described in U.S. patent application Ser. No. 11/616,844 is only regarded as a preferred embodiment, but not a limitation of the present invention. Those skilled in the art can readily replace the edge detector 110 by other edge detectors equipped with other known or new edge detecting techniques after understanding the disclosure of the present application.
According to U.S. patent application Ser. No. 11/616,844, the edge detector 110 detects whether there is an edge in the above-mentioned 4*4 pixels image region. It further teaches that if there is an edge, the edge detector 110 detects which one of the 12 edge directions shown in
The interpolator 130 determines the weights, which are to be used in the interpolation, according to the position of the target pixel. And then, the interpolator 130 utilizes the weights to perform weighted average operations on a plurality of pixel values of the pixels surrounding the target pixel (such as pixels located on (1,1), (1,2), (2,1), (2,2)) such that the original pixel value of the target pixel A can be obtained. Please note that since the operation of the image interpolation is well known to those skilled in the art, more detailed illustrations are omitted herein.
However, in addition to the interpolation operation of the target pixel, in order to perform the edge enhancement, the interpolator 130 further performs the interpolation operations to generate reference pixel values of reference pixels, which are located on appropriate locations. For example, if the edge detector 110 determines that the edge direction of the image region 200 is horizontal (corresponding to 0 degree), the interpolator 130 further generates reference pixel values of two reference pixels (such as pixels B and C shown in
And then, the high-pass filter 140 performs a high-pass filtering operation on the above-mentioned three pixel values (including two reference pixel values of two reference pixels and the original pixel value of the target pixel) to generate high-frequency information of the target pixel. For example, the high-pass filter 140 can multiply the two reference pixel values by a smaller weight (such as −1), multiply the original pixel value of the target pixel by a larger weight (such as 2), and in such a manner perform weighted average operation that the above-mentioned high-frequency information can be generated. In other words, the high-frequency filter 140 performs the filtering operation with the weights (−1, 2, −1) on the aforementioned three pixel values.
Afterwards, the adder 150 adds the high-frequency information to the original pixel value of the target pixel such that an adjusted pixel value of the target pixel can be generated. This adjusted pixel value is used as an update of the original pixel value of the target pixel. In this way, the edge of the image can be enhanced. Moreover, the gain controller 160 is further utilized to adjust the gain of the high-frequency information to further enhance the display effect of the edge of the image. In this embodiment, the gain controller 160 can set the gain value corresponding to the high-frequency information according to the detection result of the edge detector 110 in order to obtain an optimized edge enhancement effect.
After the edge enhancing device 100 perform the edge enhancement operation on the target pixel, which means after the adjusted pixel value is generated, the edge enhancing device 100 starts to process a next target pixel. The above-mentioned operations are continuously performed until all pixels of the entire image are processed.
Please note that, if the detection result of the edge detector 110 shows that there is no apparent edge direction in the image region 200, the edge enhancing device 100 does not perform those following operations to avoid spoiling the image. At this time, the edge detector 110 can control the gain controller 160 to set the gain value of the high-frequency information as 0. In this way, the final output pixel value is equal to the original pixel value of the target pixel, which is originally calculated by the interpolator 130.
From the above disclosure, it can be seen that the present invention edge enhancement technique first utilizes an edge detection technique to determine the edge direction of the image, and then enhances the image according to the edge direction. Please note, for the entire image, the present invention does not perform the edge enhancement all the time. Instead, the present invention selectively performs the edge enhancement on individual image region, which depends on whether there is an apparent edge direction of the image region. In this way, the present invention can avoid enhancing the noises of the image.
Please note that, in the above embodiment, the three pixels (including the target pixel and two reference pixels) are chosen along the vertical direction of the edge direction. But this is only regarded as a preferred embodiment, not a limitation of the present invention. In actual implementation, the three pixels (including the target pixel and two reference pixels) only need to be chosen roughly, but not precisely, along the vertical direction of the edge direction, in order that the edge enhancement effect can be achieved.
Please refer to
As mentioned previously, when the image region has tilted edge direction (such as the third group or the fourth group), the target pixel and the two reference pixels only need to be chosen roughly along the vertical direction of the edge direction. As shown in
As mentioned previously, in a preferred embodiment, the target pixel and the reference pixels are located on the vertical direction of the edge direction such that an optimized edge enhancement effect can be achieved. When the edge direction corresponds to 0 or 90 degrees (such as the embodiment shown in
Therefore, the present invention does not impose further restriction on the shadow regions 310 and 320. Basically, it is only desirable that appropriate reference pixels can be obtained from within the shadow regions 310 and 320, such that the operation of high-pass filtering the obtained reference pixels and the target pixel can result in substantial edge enhancement effect. Therefore, the designer can determine a larger or smaller shadow regions 310 and 320 according design needs.
Furthermore, in the above-mentioned embodiment, the present invention edge enhancing device 100 is utilized in a scaler. Therefore, the edge enhancing device 100 comprises an interpolator 130 for scaling an image. However, the interpolator 130 can be regarded as a pixel value obtaining module for obtaining the reference pixel values of the two reference pixels and the original pixel value of the target pixel to perform the follow-up operations. In other words, in the case where the image is in no need of being scaled, for example, where the pixel value of the target pixel is not generated through interpolation, but is one of the 4*4 pixels in the image region, the interpolator 130 can directly utilize existing target pixel (such as the pixel located on the point (2,2)) and existing reference pixels (such as the pixels located on the points (1,2) and (3,2) shown in
Please note that, the gain controller 160 is an optional component. As mentioned earlier, the gain controller 160 is utilized to further enhance the display effect of the edge. Therefore, the above-mentioned edge enhancing device 100 is regarded as a preferred embodiment of the present invention. In actual implementation, the present invention edge enhancing device 100 does not have to comprise the gain controller 160.
In addition, the present invention does not limit the size of the image region. In the above-mentioned embodiment, the present invention detects an edge direction of a 4*4 pixels image region and performs the edge enhancement according to the 4*4 pixels image region. However, the designer can adopt an image region of a different size according to design needs.
On the other hand, the present invention does not limit the parameters utilized by the high-pass filter 140. As mentioned earlier, the high-pass filter 140 multiplies the reference pixel values of the reference pixels with a smaller weight (such as −1), multiplies the original pixel values of the target pixel with a larger weight (such as 2), and as such performs the weighted average operation on the pixel value to generate the above-mentioned filtered pixel value. However, the designer can change the weights according to different design needs.
While certain exemplary embodiments have been described and shown in the accompanying drawings, it is to be understood that such embodiments are merely illustrative of and not restrictive on the broad invention, and that this invention should not be limited to the specific construction and arrangement shown and described, since various other modifications may occur to those ordinarily skilled in the art.
Yu, Chia-Wei, Wang, Chi-Feng, Wu, Yen-Hsing
Patent | Priority | Assignee | Title |
10018872, | Dec 19 2008 | Semiconductor Energy Laboratory Co., Ltd. | Method for driving liquid crystal display device |
10254586, | Dec 19 2008 | Semiconductor Energy Laboratory Co., Ltd. | Method for driving liquid crystal display device |
10578920, | Dec 19 2008 | Semiconductor Energy Laboratory Co., Ltd. | Method for driving liquid crystal display device |
11300832, | Dec 19 2008 | Semiconductor Energy Laboratory Co., Ltd. | Method for driving liquid crystal display device |
11543700, | Dec 19 2008 | Semiconductor Energy Laboratory Co., Ltd. | Method for driving liquid crystal display device |
11899311, | Dec 19 2008 | Semiconductor Energy Laboratory Co., Ltd. | Method for driving liquid crystal display device |
8928706, | Dec 19 2008 | Method for driving liquid crystal display device | |
8929662, | Jun 15 2011 | Samsung Electronics Co., Ltd.; Industry-Academic Cooperation Foundation, Yonsei University | Method and apparatus for generating super-resolution image using prediction and stabilization of high-frequency information of image |
9280937, | Dec 19 2008 | Semiconductor Energy Laboratory Co., Ltd. | Method for driving liquid crystal display device |
Patent | Priority | Assignee | Title |
4985764, | Sep 29 1988 | KABUSHIKI KAISHA TOSHIBA, A CORP OF JAPAN | Apparatus for detecting a pixel correlation and generating an interpolation signal for a digital television signal |
5991463, | Nov 08 1995 | TAMIRAS PER PTE LTD , LLC | Source data interpolation method and apparatus |
20060291741, | |||
20070154097, | |||
TW535408, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Sep 21 2006 | YU, CHIA-WEI | Realtek Semiconductor Corp | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 019840 | /0885 | |
Sep 22 2006 | WU, YEN-HSING | Realtek Semiconductor Corp | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 019840 | /0885 | |
Oct 13 2006 | WANG, CHI-FENG | Realtek Semiconductor Corp | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 019840 | /0885 | |
Sep 05 2007 | Realtek Semiconductor Corp. | (assignment on the face of the patent) | / |
Date | Maintenance Fee Events |
Jan 09 2015 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
Aug 29 2018 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
Oct 03 2022 | M1553: Payment of Maintenance Fee, 12th Year, Large Entity. |
Date | Maintenance Schedule |
Aug 23 2014 | 4 years fee payment window open |
Feb 23 2015 | 6 months grace period start (w surcharge) |
Aug 23 2015 | patent expiry (for year 4) |
Aug 23 2017 | 2 years to revive unintentionally abandoned end. (for year 4) |
Aug 23 2018 | 8 years fee payment window open |
Feb 23 2019 | 6 months grace period start (w surcharge) |
Aug 23 2019 | patent expiry (for year 8) |
Aug 23 2021 | 2 years to revive unintentionally abandoned end. (for year 8) |
Aug 23 2022 | 12 years fee payment window open |
Feb 23 2023 | 6 months grace period start (w surcharge) |
Aug 23 2023 | patent expiry (for year 12) |
Aug 23 2025 | 2 years to revive unintentionally abandoned end. (for year 12) |