In the case where a digital camera is used for evaluating a display quality of an image display panel, moire is generated due to a shift of a pixel pitch between a pixel of a panel and a pixel of a digital camera, and thus, a great influence is given as measurement deviation. The present invention carries out a panel display quality evaluation at low cost and short time with relieved influence of moire by treating a value, which is obtained by recognizing a coordinate of a panel pixel in a shot image based on an image for detecting a coordinate and positional information thereof with high accuracy and by calculating average luminance by panel pixel unit based on a center position of a coordinate, as representative luminance in each pixel of the panel, in a panel evaluation method of shooting an image display panel with a digital camera.
|
1. An image analysis method comprising the steps of:
shooting a display panel while displaying a fixed pattern having a lattice design with a digital camera as an image;
shooting an entire black image of the display panel;
subtracting the entire black image from the image; and
recognizing a center coordinate of each pixel of the display panel based on the image by using an approximated curve due to an arbitrary function and by using a number of pixels included in a frame of the lattice design.
16. A pixel evaluation system comprising:
a computer comprising:
a recording medium, the recording medium recorded with:
a program for recognizing a center coordinate of each pixel of a display panel based on a first image shot with a digital camera;
a program for calculating average luminance of a second image in each pixel of the display panel based on the center coordinate, and
a program for outputting a third image in which a value of calculated luminance is set as luminance in each pixel of the display panel.
18. A pixel evaluation system comprising:
a computer comprising:
a recording medium, the recording medium recorded with:
a program for recognizing a center coordinate of each pixel of a display panel based on a first image shot with a digital camera, wherein the display panel has a non-display area that regularly exists between pixels;
a program for calculating average luminance of a second image shot with the digital camera in each pixel of the display panel based on the center coordinate, and
a program for outputting a result of the calculation as a third image with reduced influence of moire due to the non-display area.
2. An image analysis method comprising the steps of:
shooting a display panel while displaying a first image having a fixed pattern having a lattice design with a digital camera to obtain a first image data;
shooting an entire black image of the display panel;
subtracting the entire black image from the first image;
recognizing a center coordinate of each pixel of the display panel based on the first image data by using a number of pixels included in a frame of the lattice design;
shooting the display panel while displaying a second image with the digital camera to obtain a second image data, and
calculating average luminance of each pixel of the second image based on the center coordinate by averaging an image included in a range of a predetermined distance from the center coordinate of each pixel.
3. An image analysis method comprising the steps of:
shooting a display panel while displaying a first image having a fixed pattern having a lattice design with a digital camera to obtain a first image data, wherein the display panel has a non-display area that regularly exists between pixels;
shooting an entire black image of the display panel;
subtracting the entire black image from the first image;
recognizing a center coordinate of each pixel of the display panel based on the first image data by using a number of pixels included in a frame of the lattice design;
shooting the display panel while displaying a second image with the digital camera to obtain a second image data;
calculating average luminance of each pixel of the second image based on the center coordinate by averaging an image included in a range of a predetermined distance from the center coordinate of each pixel; and
outputting a result of the calculation as a third image with reduced influence of moire due to the non-display area.
4. An image analysis method according to
the step of shooting the image is performed with a location of the digital camera with respect to the display panel being fixed.
5. An image analysis method according to
the step of shooting the first image and the step of shooting the second image are performed with a location of the digital camera with respect to the display panel being fixed.
6. An image analysis method according to
the step of shooting the first image and the step of shooting the second image are performed with a location of the digital camera with respect to the display panel being fixed.
7. An image analysis method according to
the second image is an entire black image or an entire white image.
8. An image analysis method according to
the second image is an entire black image or an entire white image.
9. An image analysis method according to
wherein the center coordinate of each pixel of the display panel is recognized by using an approximated curve due to an arbitrary function.
10. An image analysis method according to
wherein the center coordinate of each pixel of the display panel is recognized by using an approximated curve due to an arbitrary function.
11. An image analysis method according to
wherein a predetermined threshold to luminance which indicates a boundary between a normal pixel and a display defect pixel is set to a second image,
wherein display defect pixels are counted by comparing luminance of each pixel to the predetermined threshold,
wherein a ratio of the display defect pixel to the normal pixel in a localized region, a size of the display defect pixel, or a shape of the display defect pixel is classified when the display defect pixel locally exists, and
wherein a number of defect pieces is counted by using at least one of the ratio of the display defect pixel to the normal pixel in the localized region, the size of the display defect pixel, and the shape of the display defect pixel.
12. An image analysis method according to
wherein a predetermined threshold to luminance which indicates a boundary between a normal pixel and a display defect pixel is set to the second image,
wherein display defect pixels are counted by comparing the average luminance of each pixel to the predetermined threshold,
wherein a ratio of the display defect pixel to the normal pixel in a localized region, a size of the display defect pixel, or a shape of the display defect pixel is classified when the display defect pixel locally exists, and
wherein a number of defect pieces is counted by using at least one of the ratio of the display defect pixel to the normal pixel in the localized region, the size of the display defect pixel, and the shape of the display defect pixel.
13. An image analysis method according to
wherein a predetermined threshold to luminance which indicates a boundary between a normal pixel and a display defect pixel is set to the second image,
wherein display defect pixels are counted by comparing the average luminance of each pixel to the predetermined threshold,
wherein a ratio of the display defect pixel to the normal pixel in a localized region, a size of the display defect pixel, or a shape of the display defect pixel is classified when the display defect pixel locally exists, and
wherein a number of defect pieces is counted by using at least one of the ratio of the display defect pixel to the normal pixel in the localized region, the size of the display defect pixel, and the shape of the display defect pixel.
14. An image analysis method according to
wherein a result of counting the number of defect pieces by using the at least one of the ratio of the display defect pixel to the normal pixel in the localized region, the size of the display defect pixel, and the shape of the display defect pixel is outputted with the center coordinate.
15. An image analysis method according to
wherein an image in which a defect pixel detected by using the predetermined threshold is separated by color is outputted.
17. The pixel evaluation system
according to
19. The pixel evaluation system according to
wherein the program for recognizing the center coordinate of each pixel of the display panel comprises:
setting an image in which display in a state of inputting an image signal of an entire non-display in the display panel is shot with the digital camera as a background image; and
performing a difference process to the first image shot with the digital camera by using the background image.
20. The pixel evaluation system according to
wherein the program for recognizing the center coordinate of each pixel of the display panel comprises:
setting an image in which display in a state of inputting an image signal of an entire non-display in the display panel is shot with the digital camera as a background image; and
performing a difference process to the first image shot with the digital camera by using the background image.
21. The pixel evaluation system according to
wherein the program for recognizing the center coordinate of each pixel of the display panel comprises:
setting an image in which display in a state of inputting an image signal of an entire non-display in the display panel is shot with the digital camera as a background image; and
performing a difference process to the first image shot with the digital camera by using the background image.
22. The pixel evaluation system according to
the recording medium further recorded with:
a program for forming a first image for integrating a pixel from the first image, and forming a second image for integrating a pixel from a fourth image shot by being fixed so as to shift from the first image, and
a program for carrying out a difference process for the first image for integrating a pixel and the second image for integrating a pixel.
23. The pixel evaluation system according to
the recording medium further recorded with:
a program for forming a first image for integrating a pixel from the first image, and forming a second image for integrating a pixel from a fourth image shot by being fixed so as to shift from the first image, and
a program for carrying out a difference process for the first image for integrating a pixel and the second image for integrating a pixel.
24. The pixel evaluation system according to
the recording medium further recorded with:
a program for forming a first image for integrating a pixel from the first image, and forming a second image for integrating a pixel from a fourth image shot by being fixed so as to shift from the first image, and
a program for carrying out a difference process for the first image for integrating a pixel and the second image for integrating a pixel.
25. The pixel evaluation system according to
the recording medium further recorded with:
a program for forming the first image for integrating a pixel by integrating and averaging the first image included in a range of a predetermined distance from the center coordinate of each pixel, and
a program for forming the second image for integrating a pixel by integrating and averaging a fourth image included in the range of the predetermined distance from the center coordinate of each pixel,
wherein the fourth image is shot by being fixed so as to shift from the first image.
26. The pixel evaluation system according to
the recording medium further recorded with:
a program for forming the first image for integrating a pixel by integrating and averaging the first image included in a range of a predetermined distance from the center coordinate of each pixel, and
a program for forming the second image for integrating a pixel by integrating and averaging a fourth image included in the range of the predetermined distance from the center coordinate of each pixel,
wherein the fourth image is shot by being fixed so as to shift from the first image.
27. The pixel evaluation system according to
the recording medium further recorded with:
a program for forming the first image for integrating a pixel by integrating and averaging the first image included in a range of a predetermined distance from the center coordinate of each pixel, and
a program for forming the second image for integrating a pixel by integrating and averaging a fourth image included in the range of the predetermined distance from the center coordinate of each pixel,
wherein the fourth image is shot by being fixed so as to shift from the first image.
28. The pixel evaluation system according to
the recording medium further recorded with:
a program for setting a predetermined threshold to luminance which indicates a boundary between a normal pixel and a display defect pixel to the second image,
a program for counting display defect pixels by comparing the average luminance of each pixel to the predetermined threshold,
a program for classifying a ratio of the display defect pixel to the normal pixel in a localized region, a size of the display defect pixel, or a shape of the display defect pixel when the display defect pixel locally exists, and
a program for counting a number of defect pieces by using at least one of the ratio of the display defect pixel to the normal pixel in the localized region, the size of the display defect pixel, and the shape of the display defect pixel.
29. The pixel evaluation system according to
the recording medium further recorded with:
a program for setting a predetermined threshold to luminance which indicates a boundary between a normal pixel and a display defect pixel to the second image,
a program for counting display defect pixels by comparing the average luminance of each pixel to the predetermined threshold,
a program for classifying a ratio of the display defect pixel to the normal pixel in a localized region, a size of the display defect pixel, or a shape of the display defect pixel when the display defect pixel locally exists, and
a program for counting a number of defect pieces by using at least one of the ratio of the display defect pixel to the normal pixel in the localized region, the size of the display defect pixel, and the shape of the display defect pixel.
30. The pixel evaluation system according to
the recording medium further recorded with:
a program for setting a predetermined threshold to luminance which indicates a boundary between a normal pixel and a display defect pixel to the second image,
a program for counting display defect pixels by comparing the average luminance of each pixel to the predetermined threshold,
a program for classifying a ratio of the display defect pixel to the normal pixel in a localized region, a size of the display defect pixel, or a shape of the display defect pixel when the display defect pixel locally exists, and
a program for counting a number of defect pieces by using at least one of the ratio of the display defect pixel to the normal pixel in the localized region, the size of the display defect pixel, and the shape of the display defect pixel.
31. The pixel evaluation system according to
the recording medium further recorded with:
a program for saving a position of a display defect pixel and an image data of the display defect pixel in the second image shot by the digital camera,
a program for replacing the image data to an image data of a peripheral non-defect pixel,
a program for creating a blurred image, and
a program for overwriting the image data of the display defect pixel in the position of the display defect pixel to the blurred image.
32. The pixel evaluation system according to
the recording medium further recorded with:
a program for saving a position of a display defect pixel and image data of the display defect pixel in the second image shot by the digital camera,
a program for replacing the image data to an image data of a peripheral non-defect pixel,
a program for creating a blurred image, and
a program for overwriting the image data of the display defect pixel in the position of the display defect pixel to the blurred image.
33. The pixel evaluation system according to
the recording medium further recorded with:
a program for saving a position of a display defect pixel and image data of the display defect pixel in the second image shot by the digital camera,
a program for replacing the image data to an image data of a peripheral non-defect pixel,
a program for creating a blurred image, and
a program for overwriting the image data of the display defect pixel in the position of the display defect pixel to the blurred image.
34. The pixel evaluation system according to
the recording medium further recorded with a program for carrying out a consecutive process from recognition of the center coordinate of each pixel to an image analysis by listing a combination of a first file in which information related to an image display panel is written, a second file in which information related to the first image is written, a third file in which information related to the third image is written and a fourth file in which analysis condition in the pixel evaluation system is written.
35. The pixel evaluation system according to
the recording medium further recorded with a program for carrying out a consecutive process from recognition of the center coordinate of each pixel to an image analysis by listing a combination of a first file in which information related to an image display panel is written, a second file in which information related to the first image is written, a third file in which information related to the third image is written and a fourth file in which analysis condition in the pixel evaluation system is written.
36. The pixel evaluation system according to
the recording medium further recorded with a program for carrying out a consecutive process from recognition of the center coordinate of each pixel to an image analysis by listing a combination of a first file in which information related to an image display panel is written, a second file in which information related to the first image is written, a third file in which information related to the third image is written and a fourth file in which analysis condition in the pixel evaluation system is written.
37. The pixel evaluation system according to
wherein the center coordinate of each pixel of the display panel is recognized by using an approximated curve due to an arbitrary function.
38. The pixel evaluation system according to
wherein the center coordinate of each pixel of the display panel is recognized by using an approximated curve due to an arbitrary function.
|
1. Field of the Invention
The present invention relates to an image analysis method, an image analysis program and a pixel evaluation system having the same for evaluating an image display panel.
2. Description of the Related Art
Conventionally, there is a method for evaluating display by shooting a color liquid crystal panel with a CCD camera (Patent Document 1: Japanese Patent Laid-Open No. H8-327497). According to the Patent Document 1, when a color liquid crystal panel is shot with a CCD camera, a center coordinate, a leakage gray value in every pixel and a CCD element region covered with a pixel image are saved firstly. Then a white raster is formed on a color liquid crystal display panel to be examined and shot with a CCD camera. Correction processing is carried out for removing the leakage gray value from outputting in every pixel displayed to a sensor element surface of a CCD camera. Then, output of the sensor element covered with the pixel image is added as well as obtaining a correction gray scale and a correction gray scale in every pixel is obtained. The liquid crystal display surface is reconstructed from a center coordinate and a correction gray value in every pixel and a liquid crystal display image is expressed by binary with a threshold; and thus, a defect is detected.
When a digital camera with the use of CCD which has not much high resolution for a panel is employed to reduce the cost of a digital camera as typified by a CCD camera with the use of a CCD type sensor, a pixel pitch of a digital camera shifts to a pitch of a non-display area such as a black matrix existing between each pixel of the panel; accordingly, moire (indicates a stripe design which does not exists under normal condition) is generated more intensively. And thus, display unevenness which is to be essentially evaluated becomes difficult to be distinguished. Especially, moire has significant effects on using a panel having low aperture ratio of a pixel. In addition, in the case where a shot image is displayed in a reduced-size on a display or printed in a reduced-size with a printer, moire appears more intensively since there are also influences of a pixel of the display and a dot of the printer.
To reduce the influences of moire, it is required to reconstruct an image by recognizing a center coordinate of each pixel with respect to a shot image with a digital camera with high accuracy and by calculating an average luminance value in each pixel unit. Note that a specific method for recognizing the pixel position of a panel is not mentioned in the description of evaluation equipment disclosed in the above Patent Document 1.
Alternatively, as a method for relieving moire, there is a method of blurring by defocusing when shooting with a digital camera or blurring a shot image using a software; however, a display defect portion such as a point defect is blurred and hard to distinguish since it is required to be blurred much intensively. Besides, display unevenness which is to be essentially evaluated is observed differently from the actual display unevenness.
Further alternatively, as a method for relieving moire, it is considered that there is a method of sufficiently increasing the number of pixels of a digital camera with respect to the number of pixels of a panel. However, it is difficult to manufacture a high-definition digital camera which has higher resolution than that of a high-resolution panel without lowering a dynamic range; and thus, it is required to employ a very expensive digital camera. Therefore, a method for relatively increasing pixel density of a digital camera by enlarging a part of a panel display surface and shooting at several times is employed. However, in this case, it takes extra effort and time to shoot, and besides, the size or cost of evaluation equipment increases when combined with an automatic stage. In addition, it takes long time to analyze various kinds of data after shooting since the size of image data after shooting is also greatly enlarged. Furthermore, even saving evaluation data takes time and consumes an enormous storage capacity of a recording medium.
It is an object of the present invention to provide a display quality evaluation system of an image display panel at low cost and short time with relieved influence of moire.
In view of the foregoing problem, one mode of the present invention is fixing an image display panel (hereinafter, also referred to as a panel) and a digital camera, shooting with the digital camera by displaying a fixed pattern to the panel, and recognizing a pixel coordinate of the panel based on the image shot with the digital camera.
Consequently, a center coordinate of each pixel can be obtained with high accuracy. Note that the term “pixel” in this specification denotes one dot of any of R, G and B in the case of a color panel using three colors of RGB.
Another mode according to the invention is fixing an image display panel and a digital camera, shooting with the digital camera by displaying a fixed pattern to the panel, recognizing a center coordinate of a pixel of the panel based on a first image shot with the digital camera, and calculating average luminance of each pixel to a second image shot with the digital camera.
Consequently, an image for integrating a pixel unit can be outputted with high accuracy without blurring a state of displaying a defect pixel between adjacent pixels. Furthermore, a fixed size of an image for integrating each of pixel unit having no rotational shift can be outputted constantly even in the case where the shift of size of an image for being evaluated or a rotational shift is generated.
Another mode according to the invention is fixing an image display panel in which non-display area regularly exists between pixels and a digital camera, shooting with the digital camera by displaying a fixed pattern to the panel, recognizing a center coordinate of a pixel of the panel based on a first image shot with the digital camera, and
outputting an image for integrating a pixel unit with reduced influence of moire due to the non-display area by calculating average luminance of each pixel to a second image shot with the digital camera based on the center coordinate to be luminance in each pixel of the second image.
According to the invention, in the case of recognizing a pixel coordinate of a panel in an image shot with the digital camera, a center coordinate of a pixel of a panel may be recognized as follows: an image in which display in a state of inputting an image signal of an entire non-display in the panel is shot with the digital camera is set as a background image, then difference process is carried out to a first image shot with the digital camera by using the background image. Consequently, a frequency of misrecognizing a pixel coordinate of a panel can be reduced since a position can be recognized after eliminating the influence of a display defect even in the case where a pattern due to a display defect is appeared.
According to the invention, in the case of recognizing a pixel coordinate of a panel in an image shot with the digital camera, a center coordinate of a pixel of a panel may be recognized by using an approximated curve due to an arbitrary function. Consequently, a pixel coordinate of a panel can be recognized with higher accuracy even in the case where a horizontal shift is generated between a panel display surface and the digital camera or the case where an overall or partial distortion is generated in a lens of the digital camera when shooting in fixing the panel and the digital camera.
According to the invention, a first image for integrating a pixel unit may be formed from the first image,
a second image for integrating a pixel unit may be formed from a third image shot by being fixed so as to shift from the first image,
and difference process may be carried out for the first image for integrating a pixel unit and the second image for integrating a pixel unit.
Consequently, for example, an appear or disappear defect before and after a reliability test can be counted since the difference of an image for being evaluated can be detected as the difference of luminance for integrating a pixel unit.
According to the invention, the image for integrating a pixel unit may be formed by integrating and averaging an image included in the range of a predetermined distance from the center coordinate of the pixel.
Consequently, an average luminance by the pixel unit of the panel corresponding to an aperture of the pixel of the panel can be calculated.
According to the invention, a predetermined threshold to luminance which indicates a boundary between a normal pixel and a display defect pixel may be set to the second image when an image display panel has a display defect pixel, the number of display defect pixels may be counted with the threshold, ratio of a display defect pixel to a normal pixel in a localized region, the size of the display defect pixel, or the shape of the display defect pixel may be classified when the display defect pixel locally exists, and the number of pieces may be counted every ratio of the display defect pixel in a local region, the size of the display defect pixel, or the shape of the display defect pixel. At this time, counting in the local region is carried out separately from the number of display defect pixels. Consequently, one or a plurality of a point defect which is isolated (isolated point defect), a collection of point defects (point defect group), a whole line defect (whole line defect) and an unwhole line defect (unwhole line defect) can be counted individually with sensitivity which is arbitrarily set.
According to the invention, a result of counting the number of defects every ratio of the display defect pixel, the size of the display defect pixel, or the shape of the display defect pixel may be outputted with a pixel coordinate. Consequently, a pixel coordinate can be identified firstly when a pixel of certain defect level is confirmed with an optical microscope; therefore, a location of a pixel coordinate can be quickly specified.
According to the invention, an image in which a defect pixel detected by every threshold is separated by color may be outputted. As a result, whether which part in the panel display surface the defect of each level appears can be visually and easily judged.
According to the invention, in the case where the panel has the display defect pixel, a position of a display defect pixel and image data of the display defect pixel in a second image shot by the digital camera may be saved, the display defect pixel may create a blurred image before replacing image data of a peripheral non-defect pixel, and image data of the display defect pixel may be overwritten in a position of the display defect pixel to a blurred image.
Consequently, an image can be blurred other than display defect portion without blurring display defect portion.
According to the invention, processing from blurring to enhancing contrast may be carried out with a series of operations in the case where a contrast enhancing process is carried out to a blurred image. Consequently, a smoother image can be obtained after enhancing contrast.
According to the invention, processing for integrating a pixel unit may be carried out by separating a second image in each element of RGB calorimetric system, XYZ colorimetric system or other colorimetric system in the case where the image display panel is shot with a digital camera for color and is set as a second image of the panel.
Consequently, analysis can be carried out as a color image by carrying out a pixel unit processing according to each element of certain calorimetric system and by finally combining each element.
According to the invention, a second image may be corrected so that a median of luminance distribution in the second image shot with the digital camera or a threshold may be corrected according to ratio of a median and a predetermined value of luminance in the second image before counting a display defect. Consequently, sensitivity of defect level can be corrected to a certain standard even in the case where average luminance of a shot image is different according to a difference of a panel display state or a shooting condition with a camera; therefore, a result of counting a defect can be compared more precisely.
In addition, a consecutive process may be carried out from recognition of a center coordinate of a pixel to an image analysis by listing the combination of a first file in which information related to an image display panel is written, a second file in which information related to a first image is written, a third file in which information related to a third image is written and a fourth file in which analysis condition in one or more of the above image analysis methods. Consequently, a large number of files can be smoothly processed.
Consequently, a large number of files can be smoothly processed.
Note that a case of using a digital camera as an appliance for shooting for evaluating display quality of an image display panel is described; however, MOS type sensor, CCD type sensor or the like can be employed for a digital camera. Moreover, a digital camera at low cost can be also employed.
According to the invention, a panel display quality evaluation system having a feature of possessing an image analysis method can be also provided.
Furthermore, according to the invention, an image analysis program for performing the image analysis method can be provided. For example, an image display panel is shot with a digital camera, and an image analysis program for serving a computer for analyzing the image shot with the digital camera as a recognizer for a pixel coordinate of the panel based on the image shot with the digital camera, a calculator for average luminance of each pixel unit of the panel based on the pixel coordinate and outputter of an image in which a value of calculated luminance for integrating a pixel unit is set to as luminance in each pixel of the panel can be provided.
According to the invention, a panel can be evaluated in a state that moire which is problematic in the case of shooting a state of displaying of a panel in which a non-display region between pixels exists with a digital camera is eased or reduced.
Moreover, according to the invention, evaluation equipment and evaluation system at low cost can be provided since a digital camera with very high resolution is not required and a digital camera with a certain level of resolution may be employed.
Furthermore, according to the invention, a processing can be carried out at short time since an entire panel can be shot and evaluated at once.
These and other objects, features and advantages of the present invention will become more apparent upon reading of the following detailed description along with the accompanied drawings.
Embodiment modes according to the present invention are described in detail with reference to the drawings. It is easily understood by those who are skilled in the art that embodiments and details herein disclosed can be modified in various ways without departing from the purpose and the scope of the present invention. Therefore, it should be noted that the description of embodiment modes to be given below should not be interpreted as limiting the present invention. Further, in constitutions according to the present invention to be described below, similar parts among different drawings are marked in common with the same reference numerals.
In this embodiment mode, a specific method for analyzing an image is described.
First, the followings are set firstly: specification (hereinafter, referred to as a panel specification file) related to a panel such as the number of pixels and the state of an RBG sequence; the condition of a regular fixed pattern image (hereinafter, referred to as a pattern), for example, the condition such as a lattice interval, the number of the lattices and a coordinate of a first line of the lattice in the case of a pattern having a lattice design; specification (hereinafter, referred to as a lattice specification file) related to an image for carrying out detecting a coordinate (hereinafter, referred to as an image for detecting a coordinate); and specification (hereinafter, referred to as an analysis specification file) related to an image analysis such as a threshold of each defect. Then, these are reserved in a file (ex. text file).
Next, as shown in
Next, an image to be evaluated, which has one color entirely so as to identify readily a poor or defect element 104 or display unevenness, is displayed to shoot with the digital camera 100 as an image to be evaluated. In the case of evaluating a defect of a bright spot, an image for being evaluated of a panel may be displayed in a black color entirely (an entire black image), for example, as shown in
The digital camera 100 and the panel 101 are fixed so as not to move the position, then, the image of the panel is displayed by switching to a pattern such as a lattice design and shot with the digital camera 100 as an image for detecting a coordinate, as shown in
Note that either the image to be evaluated or the image for detecting a coordinate may be shot firstly.
Then, data 106 of the image for being evaluated and the image for detecting a coordinate is transferred to the computer 105 serving as an information processor.
Next, a pixel analysis program for functioning the computer 105 serving as an information processor is ran to select the panel specification file, the lattice specification file and an image file for detecting a coordinate. Then, the lattice position of the image file for detecting a coordinate is determined by a series of image processing to output the result as a coordinate data file. The above image processing is carried out as follows: binarizing; thinning; obtaining a center with horizontal dilation; combining; re-calculating a center position of each line with floating-point operation considering peripheral data; fitting by an arbitrary function in a unit of each line of a lattice with a least-square method; or the like. For example, a horizontal shift between the digital camera and the surface of a panel display or distortion of an optical system of the digital camera can be recognized with high accuracy by approximating to a curve such as a quadratic function.
Note that the image processing is described in detail in Embodiment Mode 2.
When a number of display defects are seen in the image for detecting a coordinate, an entire white or entire black image is shot as a background image thereof (an image in which a display in a condition of inputting picture signal of an entire non-display is shot with a digital camera) to suppress an influence of a display defect with a difference process between the background image and the image for detecting a coordinate before a processing for detecting a lattice position to the image file for detecting a coordinate.
Subsequently, the coordinate data file outputted as above, the image file for being evaluated shot as above, and the analysis specification file prepared as above are selected. Then, a processing for integrating a pixel unit is carried out by a method written in the analysis specification file. In the processing for integrating a pixel unit, a center coordinate of each pixel is calculated from the coordinate data file, then, an average value of luminance of a pixel unit is calculated from integrating image data of an arbitral method and an arbitral range based on a center coordinate thereof. For example, a value in which luminance of pixel unit is averaged is calculated by integrating image data up to a boundary between each pixels.
When the above processing for integrating a pixel unit is completed, the result can be outputted as an image for integrating a pixel unit, for example, as a bitmap format of 256 (8-bit) tones. At this time, integral multiplication of aspect ratio of an image is preferably carried out in a longitudinal or horizontal direction as shown in
Based on a condition (threshold) to assume a pixel defect written in the analysis specification file, the number of defect pixels is counted from the image outputted by the processing for integrating a pixel unit. In other words, an image analysis program can make a computer function as a counter of the number of display defect pixels by using a threshold. Furthermore, a point defect group and a line defect group can be counted by type of each defect by separately setting the point defect group and the line defect group by ratio of a defect pixel (ratio of a local defect pixel to a normal pixel, namely ratio in the local range in the case where a defect pixel is locally generated), a size thereof, a shape thereof or the like. For example, the defects can be set as follows: a point defect group when point defects exist more than 30% in all pixels in an area surrounded by a rectangle having an arbitrary size; a whole line defect when point defects exist more than 95% in all in one line of a pixel of a vertical direction or a horizontal direction; and an unwhole line defect when point defects exist more than 20%. In addition, a separately counted pixel defect which is not applied to the above type of defects can be calculated as the number of the isolated point defect. The counting result can be outputted by type of a defect as a view format of a coordinate and a defect level (hereinafter, referred to as a defect coordinates file) and a list format in which only the number of counted defects is listed (hereinafter, referred to as a log form file), for example, as text data.
Note that, when evaluating the increase and the decrease of defects before and after a reliability test, an appear or disappear defect can be individually evaluated by a difference process of an image for integrating a pixel unit before and after the test even in the case where the fixing state of the panel and the digital camera is shifted before and after the test.
If required, an image of defect point form in which a defect portion is filled completely as shown in
Moreover, the defect can be outputted as the log file by calculating luminance median and standard deviation in an entire of the display area of the panel, and further, standard deviation showing dimension of display unevenness having a stripe shape of a vertical direction or a horizontal direction in the surface.
At this time, display unevenness of a vertical direction or a horizontal direction can be evaluated. For example, degree of display unevenness of a horizontal direction can be represented by calculating an average value for every pixel line unit of a perpendicular direction and by calculating standard deviation thereof assuming that is the same as the variation of the average value.
Furthermore, to the an image for integrating a pixel unit, a defect portion can be filled and blurring can be performed based on a setting to blurring written in an analysis specification file, and further, an image in which a defect portion is overwritten can be outputted to the blurred image. For example, a general lowpass filter can be used for blurring itself. A blurred image is referred to as a moire-erased image.
Moreover, in the case of making original display unevenness be enhanced by a contrast enhancing process, the contrast enhancing process is carried out as the series of floating-point operation from blurring, and a moire-erased and contrast-enhanced image as shown in
Note that a panel can be evaluated with a digital camera for color. For example, when shooting an image for panel display, a processing may be carried out by extracting only luminescence data if it is not required to evaluate a hue of a panel which is an object for evaluation.
On the other hand, when shooting an image for panel display with a digital camera for color, the above-mentioned processing for integrating a pixel unit of every element of an RGB calorimetric system, XYZ colorimetric system or other type of colorimetric system is carried out if it is required to evaluate a hue, and each element value may be transformed as a color image when outputting an image after various processing. For example, in the case of using an RGB calorimetric system, the processing for integrating a pixel unit is carried out to each element value of an RGB colorimetric system, so display defect can be carried out from contrast enhancing process and blurring. In the case of outputting a bitmap image with an RGB colorimetric system, so display defect can be carried out from contrast enhancing process and blurring. In the case of outputting a bitmap image with an RGB calorimetric system, each element value of an RGB colorimetric system may be directly outputted. Moreover, each element value may be corrected before the processing for integrating a pixel unit so that a median of each element value becomes a fixed value or a predetermined value. Accordingly, the need to provide a threshold of a defect level for each element value can be eliminated even in the case where a median of every element value is greatly different. When an image is outputted after various processing, a hue can be returned to a condition of an early stage by dividing the each element value by the correction value.
In addition, a consecutive process may be carried out from recognition of a center coordinate of a pixel by listing the combination of a first file in which information related to a panel is written, a second file in which information related to an image for being evaluated is written, a third file in which information related to an image for detecting a coordinate is written and a fourth file in which analysis condition in one or more of the above image analysis methods. Consequently, a large number of files can be smoothly processed.
As described above, an image shot with a digital camera can be outputted as an image for integrating a pixel unit by analyzing. And thus, display unevenness and a display defect of an original panel can be evaluated by being distinguished from moire. Furthermore, according to the invention, a moire-erased image which is closer to an actual panel display can be outputted and a display defect can be counted with high accuracy even in the case of using a digital camera having not so much high resolution. Accordingly, a display quality evaluation system of an image display panel at low cost and high performance can be provided.
In this embodiment mode, a case that each pixel in a panel has a rectangular shape is described; however, the invention is not limited to this, and can be applied to a panel having a unique shape, for example, a pixel having a circular shape.
In this Embodiment Mode, the details of an image processing in Embodiment Mode 1 are described with a flowchart shown in
A brief description of an image processing shown in this Embodiment Mode is as follows: a coordinate of a pixel of a panel is detected; luminance calculated; graph of the result of calculation is created; a defect is detected; and an image in which display unevenness is enhanced is produced, as shown in
Hereinafter, each processing is described in detail.
To detect a coordinate, an entire black image is used as a background image, and a display defect is eliminated by subtracting the entire black image from an image for detecting a coordinate, as shown in
Then, detecting a horizontal line of a panel (hereinafter, referred to as horizontal line detection) and detecting a perpendicular line of the panel (hereinafter, referred to as perpendicular line detection) are carried out with respect to an image for detecting a coordinate shown in
Note that either horizontal line detection or perpendicular line detection may be carried out firstly.
Hereinafter, horizontal line detection (A1), perpendicular line detection (A2) and a coordinate specification (A3) are described.
The horizontal line detection is completed by carrying out the following steps as shown in
Note that there is a case that a horizontal component can not be normally detected since a line of a lattice has a dashed shape depending on a shape of a pixel or a shooting condition; however, in this case, detection can be normally carried out by turning a dashed line to a continuous line with the dilation to an image for detecting a coordinate before detection.
Detection algorithm of a horizontal line can be diverted to the detection of a perpendicular line as shown in
Furthermore, specifying a coordinate is completed through the following steps as shown in
In the case of a colored image for being evaluated, the images color may be transformed into luminance data from white to black of 256 steps (hereinafter, refereed to as gray scale) with extracting luminance from the image or may be processed every element value in colorimetric system such as RGB as described in Embodiment Mode 1.
Next, calculation of a color component of a pixel of (x, y) of panel is looped to a y direction and an x direction. The loop to the y direction is carried out from 0 to (n−1), and the loop to the x direction is carried out from 0 to (m−1). Note that either loop of x or y may be started firstly.
Note that, in the case of carrying out luminance calculation by the pixel unit, for example, any one of a center neighbor method by which a value of 1 dot in a center of a pixel region is taken (refer to
A graph creation is completed through the following steps as shown in
Detecting a defect is completed as shown in
The production of an unevenness-enhanced image is completed through the following steps as shown in
An image analysis method according to the present invention can be applied to a panel having a pixel of delta array as shown in
A lattice image which is the same as a pixel arrangement shown in Embodiment Modes 1 and 2, namely stripe array, may be used in such delta array when detecting a coordinate. At this time, a perpendicular line is recognized as a wavy line in delta array as shown in
Next, a pixel of delta array is required to be changed to stripe array. In other words, a corresponding location is required to be displaced by half pixel at the stage in which a detected lattice line is divided and complement in the case of stripe array. Especially, processing for displacing a pixel by half pixel is carried out in a process during after interpolating and extrapolating a pixel along the edge of a panel and before specifying a coordinate, which is shown in
As described above, an image analysis method according to the invention can be applied to a panel having a pixel of delta array.
In this embodiment, a specific standard method for evaluating a defect of a blind spot to an entire white image is described.
First, as shown in Embodiment Mode 1, the entire white image in panel display is shot with a digital camera. Then, a defect of a blind spot is counted by using an image analysis program.
Specification of a panel used for shooting in this embodiment is shown in Table 1.
TABLE 1
Display Size
2.1 inch
arranging of pixel
stripe shape consist of RGB
pixel number
(176 × 3) horizontal × 220 vertical
pixel pitch
63 μm × 189 μm
A condition of shooting is as follows: using a digital camera of OLYMPUS CAMEDIA E-20 (CCD sensor type) of aperture=2.4 and shutter speed= 1/20 sec; using a macro lens; shooting with a macro mode; and saving of an image=JPEG compression level 2.7.
A shooting and an evaluation are carried out in the above condition as shown in the above embodiment mode.
Note that processing for integrating a pixel unit is calculated by integrating 100% (an entire region in which one primary pixel is accounted) in either horizontal or perpendicular direction.
In the above processing, as a threshold of a blind spot, level 1 is set from 0 to 59, level 2 is set from 60 to 99, and level 3 is set from 100 to 139 among 256 tones of from 0 to 255. The result of counting blind spots of each level is as follows: 145 pieces in level 1, 201 pieces in level 2, and 193 pieces in level 3. However, a group of point defects are generated in the upper left corner of a display area of the panel among the above defects; therefore, the area is separately evaluated as an area of the group of point defects. As a result, the number of isolated blind defects except the area of the group of point defects is as follows: 14 pieces in level 1, 82 pieces in level 2, and 106 pieces in level 3.
As described above, according to the present invention, moire and unevenness of a panel can be distinctively evaluated even if a digital camera having not so high resolution is used, and further, a defect can be grasped as well as a pixel coordinate of the panel.
In this embodiment, a specific standard method for evaluating a defect of a bright spot to an entire black image is described.
First, a shooting is carried out with the same panel and digital camera as in Embodiment 1. However, shutter speed is set to 1 sec so as to increase sensitivity for detecting a bright defect.
As a threshold of a bright spot, level 1 is set from 255 to 200, level 2 is set from 199 to 150, and level 3 is set from 149 to 100 among 256 tones of from 255 to 0. The result of counting bright spots of each level is as follows: 3 pieces in level 1, 1 piece in level 2, and 4 pieces in level 3.
In this embodiment, a group of bright defects does not exist; therefore, the number of counted bright defects can be referred to as the number of isolated bright defects.
Note that, when detecting a bright defect, there is a case that an adjacent normal pixel is counted as a defect, for example, regardless of an isolated point defect, since light from a bright defect portion leaks onto a periphery of a pixel. Therefore, a method by which a pixel having comparatively low-level point defect is not counted judging as an influence of light leakage may be employed in the case where the pixel having comparatively low-level point defect is adjacent to a pixel having high-level point defect. In this embodiment, counting is carried out by using the above method with implementing a measure for light leakage.
As described above, according to the present invention, a defect can be grasped as well as a pixel coordinate of a panel even if a digital camera having not so high resolution is used.
In this embodiment, a case of carrying out an image processing such as blurring an image or enhancing contrast of an image is described.
As shown in
Consequently, a blind defect is counted in advance based on a threshold of a defect which is the same as in Embodiment 1 in an image for integrating a pixel unit of
Next, processing in which a detected defect portion is overwritten by an average value of data of the periphery pixel is carried out. Then, processing for blurring an image with a lowpass filter is carried out. At this time, data of each pixel is saved as real number (floating point number) without transforming to an integer value. And then, the image is overwritten after blurring each defect based on a content of the data file for information on a defect which is saved. Thereafter, contrast enhancing process is carried out.
According to the series of the processing described above, blurring can be carried out without blurring a display defect portion and the periphery thereof, and a moire-erased image with enhancing display unevenness more can be outputted, as well as further reducing the influence of moire more. Furthermore, contrast enhancing process is carried out by each pixel data based on a real number value after blurring; therefore, a smoother image can be obtained compare with a case of transforming to an integer value such as 256 tones after blurring.
In this embodiment, an image processing of the case where a panel is set in a state that is fixed so as to shift against a digital camera, namely a state that has a rotational shift, is described.
As shown in
The panel is shot by being tilted artificially to the camera when shooting with the digital camera; accordingly, moire is reduced. Therefore, an image analysis method according to this embodiment is suitable for evaluating display unevenness having a linear shape, which especially appears in a horizontal or perpendicular direction to a display area of the panel.
This application is based on Japanese Patent Application serial no. 2004-122618 filed in Japan Patent Office on Apr. 19, 2004, the contents of which are hereby incorporated by reference.
Hayakawa, Masahiko, Nishijima, Tatsuji
Patent | Priority | Assignee | Title |
Patent | Priority | Assignee | Title |
5351201, | Aug 19 1992 | MTL Systems, Inc. | Method and apparatus for automatic performance evaluation of electronic display devices |
5650844, | Jul 14 1994 | Advantest Corporation | LCD panel image quality inspection system and LCD image presampling method |
5675380, | Dec 29 1994 | U S PHILIPS CORPORATION | Device for forming an image and method of correcting geometrical optical distortions in an image |
5696550, | Jul 14 1994 | Advantest Corporation | Image quality inspection system |
5764209, | Mar 16 1992 | Photon Dynamics, Inc | Flat panel display inspection system |
5917935, | Jun 13 1995 | Photon Dynamics, Inc | Mura detection apparatus and method |
5982946, | Sep 20 1996 | Dainippon Screen Mfg. Co., Ltd. | Method of identifying defective pixels in digital images, and method of correcting the defective pixels, and apparatus and recording media therefor |
6099134, | Sep 27 1996 | PANASONIC LIQUID CRYSTAL DISPLAY CO , LTD | Liquid crystal display device |
6215895, | Mar 14 1994 | Orbotech Ltd. | Apparatus and method for display panel inspection |
6219460, | Dec 25 1995 | Olympus Optical Co., Ltd. | Information reproducing system, information recording medium, and information recording apparatus |
6483537, | May 21 1997 | Metavision Corporation | Apparatus and method for analyzing projected images, singly and for array projection applications |
6831995, | Mar 23 1999 | Hitachi, LTD | Method for detecting a defect in a pixel of an electrical display unit and a method for manufacturing an electrical display unit |
6983067, | Nov 01 2000 | Nokia Technologies Oy | Testing an image display device |
7308157, | Feb 03 2003 | Photon Dynamics, Inc | Method and apparatus for optical inspection of a display |
7538750, | Jan 14 2004 | Samsung Electronics Co., Ltd | Method of inspecting a flat panel display |
20020041383, | |||
20020122123, | |||
20020157033, | |||
20030142298, | |||
20030210344, | |||
20030215129, | |||
JP2000105167, | |||
JP2003042900, | |||
JP8327497, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Apr 01 2005 | Semiconductor Energy Laboratory Co., Ltd. | (assignment on the face of the patent) | / |
Date | Maintenance Fee Events |
Date | Maintenance Schedule |
Jan 10 2015 | 4 years fee payment window open |
Jul 10 2015 | 6 months grace period start (w surcharge) |
Jan 10 2016 | patent expiry (for year 4) |
Jan 10 2018 | 2 years to revive unintentionally abandoned end. (for year 4) |
Jan 10 2019 | 8 years fee payment window open |
Jul 10 2019 | 6 months grace period start (w surcharge) |
Jan 10 2020 | patent expiry (for year 8) |
Jan 10 2022 | 2 years to revive unintentionally abandoned end. (for year 8) |
Jan 10 2023 | 12 years fee payment window open |
Jul 10 2023 | 6 months grace period start (w surcharge) |
Jan 10 2024 | patent expiry (for year 12) |
Jan 10 2026 | 2 years to revive unintentionally abandoned end. (for year 12) |