A method of reducing color smearing or color artifacts in a low resolution picture that is subjected to chrominance downsampling prior to display on a display device first upsamples the pixels in each row of the picture to double the picture width, then downsamples the chrominance values to produce a compressed data stream for transmission to the display device, and finally decompresses the compressed data stream for display. In order to maintain the aspect ration of the original picture, each doubled row may be repeated prior to transmission to the display device.
|
1. A method of reducing chrominance compression induced smearing in a JPEG picture stored in a memory using a controller, the JPEG picture representing a low resolution image, having pixels arranged in rows and columns that define an aspect ratio, where each pixel has a luminance value and two chrominance values, comprising the steps of:
upsampling the pixels of the JPEG picture from the memory to double the number of pixels in each row to produce an upsampled data stream;
downsampling the chrominance values in the upsampled data stream so each pixel pair includes the luminance value and a respective one of the chrominance values from a corresponding pixel of the JPEG picture to produce a compressed data stream; and
transmitting the compressed data stream to a display device for display.
5. A digital storage oscilloscope, comprising:
acquisition circuitry having an input at which is receive an input signal to be acquired;
a memory coupled to said acquisition circuitry;
the acquisition circuitry digitizing the input signal and storing data samples representative of the input signal in said memory;
a rasterizer receiving the acquired data samples and producing rasterized data for display;
display circuitry receiving the rasterized data and displaying a low resolution image representing the input signal;
a controller controlling the acquisition circuitry, the memory, the rasterizer and the display; and
a communication port coupled to said controller;
said controller operating on the samples representative of the input signal to produce original JPEG image data in a 4:4:4 format;
said controller doubling each pixel of each row of the 4:4:4 formatted data to form a doubled row of pixels, the doubled row being twice as wide as the corresponding row of the original JPEG image data;
said controller storing each doubled row of pixels on two adjacent lines to double the image size in the vertical direction;
said controller compressing said doubled rows of pixel data according to a 4:2:2 compression scheme;
said controller transmitting the 4:2:2 formatted compressed data via said communications port.
2. The method of
doubling each row of the upsampled data stream prior to the transmitting step to restore the aspect ratio of the JPEG picture when displayed by the display device.
3. The method of
4. The method of
decompressing the compressed data stream in the display device to recreate the upsampled data stream for display by the display device.
7. The digital storage oscilloscope of
a printer is connected to said communications port, said printer decompressing said 4:2:2 formatted data and printing an image representing said low resolution image.
|
The present application claims the benefit of the filing date of provisional U.S. Patent Application No. 60/835,585, filed Aug. 3, 2006 entitled “Method for Reducing Color Smearing Artifact in a Low Resolution Picture Which Uses the Exif/JPEG Format”, the contents of which are herein incorporated by reference.
The present invention relates to the display of data that has been compressed by a lossy algorithm, and more particularly to a method of reducing color smearing artifacts in a low resolution picture which has been compressed by a lossy algorithm when the picture is subsequently uncompressed for display.
Some display standards require the display of data in a compressed format. For example the PictBridge standard from the Camera & Imaging Products Association (CIPA) allows images to be printed directly from digital cameras to a printer without having to connect the camera to a computer. Such printers currently must conform to at least the Exif/JPEG standard so that products from various vendors are compatible with each other. In the test and measurement field, it is often desired to print out the image that appears on an instrument screen, wherein the screen image represents acquired data. Therefore, it is desirable that the output which is to be printed from the instrument be in a format that is acceptable by printers which conform to the PictBridge standard. That is, the image data should be in the Exif/JPEG format, which requires either 4:2:2 or 4:2:0 chrominance downsampling.
When the original data comes from a low resolution source, such as an oscilloscope screen (typically 320×240, a “quarter VGA” display), reconstruction of the data from the lossy compressed format may cause color distortion or smearing, leading to an improper interpretation of the original data. Using JPEG as an example, the data from the low resolution source is in the form of pixels, each pixel having a luminance value (Y) and a pair of chrominance values (U,V). Where all three values are given for each pixel, the format is referred to as being in a 4:4:4 format. However it is often desired to compress these pixels for transmission or storage, and then later decompress them for display. The Exif2.1 JPEG format specifies that either 4:2:2 or 4:2:0 chrominance downsampling be used for storage and transmission of the original JPEG image data. Chrominance downsampling is specified because the human eye is less sensitive to chrominance variations than to luminance variations.
An example of chrominance downsampling is the following conversion of the first four pixels of a display line:
{4:4:4} [Y0U0V0][Y1U1V1][Y2U2V2][Y3U3V3]
{4:2:2} [Y0U0] [Y1V1] [Y2U2] [Y3V3]
When a printer, for example, converts the 4:2:2 bit stream back into viewable pixels having luminance and both chrominance components {4:4:4}, the following pixels are produced:
[Y0U0V1][Y1U0V1][Y2U2V3][Y3U2V3]
As is apparent, the chrominance components of the decompressed pixels are not identical to those of the original pixels, i.e., U0V0≠U0V1 for the first pixel. This discrepancy occurs because neighboring pairs of compressed pixels are used to reconstruct the decompressed pixels. Within each pair of reconstructed pixels [Y0U0V1][Y1U0V1] or [Y2U2V3][Y3U2V3], is actually sharing a chrominance value from its neighboring pixel. That is, first reconstructed pixel (with luminance value Y0) is using the V1 chrominance value copied from its neighbor on the right, while the second reconstructed pixel (with luminance value Y1) is using the U0 chrominance value copied from its neighbor on the left. This reconstructed pattern is repeated for each pair of adjacent pixels.
Referring to
What is desired is an apparatus and method of formatting the compressed data such that reconstructing the original low resolution picture from a lossy compressed version occurs without chrominance compression induced color smearing or color artifacts.
Accordingly, the present invention provides a method of reducing chrominance compression induced color smearing artifacts in a low resolution picture which uses a compressed format, such as the Exif/JPEG format, for display. The low resolution JPEG picture is upsampled to double the number of pixels in each row. Then, the chrominance values are downsampled conventionally so that each pixel pair includes the luminance value and one of the chrominance values from the original doubled pixel to produce a compressed data stream. To maintain the aspect ratio, each line of the picture also is doubled, either before or after the chrominance downsampling. The compressed data stream is then transmitted to a display device, such as a printer, and decompressed to substantially recreate the original picture.
The objects, advantages and other novel features of the present invention are apparent from the following detailed description when read in conjunction with the accompanying claims and attached drawing.
The subject invention will be described, at first, with reference to
[Y0U0V0][*Y0*U0*V0][Y1U1Vi][*Y1*U1*V1][Y2U2V2][*Y2*U2*V2] . . . (where *Xn=Xn)
The data representing the JPEG-transformed and doubled pixel elements of
Applying the 4:2:2 downsampling scheme (which is easier to implement than the 4:2:0 downsampling scheme), produces the following compressed data stream for transmission or storage:
[Y0U0] [*Y0*V0] [Y1U1] [*Y1*V1] [Y2U2] [*Y2*V2]
When the pixels are reconstructed (for example by a printer) the following pixel values are derived:
[Y0U0*V0][*Y0U0*V0][Y1U1*V1][*Y1U1*V1][Y2U2*V2][*Y2U2*V2]
As shown in
To achieve the same aspect ratio in the reconstructed image, as was exhibited by the original JPEG-formatted picture, there are two options—(i) decimate the pixels after the reconstruction to produce the original picture or (ii) send each compressed row twice so that the number of rows is also doubled. As noted above, doubling both the row width and the number of rows converts the “quarter VGA” image to a full VGA image that is easily handled by the attached printer. In fact, many display devices, such as printers, only provide for decompression for display, so the second option is preferable. Although this might appear to produce aliasing or “jaggies” (step-like transitions for edges that are slanted in the picture), most display devices are of a higher resolution than the low resolution picture and include algorithms to reduce such “jaggies”. In practice, the doubled row and column “size” of the Exif/JPEG is seldom used by printers, which either re-size the picture to the paper size or to the user's picture size selection from the printer side.
Referring again to
In the case of the oscilloscope shown in
The digital oscilloscope shown in
When the acquisition is complete, the linear waveform record stored in acquisition memory 322 is supplied to a rasterizer 326 which generates a rasterized waveform record and stores it in a rasterizer memory 330 having a two-dimensional address space (X1-XN, Y1-YN) for display on display panel 310.
In a practical application, an oscilloscope display panel 310 may have 320 pixel rows by 240 pixel columns, known as a “quarter VGA” format. By doubling both the rows and columns, as described above, a full VGA format is achieved for the display device. In this way, instrument screen images may be compressed, doubled, and outputted to printers directly, without any chrominance compression induced color smearing or color artifacts appearing after reconstruction of the image.
The pixel and line doubling method described above is illustrated in the flowchart of
At steps 420 and 430 respectively, a row “counter” and a pixel “counter” are reset to zero to point to the first pixel of the first row of the 4:4:4 formatted data. The “counters” of steps 420 and 430 may be registers, or memory locations, or may simply be pointers to memory arrays within controller 338. At step 440, controller 338 causes a fetch of the pixel data currently addressed via the pixel counter, and stores that data in two adjacent pixel locations in a memory array in which the doubled pixel rows are stored. At step 450, a check is made to see if the last pixel in the current row has been processed. If not, the NO path is taken to step 460 where the pixel counter is incremented to point to the next pixel to be processed. The routine then loops back to step 440 to double store the next pixel. If at step 450, all pixels in the current row have been processed, then the YES path is taken to step 470 at which the entire contents of the current doubled pixel row are stored again in the next adjacent row, thus doubling in the vertical direction as well. Thereafter, at step 480 a check is made to see if all rows of the original 4:4:4: formatted data have been processed. If not, the NO path is taken to step 490 where the row counter is incremented, and the program then loops back to step 430 where the pixel counter is re-initialized to point to the first pixel of the next row. If, at step 480, it was determined that all rows had been processed, then the routine would advance to step 495 where 4:4:2 compression is performed on the doubled pixels in the doubled rows. Although 4:4:2 format is preferred, one skilled in the art will realize that the 4:4:4 formatted data could be converted instead to 4:2:0 format at step 495. The routine is then exited at step 498. Thereafter, the data can be transmitted to an external display device or printer for reconstruction of the image.
Original JPEG pictures having full VGA or XVGA resolutions, such as the picture shown in
In a second embodiment of the invention, the pixel and row doubling operation is performed on the original (or “native”) screen image data, stored in the format used by the manufacturer of the test and measurement instrument. That is, the pixel and row data are doubled before JPEG translation of the data is performed. Thereafter, the JPEG chrominance compression (i.e., downsampling) algorithm operates on 8 pixel by 8 pixel blocks of the JPEG-transformed data. It should be noted that, because of the pixel and row doubling, only 16 unique source pixels are presented within each 8 by 8 block. The JPEG chrominance compression (i.e., downsampling) algorithm operates on 8 rows of data at a time, processing 40 blocks of pixels to complete each group of 8 rows.
During implementation of the row and column doubling feature, it was realized that a number of calculations within the JPEG chrominance compression algorithm could be skipped because the subtraction of luminance or chrominance values of certain pixels within the 8 by 8 block always yields zero. Multiplications employing this zero difference as a multiplier or multiplicand can also be skipped because the product would also equal zero.
Thus, the present invention provides a method of reducing color smearing when using lossy compression, such as chrominance downsampling, by upsampling or doubling each pixel in each row of an original picture, and compressing the resulting doubled rows, before transmitting the image to an external display device or printer for decompression of the doubled rows for display or printing.
Patent | Priority | Assignee | Title |
10777880, | May 07 2018 | ST. JUDE MEDICAL LUXEMBOURG HOLDINGS II S.A.R.L. (#SJM Lux II); ST JUDE MEDICAL LUXEMBOURG HOLDINGS II S A R L SJM LUX II | Adjustable antenna system to communicate with an implantable medical device and method for using same |
Patent | Priority | Assignee | Title |
5835627, | May 15 1995 | Intellectual Ventures I LLC | System and method for automatically optimizing image quality and processing time |
6175592, | Mar 12 1997 | MATSUSHITA ELECTRIC INDUSTRIAL CORP , LTD | Frequency domain filtering for down conversion of a DCT encoded picture |
6539120, | Mar 12 1997 | Matsushita Electric Industrial Co., Ltd. | MPEG decoder providing multiple standard output signals |
6788347, | Mar 12 1997 | Matsushita Electric Industrial Co., Ltd. | HDTV downconversion system |
7656950, | May 28 2003 | VIDEO 264 INNOVATIONS, LLC | Video interpolation coding |
7715477, | May 29 2002 | VIDEO 264 INNOVATIONS, LLC | Classifying image areas of a video signal |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Aug 02 2007 | Tektronix, Inc. | (assignment on the face of the patent) | / | |||
Aug 03 2007 | NELSON, CRAIG H | Tektronix, Inc | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 026764 | /0871 |
Date | Maintenance Fee Events |
May 01 2015 | REM: Maintenance Fee Reminder Mailed. |
Sep 20 2015 | EXP: Patent Expired for Failure to Pay Maintenance Fees. |
Date | Maintenance Schedule |
Sep 20 2014 | 4 years fee payment window open |
Mar 20 2015 | 6 months grace period start (w surcharge) |
Sep 20 2015 | patent expiry (for year 4) |
Sep 20 2017 | 2 years to revive unintentionally abandoned end. (for year 4) |
Sep 20 2018 | 8 years fee payment window open |
Mar 20 2019 | 6 months grace period start (w surcharge) |
Sep 20 2019 | patent expiry (for year 8) |
Sep 20 2021 | 2 years to revive unintentionally abandoned end. (for year 8) |
Sep 20 2022 | 12 years fee payment window open |
Mar 20 2023 | 6 months grace period start (w surcharge) |
Sep 20 2023 | patent expiry (for year 12) |
Sep 20 2025 | 2 years to revive unintentionally abandoned end. (for year 12) |