An adaptive halftoning method where the difference between a digital image and a filtered digital image is introduced into the system on a pixel by pixel basis is disclosed. In this method, each input difference pixel has a corresponding error value of the previous pixel added to the input value at a summing node, resulting in modified image difference data; the modified image difference data is passed to a threshold comparator where the modified image difference data is compared to a threshold value, the threshold value varying according to the properties of the digital image, to determine the appropriate output level; the output level is subtracted from the modified image difference value to produce the input to an error filter; the output of the error filter is multiplied by an adaptation coefficient, where the adaptation coefficient varies according to the properties of the digital image, to generate the error level for the subsequent input pixel; and, the cyclical processing of pixels is continued until the end of the input data is reached.

Patent
   RE42473
Priority
May 30 2001
Filed
Aug 30 2007
Issued
Jun 21 2011
Expiry
May 30 2021
Assg.orig
Entity
Large
3
253
all paid
0. 35. A mobile device capable of generating a halftone image from an input digital image, said input digital image represented by a multiplicity of pixels, each pixel having a given value, said mobile device comprising:
means for determining one or more properties of said input digital image;
means for retrieving the pixel values;
means for filtering the input digital image, said filtering having as output a filtered value at each pixel;
means for obtaining the difference between the value at a pixel and the filtered value at the pixel, said difference being a threshold input;
means for producing an error value, said error value being indicative of the deviation of said threshold input from an output state;
means for multiplying said error value by an adaptation coefficient to obtain a diffused value and means for storing the diffused value and delaying said stored diffused value by one pixel;
means for combining the stored delayed diffused value with the difference between the pixel value and the filtered value;
means for varying a threshold according to the one or more properties of the input digital image at the pixel value;
means for selectively changing the adaptation coefficient according to the one or more properties of the input digital image; and
a rendering device.
14. A system for generating a halftone image from an input digital image, said input digital image represented by a multiplicity of pixels, each pixel having a given value, said values being stored in a memory, said apparatus system comprising:
means for determining the one or more properties including local properties of said input digital image; and
means for retrieving the pixel values; and
means for filtering the input digital image, said filtering having as output a filtered value at each pixel; and
means for obtaining the difference between the value at the a pixel and the filtered value at the pixel, said difference being a threshold input; and
means for producing an error value, said error value being indicative of the deviation of said threshold input from the an output state; and
means for multiplying said error value by an adaptation coefficient to obtain a diffused value and
means for storing the diffused value and delaying said stored diffused value by one pixel; and
means for combining the stored delayed diffused value with the difference between the pixel value and the filtered value; and
means for varying the a threshold according to the one or more properties of the input digital image at the pixel value; and
means for selectively changing the adaptation coefficient according to the local one or more properties of the input digital image.
1. A method of generating a halftone image from an input digital image, said input digital image represented by a multiplicity of pixels, each pixel having a given value, said values being stored in a memory, said method comprising the steps of:
(A) determining the one or more properties including local properties of the input digital image;
(B) filtering the input digital image, said filtering having as output a filtered value at each pixel;
(C) obtaining the difference between the value at the a pixel and the filtered value at the pixel, said difference being a threshold input;
(D) generating the an output state for the pixel depending upon the relationship of the value of said threshold input relative to a threshold;
(E) producing an error value, said error value being indicative of the deviation of said threshold input from the output state;
(F) multiplying said error value by a coefficient, the result of said multiplication being stored;
(G) combining the stored value with the difference between the next pixel value and the next filtered value to produce a new threshold input;
(H) repeating steps (D) through (G) the generating an output state, the producing an error value, the multiplying said error value, and the combining the stored error value for each pixel in the input digital image thereby producing a halftone image; and
varying the threshold according to the one or more properties of the input digital image; and
selectively changing the coefficient in step (E) according to the local one or more properties of the input digital image.
18. A computer program product comprising:
a computer usable storage medium having computer readable code embodied therein for generating a halftone image from an input digital image, said input digital image represented by a multiplicity of pixels, each pixel having a given value, said values being stored in a memory, said code causing comprising instructions for a computer system to:, the instructions comprising:
instructions to determine the one or more properties including local properties of said input digital image; and
instructions to retrieve the pixel values; and
instructions to filter the input digital image, said filtering having as output a filtered value at each pixel; and
instructions to obtain the difference between the value at the a pixel and the filtered value at the pixel, said difference being a threshold input; and
instructions to produce an error value, said error value being indicative of the deviation of said threshold input from the an output state; and
instructions to multiply said error value by an adaptation coefficient to obtain a diffused value; and
instructions to store the diffused value and delaying delay said stored diffused value by one pixel; and
instructions to combine the stored delayed diffused value with the difference between the pixel value and the filtered value; and
instructions to vary the a threshold according to the one or more properties of the input digital image at the pixel value; and
instructions to selectively change the adaptation coefficient according to the local one or more properties of the input digital image.
2. The method of claim 1 further comprising the step of:
performing a histogram modification of the image pixels, before step (B) filtering the input digital image.
3. The method of claim 1 further comprising the step of:
performing a histogram modification of the difference between the value at the pixel and the filtered value at the pixel, before step (D) generating the output state.
4. The method of claim 1 wherein the selectively changing of the coefficient comprises:
dividing a first function of the local pixel values of the input digital image by a second function of the local pixel values of the input digital image; and
multiplying the absolute value of the result of said division by a first parameter; and
adding a second parameter to the result of the multiplication, thereby obtaining the coefficient.
5. The method of claim 4 wherein said first function is the difference between the value at the pixel and the filtered value at the pixel and said second function is the filtered value at the pixel.
6. The method of claim 4 wherein the threshold is a third function of the local pixel values of the input digital image.
7. The method of claim 6 wherein said third function is a linear function of the local pixel values of the input digital image.
0. 8. The method of claim 6 wherein said third function is a linear function of the local values of the digital image.
9. The method of claim 4 wherein the threshold is the filtered value at the pixel multiplied by a third parameter.
10. The method of claim 9 wherein the filter in step (B) is filtering comprises using a filter of finite extent, the extent of the filter, the first parameter, the second parameters parameter and the third parameters parameter being selected to produce the an image of highest perceptual quality at a specific output device.
11. The method of claim 9 further comprising the step of:
performing a histogram modification of the difference between the value at the pixel and the filtered value at the pixel, before step (D) generating the output state.
12. The method of claim 1 wherein the input digital image is a monochrome image.
13. The method of claim 1 wherein the input digital image is a color image.
15. The system of claim 14 further comprising:
means performing a histogram modification of the image pixels.
16. The system of claim 14 further comprising:
means for performing a histogram modification of the difference between the value at the pixel and the filtered value at the pixel.
17. The system of claim 14 wherein the means for selectively changing of the adaptation coefficient comprise:
means for dividing a first function of the local pixel values of the input digital image by a second function of the local pixel values of the input digital image; and
means for multiplying the absolute value of the result of said division by a first parameter; and
adding a second parameter to the result of the multiplication, thereby obtaining the adaptation coefficient.
19. The computer program product of claim 18 where, the computer readable code further causes the computer system to wherein the instructions further comprise:
instructions to perform a histogram modification of the image pixels.
20. The computer program product of claim 18 where, the computer readable code further causes the computer system to wherein the instructions further comprise:
instructions to perform a histogram modification of the difference between the value at the pixel and the filtered value at the pixel.
21. The computer program product of claim 18 where, the computer readable code in causing the computer system wherein the instructions to selectively change the adaptation coefficient, further causes the computer system to comprise:
instructions to divide a first function of the local pixel values of the input digital image by a second function of the local pixel values of the input digital image; and
instructions to multiply the absolute value of the result of said division by a first parameter; and
instructions to add a second parameter to the result of the multiplication, thereby obtaining the adaptation coefficient.
22. The computer program product of claim 21 wherein said first function is the difference between the value at the pixel and the filtered value at the pixel and said second function is the filtered value at the pixel.
23. The computer program product of claim 22 wherein said the threshold is the filtered value at the pixel multiplied by a third parameter.
24. The computer program product of claim 23 wherein the filter used to filter the input digital image is a filter of finite extent, the extent of the filter, the first parameter, the second parameters parameter and third parameters parameter being selected to produce the an image of highest quality at a specific output device.
25. The computer program product of claim 25 where, the computer readable code further causes the computer system to 18 wherein the instructions further comprise:
instructions to perform a histogram modification of the difference between the value at the pixel and the filtered value at the pixel.
26. The computer program product of claim 21 wherein the threshold is a third function of the local pixel values of the input digital image.
27. The computer program product of claim 26 wherein said third function is a linear function of the local pixel values of the input digital image.
0. 28. The computer program product of claim 26 wherein said third function is a linear function of the local values of the digital image.
29. The computer program product of claim 18 wherein the input digital image is a color image.
30. The computer program product of claim 18 wherein the input digital image is a monochrome image.
0. 31. The system of claim 14, further comprising: a rendering device.
0. 32. The system of claim 31, wherein said rendering device is a binary output device.
0. 33. The system of claim 31, wherein said rendering device is a M-ary display or a M-ary rendering device.
0. 34. The system of claim 31, wherein said rendering device is a mobile phone display.

1. Field of the Invention

The present invention relates to the rendering of digital image data, and in particular, to the binary or multilevel representation of images for printing or display purposes

2. Background Description

Since images constitute an effective means of communicating information, displaying images should be as convenient as displaying text. However, many display devices, such as laser and ink jet printers, print only in a binary fashion. Furthermore, some image format standards only allow binary images. For example, the WAP1.1 (Wireless Application Protocol) protocol specification allows only for one graphic format, WBMP, a one (1) bit version of the BMP (bitmap) format. Besides allowing only binary images, some image format standards and some displays only allow images of a limited number of pixels. In the WAP 1.1 standard, a WBMP image should not be larger than 150×150 pixels. Some WAP devices have screens that are very limited in terms of the number of pixels. For example, one WAP device has a screen that is 96 pixels wide by 65 pixels high. In order to render a digitized continuous tone input image using a binary output device, the image has to be converted to a binary image.

The process of converting a digitized continuous tone input image to a binary image so that the binary image appears to be a continuous tone image is known as digital halftoning.

In one type of digital halftoning processes, ordered dither digital halftoning, the input digitized continuous tone image is compared, on a pixel by pixel basis, to a threshold taken from a threshold array. Many ordered dither digital halftoning methods suffer from low frequency artifacts. Because the human vision system has greater sensitivity at low frequencies (less than 12 cycles/degree), such low frequency artifacts are very noticeable.

The visibility of low frequency artifacts in ordered dither digital halftoning methods has led to the development of methods producing binary images with a power spectrum having mostly higher frequency content, the so called “blue noise methods”.

The most frequently used “blue noise method” is the error diffusion method. In an error diffusion halftoning system, an input digital image In (the digitized continuous tone input image) is introduced into the system on a pixel by pixel basis, where n represents the input image pixel number. Each input pixel has its corresponding error value En−1, where En−1 is the error value of the previous pixel (n−1), added to the input value In at a summing node, resulting in modified image data. The modified image data, the sum of the input value and the error value of the previous pixel (In+En−1), is passed to a threshold comparator. The modified image data is compared to the constant threshold value T.O, to determine the appropriate output level On. Once the output level On is determined, it is subtracted from the modified image value to produce the input to an error filter. The error filter allocates its input, In−On, to subsequent pixels based upon an appropriate weighting scheme. Various weighting techniques may be used generate the error level E.n for the subsequent input pixel. The cyclical processing of pixels is continued until the end of the input data is reached. (For a more complete description of error diffusion see, for example, “Digital Halftoning”, by Robert Ulichney, MIT Press, Cambridge, Mass. and London, England, 1990, pp. 239-319).

Although the error diffusion method presents an improvement over many ordered dither methods, artifacts are still present. There is an inherent edge enhancement in the error diffusion method. Other known artifacts produced by the error diffusion method include artifacts called “worms” and “snowplowing” which degrade image quality.

In U.S. Pat. No. 5,045,952, Eschbach disclosed selectively modifying the threshold level on a pixel by pixel basis in order to increase or decrease the edge enhancement of the output digital image. The improvements disclosed by Eschbach do not allow the control of the edge enhancement by controlling the high frequency portion of the error. Also, the improvements disclosed by Eschbach do not introduce parameters that can be selected to produce the image of the highest perceptual quality at a specific output device.

In U.S. Pat. No. 5,757,976, Shu disclosed utilizing a set of error filters having different sizes for diffusing the input of the error filter among neighboring pixels in predetermined tonal areas of an image and adding “noise” to the threshold in order to achieve a smooth halftone image quality. The improvements disclosed by Shu do not introduce parameters that can be selected to produce the image of the highest perceptual quality at a specific output device.

It is the primary object of this invention to provide a method for generating a halftone image from a digitized continuous tone input image that provides adjustment of the local contrast of the resulting halftone image, minimizes artifacts and is easily implemented.

It is also an object of this invention to provide a method for generating a halftone image with parameters that can be selected to produce the image of highest quality at a specific output device.

To achieve the objects of this invention, one aspect of this invention includes an adaptive halftoning method where the difference between a digital image and a filtered digital image is introduced into the system on a pixel by pixel basis; each input difference pixel having a corresponding error value, generated from the previous pixels, added to the input value at a summing node, resulting in modified image difference data; the modified image difference data being passed to a threshold comparator where the modified image difference data is compared to a threshold value, the threshold value varying according to the properties of the digital image, to determine the appropriate output level; the output level is subtracted from the modified image difference value to produce the input to an error filter; the output of the error filter is multiplied by a adaptation coefficient, where the adaptation coefficient varies according to the properties of the digital image, to generate the error level for the subsequent input pixel; and, the cyclical processing of pixels is continued until the end of the input data is reached.

In another aspect of this invention, in the method described above, a histogram modification is performed on the image, and the difference between the histogram modified digital image and the filtered digital image is introduced into the system on a pixel by pixel basis.

In still another aspect of this invention, in the method described above, the histogram modification is performed on the difference between the digital image and the filtered digital image and the histogram modified difference is introduced into the system on a pixel by pixel basis.

In a further aspect of this invention, in the method described above, the selectively changing of the adaptation coefficient comprises dividing the difference between the value at the pixel and the filtered value at the pixel by the filtered value at the pixel, multiplying the absolute value of the result of the division by a first parameter, and adding a second parameter to the result of the multiplication, thereby obtaining the coefficient.

In still another aspect of this invention, in the method described above, the threshold calculation comprises multiplying the filtered value at the pixel by a third parameter.

In still another aspect of this invention, in the method described above and including the adaptation coefficient and threshold calculated as in the two preceding paragraphs, where the filter is a filter of finite extent, the extent of the filter, the first, second parameters and third parameters are selected to produce the image of the highest perceptual quality at a specific output device.

The methods, systems and computer readable code of this invention can be used to generate halftone images in order to obtain images of the highest perceptual quality when rendered on displays and printers. The methods, systems and computer readable code of this invention can also be used to for the design of computer generated holograms and for the encoding of the continuous tone input data.

The novel features that are considered characteristic of the invention are set forth with particularity in the appended claims. The invention itself, however, both as to its organization and its method of operation, together with other objects and advantages thereof will be best understood from the following description of the illustrated embodiment when read in connection with the accompanying drawings wherein:

FIG. 1a depicts a block diagram of selected components of an embodiment of a system, of this invention for generating a halftone image from a digitized continuous tone input image, where the histogram modification block is included after the summing node; and,

FIG. 1b depicts a block diagram of selected components of an embodiment of a system of this invention for generating a halftone image from a digitized continuous tone input image, where the histogram modification block is included before the summing node; and,

FIG. 1c depicts a block diagram of selected components of an embodiment of a system of this invention for generating a halftone image from a digitized continuous tone input image, where the adaptation coefficient multiplies the input to the error filter block; and

FIG. 2 depicts a block diagram of selected components of another embodiment of the system of this invention for generating a halftone image from a digitized continuous tone input image; and

FIG. 2a depicts a block diagram of selected components of another embodiment of the system of this invention for generating a halftone image from a digitized continuous tone input image, where the adaptation coefficient multiplies the input to the error filter block.

A method and system, for generating a halftone image from a digitized continuous tone input image, that provide adjustment of the local contrast of the resulting halftone image, minimizes artifacts, are easily implemented and contain parameters that can be selected on the basis of device characteristics like brightness, dynamic range, and pixel count, to produce the image of highest perceptual quality at a specific output device are disclosed.

A block diagram of selected components of an embodiment of a system of this invention for generating a halftone image from a digitized continuous tone input image (also referred to as a digital image) is shown in FIG. 1a. Referring to FIG. 1a, image input block 10 introduces an input digital image In into the system on a pixel by pixel basis, where n represents the input image pixel number. The input image is also provided to the filtering block 20. The output of filtering block 20 has the form
Avn32 h( . . . ,Ik, . . . , I.n, . . . )   (1)
where h is a functional form spanning a number of pixels. It should be apparent that the input digital image 10 can be a two dimensional array of pixel values and that the array can be represented as a linear array by using such approaches as raster representations or serpentine representation. For a two dimensional array of pixel values, the filter 20 will also be a two dimensional array of filter coefficients and can also be represented as a linear array. The functional forms will be shown in the one dimensional form for ease of interpretation.

In one embodiment: the output of the filtering block 20 has the form
Avn={Σn−Nn+NIj}/(2N+1)   (2)
If the filtering block 20 comprises a linear filter, Avn will be given by a sum of terms, each term comprising the product of an input image pixel value multiplied by a filter coefficient.

It should be apparent that special consideration has to be given to the pixels at the boundaries of the image. For example, the calculations can be started N pixels from the boundary in equation (2). In that case the calculated and halftone image are smaller than the input image. In another case, the image is continued at the boundaries, the continuation pixels having the same value as the boundary pixel. It should be apparent that other methods of taking into account the effect of the boundaries can be used.

The output of the filtering block 20, Avn, is subtracted from the input digital image I.n at node 25, resulting in a difference value, Dn. In the embodiment in which histogram modification is not included, Dn is the input to a summing node 70. At the summing node 70, a corresponding error value En−1, where En−1 is the error value accumulated from the previous pixels, is added to the input value Dn resulting in a modified image datum. The modified image data, Dn+En−1, is compared to the output of the threshold calculation block 30 in the threshold comparison block 40 to produce the halftoning output, On. (In the case of a binary output device, if the modified image datum is above the threshold, the output level is the white level. Otherwise, the output level is the black level.) Once the output level On is determined, it is subtracted from the modified image value to produce the input to an error filter block 50. The error filter block 50 allocates its input, Dn+En−1−On, to subsequent pixels based upon an appropriate weighting scheme. The weighted contributions of the error filter block 50 input are stored and all the contributions to the next input pixel are summed to produce the output of the error filter block 50, the error value. The output of the error filter block 50, the error value, is multiplied by the adaptation coefficient in block 60 to generate the error level E.n for the subsequent input pixel. The cyclical processing of pixels, as further described below, is continued until the end of the input data is reached.

Referring again to FIG. 1, the input image is also provided to the threshold calculation block 30. The output of the threshold calculation block 30 has the form
t( . . . , Ik, . . . , I.n, . . . )   (3)
where t is a functional form spanning a number of pixels. The form in equation (3) allows the varying of the threshold according to properties of the digital image.

In one embodiment,
t( . . . ,Ik, . . . , I.n, . . . )=C0n−Nn+NIj}/(2N+1)   (4)
In another embodiment, the output of the threshold calculation block is a linear combination of terms, each term comprising the product of an input image pixel value multiplied by a coefficient. It should be apparent that this embodiment can also be expressed as a function times a parameter.
The output of the threshold calculation block 30 is the threshold.

The first pixel value to be processed, IO, produces a difference value DO from summing node 25 and produces a value of DO out of summing node 70 (since E−1 is equal to 0). DO is then compared to the threshold producing an output of OO. At summing node 45, OO is subtracted from DO to produce the input to the error filter 50. The error filter 50 allocates its input, DO−OO, to subsequent pixels based upon an appropriate weighting scheme which determines how much the current input contributes to each subsequent pixel. Various weighting techniques may be used (see, for example, “Digital Halftoning” by Robert Ulichney, MIT Press, Cambridge, Mass. and London, England, 1990, pp. 239-319). The output of error filter 50 is multiplied by a adaptation coefficient 60. The adaptation coefficient 60 is the output of the coefficient calculation block 80. In one embodiment, the output of the coefficient calculation block 80 has the form
C1+C2abs{f( . . . ,Ik, . . . , I.n, . . . ,)/g( . . . ,Ik, . . . , I.n, . . . )}  (5)
where f and g are functional forms spanning a number of pixels. The form of Equation (5) allows the selective changing, of the coefficient according to the local properties of the digital image. C1 and C2 and the parameter in the threshold expression can be selected to produce the image of highest perceptual quality at a specific output device.

In another embodiment, the output of the coefficient calculation block 80 has the form
C1+C2{abs((I.n−({Σn−Nn+NIj}/(2N+1)))/({Σn−Nn+NIj}/(2N+1))))}  (6)

The input of error filter block 50 is multiplied by weighting coefficients and stored. All the contributions from the stored weighted values to the next pixel are summed to produce the out put of the error filter block 50. The output of the error filter block 50 is multiplied by the adaptation coefficient 60. The delay block 65 stores the result of the product of the adaptation coefficient 60 and the output of the error filter block 50. (In one embodiment, the Floyd-Steinberg filter, the input to the error filter is distributed according to the filter weights to the next pixel in the processing line and to neighboring pixels in the following line.) The output of delay block 65 is En−1 and is delayed by one pixel. (When the first pixel is processed, the output of the delay, EO, is added to the subsequent difference, D1.)

It should be apparent that the sequence order of error filter block 50 and the adaptation coefficient block 60 can be interchanged with similar results. In the embodiment in which the adaptation coefficient 60 multiplies the difference between the modified image datum and the output level, shown in FIG. 1c, the delay block 65 stores the output of the error filter block.

When the next pixel, I1, is introduced into the system from the image input block 10, it produces a difference value D1 from summing node 25 and produce a value of (D1+EO) out of summing node 70.

The above steps repeat for each subsequent pixel in the digital image thereby producing a halftone image, the sequence OO, O1, . . . , On. The modification of the threshold level and the adaptation coefficient allows control of the amount of edge enhancement and provides the opportunity to reduce artifacts.

In the embodiment in which histogram modification is included after the summing node 25, Dn is the input to the histogram modification block 75 and the output of the histogram modification block 75 is the input to the summing node 70. The above description follows if Dn is replaced by the output of the histogram modification block 75. It should be apparent that histogram modification operates on the entire difference image. (Histogram modification is well known to those skilled in the art. For a discussion of histogram modification, see, for example, Digital Image Processing, by William K. Pratt, John Wiley and Sons, 1978, ISBN 0-471-01888-0, pp. 311-318. For a discussion of histogram equalization, a form of histogram modification, see, for example, Digital Image Processing, by R. C. Gonzalez and P. Wintz, Addison-Wesley Publishing Co., 1977, ISBN 0-201-02596-3, pp. 119-126.)

In the embodiment in which histogram modification is included after the image input block 10, Dn is the difference between the output of the histogram modification block 75 (FIG. 1b) and the filtered image. The above description follows if In is replaced by the output of the histogram modification block.

The method described above produces improvements of the error diffusion method by utilizing the difference between the digital image and the filtered digital image as input into the system instead of the digital image, by multiplying the .the output of the error filter by the adaptation coefficient, where the adaptation coefficient varies according to the properties of the digital image, and by using a threshold value that varies according to the properties of the digital image to determine the appropriate output level.

Sample Embodiment

In a specific embodiment, shown in FIG. 2, the output of the filtering block 20, Avn, is given by Equation (2). The threshold calculation 30 is a function of the output of the filtering block 20 and is given by
t( . . . ,Ik, . . . , I.n, . . . )=COAvn   (7)
which is the same function as in Equation 4 when the output of the filtering block 20, Avn, is given by Equation (2). The output of the coefficient calculation block 80 depends on the output of the filtering block 20, Avn, and the difference Dn and is given by
C1+C2{abs((Dn−Avn)/Avn)}  (8)
When the output of the filtering block 20, Avn, is given by Equation (2), Equation (8) is the same as Equation (6).

Histogram equalization is included after the summing node 25. The processing of the input image pixels 10 occurs as described in the preceding section.

The value of N in Equation (2) (the extent of the filter), CO, C1, and C2 (first, second parameters and third parameters) can be selected to produce the image of highest perceptual quality at a specific output device. For a WBMP image on a specific monochrome mobile phone display, utilizing a Floyd-Steinberg error filter, the following parameters yield images of high perceptual quality:
N=7,
CO=−20,
C1=0.05, and
C2=1.
In another embodiment, shown in FIG. 2a, the sequence order of error filter block 50 and the adaptation coefficient block 60 are interchanged. In the embodiment of FIG. 2a, in which the adaptation coefficient 60 multiplies the difference between the modified image datum and the output level, the delay block 65 stores the output of the error filter block.

The embodiments described herein can also be expanded to include composite images, such as color images, where each color component might be treated individually by the algorithm. In the case of color input images, the value of N in Equation (2) (the extent of the filter), CO, C1, and C2 (first, second parameters and third parameters) can be selected to control the color difference at a color transition while minimizing any effects on the brightness at that location. Other possible applications of these embodiments include the design of computer generated holograms and the encoding of the continuous tone input data.

Although the embodiments described herein are most easily understood for binary output devices, the embodiments described herein can also be expanded to include rendering an output image when the number of gray levels in the image exceeds that of obtainable in the rendering device. It should be apparent how to expand the embodiments described herein to M-ary displays or M-ary rendering devices (see, for example, “Digital Halftoning” by Robert Ulichney, MIT Press, Cambridge, Mass., and London, England, 1990, p. 341).

It should be appreciated that the various embodiments described above are provided merely for purposes of example and do not constitute limitations of the present invention. Rather, various other embodiments are also within the scope of the claims, such as the following. The filter 20 can be selected to impart the desired functional behavior of the difference. The filter 20 can, for example, be a DC preserving filter. The threshold 40 and the adaptation coefficient 60 can also be selected to impart the desired characteristics of the image.

It should be apparent that Equations (4) and (5) are exemplary forms of functional expressions with parameters that can be adjusted. Functional expressions for the threshold and the adaptation coefficient ,where the expressions include parameters that can be adjusted, will satisfy the object of this invention.

In general, the techniques described above may be implemented, for example, in hardware, software, firmware, or any combination thereof. The techniques described above may be implemented in one or more computer programs executing on a programmable computer including a processor, a storage medium readable by the processor (including, for example, volatile and non-volatile memory and/or storage elements), at least one input device, and at least one output device. Program code may be applied to data entered using the input device to perform the functions described and to generate output information. The output information may be applied to one or more output devices.

Elements and components described herein may be further divided into additional components or joined together to form fewer components for performing the same functions.

Each computer program within the scope of the claims below may be implemented in any programming language, such as assembly language, machine language, a high-level procedural programming language, or an object-oriented programming language. The programming language may be a compiled or interpreted programming language. Each computer program may be implemented in a computer program product tangibly embodied in a machine-readable storage device for execution by a computer processor. Method steps of the invention may be performed by a computer processor executing a program tangibly embodied on a computer-readable medium to perform functions of the invention by operating on input and generating output.

The generation of the halftone image can occur at a location remote from the rendering printer or display. The operations performed in software utilize instructions (“code”) that are stored in computer-readable media and store results and intermediate steps in computer-readable media.

Common forms of computer-readable media include, for example, a floppy disk, a flexible disk, hard disk, magnetic tape, or any other magnetic medium, a CDROM, any other optical medium, punch cards, paper tape, any other physical medium with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, any other memory chip or cartridge, a carrier wave as described hereinafter, or any other medium from which a computer can read. Electrical, electromagnetic or optical signals that carry digital data streams representing various types of information are exemplary forms of carrier waves transporting the information.

Other embodiments of the invention, including combinations, additions, variations and other modifications of the disclosed embodiments will be obvious to those skilled in the art and are within the scope of the following claims.

Thornton, Jay E., Gorian, Izrail S., Pineau, Richard A.

Patent Priority Assignee Title
10791239, Jun 15 2018 Hewlett-Packard Development Company, L.P. Encoding information in printed images by decreasing grayscale pixel values exceeding threshold
11089180, Mar 20 2018 Hewlett-Packard Development Company, L.P. Encoding dot patterns into printed images based on source pixel color
11277539, Mar 20 2018 Hewlett-Packard Development Company, L.P. Encoding information using disjoint highlight and shadow dot patterns
Patent Priority Assignee Title
3820133,
3864708,
4070587, Feb 24 1975 Canon Kabushiki Kaisha Energizing control system for an intermittently energized device
4072973, Jan 26 1976 Camera signal system for portrait taking
4089017, Sep 07 1976 Polaroid Corporation Automatic photostudio
4154523, May 31 1977 Eastman Kodak Company Exposure determination apparatus for a photographic printer
4168120, Apr 17 1978 Pako Corporation Automatic exposure corrections for photographic printer
4284876, Apr 24 1979 Oki Electric Industry Co., Ltd. Thermal printing system
4309712, Dec 27 1978 Canon Kabushiki Kaisha Thermal printer
4347518, Sep 04 1979 GOULD INSTRUMENT SYSTEMS, INC Thermal array protection apparatus
4364063, Mar 31 1980 Tokyo Shibaura Denki Kabushiki Kaisha Thermal recording apparatus
4385302, Oct 16 1980 Fuji Xerox Co., Ltd. Multicolor recording apparatus
4391535, Aug 10 1981 Intermec IP Corporation Method and apparatus for controlling the area of a thermal print medium that is exposed by a thermal printer
4415908, Jun 13 1980 Canon Kabushiki Kaisha Thermal printer
4443121, Mar 02 1982 Sony Corporation Thermal printing apparatus with reference gray scale comparator
4447818, Feb 20 1981 Fuji Xerox Co., Ltd. Multicolor heat-sensitive recording apparatus
4464669, Jun 19 1981 Tokyo Shibaura Denki Kabushiki Kaisha Thermal printer
4514738, Nov 22 1982 Tokyo Shibaura Denki Kabushiki Kaisha Thermal recording system
4524368, Apr 01 1983 FUJI XEROX CO , LTD A CORP OF JAPAN Thermal head drive circuit
4540992, Apr 07 1983 Kabushiki Kaisha Daini Seikosha Thermal color transfer system
4563691, Dec 24 1984 FUJI XEROX CO , LTD Thermo-sensitive recording apparatus
4607262, Jan 11 1983 Fuji Xerox Co., Ltd. Thermal head drive circuit
4638372, Oct 17 1983 Fuji Xerox Co., Ltd. Color copier
4686549, Dec 16 1985 Minnesota Mining and Manufacturing Company; MINNESOTA MINING AND MANUFACTURING COMPANY, SAINT PAUL, MINNESOTA, A CRP OF DELAWARE Receptor sheet for thermal mass transfer printing
4688051, Aug 15 1983 RICOH COMPANY, LTD , 3-6, NAKAMAGOME 1-CHOME, OHTA-KU, TOKYO 143 JAPAN, A CORP OF JAPAN Thermal print head driving system
4704620, Sep 04 1985 Canon Kabushiki Kaisha Temperature control system and ink jet printer utilizing the temperature control system
4738526, Nov 21 1986 AUTOSTUDIO CORPORATION, A NY CORP Auto-portrait photo studio
4739344, Feb 27 1987 ASTRONOVA, INC Chart recorded having multiple thermal print heads
4777496, May 24 1986 Sony Corporation Thermal printer with printing plate making mode
4805033, Feb 18 1987 Olympus Optical Co., Ltd. Method of forming oblique dot pattern
4809063, Nov 09 1983 Fuji Xerox Co., Ltd. Multicolor printing method using rectangular dither matrices of different size, shape, and arrangement of threshold values to minimize overlap of differently colored inks at lower gradations
4884080, Jan 31 1985 Kabushiki Kaisha Toshiba Color image printing apparatus
4907014, May 18 1989 Calcomp Inc. Safely retracting paper-cutting apparatus for a roll paper printer
4933709, Sep 25 1989 Eastman Kodak Company Adjusting photographic printer color exposure determination algorithms
4962403, Dec 11 1989 Eastman Kodak Company Adjusting photographic printer color exposure determination algorithms
5006866, Oct 31 1988 Kabushiki Kaisha Toshiba Thermal printing apparatus responsive to estimated stored heat of the heating element
5045952, Aug 21 1989 Xerox Corporation Method for edge enhanced error diffusion
5046118, Feb 06 1990 CARESTREAM HEALTH, INC Tone-scale generation method and apparatus for digital x-ray images
5066961, Feb 17 1989 Matsushita Electric Industrial Co., Ltd. Tonal printer utilizing heat prediction and temperature detection means
5086306, Jul 19 1989 Ricoh Company, Ltd. Line head driving apparatus
5086484, Aug 24 1988 Canon Kabushiki Kaisha Image processing apparatus with fixed or variable threshold
5109235, Aug 18 1988 Ricoh Company, Ltd. Recording density correcting apparatus
5115252, Feb 03 1989 RICOH COMPANY, LTD , 3-6, 1-CHOME NAKAMAGOME, OTA-KU, TOKYO JAPAN, A JOINT-STOCK COMPANY OF JAPAN Thermal head drive apparatus correcting for the influence on a printing element of heat from other printing elements
5130821, Apr 16 1990 Eastman Kodak Company Method and apparatus for digital halftoning employing density distribution for selection of a threshold template
5132703, Mar 08 1991 Yokogawa Electric Corporation Thermal history control in a recorder using a line thermal head
5132709, Aug 26 1991 Zebra Technologies Corporation Apparatus and method for closed-loop, thermal control of printing head
5162813, Aug 31 1989 FUJIFILM Corporation Method of and device for driving thermal head in printer
5184150, Aug 07 1989 Sharp Kabushiki Kaisha Thermal printer for providing printed characters with a uniform density
5208684, Apr 26 1990 Fujitsu Limited Half-tone image processing system
5244861, Jan 17 1992 Eastman Kodak Company; EASTMAN KODAK COMPANY A NJ CORP Receiving element for use in thermal dye transfer
5248995, Feb 25 1991 ALPS Electric Co., Ltd. Heat control method of a thermal head
5268706, Feb 14 1991 ALPS Electric Co., Ltd. Actuating control method of thermal head
5285220, Nov 22 1989 Canon Kabushiki Kaisha Image recording apparatus with tone correction for individual recording heads
5307425, Sep 02 1991 Rohm Co., Ltd. Bi-level halftone processing circuit and image processing apparatus using the same
5323245, Sep 14 1990 Minnesota Mining and Manufacturing Company Perpendicular, unequal frequency non-conventional screen patterns for electronic halftone generation
5333246, Apr 05 1990 Seiko Epson Corporation Page-description language interpreter for a parallel-processing system
5422662, Mar 27 1992 NEC Corporation; SUSUMU CO , LTD Thermal printer head having current sensors connected to heating elements
5450099, Apr 08 1993 Eastman Kodak Company Thermal line printer with staggered head segments and overlap compensation
5455685, Sep 04 1991 FUJIFILM Corporation Video camera exposure control apparatus for controlling iris diaphragm and automatic gain control operating speed
5469203, Nov 24 1992 Eastman Kodak Company Parasitic resistance compensation for a thermal print head
5479263, Jul 01 1993 Xerox Corporation Gray pixel halftone encoder
5497174, Mar 11 1994 Xerox Corporation Voltage drop correction for ink jet printer
5521626, Oct 12 1992 JVC Kenwood Corporation Fusion-type thermal transfer printing system
5539443, Jul 03 1992 Matsushita Electric Industrial Co., Ltd. Printer utilizing temperature evaluation and temperature detection
5569347, Dec 21 1993 Fujicopian Co., Ltd. Thermal transfer material
5576745, May 27 1993 Canon Kabushiki Kaisha Recording apparatus having thermal head and recording method
5602653, Nov 08 1994 Xerox Corporation Pixel pair grid halftoning for a hyperacuity printer
5617223, Feb 28 1992 Eastman Kodak Company Image scanner system and method for improved microfilm image quality
5623297, Jul 07 1993 Intermec IP Corporation Method and apparatus for controlling a thermal printhead
5623581, Jan 22 1996 AMERICAN PHOTO BOOTHS, INC Direct view interactive photo kiosk and image forming process for same
5625399, Jan 31 1992 Intermec IP Corporation Method and apparatus for controlling a thermal printhead
5642148, Nov 30 1993 NEC Corporation; Susumu Co., Ltd. Thermal head apparatus with integrated circuits and current detection
5644351, Dec 04 1992 MATSUSHITA ELECTRIC INDUSTRIAL CO , LTD Thermal gradation printing apparatus
5646672, Dec 16 1994 NEC Corporation Thermal head apparatus
5664253, Apr 04 1996 Eastman Kodak Company Stand alone photofinishing apparatus
5668638, Jun 27 1996 Xerox Corporation Error diffusion method with symmetric enhancement
5694484, May 15 1995 Intellectual Ventures I LLC System and method for automatically processing image data to provide images of optimal perceptual quality
5703644, May 21 1992 MATSUSHITA ELECTRIC INDUSTRIAL CO , LTD Automatic exposure control apparatus
5706044, Dec 20 1994 NEC Corporation Thermal head apparatus
5707082, Jul 18 1995 MOORE BUSINESS FORMS, INC Thermally imaged colored baggage tags
5711620, Sep 28 1995 FUJIFILM Corporation Color thermal printer
5719615, Mar 09 1989 Kyocera Corporation Apparatus for driving heating elements of a thermal head
5721578, Dec 27 1993 Sharp Kabushiki Kaisha Methods of gradation control and picture quality improvement in a thermal printer which adapts a staggered printing system
5724456, Mar 31 1995 Intellectual Ventures I LLC Brightness adjustment of images using digital scene analysis
5729274, Nov 05 1992 FUJIFILM Corporation Color direct thermal printing method and thermal head of thermal printer
5757976, Oct 11 1994 Seiko Epson Corporation Adaptive filtering and thresholding arrangement for reducing graininess of images
5777599, Feb 14 1992 OKI ELECTRIC INDUSTRY CO , LTD Image generation device and method using dithering
5781315, Nov 09 1995 FUJIFILM Corporation Image processing method for photographic printer
5784092, Dec 24 1993 Shinko Electric Co., Ltd. Thermal printer in which head energization period is controlled based on number of heads to be energized
5786837, Nov 29 1994 AGFA HEALTHCARE N V Method and apparatus for thermal printing with voltage-drop compensation
5786900, Mar 23 1994 FUJIFILM Corporation Image recording device for recording multicolor images with dot pitch pattern randomly arranged only in the sub-scanning direction
5800075, Apr 11 1996 FUJIFILM Corporation Data processing method for eliminating influence of heat accumulating in thermal head
5808653, Dec 04 1992 Matsushita Electric Industrial Co., Ltd. Thermal gradation printing apparatus
5809164, Mar 07 1996 HANGER SOLUTIONS, LLC System and method for color gamut and tone compression using an ideal mapping function
5809177, Jun 06 1996 Xerox Corporation Hybrid error diffusion pattern shifting reduction using programmable threshold perturbation
5818474, Jun 30 1993 Canon Kabushiki Kaisha Ink-jet recording apparatus and method using asynchronous masks
5818975, Oct 28 1996 KODAK ALARIS INC Method and apparatus for area selective exposure adjustment
5835244, Oct 15 1993 Heidelberger Druckmaschinen AG Method and apparatus for the conversion of color values
5835627, May 15 1995 Intellectual Ventures I LLC System and method for automatically optimizing image quality and processing time
5841461, Aug 17 1995 FUJIFILM Corporation Accumulated heat correction method and apparatus
5859711, Aug 07 1995 Electronics for Imaging, Inc Multiple print engine with virtual job routing
5870505, Mar 14 1996 Intellectual Ventures I LLC Method and apparatus for pixel level luminance adjustment
5880777, Apr 15 1996 MASSACHUSETTS INST OF TECHNOLOGY Low-light-level imaging and image processing
5889546, Jun 04 1996 Shinko Electric Co., Ltd. Heat accumulation control device for line-type thermoelectric printer
5897254, Jul 12 1996 JVC Kenwood Corporation Melt-type thermal transfer printing apparatus and a printing sheet with multiple porous layers
5913019, Jan 22 1996 FOTO FANTASY, INC Direct view interactive photo kiosk and composite image forming process for same
5956067, Oct 28 1993 Nisca Corporation Thermal transfer printing device and method
5956421, Feb 28 1996 Canon Kabushiki Kaisha Image processing method and apparatus for determining a binarization threshold value used for binarizing a multi-valued image and performing binarization processing
5970224, Apr 14 1997 Ricon Corporation Multifunctional printing system with queue management
5978106, Jun 21 1996 Nikon Corporation Picture image processing method
5995654, May 28 1998 Eastman Kodak Company Digital photofinishing system including scene balance and image sharpening digital image processing
5999204, Feb 13 1996 FUJIFILM Corporation Apparatus and method for thermal image recording
6005596, Oct 04 1996 SEIKO I INFOTECH INC Method for recording color image, apparatus for recording color image, and method for controlling recording of color image
6028957, Mar 07 1996 Minolta Co., Ltd. Image forming apparatus having a noise removing unit
6069982, Dec 23 1997 CABIER INSTITUTE SL Estimation of frequency dependence and grey-level dependence of noise in an image
6104421, Sep 29 1995 Toshiba Tec Kabushiki Kaisha Thermal transfer type color printer
6104468, Jun 29 1998 Monument Peak Ventures, LLC Image movement in a photographic laboratory
6104502, Apr 30 1996 SCREEN HOLDINGS CO , LTD Method and apparatus for generating halftone dots for color printing
6106173, Mar 06 1998 Asahi Kogaku Kogyo Kabushiki Kaisha Image-forming system including a plurality of thermal heads and an image-forming sheet with a plurality of types of micro-capsules
6108105, Sep 08 1988 Canon Kabushiki Kaisha Dot image output apparatus
6128099, Jun 08 1995 AGFA-GEVAERT N V Halftone screen generator, halftone screen and method for generating same
6128415, Sep 06 1996 DIGITECH IMAGE TECHNOLOGIES LLC Device profiles for use in a digital image processing system
6133983, Nov 12 1993 Eastman Kodak Company Photographic printing method and apparatus for setting a degree of illuminant chromatic correction using inferential illuminant detection
6157459, Dec 24 1996 FUJIFILM Corporation Method and apparatus for outputting picture image data
6172768, Feb 05 1998 Canon Kabushiki Kaisha Halftoning with changeable error diffusion weights
6186683, Aug 11 1997 MINOLTA CO , LTD Recording apparatus
6204940, May 15 1998 HEWLETT-PACKARD DEVELOPMENT COMPANY, L P Digital processing of scanned negative films
6208429, May 29 1998 FlashPoint Technology, Inc. Method and system for band printing of rotated digital image data
6226021, Apr 03 1998 ALPS Electric Co., Ltd. Image forming method of thermal transfer printer
6233360, Sep 24 1996 Xerox Corporation Method and system for hybrid error diffusion processing of image information using adaptive white and black reference values
6243133, Mar 07 1997 Monument Peak Ventures, LLC Method for automatic scene balance of digital images
6263091, Aug 22 1997 UNILOC 2017 LLC System and method for identifying foreground and background portions of digitized images
6282317, Dec 31 1998 Monument Peak Ventures, LLC Method for automatic determination of main subjects in photographic images
6293651, Jun 24 1997 FUJIFILM Corporation Multi-head printer
6402283, Apr 29 1999 HEWLETT-PACKARD DEVELOPMENT COMPANY, L P Variable drop mass inkjet drop generator
6425699, Sep 29 1999 HEWLETT-PACKARD DEVELOPMENT COMPANY, L P Use of very small advances of printing medium for improved image quality in incremental printing
6447186, Sep 29 1999 Seiko Epson Corporation Printing apparatus, control method thereof, and data storage medium storing a computer program realizing the control method
6456388, Aug 01 1997 Sharp Kabushiki Kaisha Printer enclosing network computer and computer network system employing the same
6462835, Jul 15 1998 Eastman Kodak Company Imaging system and method
6501566, Apr 03 1977 Minolta Co., Ltd. Image processing apparatus carrying out multi-value error diffusion process
6537410, Feb 01 2000 Intellectual Ventures I LLC Thermal transfer recording system
6563945, Mar 24 1997 RPX Corporation Pictorial digital image processing incorporating image and output device modifications
6567111, Nov 22 2000 FUJIFILM Corporation Image recording method and apparatus
6577751, Jun 11 1998 FUJIFILM Corporation Image processing method capable of correcting red eye problem
6583852, Sep 21 2000 Shutterfly, LLC Apparatus, architecture and method for high-speed printing
6608926, Jun 24 1998 Canon Kabushiki Kaisha Image processing method, image processing apparatus and recording medium
6614459, Feb 05 2001 Rohm Co., Ltd. Thermal printer capable of performing error diffusion
6628417, Oct 30 1998 Canon Kabushiki Kaisha Data communication apparatus, image server, control method, storage medium, and image system
6628823, Mar 24 1997 RPX Corporation Pictorial digital image processing incorporating adjustments to compensate for dynamic range differences
6628826, Nov 29 1999 Eastman Kodak Company Color reproduction of images from color films
6628899, Oct 08 1999 FUJIFILM Corporation IMAGE PHOTOGRAPHING SYSTEM, IMAGE PROCESSING SYSTEM, AND IMAGE PROVIDING SYSTEM CONNECTING THEM, AS WELL AS PHOTOGRAPHING CAMERA, IMAGE EDITING APPARATUS, IMAGE ORDER SHEET FOR EACH OBJECT AND METHOD OF ORDERING IMAGES FOR EACH OBJECT
6650771, Nov 22 1999 Eastman Kodak Company Color management system incorporating parameter control channels
6661443, Feb 22 2002 TPP TECH LLC Method and apparatus for voltage correction
6671063, Jan 27 1999 PANASONIC COMMUNICATIONS CO , LTD Network facsimile apparatus
6690488, Sep 30 1999 Intellectual Ventures I LLC Method and apparatus for estimating the spatial frequency response of a digital image acquisition system from the images it produces
6694051, Jun 24 1998 Canon Kabushiki Kaisha Image processing method, image processing apparatus and recording medium
6711285, Aug 09 1998 FUJIFILM Corporation Method and apparatus for correcting the density and color of an image and storage medium having a program for executing the image correction
6760489, Apr 06 1998 Seiko Epson Corporation Apparatus and method for image data interpolation and medium on which image data interpolation program is recorded
6762855, Jul 07 2000 Eastman Kodak Company Variable speed printing system
6771832, Jul 29 1997 PANASONIC COMMUNICATIONS CO , LTD Image processor for processing an image with an error diffusion process and image processing method for processing an image with an error diffusion process
6819347, Aug 22 2001 MITCHAM GLOBAL INVESTMENTS LTD Thermal response correction system
6826310, Jul 06 2001 Intel Corporation Automatic contrast enhancement
6842186, May 30 2001 Senshin Capital, LLC High speed photo-printing apparatus
6906736, Feb 19 2002 Intellectual Ventures I LLC Technique for printing a color image
6937365, May 30 2001 Senshin Capital, LLC Rendering images utilizing adaptive error diffusion
6956967, May 20 2002 Intellectual Ventures Fund 83 LLC Color transformation for processing digital images
6999202, Mar 27 2001 SENSHLN CAPITAL, LLC; Senshin Capital, LLC Method for generating a halftone of a source image
7050194, Nov 27 1998 Seiko Epson Corporation Image processing apparatus, method of processing images, and printing apparatus to which image processing method is applied
7092116, Jun 29 2000 Method and system for processing an annotated digital photograph using a composite image
7127108, May 29 1998 FUJIFILM Corporation Image processing method
7129980, Jan 25 1999 FUJIFILM Corporation Image capturing apparatus and automatic exposure control correcting method
7154621, Mar 20 2001 RPX Corporation Internet delivery of digitized photographs
7154630, Jun 29 1999 CASIO COMPUTER CO , LTD Printing apparatus and printing method
7167597, Nov 29 2001 Ricoh Company, Ltd. Image processing apparatus, image processing method, computer program and storage medium
7200265, Feb 26 2002 Seiko Epson Corporation Image processing apparatus, image processing method, image processing program, and medium recording the image processing program
7224476, Sep 11 1997 MINOLTA CO , LTD Control device and control method for network-connected device
7260637, Oct 23 2000 Canon Kabushiki Kaisha Printing system and method of setting same, information processing apparatus and storage medium
7272390, Dec 19 2000 Cisco Technology, Inc. Method and system for sending facsimile transmissions from mobile devices
7283666, Feb 27 2003 Intellectual Ventures I LLC Digital image exposure correction
7336775, Oct 30 2001 Nikon Corporation Image storage apparatus, image storage supporting apparatus, image storage system, image management apparatus and image saving apparatus
7548260, Dec 24 1999 FUJIFILM Corporation Identification photo system and image processing method which automatically corrects image data of a person in an identification photo
7557950, Jul 23 2001 Seiko Epson Corporation Printing system and printing method
20030021478,
20030038963,
20040073783,
20040179226,
20040207712,
20050005061,
20050219344,
20070036457,
20080017026,
20090128613,
EP204094,
EP454495,
EP619188,
EP625425,
EP626611,
EP762736,
EP773470,
EP791472,
EP933679,
EP939359,
EP1004442,
EP1056272,
EP1078750,
EP1137247,
EP1201449,
EP1392514,
EP1393544,
GB2356375,
JP10285390,
JP1040371,
JP11055515,
JP11275359,
JP11505357,
JP2000050077,
JP2000050080,
JP2000184270,
JP2001160908,
JP2001273112,
JP2002199221,
JP2002247361,
JP2003008986,
JP2248264,
JP2289368,
JP3024972,
JP3222588,
JP4008063,
JP4119338,
JP5136998,
JP58164368,
JP59127781,
JP6183033,
JP6266514,
JP6292005,
JP6308632,
JP63209370,
JP6350888,
JP83076999,
JP9138465,
JP9167129,
KR20010037684,
WO4492,
WO101669,
WO1031432,
WO2078320,
WO2096651,
WO2098124,
WO3071780,
WO4077816,
WO5006200,
WO9734257,
WO9953415,
///
Executed onAssignorAssigneeConveyanceFrameReelDoc
Feb 05 2007Polaroid CorporationSenshin Capital, LLCASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS 0258980659 pdf
Aug 30 2007Senshin Capital, LLC(assignment on the face of the patent)
Feb 12 2013Senshin Capital, LLCIntellectual Ventures I LLCMERGER SEE DOCUMENT FOR DETAILS 0306390279 pdf
Date Maintenance Fee Events
Jan 25 2013M1552: Payment of Maintenance Fee, 8th Year, Large Entity.
Apr 10 2015ASPN: Payor Number Assigned.
Jan 26 2017M1553: Payment of Maintenance Fee, 12th Year, Large Entity.


Date Maintenance Schedule
Jun 21 20144 years fee payment window open
Dec 21 20146 months grace period start (w surcharge)
Jun 21 2015patent expiry (for year 4)
Jun 21 20172 years to revive unintentionally abandoned end. (for year 4)
Jun 21 20188 years fee payment window open
Dec 21 20186 months grace period start (w surcharge)
Jun 21 2019patent expiry (for year 8)
Jun 21 20212 years to revive unintentionally abandoned end. (for year 8)
Jun 21 202212 years fee payment window open
Dec 21 20226 months grace period start (w surcharge)
Jun 21 2023patent expiry (for year 12)
Jun 21 20252 years to revive unintentionally abandoned end. (for year 12)