A printed dynamic optical illusion printed on a printing device using a plurality of colorants, wherein one or more of the colorants are appearance mutable colorants having spectral characteristics that can be controllably switched between a first colorant state and a second colorant state by application of an appropriate external stimulus, and wherein one or more mutable portions of the optical illusion image are printed using at least one appearance mutable colorant. The mutable portions are controllable such that when they are in a first appearance state the printed optical illusion image has a first illusion state, and when they are in a second appearance state the printed optical illusion image has a second illusion state, thereby changing the optical illusion image from the first illusion state to the second illusion state so as to affect the perception of an optical illusion by a human observer.
|
1. A printed dynamic optical illusion image printed by a printing device on a print media using a plurality of colorants, wherein one or more of the colorants are appearance mutable colorants having spectral characteristics that can be switched between a first colorant state and a second colorant state by application of an appropriate external stimulus, and wherein one or more mutable portions of the printed dynamic optical illusion image are printed using at least one appearance mutable colorant;
wherein when the mutable portions are in a first appearance state the printed dynamic optical illusion image has a first illusion state, and when the mutable portions are in a second appearance state the printed dynamic optical illusion image has a second illusion state, such that changing the optical illusion image from the first illusion state to the second illusion state affects the perception of an optical illusion by a human observer;
the printed dynamic optical illusion image being switchable between the first and second illusion states by applying the appropriate external stimulus to switch the one or more appearance mutable colorants between their first and second colorant states, thereby switching the mutable portions of the printed dynamic optical illusion image between their corresponding first and second appearance states;
wherein the appearance mutable colorants include dyes or pigments that undergo a chemical change in response to the application of the external stimulus to switch between the first colorant state and the second colorant state.
2. The printed dynamic optical illusion image of
3. The printed dynamic optical illusion image of
4. The printed dynamic optical illusion image of
5. The printed dynamic optical illusion image of
6. The printed dynamic optical illusion image of
7. The printed dynamic optical illusion image of
8. The printed dynamic optical illusion image of
9. The printed dynamic optical illusion image of
10. The printed dynamic optical illusion image of
11. The printed dynamic optical illusion image of
12. The printed optical dynamic illusion image of
13. The printed dynamic optical illusion image of
14. The printed dynamic optical illusion image of
15. The printed dynamic optical illusion image of
16. The printed dynamic optical illusion image of
17. The printed dynamic optical illusion image of
18. The printed dynamic optical illusion image of
19. The printed dynamic optical illusion image of
20. The printed dynamic optical illusion image of
21. The printed dynamic optical illusion image of
22. The printed dynamic optical illusion image of
23. The printed dynamic optical illusion image of
24. The printed dynamic optical illusion image of
25. The printed dynamic optical illusion image of
26. The printed dynamic optical illusion image of
27. The printed dynamic optical illusion image of
28. The printed dynamic optical illusion image of
29. The printed dynamic optical illusion image of
30. The printed dynamic optical illusion image of
31. The printed dynamic optical illusion image of
32. The printed dynamic optical illusion image of
33. The printed dynamic optical illusion image of
34. The printed dynamic optical illusion image of
35. The printed dynamic optical illusion image of
36. The printed dynamic optical illusion image of
|
Reference is made to commonly assigned, co-pending U.S. patent application Ser. No. 13/181,760, entitled “Method for providing dynamic optical illusion images,” by Kurtz et al.; and to commonly assigned, U.S. patent application Ser. No. 13/181,828, now U.S. Pat. No. 8,385,640, entitled: “System for controlling dynamic optical illusion images,” by Kurtz et al, both of which are incorporated herein by reference.
This invention pertains to the field of optical illusion images and more particularly to the creation and use of dynamic optical illusion images, whose appearance changes when subjected to an external stimulus.
In considering the human visual system, most people immediately think about the eyes and the constituent parts, such as the cornea, pupil, eye lens, the vitreous humor, and the retina with the rods and cones. However, the human visual system also includes neural processing that enables image interpretation and understanding. Such neural processing generally occurs automatically, without any conscious consideration by the observer. For example, the images formed on the retina of each eye are upside down, but the visual system automatically provides orientational corrections. As another example, the ratios of the number of short or blue cones, the number of medium or green cones, and the number of long or red cones varies widely among individuals, as does the organization of these cones within the retina, whether randomly dispersed or clustered. The green cones are also much more light sensitive than the red or blue cones. Yet, by and large, most people perceive the various color shades in a sufficiently comparable way that we can agree upon the colors present in a scene.
The structure and response attributes of the human visual system impact perception; for example, in cinema, the temporal processing limits allow people to perceive continuous motion from a series of still frame images presented at 30 frames/sec (fps). By comparison, human perception of optical illusions exploit gaps or expectations in our automatic cognitive visual system, such that we can perceive visual content or sensations within the image content which is often not actually present in the content itself. An optical illusion is characterized by the visual perception of image content that differ from objective reality. The information gathered by the eye is processed in the brain to give a perception that does not completely correlate with a physical measurement of the stimulus source or image. Certainly, the perception of optical illusions varies on an individual basis, depending on visual sensitivity and impairments (such as color blindness). The perception of optical illusion can also depend on age and cultural influences. For example, children tend not to perceive the well-known Ebbinghaus illusion as strongly as adults do, while non-Western and rural people, who are less accustomed to interpreting depth and flatness cues from two-dimensional (2D) images, can be less susceptible to the well-known Ponzo illusion. While human observers often respond to optical illusions attentively and with puzzlement or bemusement, some illusions can induce discomfort or nausea in certain observers.
Optical illusions can be characterized to include cognitive optical illusions, in which the eye and brain make unconscious inferences, and physiological illusions, in which the eyes and brain are affected by excessive stimulation of a specific type (e.g., brightness, tilt, color or motion). Examples of cognitive illusions include illusions of perspective, such as the Penrose Stairs or the drawings by M. C. Escher. These images exploit our expectations of how a three-dimensional view is illustrated in two-dimensions, by cleverly misapplying cues of perspective and shading to depict objects that are physically impossible. The Ponzo illusion similarly exploits our expectations that convergent lines are associated with distance; to have two lines intersecting the convergent lines appear of different length, even though their lengths are identical.
While many physiological optical illusions have been created, their perceptive impact on the human visual system has not been fully explained. The article “Uncertainty in visual processes predicts geometrical optical illusions”, by Cornelia Fermüller et al. (Vision Research, Vol. 44, pp. 727-749, 2004) proposes that uncertainty or noise in the human visual system that relates to determining intensity, positions, and orientations of image features introduces systemic errors that cause perceptual anomalies compared to the original image. For example, interpretive biases relative to perception of edge elements and intersection points may explain many geometrical illusions, while biases in interpreting motion or optical flow may cause motion illusions such as the Ouchi illusion (see
There are also physiological optical illusions that specifically exploit attributes of human color perception, such as color and contrast adjacency effects, to fool the eye in seeing colors and grayscale patches incorrectly. The article, “A Brief Classification of Colour Illusions’, by A. Kitaoka (Colour: Design & Creativity, Vol. 5, pp. 1-9, 2010), gives many examples of color perception optical illusions. For example, there are illusions of color or contrast differences that exploit adjacency interactions that are embedded in human lateral signal processing. These illusions reveal perceptual difference in color or contrast perception of an area when adjacent areas have different luminosities or color content. For example, with the Munker-White illusion, the perception of mid-tone neutral (grey) patches is altered by the presence of strong luminance shifts (darker or lighter) in neighboring image content. The Munker illusion illustrates a similar effect on color perception, where the perception of identical color patches is altered by the presence of different adjacent colors near one color patch as compared to another.
While some optical illusions, such as the Ouchi illusion or the Fraser-Wilcox illusions, are motion illusions that have a perceptual impact as black and white or grayscale images, their effects can be enhanced when color is also used. For example, A. Kitaoka has published integrated illusions, such as peripheral drift illusions and the “rotating snakes” illusion, which combines color selection with other illusions, such as the optimized Fraser-Wilcox and the Rotating Ouchi illusion to create illusions that can be more visually compelling than the black and white parent illusions. The paper “The effect of color on the optimized Fraser-Wilcox illusion”, by A. Kitaoka (9th L'OREAL Art and Science of Color Prize, pp. 1-16, 2006) discusses how color and contrast manipulation can change the visual impact of the optimized Fraser-Wilcox illusion, including changing the direction and rate or magnitude of the apparent rotation of the image. The paper “Illusory motion from change over time in the response to contrast and luminance”, by B. Backus et al. (Journal of Vision, Vol. 5, pp. 1055-1069, 2005) proposes that optical illusions of motion are generated when viewing static repeated asymmetric patterns due to fast and slow changes over time in the neuronal representation of contrast or luminance. The impact of other temporal illusions, such as the pulsing vortex illusion, or the Hermann grid and scintillating grid illusions, the latter of which cause the perception of pulsing at the intersections of a white (or light-colored) grid on a black background, can also be altered by changing the pattern of colors and contrast within the illusionary image.
At present, optical illusions are generally available as collections in books or on websites, and their design and physiological basis is discussed in academic papers. In general, optical illusions are primarily used to amuse or entertain viewers, including in art and architecture. With their unusual visual trickery, optical illusions often hold an observer's attention for prolonged time periods, while the observer is both amused and puzzled by the visual effects. Optical illusions are also used as tools in vision research to test or reveal the cognitive or perceptual mechanisms, interactions, or clinical deficiencies of the human visual system.
Otherwise, the human perception of optical illusions has been used for little practical effect, although their selective use as a “reverse Turing test”, has been proposed in the paper “Practical Application of Visual Illusions: errare humanum est” by G. Brelstaff et al (Proc. 2nd Symposium on Applied Perception in Graphics and Visualization, p. 161, 2005). A Turing test is a test of a machine's ability to exhibit intelligent behavior, and a machine passes the test if its function, at least in a limited way, is indistinguishable from that of a human. By comparison, a reverse Turing test is a test to distinguish humans from computers and other forms of artificial or alien intelligence. The one widely used version of a reverse Turing test practiced today, involves the use of a “CAPTCHA”, a “Completely Automated Public Turing test to tell Computers and Humans Apart”, as a visual word recognition challenge-response test. CAPTCHAs are widely used in computing to attempt to ensure that a response is generated by a human rather than a computer. For example, as humans can readily interpret the confusing image content of a CAPTCHA, while computer algorithms have difficulty, humans can gain website access while automated programs are restrained. The Belstraff paper proposes that as humans innately can perceive optical illusions, such as Kitaoka's Rotating Snakes, and machine vision systems cannot, that the human perceptual reaction to static optical illusion images can be used to discriminate the presence of human intelligence. As a variant, it has also been proposed to use text illusions as CAPTCHAs, as human readable steganography, in which smaller case static text is hidden within larger case static text.
Thus, the opportunity exists to present, create, and alter optical illusion images for various practical and previously unforeseen effects. In particular, printed optical illusion images which are dynamic by the use of mutable inks can provide novel functional value.
The present invention represents a printed dynamic optical illusion image printed by a printing device on a print media using a plurality of colorants, wherein one or more of the colorants are appearance mutable colorants having spectral characteristics that can be switched between a first colorant state and a second colorant state by application of an appropriate external stimulus, and wherein one or more mutable portions of the printed dynamic optical illusion image are printed using at least one appearance mutable colorant;
wherein when the mutable portions are in a first appearance state the printed dynamic optical illusion image has a first illusion state, and when the mutable portions are in a second appearance state the printed dynamic optical illusion image has a second illusion state, such that changing the optical illusion image from the first illusion state to the second illusion state affects the perception of an optical illusion by a human observer;
the printed dynamic optical illusion image being controllably switchable between the first and second illusion states by applying the appropriate external stimulus to controllably switch the one or more appearance mutable colorants between their first and second colorant states, thereby switching the mutable portions of the printed dynamic optical illusion image between their corresponding first and second appearance states.
This invention has the advantage that the printed optical illusion image can be controlled to dynamically adjust the visual impact of the optical illusion.
It has the additional advantage that changing the visual impact of the optical illusion can be used to attract the attention of an observer.
It is to be understood that the attached drawings are for purposes of illustrating the concepts of the invention and may not be to scale.
The invention is inclusive of combinations of the embodiments described herein. References to “a particular embodiment” and the like refer to features that are present in at least one embodiment of the invention. Separate references to “an embodiment” or “particular embodiments” or the like do not necessarily refer to the same embodiment or embodiments; however, such embodiments are not mutually exclusive, unless so indicated or as are readily apparent to one of skill in the art. The use of singular or plural in referring to the “method” or “methods” and the like is not limiting. It should be noted that, unless otherwise explicitly noted or required by context, the word “or” is used in this disclosure in a non-exclusive sense.
The present invention involves a form of intelligent printing that provides dynamically-changing printed optical illusion images. Optical illusion images have the characteristic that they are eye catching. Dynamically-changing optical illusion images are even more eye catching. This makes them valuable for applications such as advertising displays and product packaging where the goal is to draw the attention of a potential customer. They can also be useful for many other applications including watermarking, steganography, security, and the study of human perception and cognition.
Within the content of the present invention, a dynamically-changing optical illusion is a printed optical illusion image whose content is dynamically changed as a function of time, either in whole or in part, in response to an appropriate external stimulus. In particular, within an image or document including an optical illusion image, the visual design of the optical illusion image, or part thereof, including color and contrast, is changed to make the perceptual experience for an observer of the optical illusion image more or less effective, or altogether different, or to hide or reveal other image or informational content hidden in or near the optical illusion image.
In one embodiment, the external stimulus that is used to dynamically modify the printed optical illusion image is an optical radiation stimulus that provides illuminating radiation. For example, a dynamically-changing optical illusion image can be included on the packaging for a particular product. The product can then be displayed in a store and a nearby optical radiation source can be modulated, to change the appearance of the optical illusion image with time, thereby attracting the attention of a potential customer to the image and the accompanying product. In general, the visual response of observers to a dynamically-changing optical illusion image can be used to either attract their attention to the images themselves or to accompanying messages, or to distract the observers from other considerations, including accompanying messages.
The present invention will now be described with reference to
In the original version of the static Walter Anthony optical illusion image 400 of
In one exemplary embodiment of the present invention, the optical illusion image 400 is dynamically altered to become a dynamic optical illusion image 410 wherein the image regions 420 and 422 are mutable portions that can take on a plurality of appearance states. The image regions 420 and 422 are printed with appearance mutable colorants having spectral characteristics that can be controllably switched between first colorant states and second colorant states by application of an appropriate external stimulus. For example, when the mutable colorants in the mutable portions are in their first colorant states, the image regions 420 and 422 can take on a highly chromatic appearance (e.g, dark purple and dark green, respectively), corresponding to first appearance states, such that the optical illusion image 400 takes on a first illusion state providing a strong optical illusion effect. Alternately, when the mutable colorants in the image regions 420 and 422 are in their second colorant states, the mutable image regions 420 and 422 take on second appearance states, which can be neutral, less chromatic, or chromatically shifted in appearance, thereby producing a second illusion state of the dynamic optical illusion image 400. In this second illusion state, the optical illusion image 400 can have a weak, or even negligible, optical illusion effect.
In this hierarchy of image mutability, a change in the colorant states of the mutable colorants in one or more mutable portions of a dynamic optical illusion image 400 changes the appearance of the one or more mutable portions (e.g., image regions 420 and 422) from a first appearance state to a second appearance state. This provides a corresponding change in the overall appearance of the dynamic optical illusion image. The different states of the dynamic optical illusion image can be referred to as illusion states. Changing the mutable portions from their first appearance state to their second appearance state provides a corresponding change in the dynamic optical illusion image from the first illusion state to the second illusion state. In many cases, the change in illusion states corresponds to a change in the perceptual impact of the optical illusion. In other instances, the change in the illusion states can correspond to the appearance or disappearance of hidden text, messages, images, or codes within or adjacent to the optical illusion portion of the dynamic optical illusion image (with or without changing the state or perceptual impact of the optical illusion). As another example, a change in the illusion states can also leave a primary optical illusion image intact, but add a secondary illusion effect to the dynamic optical illusion image 400. Changes in the perceptual impact of the optical illusion can also occur in combination with changes in the appearance of hidden content. The changes in illusion states can be either subtle or dramatic. In some cases, the entire dynamic optical illusion image may be a mutable portion such that the entire image area can be changed when the colorant states of the mutable colorants are changed.
In the above example, the spectral absorption characteristics (or likewise, the spectral reflectance characteristics or the spectral transmittance characteristics) of the mutable colorants is controlled between a low-saturation state and a high saturation state. By adjusting the shape or amplitude of the spectral absorption characteristics, it is possible to adjust various color appearance characteristics of the mutable portions of the optical illusion image, such as the hue, saturation or lightness. In some embodiments, the spectral fluorescence characteristics of the mutable colorants can be controlled such that the mutable colorants have more or less fluorescence, or fluoresce with different spectral absorption/emission characteristics. In other embodiments, the mutable portions of the optical illusion image can be controlled to adjust image attributes such as image contrast or image content.
As another variant, rather than controlling the image regions 420 and 422 between first colorant states having a highly chromatic appearance and second colorant states having a neutral appearance, one or both of the image regions 420 and 422 can be controlled between two chromatic colorant states. For example, the image regions 420 can be controlled between a first colorant state and a second green colorant state which matches the green color present in image regions 422. When the image regions 420 are in the second green colorant state, the optical illusion image 400 exhibits a greatly reduced perceptual optical illusion effect relative to the case when the image regions 420 are in the first purple colorant state, similar to the visual effect produces when the image regions 420 and 422 are controlled to have a neutral appearance. For example, it has been found that an intermediate level of the optical illusion effect can be observed if the colorant state for the image regions 420 is controlled to provide a brown colorant state, whereas a strong level of the optical illusion effect can be observed if the colorant state for the image regions 420 is controlled to provide a red colorant state. Therefore, it can be seen that by proper selection of an appropriate pair of colorant states for one or more of the image regions in the optical illusion image 400, it is possible to control the perceptual impact of the optical illusion effect to produce the desired results. Additionally, although the changes to the mutable portions can change image content of a optical illusion portion of a dynamic optical illusion image, such as by changing its perceptual impact, such changes can provide other effects, including providing alternate or secondary optical illusions (such as causing a second optical illusion portion to appear) or altering various appearance attributes of the optical illusion (such as adding an illusionary scintillation effect to an existing optical illusion image) or hiding or revealing hidden text or patterns.
To further illustrate the effect of selectively altering optical illusion images, a cognitive dynamic optical illusion image 410F in the style of M. C. Escher is shown in
In that context,
Accordingly, it is seen that careful adjustment of an image can introduce (or remove) an optical illusion, or can alter the perceptual impact of an optical illusion for an observer. Specifically, portions of an optical illusion image can be adjusted to affect any of its attributes, including but not limited to content, color (hue, saturation or lightness) and contrast to enhance or reduce the illusionary effect. To that end,
When the dynamic optical illusion image 410H is presented on the display 120, the mutable portions can be controlled by dynamically switching back and forth between two different versions of the optical illusion image where the mutable portions have been adjusted appropriately. Alternately, the mutable portions of the image can be adjusted in real time by altering the content of the memory used to store the image data for the dynamic optical illusion image 410H. The display 120 can be used for a user to preview the appearance of the dynamic optical illusion image 410H during the process of designing and optimizing the optical illusion effect, and for example, compare it to the original static optical illusion image 400, to determine if the desired transformation and perceptual effects are being achieved. Preferably, the previewed dynamic optical illusion image 410H is designed to simulate the appearance of a printed dynamic optical illusion image 410G that will be produced by the printer 100, accounting for the spectral characteristics of the mutable and immutable colorants available in the printer.
In the case of printed content, most colorants such as inks, toners, pigments, dyes, or other materials that can be printed onto the print media 110 to provide informational or image content are not dynamic once they have been deposited and cured or dried. Normal colorants have static spectra characteristics, aside from being subject to degradation, such as fade due to UV exposure, or other abuse (such as smearing). Thus, it is particularly difficult to dynamically change printed content.
There are however certain special classes of mutable colorants that can be printed, then controllably stimulated to induce changes in their spectral characteristics. Mutable colorants are chromogenic materials, which are materials that change their color upon application of an appropriate stimulus. Types of mutable colorants include thermochromic colorants, photochromic colorants, and electrochromic colorants. Such colorants can be controllably switched between a first colorant state and a second colorant state by application of an appropriate external stimulus. Thermochromic colorants have spectral characteristics that can be controllably switch by a thermal stimulus. Photochromic colorants have spectral characteristics that can be controllably switch by an optical radiation stimulus. Likewise, electrochromic colorants can reversibly change between coloration states and transparency (changed spectral characteristics) when subjected to an electrical stimulus such as an applied voltage. However, thermochromic and photochromic colorants have the advantage that they enable a dynamic response without requiring the presence of imbedded or printed electronics. There are a wide variety of thermochromic and photochromic colorants that are commercially available, including both reversible colorants that can be cycled back and forth between the different colorant states, and irreversible colorants that can only undergo a single state change (e.g., from clear to colored).
It is noted that other forms of mutable colorants, such as fluorescent colorants, photoluminous (glow-in-the dark) colorants, piezochromic (pressure sensitive) colorants, hydrochromic (moisture sensitive) colorants, or halochromic (pH sensitive) colorants, can also be used for various embodiments. In some applications, the mutable colorants can be mixed or over-coated with other colorants or protective materials.
Thermochromic inks that can be used for mutable colorants in various embodiments of the present invention are commercially available from many companies, including Chromatic Technologies International of Colorado Springs, Colo., LCR Hallcrest of Glenview, Ill., and Printcolor Screen Ltd. of Berikon, Switzerland. Typically, thermochromic inks have a first colorant state producing a first visible color at a nominal temperature level. Then when the thermochromic inks are heated (or cooled) by application of an appropriate thermal stimulus their spectral characteristics change to a second colorant state producing a second visible color. In some cases, one of the colorant states may be a clear (i.e., invisible) colorant state where only a minimal amount of the incident light is absorbed by the colorant. Some common types of thermochromic dyes are based on mixtures of leuco dyes with suitable other chemicals that display a color change (usually between the colorless leuco form and the colored form) in dependence on temperature.
As an example, LCR Hallcrest offers a range of mixed temperature thermochromic inks that respond under different temperature conditions. These include cold activated thermochromic inks which undergo a color change when cooled (progress from clear to colored at or below 15° C.), thermochromic inks that change color at body temperatures (progress from colored to clear at 31° C.), and thermochromic inks that change color in response to high temperatures (progress from colored to clear at 47° C.).
Photochromic inks are also available from many companies, including Chromatic Technologies International and LCR Hallcrest. Typically photochromic inks are invisible (clear or colorless) or lightly colored (nearly colorless or pale) until illuminated with light (typically UV or short wavelength blue), and then become fully colored colors which are much more saturated colors, including pastel or fully saturated colors, once stimulated with the appropriate light dosage (intensity, wavelength or spectrum, and time).
Photochromic and thermochromic color changes are distinct from fluorescence induced color changes, as the color changes do not require a continuous stimulus, but are metastable and can linger over extended periods of time (e.g., minutes or hours). Response times vary, but the changes can be relatively quick (within seconds or less). Some photochromic dyes have been experimentally used as optical switches with switching times of ˜1 μs. For example, some LCR Hallcrest photochromic inks become fully colored colors that are intensely colored after only 15 seconds exposure to direct sunshine and then return to clear after about 5 minutes indoors. Photochromic inks can fade to clear at various rates. For example, the LCR Hallcrest orange and yellow inks are relatively slow to return back from their colored state to their clear state. The prolonged or metastable color states can be particularly advantageous for the present invention, because typically humans perceive optical illusion images more slowly than they do normal image content. Additionally, for many applications, such as smart packaging, the temporal pattern of an occasional stimulus and a prolonged response can be advantageous. The ink lifetime can be limited because of the degradation from solar UV exposure, but UV protected inks are becoming available.
While thermochromic and photochromic inks often produce pastel or unsaturated colors, they still span a range of hues, as for example, thermochromic inks can change from colorless, or near colorless, states to fully colored colors that are red, orange, green, blue, purple, magenta, or other colors, depending on the formulation. Photochromic inks can experience similar color changes. The color gamut which can be achieved can be expanded by printing these mutable inks in combination with normal non-mutable inks Published papers, such as “Chromatic Properties of Thermochromic Inks”, by L. Johansson (TAGA Proceedings, 2006) and “Thermochromic Inks—Dynamic Colour Possibilities”, by R. Kulcar et al., (Proc. CREATE Conference, pp. 202-206, 2010), provide some detail about the color changes obtained with these types of inks during screen printing experiments.
Examples of electrochromic colorants that could be used in accordance with the present invention would include NanoChromics inks available from NTERA of Philadelphia, Pa. These inks combine nanocrystalline and color change materials for applications such as smart packaging and flexible displays.
The color changes shown in
As another example,
Thus, it can be seen that chromogenic materials or mutable colorants, including thermochromic and photochromic inks, can produce a wide range of controllable color changes when used individually. The range of color change can be expanded when these inks are used in combination, including combining multiple types of thermochromic or photochromic inks (either reversible or irreversible), or combining photochromic inks with thermochromic inks, or combining mutable inks or with normal non-mutable inks. These abilities can be used for the present purpose to create and controllably alter mutable portions of dynamic optical illusion images 410 between multiple appearance states, thereby providing one or more illusion states, such that the perceptual impact of an optical illusion image 400 can be changed for an observer. Depending on the properties of the respective inks, combination printing can be achieved by over-coating or patterning, such as with halftone or continuous tone dots. Other properties, such as dot gain differences or transparency, can determine which inks are preferentially printed first, and which are printed later, and are nearer the top surface of the printed surface. It should be understood that the term “ink”, for the purposes of the present invention, is a pigmented liquid or paste used especially for writing or printing, which includes a colorant, a solvent, a vehicle and additives, as appropriate. Mutable inks are often micro-encapsulated with a color former (dye), a color developer within the microcapsules, and binders between them. Other types of mutable colorants can also be used in accordance with the present invention, such as mutable toners for use in electrophotographic printing systems.
Returning to a discussion of
The printer 100 shown in
As depicted, the exemplary printer 160 has 4 print stations 170, although it may have more. In this example, the first three print stations 170c, 170m, and 170y, apply cyan, magenta, and yellow inks, respectively, and the fourth print station 170M applies a mutable ink. Alternately, these print stations can deposit different colored inks, such as black, red, green, or blue inks. In some embodiments, one or more additional print stations can be added to apply additional inks such as a black ink or another mutable ink. Mutable ink is applied by one or more print stations 170M, which can apply any type of mutable ink, including the thermochromic or photochromic inks that were discussed earlier.
In other embodiments, the print head 175 can be a drop-on-demand print head which only produces drops as they are needed. In some configurations of the printer 160 in
Returning to a discussion of
As another embodiment of the present invention, a dynamic optical illusion image 410A is shown in
In another embodiment, the central mutable portion 430 of the dynamic optical illusion image 410A in
In other embodiments, the hidden pattern 450 can be a mutable pattern embedded in the dynamic optical illusion image 410D. For example, most of the dynamic optical illusion image 410D can be static (i.e., printed with normal immutable inks) or partially static (i.e., printed with mixtures of immutable inks and mutable inks), such that a perceptually impactful optical illusion image is present at all times. In this case, the hidden pattern 450 is printed predominantly with mutable inks that can experience dramatic color changes in response to an appropriate external stimulus. As a result, the mutable portion 430 of the dynamic optical illusion image 410D of
In some embodiments, the dynamic optical illusion image 410E can include some image regions that use mutable colorants (or combinations of mutable and immutable colorants) and are subject to modification using a patterned stimulus 440, and other image areas that use only immutable colorants and are therefore unaffected by the patterned stimulus 440. In this example, the stimulus can be applied in a spatially variant manner to selectively change the image content in image regions that use the mutable colorants, while leaving the image areas that use only immutable colorants unaffected. For example, the image regions that use the mutable colorants can be printed with photochromic inks that transition from colorless (or pale) color states to colored states when a patterned light stimulus is applied to activate the inks.
Various combinations of structured and unstructured stimuli are also possible. For example, a first stimulus (e.g., light of a first spectral band) can be uniformly applied to the whole image to cause changes in large image areas, while a second stimulus (e.g., light of a second spectral band) can be applied selectively to cause changes in particular image areas.
Returning to a discussion of
When the photochromic mutable ink is in its unactivated clear state, the mutable portion 520 will have a yellow color matching the color of the gazebo structure 510. In this case, the dynamic optical illusion image 410F has the appearance shown in
In some embodiments, the printed dynamic optical illusion image 410G is viewed by the observer as part of a visual experiment, or a marketing study. In this case it is useful for an image capture device 230 such as a digital camera to be included in the viewing environment. This enables the response of the observer 210 to be monitored as the illusion state of the printed dynamic optical illusion image 410G is varied. This monitoring can be conducted to determine emotional or physiological responses to the optical illusion images or accompanying messages (including advertising), or to test or reveal responses related to vision or cognitive research.
In a preferred embodiment, the stimulating radiation source 222 provides an optical radiation stimulus 220 that has little or no visibility to the observer 210. In various embodiments, the optical radiation stimulus 220 can be UV radiation (for example having a bandwidth of 300-380 nm or 360-380 nm), low wavelength blue light (for example having a wavelength of ˜420 nm), or infrared radiation (for example having a bandwidth of 800-960 nm) as is appropriate for safely activating or deactivating the printed dynamic optical illusion image 410G. In other embodiments, the stimulating radiation source 222 can provide high intensity visible light 227, or narrow bandwidth laser light, as the optical radiation stimulus 220.
In some embodiments, the printed dynamic optical illusion image 410G can be made using mutable UV responsive inks that are essentially sensitive only to short wavelength UV radiation having wavelengths<300 nm. In this case the optical radiation stimulus 220 should include optical radiation at the corresponding wavelengths. This has the useful advantage that the mutable inks will not be activated by the UV radiation in atmospheric-filtered solar radiation.
Although most photochromic colorants or materials are stimulated to exposure by UV light, versions sensitive to IR light have been reported in the literature. In one embodiment of the present invention, photochromic inks which have at least one stimulative bandwidth that resides between ˜1400-1500 nm are used and activated by the appropriate IR optical radiation stimulus 220. These inks have the advantage that they cannot be accidently stimulated by daylight, because the spectral profile of atmospherically filtered solar radiation lacks significant light in that spectral band. Alternately, other IR spectral bands, spanning ˜1150-1200 nm, at ˜980 nm, and at ˜790 nm can be used, although the atmospheric filtering is progressively less effective as the stimulating wavelength drops towards the visible wavelength range. Of course, there are also applications, including artwork or environmental sensing, where it can be advantageous to use photochromic inks that respond to ambient light, including visible light, daylight, or general room lights.
As was discussed with reference to
The mutable portions of the printed dynamic optical illusion image 410G can also be activated by other types of external stimulus or by combinations of different types of stimuli, which can include a pressure stimulus (e.g., provided by a touch or by sound waves), or a thermal stimulus from a heat source. If thermal stimulation is to be applied broadly, the stimulating radiation source 222 can be used as a physically distant heat source that provides a heat stimulus 228. In some embodiments, a thermal stimulus can be applied using other type of heat sources (e.g., using a resistive heater array) positioned closer to the printed item 200. For example, the printed item 200 can be positioned on top of a surface that contains the controlled heat source. This approach enables the provision of a patterned thermal stimulus. For environmental sensing type applications, the printed dynamic illusion image 410 can respond to a thermal stimulus according to ambient heat levels. The thermal stimulus can be specified in terms of the flux, flux density, energy, or energy density delivered.
In some embodiments, the printed dynamic optical illusion image 410G can be used to attract the attention of a consumer 212 in a retail viewing environment 217 as shown in
A controller 260 is used to provide a control signal to control the stimulating radiation source 222 in order to provide the appropriate stimulus as required to change the appearance states of the mutable portions, thereby changing the illusion states of the printed dynamic optical illusion images 410G. In particular, controller 260 controls the dosage of the external stimulus applied to the dynamic optical illusion images 410G in order to cause a change in the colorant states of the mutable colorants. The controlled parameters can include light dosage (e.g., intensity, exposure time or modulation, spectral bandwidth, direction or patterning) or heat dosage (e.g., intensity, exposure time, direction, or modulation), where the dosages and dosage tolerances can be appropriate to provide endpoint colors or intermediate colors. In some embodiments, the controller 260 controls the stimulating radiation source 222 to automatically switch the printed dynamic optical illusion images 410G between first and second illusion states according to a predefined timing pattern. For example, the illusion states can be switched every 30 seconds. In some embodiments, the controller 260 controls the stimulating radiation source 222 to switch the printed dynamic optical illusion images 410G between the different states in response to user activation of a user interface control such as a button, a switch, a pointing device (e.g., a mouse or a trackball), or a touch sensitive display.
The inclusion of printed dynamic optical illusion images 410G in the product packaging 240 can take different forms in various embodiments. For example, the printed dynamic optical illusion images 410G can be printed on a box or other container used to enclose the retail product, it can be printed onto a surface of the retail product itself, it can be included on a printed label that is attached to or inserted into the product packaging 240, or it can be included in any type of printed product packaging known in the art.
The inclusion of the printed dynamic optical illusion images 410G in the advertisement display 250 can also take different forms in various embodiments. For example, printed dynamic optical illusion images 410G can be included in posters (e.g., movie posters), retail end-cap displays, store shelf displays, signage, an advertising brochure, an advertisement in a printed publication (e.g., a magazine or a newspaper), or any other type of advertisement display 250 known in the art.
The retail display also includes a stimulating radiation source 222 for providing the optical radiation stimulus 220 used for controllably switching the illusion state of the printed dynamic optical illusion images 410G. The stimulating radiation source 222 can be controlled to switch between illusion states on a regular interval in order to attract the attention of the consumer 212 in order to increase the likelihood that a product is purchased. In other embodiments, different forms of external stimuli can also be incorporated into the retail viewing environment, such as thermal heat sources.
The portrayal of dynamic optical illusion images also has other applications. For example, as the illusion state of a dynamic optical illusion image 410 is changed, a hidden pattern 450 can appear, including being imbedded or contour following, as shown in
Alternately, the observer can provide an input about the visual qualities or perceptual impact of the optical illusion(s) present in one or more states of a dynamic optical illusion image, or a series of such images, as the illusion states of the image(s) change. Exemplary questions can include: “In what portion of an image is an optical illusion image present?” or “In what direction does the optical illusion image appear to move or rotate?” or “Does the image appear to be static, pulsing, moving, rotating, or scintillating?”
The two approaches, using hidden patterns 450 embedded in a dynamic optical illusion image, and asking questions regarding illusion perception, can also be used in combination for a more difficult reverse Turing test. As differences in visual perception exist among humans (e.g., color blindness), the choice of illusions used can be tailored to different circumstances. By comparison, U.S. Pat. No. 7,929,805 by Wang et al., entitled “Image-based CAPTCHA generation system,” provides for an image-based CAPTCHA generation system, but it is reliant on distorting images to hide the human decipherable message, rather than using optical illusions to do so.
Dynamic optical illusion images 410 formed in accordance with the present invention can also be used for a variety of other purpose. For example, they can be used for applications such as security, stenography, watermarking, cognitive and visual testing, cultural or consumer research, interactive clothing or textiles and environmental sensing. They can also be used for entertainment applications, as in puzzles, games, artwork and novelty books.
As discussed previously, some optical illusion images 400, including some of the physiological variety, require color image content in order for the optical illusion to be visible. In other cases, even if the optical illusion may be visible for grayscale versions of the optical illusion image, the visual effect of the optical illusion is strongly enhanced by the use of appropriate colors. Other optical illusions do not rely on the use of color, and will have a substantial visual impact, even when they are printed in black and white. For example,
As a further example, the optical illusion image 400 of
The second illusion state 448 of the dynamic illusion image 410I of
Where
From the prior discussions, it is clear that optical illusion images cause perceptual impact by revealing or exploring different attributes of the human visual system. The presence or absence of color impacts the effectiveness of some illusions. The spatial frequencies of the image details, such as the tile pattern in the Ouchi illusion of
In some embodiments, the dynamic optical illusion images 410 are formed using irreversible mutable colorants that can only undergo a single state change (e.g., from clear to colored). In this case, the mutable colorants therein can be subjected to an external stimulus (such as heat or light) just once to induce changes in image content. In other embodiments, the dynamic optical illusion images are formed using reversible mutable colorants that can be repeatedly cycled back and forth between the different colorant states multiple times in succession.
In some embodiments the amount of the stimulus that is applied to the mutable inks can be used to control the amount of color change that is produced. In this way it is possible to achieve a range of colorant states providing intermediate colors 360, as suggested in
For many mutable inks, the color change response time is a few seconds or less, with some photochromic inks having response times as small as a microsecond. Therefore, an applied external stimulus to the printed content can potentially be modulated at video rates (˜30 frames/sec) or faster. However, if different optical illusions associated with the individual images or frames are to be perceived by an observer, the modulation rate needs to be reduced, likely to several seconds per frame or more. In general, the perception of optical illusions requires some concentration, during which an observer perceives the image content itself and then the physiological illusionary effect or cognitive illusionary puzzlement. This process typically takes at least several seconds or longer. Therefore the temporal cycling between image states should generally include a prolonged image retention time (of many seconds per image, if not minutes or longer) before changing the dynamic optical illusion image. As many color mutable inks are metastable, and can retain their color changes for minutes or hours once stimulated, this result is easily achievable. Therefore, the dosage specification for an external stimulus can include temporal modulation parameters, including exposure switching times, image retention times, and duty cycles in the case or cyclic exposures.
It should be understood that the mutable inks used to exercise the inventive method for creating and using dynamic optical illusion images can be advantaged if they have other properties in addition to those previously discussed. As an example, for some applications, it can be desirable to allow printed content including dynamic optical illusion images to change appearance for awhile, but then to have this function permanently disabled, rendering the ink permanently colored or colorless. For example, UV radiation can be applied to many chemicals or mixtures, including some photochromic or thermochromic inks, to break chemical bonds so that color changes are no longer possible. In the case of photochromic inks, this disabling light dosage (wavelength, intensity, and time) needs to be sufficiently distinct from the activating light dosages that accidental damage is unlikely to occur. As another example, the increased availability of photochromic or thermochromic inks with reduced viscosities can better enable inkjet printing of these inks. Additionally, for some applications, having photochromic inks that transition from colored to colorless states when the light stimulus is applied can be useful. Similarly, irreversible thermochromic inks which provide multiple temperature dependent color states can be useful.
In some embodiments, the dynamic optical illusion image 710 can be designed starting from an original static optical illusion image 702. One or more image regions of the static optical illusion image 702 are then designated to be the mutable portions. First and second appearance states for the mutable portions are then defined to provide different appearances for the optical illusion, corresponding to the first and second illusion states for the dynamic optical illusion image 710.
As has been described earlier, in some embodiments a hidden pattern 705 can be provided for inclusion in the dynamic optical illusion image 710. The hidden pattern 705 can be a human readable pattern, including text, or a machine readable pattern that is visible in at least one of the illusion or appearance states. Changes between appearance states can also cause changes in the appearance of hidden text or codes within or adjacent to the optical illusion portion of the dynamic optical illusion image 710, with or without causing changes in the perceptual impact of the optical illusion. During the design dynamic optical illusion step 707, the expected appearances of the dynamic optical illusion image 710, including any hidden patterns 705, for two or more illusion states, can be previewed using a softcopy display 120 (
The design dynamic optical illusion image step 707 produces a specification for the dynamic optical illusion image 710, which is then used in a print optical illusion image step 720, to print the dynamic optical illusion image 707 on a printer and thus provide a printed optical illusion image 725. The printed optical illusion image 725 is printed according to a determined print specification using a plurality of colorants, including at least one appearance mutable colorants having spectral characteristics can be controllably switched between a first colorant state and a second colorant state by application of an appropriate external stimulus. The specified appearance states of the mutable portions of the printed dynamic optical illusion image 725 are achieved by appropriate selection of the colorant levels for the plurality of mutable colorants, as well as any immutable colorants. The print specification specifies the colorant levels as a function of position for the mutable and immutable colorants, which can be optimized according to the spectral characteristics and other properties of the mutable and immutable colorants and the printing devices used to produce the printed dynamic optical illusion image 725. The colorant levels can be determined via look-up tables, algorithms or other means to provide an appropriate print specification that will provide the desired illusion states for the printed dynamic optical illusion image 725. Alternately, the printing device can receive the specification for the dynamic optical illusion image 710 and can apply corrections, via look up tables, algorithms, or other means, to determine the colorant levels. In either case, the goal is to achieve appropriate image quality attributes, including color matches, color gamut, color accuracy, the presence of intermediate colors, metamerism, resolution, or contrast for the printed optical illusion image 725 in activated and inactivated states.
An apply external stimulus step 730 is used to apply an appropriate external stimulus to the printed optical illusion image 725 to produce a modified optical illusion image 735 having a different illusion state. In some embodiments, the apply external stimulus step 730 can be replied repeatedly to modify the illusion state of the printed optical illusion image 725 a plurality of times.
In some embodiments, and optional disable optical illusion image step 740 can be applied, for example using an appropriate UV radiation dosage or a heat or chemical treatment, to prevent further modulation of the printed dynamic optical illusion image 725 between illusion states or appearance states.
The present invention, relative to creating and using dynamic optical illusion images 410, has been explained using a limited set of examples, including a peripheral drift optical illusion (
As the prior discussion has suggested, optical illusion categories are very broad, and there are many demonstrated optical illusions within any particular category. As an example, in the paper “Perceiving the present and a systematization of illusions” by Changizi et al. (Cognitive Science, Vol. 32, pp. 459-503, 2008), perceptual motion and size illusions were parsed into 28 classes or groupings. It should be understood that the inventive method for creating and using dynamic optical illusion images 410 includes modifying optical illusion images 400 selected from a group including, but not limited to, geometrical or spiral illusions, anomalous motion illusions, rotational illusions, color change illusions, peripheral drift illusions, positive after image blurring illusions, scintillation and grid illusions, convection, contraction and expansion illusions, contrast polarity illusions, perspective illusions, or variations and combinations thereof. While these illusions cannot all be depicted here, the method of the present invention can be applied to many optical illusions that are known in the art, which include, but are not limited to the Hering illusion, the Orbison illusion, the Delboeuf illusion, the Müller-Lyer illusion, the Wundt Illusion, the Ehrenstein illusion, the Hermann grid Illusion, the scintillating grid illusion, the pulsing vortex illusion, the Fraser-Wilcox illusion, the Ouchi illusion, the peripheral drift illusion, the flowing leaves illusion, the waves illusion, the moving bulge illusion, the Café Wall illusion, the rotating snakes illusion, the Kanizsa Triangle illusion, the Munker-White Illusion, Adelson's checker shadow illusion, comparative color illusions, the Zollner Illusion, the Ponzo illusion, or impossible figures such as the Penrose Triangle or the Penrose Stairs, or variations and combinations thereof.
It is noted that U.S. Pat. No. 7,136,522 by S. Harrington et al. entitled “Systems for spectral multiplexing of source images to provide a composite image, for rendering the composite image, and for spectral demultiplexing of the composite image to animate recovered source images,” provides an alternative method of intelligent printing that provides a composite image having a multitude of source images printed within it using a plurality of colorants or inks With this approach, the individual source images can be rendered distinguishable when the composite image is subjected to illumination by narrow band illuminants. However, the inks are normal process inks rather than chromogenic or mutable inks. The printed composite image can appear different to an observer based on the spectral absorption and reflection of the inks with respect to the illuminating light spectrum, in order to reveal different hidden source images. The rendered composite image may be subjected to a varying illumination, including by a switched sequence of individually activated, differing illuminants to cause a corresponding sequence of source images to be recovered in rapid succession. Harrington does not provide that the either the composite image or source images are optical illusion images.
The invention has been described in detail with particular reference to certain preferred embodiments thereof, but it will be understood that variations and modifications can be effected within the scope of the invention. It is emphasized that the apparatus or methods described herein can be embodied in a number of different types of systems, using a wide variety of types of supporting hardware and software. It should also be noted that drawings are not drawn to scale, but are illustrative of key components and principles used in these embodiments.
The invention has been described in detail with particular reference to certain preferred embodiments thereof, but it will be understood that variations and modifications can be effected within the spirit and scope of the invention.
Kurtz, Andrew F., Kane, Paul James
Patent | Priority | Assignee | Title |
Patent | Priority | Assignee | Title |
4034494, | Oct 02 1975 | Holiday light | |
5407711, | Nov 30 1993 | WELLS FARGO BUSINESS CREDIT, INC | Display with enhanced highlights |
5741578, | Jun 14 1994 | Artwork comprising overlying images | |
6357799, | Feb 09 1999 | Etsuo Shibata | Printed matter |
7002532, | May 21 1998 | Nippon Telegraph & Telephone Corporation | Three-dimensional representation method and an apparatus thereof |
7136522, | Oct 09 2002 | Xerox Corporation | Systems for spectral multiplexing of source images to provide a composite image, for rendering the composite image, and for spectral demultiplexing of the composite image to animate recovered source images |
7674747, | Jul 15 2005 | Edward L., Long | Appearance changing decorations on fabric using disappearing ink |
7876481, | Jul 08 1999 | Viavi Solutions Inc | Patterned optical structures with enhanced security feature |
7880943, | Jul 08 1999 | Viavi Solutions Inc | Patterned optical structures with enhanced security feature |
7939806, | Aug 05 2008 | General Electric Company | Nuclear medicine imaging system having attenuation correction |
8385640, | Jul 13 2011 | Eastman Kodak Company | System for controlling dynamic optical illusion images |
20030067423, | |||
20030103905, | |||
20050106367, | |||
20050181160, | |||
20050219626, | |||
20060016356, | |||
20060097515, | |||
20080024725, | |||
20080024847, | |||
20080310869, | |||
20090200792, | |||
20100295755, | |||
20120074682, | |||
20130016409, | |||
20130016415, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Jul 12 2011 | KURTZ, ANDREW F | Eastman Kodak | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 026583 | /0851 | |
Jul 12 2011 | KANE, PAUL JAMES | Eastman Kodak | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 026583 | /0851 | |
Jul 13 2011 | Eastman Kodak Company | (assignment on the face of the patent) | / | |||
Feb 15 2012 | PAKON, INC | CITICORP NORTH AMERICA, INC , AS AGENT | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 028201 | /0420 | |
Feb 15 2012 | Eastman Kodak Company | CITICORP NORTH AMERICA, INC , AS AGENT | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 028201 | /0420 | |
Mar 22 2013 | Eastman Kodak Company | WILMINGTON TRUST, NATIONAL ASSOCIATION, AS AGENT | PATENT SECURITY AGREEMENT | 030122 | /0235 | |
Mar 22 2013 | PAKON, INC | WILMINGTON TRUST, NATIONAL ASSOCIATION, AS AGENT | PATENT SECURITY AGREEMENT | 030122 | /0235 | |
Sep 03 2013 | NPEC INC | BANK OF AMERICA N A , AS AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT ABL | 031162 | /0117 | |
Sep 03 2013 | NPEC INC | BARCLAYS BANK PLC, AS ADMINISTRATIVE AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT SECOND LIEN | 031159 | /0001 | |
Sep 03 2013 | KODAK PHILIPPINES, LTD | BARCLAYS BANK PLC, AS ADMINISTRATIVE AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT SECOND LIEN | 031159 | /0001 | |
Sep 03 2013 | QUALEX INC | BARCLAYS BANK PLC, AS ADMINISTRATIVE AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT SECOND LIEN | 031159 | /0001 | |
Sep 03 2013 | PAKON, INC | BARCLAYS BANK PLC, AS ADMINISTRATIVE AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT SECOND LIEN | 031159 | /0001 | |
Sep 03 2013 | LASER-PACIFIC MEDIA CORPORATION | BARCLAYS BANK PLC, AS ADMINISTRATIVE AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT SECOND LIEN | 031159 | /0001 | |
Sep 03 2013 | KODAK REALTY, INC | BARCLAYS BANK PLC, AS ADMINISTRATIVE AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT SECOND LIEN | 031159 | /0001 | |
Sep 03 2013 | KODAK PORTUGUESA LIMITED | BARCLAYS BANK PLC, AS ADMINISTRATIVE AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT SECOND LIEN | 031159 | /0001 | |
Sep 03 2013 | KODAK IMAGING NETWORK, INC | BARCLAYS BANK PLC, AS ADMINISTRATIVE AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT SECOND LIEN | 031159 | /0001 | |
Sep 03 2013 | KODAK AMERICAS, LTD | BARCLAYS BANK PLC, AS ADMINISTRATIVE AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT SECOND LIEN | 031159 | /0001 | |
Sep 03 2013 | KODAK NEAR EAST , INC | BARCLAYS BANK PLC, AS ADMINISTRATIVE AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT SECOND LIEN | 031159 | /0001 | |
Sep 03 2013 | FPC INC | BARCLAYS BANK PLC, AS ADMINISTRATIVE AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT SECOND LIEN | 031159 | /0001 | |
Sep 03 2013 | FAR EAST DEVELOPMENT LTD | BARCLAYS BANK PLC, AS ADMINISTRATIVE AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT SECOND LIEN | 031159 | /0001 | |
Sep 03 2013 | Eastman Kodak Company | BARCLAYS BANK PLC, AS ADMINISTRATIVE AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT SECOND LIEN | 031159 | /0001 | |
Sep 03 2013 | CREO MANUFACTURING AMERICA LLC | BARCLAYS BANK PLC, AS ADMINISTRATIVE AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT SECOND LIEN | 031159 | /0001 | |
Sep 03 2013 | KODAK AVIATION LEASING LLC | BARCLAYS BANK PLC, AS ADMINISTRATIVE AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT SECOND LIEN | 031159 | /0001 | |
Sep 03 2013 | Eastman Kodak Company | BANK OF AMERICA N A , AS AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT ABL | 031162 | /0117 | |
Sep 03 2013 | KODAK PHILIPPINES, LTD | BANK OF AMERICA N A , AS AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT ABL | 031162 | /0117 | |
Sep 03 2013 | QUALEX INC | BANK OF AMERICA N A , AS AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT ABL | 031162 | /0117 | |
Sep 03 2013 | CREO MANUFACTURING AMERICA LLC | BANK OF AMERICA N A , AS AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT ABL | 031162 | /0117 | |
Sep 03 2013 | PAKON, INC | BANK OF AMERICA N A , AS AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT ABL | 031162 | /0117 | |
Sep 03 2013 | KODAK AVIATION LEASING LLC | BANK OF AMERICA N A , AS AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT ABL | 031162 | /0117 | |
Sep 03 2013 | KODAK REALTY, INC | BANK OF AMERICA N A , AS AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT ABL | 031162 | /0117 | |
Sep 03 2013 | KODAK PORTUGUESA LIMITED | BANK OF AMERICA N A , AS AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT ABL | 031162 | /0117 | |
Sep 03 2013 | KODAK IMAGING NETWORK, INC | BANK OF AMERICA N A , AS AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT ABL | 031162 | /0117 | |
Sep 03 2013 | KODAK AMERICAS, LTD | BANK OF AMERICA N A , AS AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT ABL | 031162 | /0117 | |
Sep 03 2013 | KODAK NEAR EAST , INC | BANK OF AMERICA N A , AS AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT ABL | 031162 | /0117 | |
Sep 03 2013 | FPC INC | BANK OF AMERICA N A , AS AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT ABL | 031162 | /0117 | |
Sep 03 2013 | LASER-PACIFIC MEDIA CORPORATION | BANK OF AMERICA N A , AS AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT ABL | 031162 | /0117 | |
Sep 03 2013 | FAR EAST DEVELOPMENT LTD | BANK OF AMERICA N A , AS AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT ABL | 031162 | /0117 | |
Sep 03 2013 | KODAK AMERICAS, LTD | JPMORGAN CHASE BANK, N A , AS ADMINISTRATIVE | INTELLECTUAL PROPERTY SECURITY AGREEMENT FIRST LIEN | 031158 | /0001 | |
Sep 03 2013 | KODAK AVIATION LEASING LLC | JPMORGAN CHASE BANK, N A , AS ADMINISTRATIVE | INTELLECTUAL PROPERTY SECURITY AGREEMENT FIRST LIEN | 031158 | /0001 | |
Sep 03 2013 | CREO MANUFACTURING AMERICA LLC | JPMORGAN CHASE BANK, N A , AS ADMINISTRATIVE | INTELLECTUAL PROPERTY SECURITY AGREEMENT FIRST LIEN | 031158 | /0001 | |
Sep 03 2013 | CITICORP NORTH AMERICA, INC , AS SENIOR DIP AGENT | Eastman Kodak Company | RELEASE OF SECURITY INTEREST IN PATENTS | 031157 | /0451 | |
Sep 03 2013 | WILMINGTON TRUST, NATIONAL ASSOCIATION, AS JUNIOR DIP AGENT | Eastman Kodak Company | RELEASE OF SECURITY INTEREST IN PATENTS | 031157 | /0451 | |
Sep 03 2013 | CITICORP NORTH AMERICA, INC , AS SENIOR DIP AGENT | PAKON, INC | RELEASE OF SECURITY INTEREST IN PATENTS | 031157 | /0451 | |
Sep 03 2013 | WILMINGTON TRUST, NATIONAL ASSOCIATION, AS JUNIOR DIP AGENT | PAKON, INC | RELEASE OF SECURITY INTEREST IN PATENTS | 031157 | /0451 | |
Sep 03 2013 | Eastman Kodak Company | JPMORGAN CHASE BANK, N A , AS ADMINISTRATIVE | INTELLECTUAL PROPERTY SECURITY AGREEMENT FIRST LIEN | 031158 | /0001 | |
Sep 03 2013 | FAR EAST DEVELOPMENT LTD | JPMORGAN CHASE BANK, N A , AS ADMINISTRATIVE | INTELLECTUAL PROPERTY SECURITY AGREEMENT FIRST LIEN | 031158 | /0001 | |
Sep 03 2013 | FPC INC | JPMORGAN CHASE BANK, N A , AS ADMINISTRATIVE | INTELLECTUAL PROPERTY SECURITY AGREEMENT FIRST LIEN | 031158 | /0001 | |
Sep 03 2013 | KODAK NEAR EAST , INC | JPMORGAN CHASE BANK, N A , AS ADMINISTRATIVE | INTELLECTUAL PROPERTY SECURITY AGREEMENT FIRST LIEN | 031158 | /0001 | |
Sep 03 2013 | KODAK IMAGING NETWORK, INC | JPMORGAN CHASE BANK, N A , AS ADMINISTRATIVE | INTELLECTUAL PROPERTY SECURITY AGREEMENT FIRST LIEN | 031158 | /0001 | |
Sep 03 2013 | NPEC INC | JPMORGAN CHASE BANK, N A , AS ADMINISTRATIVE | INTELLECTUAL PROPERTY SECURITY AGREEMENT FIRST LIEN | 031158 | /0001 | |
Sep 03 2013 | KODAK PHILIPPINES, LTD | JPMORGAN CHASE BANK, N A , AS ADMINISTRATIVE | INTELLECTUAL PROPERTY SECURITY AGREEMENT FIRST LIEN | 031158 | /0001 | |
Sep 03 2013 | QUALEX INC | JPMORGAN CHASE BANK, N A , AS ADMINISTRATIVE | INTELLECTUAL PROPERTY SECURITY AGREEMENT FIRST LIEN | 031158 | /0001 | |
Sep 03 2013 | PAKON, INC | JPMORGAN CHASE BANK, N A , AS ADMINISTRATIVE | INTELLECTUAL PROPERTY SECURITY AGREEMENT FIRST LIEN | 031158 | /0001 | |
Sep 03 2013 | LASER-PACIFIC MEDIA CORPORATION | JPMORGAN CHASE BANK, N A , AS ADMINISTRATIVE | INTELLECTUAL PROPERTY SECURITY AGREEMENT FIRST LIEN | 031158 | /0001 | |
Sep 03 2013 | KODAK REALTY, INC | JPMORGAN CHASE BANK, N A , AS ADMINISTRATIVE | INTELLECTUAL PROPERTY SECURITY AGREEMENT FIRST LIEN | 031158 | /0001 | |
Sep 03 2013 | KODAK PORTUGUESA LIMITED | JPMORGAN CHASE BANK, N A , AS ADMINISTRATIVE | INTELLECTUAL PROPERTY SECURITY AGREEMENT FIRST LIEN | 031158 | /0001 | |
Feb 02 2017 | BARCLAYS BANK PLC | FAR EAST DEVELOPMENT LTD | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 052773 | /0001 | |
Feb 02 2017 | BARCLAYS BANK PLC | FPC INC | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 052773 | /0001 | |
Feb 02 2017 | BARCLAYS BANK PLC | KODAK NEAR EAST INC | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 052773 | /0001 | |
Feb 02 2017 | BARCLAYS BANK PLC | KODAK AMERICAS LTD | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 052773 | /0001 | |
Feb 02 2017 | BARCLAYS BANK PLC | KODAK REALTY INC | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 052773 | /0001 | |
Feb 02 2017 | BARCLAYS BANK PLC | QUALEX INC | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 052773 | /0001 | |
Feb 02 2017 | BARCLAYS BANK PLC | KODAK PHILIPPINES LTD | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 052773 | /0001 | |
Feb 02 2017 | BARCLAYS BANK PLC | NPEC INC | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 052773 | /0001 | |
Feb 02 2017 | BARCLAYS BANK PLC | Eastman Kodak Company | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 052773 | /0001 | |
Feb 02 2017 | BARCLAYS BANK PLC | LASER PACIFIC MEDIA CORPORATION | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 052773 | /0001 | |
Jun 17 2019 | JP MORGAN CHASE BANK, N A , AS ADMINISTRATIVE AGENT | LASER PACIFIC MEDIA CORPORATION | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 049901 | /0001 | |
Jun 17 2019 | JP MORGAN CHASE BANK, N A , AS ADMINISTRATIVE AGENT | Eastman Kodak Company | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 049901 | /0001 | |
Jun 17 2019 | JP MORGAN CHASE BANK, N A , AS ADMINISTRATIVE AGENT | PAKON, INC | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 049901 | /0001 | |
Jun 17 2019 | JP MORGAN CHASE BANK, N A , AS ADMINISTRATIVE AGENT | CREO MANUFACTURING AMERICA LLC | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 049901 | /0001 | |
Jun 17 2019 | JP MORGAN CHASE BANK, N A , AS ADMINISTRATIVE AGENT | FPC, INC | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 050239 | /0001 | |
Jun 17 2019 | JP MORGAN CHASE BANK, N A , AS ADMINISTRATIVE AGENT | KODAK AVIATION LEASING LLC | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 049901 | /0001 | |
Jun 17 2019 | JP MORGAN CHASE BANK, N A , AS ADMINISTRATIVE AGENT | NPEC, INC | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 049901 | /0001 | |
Jun 17 2019 | JP MORGAN CHASE BANK, N A , AS ADMINISTRATIVE AGENT | KODAK PHILIPPINES, LTD | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 049901 | /0001 | |
Jun 17 2019 | JP MORGAN CHASE BANK, N A , AS ADMINISTRATIVE AGENT | QUALEX, INC | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 049901 | /0001 | |
Jun 17 2019 | JP MORGAN CHASE BANK, N A , AS ADMINISTRATIVE AGENT | KODAK REALTY, INC | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 049901 | /0001 | |
Jun 17 2019 | JP MORGAN CHASE BANK, N A , AS ADMINISTRATIVE AGENT | KODAK PORTUGUESA LIMITED | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 049901 | /0001 | |
Jun 17 2019 | JP MORGAN CHASE BANK, N A , AS ADMINISTRATIVE AGENT | FAR EAST DEVELOPMENT LTD | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 049901 | /0001 | |
Jun 17 2019 | JP MORGAN CHASE BANK, N A , AS ADMINISTRATIVE AGENT | KODAK IMAGING NETWORK, INC | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 049901 | /0001 | |
Jun 17 2019 | JP MORGAN CHASE BANK, N A , AS ADMINISTRATIVE AGENT | KODAK AMERICAS, LTD | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 049901 | /0001 | |
Jun 17 2019 | JP MORGAN CHASE BANK, N A , AS ADMINISTRATIVE AGENT | KODAK NEAR EAST , INC | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 049901 | /0001 | |
Jun 17 2019 | JP MORGAN CHASE BANK, N A , AS ADMINISTRATIVE AGENT | PFC, INC | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 049901 | /0001 | |
Feb 26 2021 | Eastman Kodak Company | BANK OF AMERICA, N A , AS AGENT | NOTICE OF SECURITY INTERESTS | 056984 | /0001 | |
Feb 26 2021 | Eastman Kodak Company | ALTER DOMUS US LLC | INTELLECTUAL PROPERTY SECURITY AGREEMENT | 056734 | /0001 |
Date | Maintenance Fee Events |
Nov 27 2013 | ASPN: Payor Number Assigned. |
May 25 2017 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
Aug 23 2021 | REM: Maintenance Fee Reminder Mailed. |
Feb 07 2022 | EXP: Patent Expired for Failure to Pay Maintenance Fees. |
Date | Maintenance Schedule |
Dec 31 2016 | 4 years fee payment window open |
Jul 01 2017 | 6 months grace period start (w surcharge) |
Dec 31 2017 | patent expiry (for year 4) |
Dec 31 2019 | 2 years to revive unintentionally abandoned end. (for year 4) |
Dec 31 2020 | 8 years fee payment window open |
Jul 01 2021 | 6 months grace period start (w surcharge) |
Dec 31 2021 | patent expiry (for year 8) |
Dec 31 2023 | 2 years to revive unintentionally abandoned end. (for year 8) |
Dec 31 2024 | 12 years fee payment window open |
Jul 01 2025 | 6 months grace period start (w surcharge) |
Dec 31 2025 | patent expiry (for year 12) |
Dec 31 2027 | 2 years to revive unintentionally abandoned end. (for year 12) |