Technology is provided for changing one or more image attributes pertaining to depth perception in a two-dimensional image to emphasize the perceived stereoscopy of the two-dimensional image and achieve a sensation upon viewing the two-dimensional image that is close to a sensation perceived from viewing a binocular stereoscopic image. Binocular stereoscopic image data including image data from two perspectives, for right vision and left vision, are input. A user selects the preferred one of the right vision image data and the left vision image data using an image selection unit, a planar image generating unit extracts the selected image data from the binocular stereoscopic image data, and an image output unit outputs the extracted planar image data.
|
6. An image processing method, comprising:
inputting binocular stereoscopic image data including image data of a plurality of different perspectives;
determining a specific perspective point within a three dimensional space;
calculating an absolute distance from the specific perspective point to each point within the three dimensional space defined by the binocular stereoscopic image data;
generating a two dimensional image from the specific perspective point based on the binocular stereoscopic image data; and
performing a process of emphasizing stereoscopic perception in the two dimensional image according to the absolute distance within the three dimensional space.
1. An image processing apparatus, comprising:
an image input unit to input binocular stereoscopic image data including image data of a plurality of different perspectives;
a perspective position specifying unit to determine a specific perspective point within a three dimensional space;
a distance computation unit to calculate an absolute distance from the specific perspective point to each point within the three dimensional space defined by the binocular stereoscopic image data;
a planar image generating unit to generate a two dimensional image from the specific perspective point based on the binocular stereoscopic image data; and
a stereoscopy emphasizing unit to emphasize stereoscopic perception in the two dimensional image generated by the planar image generating unit according to the absolute distance within the three dimensional space calculated by the distance computation unit.
2. The image processing apparatus as defined in
3. The image processing apparatus as claimed in
4. The image processing apparatus as claimed in
5. The image processing apparatus as defined in
7. The image processing method of
8. The image processing method of
9. The image processing method of
10. The image processing method of
|
The present application claims priority to the corresponding Japanese Application No. 2003-183970, filed on Jun. 27, 2003, the entire contents of which are hereby incorporated by reference.
1. Field of the Invention
The present invention relates to an image processing apparatus that generates a two-dimensional image from binocular stereoscopic image data including image data from multiple perspectives.
2. Description of the Related Art
In one prior art example, a method of displaying a binocular stereoscopic three-dimensional image involves presenting a right/left vision binocular image made up of images from differing perspectives of which image is divided with respect to a viewer's right vision and left vision to thereby provide binocular parallax and enable stereoscopic vision. As an example of a method of generating a two-dimensional image from an arbitrary perspective based on such a three dimensional image, a method of generating a two-dimensional image that has a seemingly natural appearance is proposed, for example, in Japanese Laid-Open Patent Application No. 2002-324249 and Japanese Laid-Open Patent Application No. 2002-56407.
When viewing a binocular stereoscopic image, depth perception owing to binocular parallax is in effect in addition to normal depth perception from viewing a two-dimensional image. Thereby the viewer feels a sensation that is different from that felt upon viewing a normal two-dimensional image.
The two-dimensional image generation methods described in Japanese Laid-Open Patent Application No. 2002-324249 and Japanese Laid-Open Patent Application No. 2002-56407 merely involve reproducing a two-dimensional image from a given perspective within a space, and thereby, a sensation perceptually similar to that felt upon viewing a binocular stereoscopic image as described above cannot be felt upon viewing a two-dimensional image produced according to these methods.
An image processing apparatus and method are described. In one embodiment, the image processing apparatus, comprises: an image input unit to input binocular stereoscopic image data including image data of a plurality of different perspectives, a planar image generating unit to generate planar image data based on the binocular stereoscopic image data, and an image output unit to output the planar image data, wherein the planar image data generated by the planar image generating unit corresponds to the image data of one of the different perspectives.
One embodiment of the present invention has been conceived in response to one or more problems of the related art, and comprises an image processing apparatus that is capable of changing one or more image attributes pertaining to depth perception in a two-dimensional image to thereby emphasize the stereoscopy that is perceived in viewing the two-dimensional image and achieve a sensation upon viewing the two-dimensional image that is similar to a sensation felt upon viewing a binocular stereoscopic image.
Another embodiment of the present invention comprises an image processing apparatus that is capable of easily and quickly generating a two-dimensional image from a binocular stereoscopic image.
One embodiment of the present invention comprises an image processing apparatus that includes an image input unit to input binocular stereoscopic image data including image data of a plurality of different perspectives, a planar image generating unit to generate planar image data based on the binocular stereoscopic image data, and an image output unit to output the planar image data, wherein the planar image data generated by the planar image generating unit corresponds to the image data of one of the different perspectives.
According to an embodiment of the present invention, a two-dimensional image may be easily and quickly generated from binocular stereoscopic image data including image data of multiple perspectives.
In one embodiment, the image processing apparatus of the present invention includes an image selection unit for selecting the planar image data to be generated by the planar image generating unit from the image data of the different perspectives. According to an embodiment of the present invention, a user may select a preferred image from image data of multiple perspectives, and a two-dimensional image may be easily and quickly generated.
The present invention according to another embodiment comprises an image processing apparatus including an image input unit to input binocular stereoscopic image data including image data of a plurality of different perspectives, a planar image generating unit to generate planar image data based on the binocular stereoscopic image data, a stereoscopy emphasizing unit to perform a stereoscopy emphasizing process of emphasizing stereoscopy perceived in a planar image corresponding to the planar image data generated by the planar image generating unit, and an image output unit to output the planar image data.
According to an embodiment of the present invention, stereoscopy perceived in a two-dimensional image may be emphasized and a sensation that is close to a sensation perceived from viewing a binocular stereoscopic image may be achieved upon viewing the two-dimensional image.
In one embodiment, the stereoscopy emphasizing process includes a process of changing chroma saturation of each of objects of the planar image generated by the planar image generating unit, the change being relative to a distance of each of corresponding objects of a binocular stereoscopic image corresponding to the binocular stereoscopic image data According to an embodiment of the present invention, stereoscopy perceived in a two-dimensional image may be emphasized and a sensation that is close to a sensation perceived from viewing a binocular stereoscopic image may be achieved upon viewing the two-dimensional image.
In another embodiment, the image processing apparatus of the present invention includes a selection unit for selecting whether to perform the stereoscopy emphasizing process. According to an embodiment of the present invention, a stereoscopy emphasizing process on a two-dimensional image may be stopped when an overly exaggerated or awkward two-dimensional image is generated from emphasizing the stereoscopy or when a user prefers to reduce the time required for image generation, for example.
In another embodiment, the image processing of the present invention includes a stereoscopy manipulation unit for controlling the degree of chroma saturation change and adjusting the degree of stereoscopy emphasis in the stereoscopy emphasizing process. According to an embodiment of the present invention, a user may be able to control the degree of stereoscopy emphasis.
In another embodiment, the stereoscopy emphasizing process includes a process of changing a spatial frequency characteristic of each of objects of the planar image generated by the planar image generating unit, the change being relative to a distance of each of corresponding objects of a binocular stereoscopic image corresponding to the binocular stereoscopic image data According to an embodiment of the present invention, stereoscopy perceived in a two-dimensional image may be emphasized and a sensation that is close to a sensation perceived from viewing a binocular stereoscopic image may be achieved upon viewing the two-dimensional image.
In another embodiment, the image processing apparatus of the present invention includes a stereoscopy manipulation unit for controlling the degree of spatial frequency characteristic change and adjusting the degree of stereoscopy emphasis in the stereoscopy emphasizing process. According to an embodiment of the present invention, a user may be able to control the degree of stereoscopy emphasis.
In another embodiment, the stereoscopy emphasizing process includes a process of changing the size of each of objects of the planar image generated by the planar image generating unit, the change being relative to a distance of each of corresponding objects of a binocular stereoscopic image corresponding to the binocular stereoscopic image data According to an embodiment of the present invention, stereoscopy perceived in a two-dimensional image may be emphasized and a sensation that is close to a sensation perceived from viewing a binocular stereoscopic image may be achieved upon viewing the two-dimensional image.
In another embodiment, the image processing apparatus of the present invention includes a stereoscopy manipulation unit for controlling the degree of size change and adjusting the degree of stereoscopy emphasis in the stereoscopy emphasizing process. According to an embodiment of the present invention, a user may be able to control the degree of stereoscopy emphasis.
In another embodiment, the stereoscopy emphasizing process includes a process of changing the contrast of each of objects of the planar image generated by the planar image generating unit, the change being relative to a distance of each of corresponding objects of a binocular stereoscopic image corresponding to the binocular stereoscopic image data. According to an embodiment of the present invention, stereoscopy perceived in a two-dimensional image may be emphasized and a sensation that is close to a sensation perceived from viewing a binocular stereoscopic image may be achieved upon viewing the two-dimensional image.
In another embodiment, the image processing apparatus of the present invention includes a stereoscopy manipulation unit for controlling the degree of contrast change and adjusting the degree of stereoscopy emphasis in the stereoscopy emphasizing process. According to an embodiment of the present invention, a user may be able to control the degree of stereoscopy emphasis.
In another embodiment, one or more stereoscopy emphasizing processes are performed. According to an embodiment of the present invention, a suitable stereoscopy emphasizing process may be performed.
In another embodiment, the image processing apparatus of the present invention includes a stereoscopy emphasizing process selection unit for selecting one or more of the stereoscopy emphasizing processes. According to an embodiment of the present invention, a user may select a preferred stereoscopy emphasizing process to be performed.
In another embodiment, the image processing apparatus of the present invention includes a stereoscopy manipulation unit for controlling the degree of stereoscopy emphasis for each stereoscopy emphasizing processes to be performed. According to an embodiment of the present invention, a user may be able to select a preferred stereoscopy emphasizing process and control the degree of stereoscopy emphasis.
In another embodiment, the image processing apparatus of the present invention includes a stereoscopy emphasis degree specifying unit for specifying the degree of stereoscopy emphasis, and an adjusting unit for adjusting the degree of change for each process that is to be performed as the stereoscopy emphasizing process according to the specified degree of stereoscopy emphasis. According to an embodiment of the present invention, a stereoscopy emphasizing process at the degree desired by a user may be performed without the user having to perform complicated procedures.
In another embodiment, the image processing apparatus of the present invention includes a planar image data compression unit for compressing the amount of the planar image data generated by the planar image generating unit. According to an embodiment of the present invention, the amount of two-dimensional image data being generated may be reduced.
In another embodiment, the binocular stereoscopic image data includes moving image data. According to an embodiment of the present invention, stereoscopy perceived in a two-dimensional moving image may be emphasized and a sensation that is close to a sensation perceived from viewing a binocular stereoscopic moving image may be achieved upon viewing the two-dimensional moving image.
In the following, preferred embodiments of the present invention are described with reference to the accompanying drawings.
According to the present embodiment, a two-dimensional image may be easily and quickly generated from binocular stereoscopic image data including image data from multiple perspectives.
It is noted that, in addition to the binocular parallax, image attributes such as chroma saturation, spatial frequency characteristics, apparent size, and contrast can also affect the perceived stereoscopy of an image.
To emphasize the stereoscopy of an image, a decreasing function with respect to the distance of an object from the perspective point (e.g., function inversely proportional to the square of the distance) may be used to change the chroma saturation, the apparent size, and the contrast of the image object. To change the spatial frequency characteristics, a blurring function such as a Gaussian function, e.g.:
G(x, y)=a*exp (−(x^2+y^2)/2σ^2)
(where ‘a’ is a constant)
may be superimposed, for example. More specifically, to emphasize the stereoscopy, an increasing function with respect to the distance of the object from the perspective point (e.g., function proportional to the distance) may be used to change the degree of blurring of the blurring function. When the blurring function corresponds to a Gaussian function, the value a may be controlled using the increasing function with respect to the distance of the object from the perspective point. To change the degree of stereoscopy emphasis, the decrease rate of the decreasing function or the increase rate of the increasing function may be changed to further emphasize the stereoscopy.
In order for the stereoscopy emphasizing unit 6 to emphasize the stereoscopy of the two-dimensional image being viewed, at least one of stereoscopy emphasizing processes such as those listed in the table shown in
Further, the image processing apparatus according to one embodiment includes a selection unit 7 that enables a user to select whether to perform the stereoscopy emphasizing process. For example, when an overly exaggerated or awkward two-dimensional image is generated by the stereoscopy emphasizing unit 6 emphasizing the image stereoscopy, or when the user prefers to reduce the time required to generate the image, the user may be able to stop the stereoscopy emphasizing process on the two-dimensional image from being performed.
In the examples according to the above-described embodiments described above with reference to
Further, it is noted that according to the embodiments of the present invention, the binocular stereoscopic image being input is not limited to still images, and moving images may also be processed in the same manner to emphasize the stereoscopy of the planar moving image generated therefrom.
As can be appreciated from the above descriptions, the following advantages may be realized by the embodiments of the present invention:
The present application is based on and claims the benefit of the earlier filing date of Japanese Patent Application No. 2003-183970 filed on Jun. 27, 2003, the entire contents of which are hereby incorporated by reference.
Patent | Priority | Assignee | Title |
Patent | Priority | Assignee | Title |
5855553, | Feb 16 1995 | Hitachi, LTD | Remote surgery support system and method thereof |
6104426, | Mar 23 1996 | Stereo-endoscope | |
6188058, | Sep 17 1998 | Hewlett-Packard Company; HEWLETT-PACKARD DEVELOPMENT COMPANY, L P ; Agilent Technologies, Inc | System for taking displacement measurements having photosensors with imaged pattern arrangement |
6747610, | Jul 22 1997 | SANYO ELECTRIC CO , LTD | Stereoscopic image display apparatus capable of selectively displaying desired stereoscopic image |
6940473, | May 21 1998 | Nippon Telegraph and Telephone Corporation | Three-dimensional representation method and an apparatus thereof |
20020024517, | |||
20020024592, | |||
20030011618, | |||
20030072487, | |||
JP2000242157, | |||
JP2001305230, | |||
JP2002032744, | |||
JP2002056407, | |||
JP2002324249, | |||
JP2003099760, | |||
JP9179998, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Jun 25 2004 | Ricoh Company, Ltd. | (assignment on the face of the patent) | / | |||
Aug 03 2004 | KAGITANI, KENJI | Ricoh Company, LTD | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 015429 | /0431 |
Date | Maintenance Fee Events |
Jan 08 2010 | ASPN: Payor Number Assigned. |
Jul 16 2012 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
Jul 19 2016 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
Sep 14 2020 | REM: Maintenance Fee Reminder Mailed. |
Mar 01 2021 | EXP: Patent Expired for Failure to Pay Maintenance Fees. |
Date | Maintenance Schedule |
Jan 27 2012 | 4 years fee payment window open |
Jul 27 2012 | 6 months grace period start (w surcharge) |
Jan 27 2013 | patent expiry (for year 4) |
Jan 27 2015 | 2 years to revive unintentionally abandoned end. (for year 4) |
Jan 27 2016 | 8 years fee payment window open |
Jul 27 2016 | 6 months grace period start (w surcharge) |
Jan 27 2017 | patent expiry (for year 8) |
Jan 27 2019 | 2 years to revive unintentionally abandoned end. (for year 8) |
Jan 27 2020 | 12 years fee payment window open |
Jul 27 2020 | 6 months grace period start (w surcharge) |
Jan 27 2021 | patent expiry (for year 12) |
Jan 27 2023 | 2 years to revive unintentionally abandoned end. (for year 12) |