Provided is a stereoscopic display device provided with a stereoscopic display panel and a display controller, the stereoscopic display panel including a lenticular lens, a color filter substrate, a TFT substrate, etc. Unit pixels arranged in a horizontal direction parallel to the direction in which both eyes of viewer are arranged are alternately used as left-eye pixels and right-eye pixels. The display controller determined, according to temperature information from a temperature sensor, the contraction/expansion of the lens by a stereoscopic image generating module and generates 3D image data for driving the display panel in which the amount of disparity in a specific disparity direction is corrected on the basis of parameter information defined by an effective linear expansion coefficient inherent in the stereoscopic display panel, or the like and the magnitude of the temperature to thereby ensure a predetermined stereoscopic visual recognition range even when the lens are contracted/expanded.
|
27. A stereoscopic display image data generating method used for a stereoscopic display device, comprising: a stereoscopic display panel including a display panel section having a plurality of unit pixels and an image distributing section for distributing and outputting visual recognition image data sent out from the display panel section as visual recognition stereoscopic image information towards outside; a display panel driving section which drives the display panel section of the stereoscopic display panel; and a stereoscopic image generating module including a main arithmetic operation controller which controls actions of the display panel driving section and generates 3D image data for driving the display panel based on a depth map containing depth information specified in advance, wherein:
when generating the 3D image data, a temperature sensor measures temperatures of the display panel part in advance, and a deformation amount calculating section provided in advance to the main arithmetic operation controller calculates a temperature difference ΔT with respect to a reference temperature set in advance based on the measurement value;
then, the depth map acquired by performing rendering processing on three-dimensional data in advance is stored to a data storage section as 3D image data;
a temperature difference judging section provided in advance compares the calculated temperature difference ΔT with a reference value ΔTth set separately in advance by their absolute values and, in a case of |ΔT|≦|ΔTth| when judging correction necessity, judges that it is necessary to perform correction regarding a depth gradation that corresponds to a parallax amount of the 3D image data; and
the depth map stored in the data storage section is outputted as two-dimensional 3D image data when it is judged in the correction necessity judging step that the temperature difference ΔT is |ΔT|<|ΔTth| and it is under a temperature environment that does not require correction of the parallax amount.
32. A stereoscopic display image data generating program used for a stereoscopic display device, comprising: a stereoscopic display panel including a display panel section having a plurality of unit pixels and an image distributing section for distributing and outputting visual recognition image data sent out from the display panel section as visual recognition stereoscopic image information towards outside; a display panel driving section which drives the display panel section of the stereoscopic display panel according to 3D image data; and a stereoscopic image generating module which controls actions of the display panel driving section and generates 3D image data for driving the display panel based on three-dimensional data containing depth information specified in advance, the program causing a computer to execute:
a temperature difference calculating function which calculates a temperature difference ΔT with respect to a reference temperature set in advance separately, when a temperature of the image distributing section is inputted from a temperature sensor provided in advance to the image distributing section;
a correction necessity judging function which compares the calculated temperature difference ΔT and a reference value ΔTth set in advance separately by their absolute values, judges that it is necessary to perform correction regarding a parallax amount of an object specified on an x-axis on an xy plane as a screen face from the three-dimensional data containing z-axis information as depth information in a case of |ΔT|>|ΔTth|, and judges that it is unnecessary to perform correction regarding the parallax amount in a case of |ΔT|≦|ΔTth|,
an image processing function which performs rendering processing on the three-dimensional data when it is judged by the correction necessity judging function as |ΔT|≦|ΔTth| and that the correction is unnecessary; and
a 3D image data generating function which generates 3D image data for driving the display panel based on the rendering-processed parallax images.
22. A stereoscopic display image data generating method used for a stereoscopic display device, comprising: a stereoscopic display panel including a display panel section having a plurality of unit pixels and an image distributing section for distributing and outputting visual recognition image data sent out from the display panel section as visual recognition stereoscopic image information towards outside; a display panel driving section which drives the display panel section of the stereoscopic display panel according to 3D image data; and a stereoscopic image generating module including a main arithmetic operation controller which controls actions of the display panel driving section and generates 3D image data for driving the display panel based on three-dimensional data containing depth information specified in advance, wherein:
a temperature sensor provided in advance to the stereoscopic image generating module detects temperatures of the image distributing section, and a deformation amount calculating section provided in advance to the main arithmetic operation controller calculates a temperature difference ΔT between the detected temperature of the image distributing section and a reference temperature set in advance;
a temperature difference judging section provided in advance to the main arithmetic operation controller compares the calculated temperature difference ΔT and a reference value ΔTth set separately in advance by their absolute values and, in a case of |ΔT|>|ΔTth|, judges that it is necessary to perform correction regarding a parallax amount of an object specified on the x-axis on an xy plane as a screen face from the three-dimensional data containing z-axis information as depth information;
the main arithmetic operation controller performs rendering processing on the three-dimensional data as it is when it is judged by the judgment of correction necessity as |ΔT|≦|ΔTth| and that the correction is unnecessary; and
the main arithmetic operation controller generates 3D image data for driving the display panel based on the rendering-processed parallax images.
28. A stereoscopic display image data generating method used for a stereoscopic display device, comprising: a stereoscopic display panel including a display panel section having a plurality of unit pixels and an image distributing section for distributing and outputting visual recognition image data sent out from the display panel section as visual recognition stereoscopic image information towards outside; a display panel driving section which drives the display panel section of the stereoscopic display panel according to 3D image data; and a stereoscopic image generating module including a main arithmetic operation controller which controls actions of the display panel driving section and generates 3D image data for driving the display panel based on a pair of parallax images for a right eye and a left eye rendering-processed in advance or captured by a stereoscopic camera, wherein:
when parallax image data A for the right eye and the left eye rendering-processed in advance is inputted, the main arithmetic operation controller accumulates it to a data storage section for generating 3D image data;
then, a deformation amount calculating section provided to the main arithmetic operation controller calculates a temperature difference |ΔT| with respect to a reference temperature set in advance based on the temperature of the image distributing section measured by a temperature sensor when collecting the parallax image data A;
a temperature difference judging section provided to the main arithmetic operation controller individually performs an arithmetic operation regarding whether or not the temperature difference |ΔT| calculated in the temperature difference calculating step is equal to or less than a reference value |ΔTth| set in advance, and judges whether or not it is under a temperature environment that requires correction for parallax amount of each object specified on an x-axis on an xy plane that is a display face; and
when it is judged by the temperature difference judging section that the temperature difference ΔT is |ΔT|≦|ΔTth| and it is under a temperature environment that does not require correction of the parallax amount, the main arithmetic operation controller generates and outputs two-dimensional 3D image data having depth information that corresponds to the parallax amount based on a pair of parallax image data A stored in the data storage section for driving the display panel.
29. A stereoscopic display image data generating method used for a stereoscopic display device, comprising: a stereoscopic display panel including a display panel section having a plurality of unit pixels and an image distributing section for distributing and outputting visual recognition image data sent out from the display panel section as visual recognition stereoscopic image information towards outside; a display panel driving section which drives the display panel section of the stereoscopic display panel according to 3D image data; and a stereoscopic image generating module including a main arithmetic operation controller which controls actions of the display panel driving section and generates 3D image data for driving the display panel based on image data having depth information or image data having parallax information, wherein:
when the image data having depth information or the image data having parallax information is inputted, the main arithmetic operation controller accumulates it to a data storage section provided in advance for generating 3D image data, and accumulates an LUT signal for performing parallax amount correction processing that corresponds to a detected temperature;
then, a deformation amount calculating section provided to the main arithmetic operation controller calculates a temperature difference |ΔT| with respect to a reference temperature set in advance based on the temperature of the image distributing section measured by a temperature sensor;
a temperature difference judging section provided to the main arithmetic operation controller individually performs an arithmetic operation regarding whether or not the temperature difference |ΔT| calculated in the temperature difference calculating step is equal to or less than a reference value |ΔTth| set in advance, and judges whether or not it is under a temperature environment that requires correction for parallax amount of each object specified on an x-axis on an xy plane that is a display face; and
when it is judged by the temperature difference judging section that the temperature difference ΔT is |ΔT|>|ΔTth| and it is under a temperature environment that requires correction of the parallax amount, the main arithmetic operation controller generates and outputs 3D image data for driving the display panel by performing parallax amount adjusting processing which corrects the parallax amount from the image data having the depth information stored in the data storage section or the image data having parallax information based on the LUT signal.
1. A stereoscopic display device, comprising: a stereoscopic display panel including a display panel section having a plurality of unit pixels and an image distributing section for distributing and outputting visual recognition image data sent out from the display panel section as visual recognition stereoscopic image information towards outside; a display panel driving section which drives the display panel section of the stereoscopic display panel; and a stereoscopic image generating module which controls actions of the display panel driving section and generates 3D image data for driving the display panel based on three-dimensional data containing depth information specified in advance, wherein
the stereoscopic image generating module is provided with: a temperature sensor which detects temperatures of the image distributing section; and a data storage section which stores information regarding an effective linear expansion coefficient difference between the image distributing section and the display panel section when the both are in a fixed state, size of the display panel section, resolution of the unit pixels, and a reference temperature as parameter information regarding an inherent stereoscopic viewing region of the stereoscopic display panel, and
the stereoscopic image generating module comprises: a deformation amount calculating section which calculates a temperature difference ΔT between temperature information detected by the temperature sensor and the reference temperature, and calculates a deformation amount that is a contraction amount or an expansion amount which changes due to a change in surrounding environment temperatures of the image distributing section based on the temperature difference ΔT and the information stored in the data storage section; and a main arithmetic operation controller which, when the deformation amount regarding contraction or expansion is calculated by the deformation amount calculating section, generates 3D image data corresponding thereto and outputs the generated data to the display panel driving section for driving the display panel
wherein the stereoscopic image generating module comprises: a camera setting information storage section which stores a pre-specified setting position parameter regarding a camera setting of rendering processing that is executed for acquiring the 3D image data from the three-dimensional data as a first camera setting A; and a temperature difference judging section which performs an arithmetic operation regarding whether or not an absolute value of the temperature difference ΔT between the detected temperature and the reference temperature is equal to or less than an absolute value of a reference value ΔTth set in advance, and judges whether or not it is under a temperature environment that requires correction of a parallax amount specified on an x-axis on an xy plane as a screen face from the three-dimensional data containing depth information, and
the main arithmetic operation controller comprises a 3D image data generating function which operates when it is judged by the temperature difference judging section that temperature difference ΔT is |ΔT|≦|ΔTth| and it is under a temperature environment that does not require correction of the parallax amount to perform rendering processing on the three-dimensional data under a condition of the first camera setting A, and to generate and output two-dimensional 3D image data having the parallax amount and the depth information of the three-dimensional data for driving the display panel.
2. The stereoscopic display device as claimed in
the image distributing section of the stereoscopic display panel is formed by a lenticular lens sheet in which a plurality of cylindrical lenses that are convex lenses having a columnar surface are arranged in parallel at a same lens pitch.
3. The stereoscopic display device as claimed in
a polarization is disposed between the display panel section and the image distributing section.
4. The stereoscopic display device as claimed in
the effective linear expansion coefficient difference of the image distributing section and the display panel section constituting the stereoscopic display panel under a state where the both are being fixed is set to be 30 ppm or more for a range of changes of the use environmental temperature of the stereoscopic display panel from −20° C. to 60° C.
5. The stereoscopic display device as claimed in
the main arithmetic operation controller is provided with a correction environment judging section which operates when it is judged by the temperature difference judging section that the temperature difference ΔT is |ΔT|>|ΔTth| and it is under a temperature environment that requires correction of the parallax amount to make judgment whether the image distributing section is in a state of ΔT<0 showing a contraction state or a state of ΔT>0 showing an expansion state; and
the main arithmetic operation controller comprises
a popup side image data processing function which operates when it is judged by the correction environment judging section that the temperature difference ΔT is ΔT<0 and the image distributing section is in a contraction state to judge whether or not depth of the object is at a position of z≧0 on a popup side and, when judged that it is located at the position of z≧0, performs rendering processing on the three-dimensional data of z≧0 under the condition of the first camera setting A,
a non-popup side image data processing function which operates when it is judged that the temperature difference ΔT is ΔT<0 and the image distributing section is in a contraction state by the correction environment judging section to judge whether or not the depth of the object is at a position of z<0 on a non-popup side and, when judged that it is located at the position of z<0, performs rendering processing on the three-dimensional data of z<0 under a condition of a second camera setting B that has a smaller included angle than an included angle of the first camera setting A, which is formed between an optical axis of each camera and the z-axis condition,
an image data synthesizing function which performs synthesizing processing of image data that are rendering-processed in the popup side image data processing function and the non-popup side image data processing function, respectively, and
a 3D image data generating function which generates and outputs 3D image data based on the synthesize-processed image data for driving the display panel.
6. The stereoscopic display device as claimed in
the main arithmetic operation controller comprises:
a non-popup side z-value conversion processing function which performs z-value conversion processing by multiplying a correction coefficient a that is smaller than “1” to three-dimensional data of z<0 by having a z-axis of a depth coordinate of the three-dimensional data under the first camera setting A as a reference, instead of the non-popup side image data processing function; and
an entire region collective image data processing function which performs, based on same camera setting information, image processing on popup side three-dimensional data and non-popup side three-dimensional data on which z-value conversion is executed, instead of the popup side image data processing function, the non-popup side image data processing function, and the image data synthesizing function.
7. The stereoscopic display device as claimed in
the main arithmetic operation controller comprises:
a non-popup side image data processing function which operates when it is judged by the correction environment judging section that the temperature difference ΔT is ΔT>0 and the image distributing section is in an expansion state to judge whether or not depth of the object is at a position of z<0 on a non-popup side and, when judged that it is located at the position of z<0, performs rendering processing on the three-dimensional data of z<0 under the condition of the first camera setting A;
a popup side image data processing function which operates when it is judged by the correction environment judging section that the temperature difference ΔT is ΔT>0 and the image distributing section is in an expansion state to judge whether or not the depth of the object is at a position of z<0 on a non-popup side and, when judged that it is located at the position of z≧0, performs rendering processing on the three-dimensional data of z≧0 under a condition of a third camera setting C that has a larger included angle than the included angle between cameras of the first camera setting A;
an image data synthesizing function which performs synthesizing processing of image data that are rendering-processed in each of three-dimensional data processing functions, i.e., the non-popup side image data processing function and the popup side image data processing function, and
a 3D image data generating function which generates and outputs 3D image data based on the synthesize-processed image data for driving the display panel.
8. The stereoscopic display device as claimed in
the main arithmetic operation controller comprises:
a popup side z-value conversion processing function which performs z-value conversion processing by multiplying a correction coefficient β that is smaller than “1” to three-dimensional data of z≧0 by having a z-axis of a depth coordinate of the three-dimensional data under the first camera setting A as a reference, instead of the popup side image data processing function; and
an entire region collective image data processing function which performs, based on same camera setting information, image processing on non-popup side three-dimensional data and popup side three-dimensional data on which z-value conversion is executed, instead of the non-popup side image data processing function, the popup side image data processing function, and the image data synthesizing function.
9. The stereoscopic display device as claimed in
the main arithmetic operation controller is provided with a depth image development processing section which develops three-dimensional data of the object sent into the main arithmetic operation controller into an object image of two-dimensional image information and a depth image of depth information thereof; and
the depth image development processing section comprises a gradation value specifying function which sets a gradation value corresponding to the depth information for the three-dimensional data by a pixel unit, and specifies the set gradation value by corresponding to a parallax amount of the two-dimensional image information specified on the x-axis.
10. The stereoscopic display device as claimed in
the main arithmetic operation controller is provided with: a correction environment judging section which operates when it is judged by the temperature difference judging section that the temperature difference ΔT is |ΔT|>|ΔTth | and it is under a temperature environment that requires correction of the parallax amount to make judgment whether the image distributing section is in a state of ΔT <0 showing a contraction state or a state of ΔT>0showing an expansion state; and an x-position threshold value setting section which sets a threshold value xth on an x-axis for making it possible to secure a stereoscopic viewing region that changes according to an extent of the temperature difference ΔT, and sets the threshold value xth to become smaller as the value of the ΔT becomes larger, and
the main arithmetic operation controller comprises
an out-of x-axis-threshold-value image data processing function which operates when it is judged by the correction environment judging section that the temperature difference ΔT is ΔT<0 and the image distributing section is in a contraction state to specify a coordinate position x of the object on the x-axis, and performs rendering processing on the three-dimensional data of the object that satisfies |x|>|xth| under a condition of a fourth camera setting D in which an included angle is set to be narrower than the included angle of the first camera setting A,
a popup side image data processing function which further judges whether or not a depth position z of the object in a case where the temperature difference ΔT is ΔT<0 and |x|≧|xth| is satisfied is z≧0 on the popup side and, when judged that the depth position z satisfies z≧0 on the popup side, performs rendering processing on the three-dimensional data of z≧0 under the condition of the first camera setting A,
a non-popup side image data processing function which further judges whether or not the depth position z of the object in a case where the temperature difference ΔT is ΔT<0 and |x|≧|xth| is satisfied is z≧0 on the popup side and, when judged that the depth position z satisfies z<0 on the non-popup side, performs rendering processing on the three-dimensional data of z<0 under the condition of the second camera setting B in which an included angle is set to be narrower than the included angle of the first camera setting A,
an image data synthesizing function which performs synthesizing processing of each of the image data that are rendering-processed in the out-of x-axis-threshold-value image data processing function, the popup side image data processing function, and the non-popup side image data processing function, and
a 3D image data generating function which generates and outputs 3D image data based on the synthesize-processed image data for driving the display panel.
11. The stereoscopic display device as claimed in
the main arithmetic operation controller comprises:
an out-of x-axis-threshold-value image data processing function which operates when it is judged by the correction environment judging section that the temperature difference ΔT is ΔT>0 and in an expansion state to specify a coordinate position x of the object on the x-axis, and performs rendering processing on the three-dimensional data of the object that is considered to satisfy |x|>|xth| under a condition of a fifth camera setting E in which an included angle is set to be narrower than the included angle of the first camera setting A;
a non-popup side image data processing function which further judges whether or not a depth position z of the object in a case where the temperature difference ΔT is ΔT>0 and |x|≧|xth| is considered to satisfy is z<0 on the popup side and, when judged as z<0, performs rendering processing on the three-dimensional data of z<0 under the condition of the first camera setting A,
a popup side image data processing function which further judges whether or not the depth position z of the object in a case where the temperature difference ΔT is ΔT>0 and |x|≧|xth| is considered to satisfy is z≧0 on the popup side and, when judged as z≧0, performs rendering processing on the three-dimensional data of z≧0 under the condition of the third camera setting C in which an included angle is set to be larger than the included angle of the first camera setting A,
an image data synthesizing function which performs synthesizing processing of each of the image data that are rendering-processed in the out-of x-axis-threshold-value image data processing function, the non-popup side image data processing function, and the popup side image data processing function, and
a 3D image data generating function which generates and outputs 3D image data based on the synthesize-processed image data for driving the display panel.
12. The stereoscopic display device as claimed in
the main arithmetic operation controller is provided with an x-position threshold value setting section which sets a threshold value xth on an x-axis for making it possible to secure a stereoscopic viewing region that changes according to an extent of the temperature difference ΔT, and sets the threshold value xth to become smaller as the value of the ΔT becomes larger, and a correction environment judging section which operates when it is judged by the temperature difference judging section that the temperature difference ΔT is |ΔT|>|ΔTth| and it is under a temperature environment that requires correction of the parallax amount to make judgment whether the image distributing section is in a state of ΔT<0 showing a contraction state or a state of ΔT>0 showing an expansion state; and
the main arithmetic operation controller comprises
a 2D image data processing function which operates when it is judged by the correction environment judging section that the temperature difference ΔT is ΔT>0 and the image distributing section is in a contraction state to specify a coordinate position x of the object on the x-axis, and performs rendering processing on the three-dimensional data of the object that satisfies |x|>|xth| under a condition of two-dimensional camera setting by a single camera that is placed anew along the z-axis instead of the three-dimensional data of the object,
a popup side image data processing function which further judges whether or not a depth position z of the object in a case where the temperature difference ΔT is ΔT<0 and |x|≧|xth| is satisfied is z≧0 on the popup side and, when judged as z≧0, performs rendering processing on the three-dimensional data of z≧0 under the condition of the first camera setting A,
a non-popup side image data processing function which further judges whether or not the depth position z of the object in a case where the temperature difference ΔT is ΔT<0 and |x|≧|xth| is satisfied is z≧0 on the popup side and, when judged that the depth position z is z<0 on the non-popup side, performs rendering processing on the three-dimensional data of z<0 under the condition of the second camera setting B in which an included angle is set to be narrower than the included angle of the first camera setting A,
an image data synthesizing function which performs synthesizing processing of each of the image data that are rendering-processed in the 2D image data processing function, the popup side image data processing function, and the non-popup side image data processing function, respectively, and
a 3D image data generating function which generates and outputs 3D image data based on the synthesize-processed image data for driving the display panel.
13. The stereoscopic display device as claimed in
the main arithmetic operation controller comprises:
a 2D image data processing function which operates when it is judged by the correction environment judging section that the temperature difference ΔT is ΔT>0 and in an expansion state to specify a coordinate position x of the object on the x-axis, and performs rendering processing on the three-dimensional data of the object that satisfies |x|>|xth| under the condition of the two-dimensional camera setting by using the single camera placed anew along the z-axis instead of the three-dimensional data of the object;
a non-popup side image data processing function which further judges whether or not the depth position z of the object in a case where the temperature difference ΔT is ΔT>0 and |x|≧|xth| is satisfied is located at z<0 on the non-popup side and, when judged to be located at z<0, immediately operates to perform rendering processing on the three-dimensional data under the condition of the first camera setting A,
a popup side image data processing function which further judges whether or not the depth position z of the object in a case where the temperature difference ΔT is ΔT>0 and |x|≧|xth| is satisfied is located at z≧0 on the popup side and, when judged to be located at z≧0, performs rendering processing on the three-dimensional data of z ≧0 under the condition of the third camera setting C in which an included angle is set to be larger than the included angle of the first camera setting A,
an image data synthesizing function which performs synthesizing processing of each of the image data that are rendering-processed in the 2 D image data processing function, the non-popup side image data processing function, and the popup side image data processing function, and a 3 D image data generating function which generates and outputs 3 D image data based on the synthesize-processed image data for driving the display panel.
14. The stereoscopic display device as claimed in
the main arithmetic operation controller is provided with an x-position threshold value setting section which operates when it is judged by the temperature difference judging section that the temperature difference ΔT is |ΔT|>|ΔTth| and it is under a temperature environment that requires correction of the parallax amount to set a threshold value xth on an x-axis for making it possible to secure a stereoscopic viewing region that changes according to an extent of the temperature difference ΔT, and sets the threshold value xth to become smaller as the value of the absolute value of the ΔT becomes larger; and
the main arithmetic operation controller comprises
a 2 D image data processing function which specifies a coordinate position x of the object on the x-axis, and performs rendering processing on the three-dimensional data of the object that satisfies |x|>|xth| under a condition of two-dimensional camera setting by a single camera that is placed anew along the z-axis instead of the three-dimensional data,
a 3 D image data processing function which, for the object that satisfies |x|≧|xth| for the coordinate position x on the x-axis, immediately operates to perform rendering processing on the three-dimensional data of the object under the condition of the first camera setting A,
an image data synthesizing function which performs synthesizing processing of each of the image data that are rendering processed in the 2D image data processing function and the 3D image data processing function, and
a 3D image data generating function which generates and outputs 3D image data based on the synthesize-processed image data for driving the display panel.
15. The stereoscopic display device as claimed in
the stereoscopic image generating module comprises: a target image data setting section which stores a depth map as a 3D image that is rendering-processed in advance in the data storage section; and a temperature difference judging section which performs an arithmetic operation regarding whether or not an absolute value of the temperature difference ΔT between the detected temperature from the temperature sensor and the reference temperature is equal to or less than an absolute value of a reference value ΔTth set in advance, and judges whether or not it is under a temperature environment that requires correction of a parallax amount of each object specified on an x-axis on an xy plane as a screen face for displaying the depth map containing z-axis information as depth information, and
the main arithmetic operation controller comprises a 3D image data generating function which operates when it is judged by the temperature difference judging section that the temperature difference ΔT is |ΔT|≧|ΔTth| and it is under a temperature environment that does not require correction of the parallax amount to output two-dimensional 3D image data having the depth information corresponding to the parallax amount of the three-dimensional data that is the image data stored in the data storage section as it is for driving the display panel.
16. The stereoscopic display device as claimed in
the main arithmetic operation controller is provided with a correction environment judging section which operates when it is judged by the temperature difference judging section that the temperature difference ΔT is |ΔT|>|ΔTth| and it is under a temperature environment that requires correction of the parallax amount to make judgment whether the image distributing section is in a state of ΔT<0 showing a contraction state or a state of ΔT>0 showing an expansion state; and
the main arithmetic operation controller comprises
a gradation value non-conversion processing function which operates when it is judged by the correction environment judging section that the temperature difference ΔT is ΔT>0 and the image distributing section is in an expansion state to judge whether or not the depth of the object is at a position of z<0 on the non-popup side and a depth gradation thereof is equal to or less than an intermediate value of an entire gradation and, when judged that it is located at a position of z<0 on the non-popup side and the depth gradation is equal to or less than the intermediate value of the entire gradation, holds it without performing a gray scale conversion,
a gradation value conversion processing function which operates when it is judged by the correction environment judging section that the temperature difference ΔT is ΔT>0 and the image distributing section is in an expansion state to judge whether or not the depth of the object is at a position of z<0 on the popup side and a depth gradation thereof is equal to or less than the intermediate value of the entire gradation and, when judged that the depth of the object is located at a position of z≧0 and the depth gradation is equal to or more than the intermediate value of the entire gradation, performs a gray scale conversion by a second gradation conversion with which a smaller gradation value than the original depth information can be acquired and holds it,
a depth image data synthesizing function which performs synthesizing processing of depth image data that are held by the gradation value non-conversion processing function and the gradation value conversion processing function, respectively, and
a 3D image data generating function which generates and outputs two-dimensional 3D image data based on the synthesize-processed image data for driving the display panel.
17. The stereoscopic display device as claimed in
the stereoscopic image generating module comprises:
a target image data setting section which inputs and accumulates, to the data storage section, a pair of parallax image data A for the right eye and the left eye rendering-processed in advance or captured by a stereoscopic camera for generating 3D image data, and a temperature difference judging section which individually performs an arithmetic operation regarding whether or not an absolute value of the temperature difference ΔT of the detected temperature from the temperature sensor regarding each of the parallax image data A with respect to an absolute value of the reference temperature is equal to or less than an absolute value of the reference value ΔTth set in advance, and judges whether or not it is a temperature environment that requires correction for the parallax amount of each object specified on an x-axis on an xy plane as a screen face of the stereoscopic display panel; and
a 3D image data generating function which operates when it is judged by the temperature difference judging section that temperature difference ΔT is |ΔT|≧|ΔTth| and it is under a temperature environment that does not require correction of the parallax amount to generate and output 3D image data based on the pair of parallax image data A stored in the data storage section for driving the display panel.
18. The stereoscopic display device as claimed in
the main arithmetic operation controller is provided with: a correction environment judging section which operates when it is judged by the temperature difference judging section that the temperature difference ΔT regarding the parallax image data A is |ΔT|>|ΔTth| and it is under a temperature environment that requires correction of the parallax amount to make judgment whether the image distributing section is in a state of ΔT<0 showing a contraction state or a state of ΔT>0 showing an expansion state;
the main arithmetic operation controller comprises an offset image generating section which operates when it is judged by the correction environment judging section that the temperature difference ΔT regarding the parallax image data A is ΔT>0 and the image distributing section is in an expansion state to generate parallax image data C by performing second parallax offset processing on the parallax image data A;
the 3D image data generating function of the main arithmetic operation controller generates and outputs two-dimensional 3D image data based on the parallax image data C generated by the offset image generating section; and
the offset image generating section comprises an image data offset processing function which performs shift processing for shifting left-eye image data within the parallax image data A to a right direction and right-eye image data to a left direction by a prescribed offset amount, respectively, and a parallax image data generating function which generates the parallax image data C by superimposing image data acquired by performing the respective offset processing to corresponding image data that has not undergone the offset processing.
19. The stereoscopic display device as claimed in
the stereoscopic image generating module comprises
a camera setting information storage section which stores a camera setting of rendering processing that is executed for acquiring the 3D image data from the three-dimensional data as a first camera setting A in which a setting position parameter is specified in advance,
a target image data setting section which stores image data having depth information or image data having parallax information to the data storage section,
a temperature difference judging section which performs an arithmetic operation regarding whether or not an absolute value of the temperature difference ΔT between the detected temperature and the reference temperature is equal to or less than an absolute value of a reference value ΔTth set in advance, and judges whether or not it is under a temperature environment that requires correction of a parallax amount specified on an x-axis on an xy plane as a screen face from the image data containing depth information or image data having parallax information, and
a parallax amount adjusting LUT signal storage section which accumulates an LUT signal for performing parallax amount correction processing that corresponds to the temperature detected by the temperature sensor; and
the main arithmetic operation controller comprises
a parallax amount adjusting function which operates when it is judged by the temperature difference judging section that the temperature difference ΔT regarding the parallax image data A is |ΔT|>|ΔTth| and it is under a temperature environment that requires correction of the parallax amount to adjust the parallax amount of two-dimensional image information according to the parallax adjusting LUT signal that corresponds to the temperature detected by the temperature sensor,
a function of generating parallax images according to the parallax amount after the correction, and
a function of generating 3D image data, which generates and outputs 3D image data based on the generated parallax images for driving the display panel.
20. The stereoscopic display device as claimed in
the parallax amount adjusting function is a function which performs adjustment to change a correction value according to the position within the screen face of the stereoscopic display panel.
21. The stereoscopic display device as claimed in
the stereoscopic image generating module is provided with a 2D/3D image preprocessing section which calculates a contrast difference between a 2D background and a 3D object; and
the main arithmetic operation controller comprises a 3D image generating function which generates and outputs 3D image data by performing prescribed parallax amount correction processing according to the ΔT and the 2D/3D contrast difference for driving the display panel.
23. The stereoscopic display image data generating method as claimed in
when it is judged by the judgment of correction necessity that the temperature difference ΔT is |ΔT|<|ΔTth| and it is under a temperature environment that requires correction of the parallax amount, a correction environment judging section provided to the main arithmetic operation controller judges whether the image distributing section is in a state of ΔT<0 showing a contraction state or a state of ΔT>0 showing an expansion state;
when it is judged by the correction environment judging section that the ΔT is ΔT<0 and the image distributing section is in a contraction state, the main arithmetic operation controller judges whether or not depth of the object is at a position of z≧0 on a popup side and, when judged to be located at the position of z≧0 on the popup side, performs rendering processing on the three-dimensional data of z≧0 under a condition of a first camera setting A in which a setting position parameter regarding a camera setting of rendering processing that is executed for acquiring the 3D image data from the three-dimensional data is specified in advance to form popup side image data;
when it is judged that the temperature difference ΔT is ΔT<0 and the image distributing section is in a contraction state, the main arithmetic operation controller further judges whether or not the depth of the object is at a position of z<0 on a non-popup side and, when judged to be located at the position of z<0, performs rendering processing on the three-dimensional data of z<0 under a condition of a second camera setting B that has a smaller included angle than an included angle of the first camera setting A, which is formed between an optical axis of each camera and the z-axis condition, to form non-popup side image data; and
the main arithmetic operation controller performs synthesizing processing on the formed non-popup side image data and the popup side image data, and generates 3D image data for driving the display panel based thereupon.
24. The stereoscopic display image data generating method as claimed in
when it is judged by the correction necessity judging step that the temperature difference ΔT is |ΔT|<|ΔTth| and it is under a temperature environment that requires correction of the parallax amount, the main arithmetic operation controller sets a threshold value xth on an x-axis for making it possible to secure a stereoscopic viewing region that changes according to an extent of the temperature difference ΔT, and sets the x-position threshold value xth to become smaller as the value of the ΔT becomes larger;
after setting the x-position threshold value, the correction environment judging section provided to the main arithmetic operation controller judges whether the image distributing section is in a state of ΔT<0 showing a contraction state or in a state of ΔT>0 showing an expansion state;
when it is judged by the judgment of correction environment that the temperature difference ΔT is ΔT<0 and the image distributing section is in a contraction state, the main arithmetic operation controller immediately operates to specify a coordinate position x of the object on the x-axis and to execute out-of x-axis-threshold-value image data processing which performs rendering processing on the three-dimensional data of the object that satisfies |x|>|xth| under a condition of a fourth camera setting D in which an included angle is set to be narrower than the included angle of the first camera setting A in which a setting position parameter regarding a camera setting of rendering processing that is executed for acquiring the 3D image data from the three-dimensional data is specified in advance,
for the object in a case where the temperature difference ΔT is ΔT<0 and |x|≦|xth| is satisfied, the main arithmetic operation controller executes popup side image data processing which judges whether or not a depth position z of the object is z≧0 on the popup side and, when judged as z≧0, immediately operates to perform rendering processing on the three-dimensional data of the object under the condition of the first camera setting A;
for the object in a case where it is judged in the judgment of correction environment that the temperature difference ΔT is ΔT<0 and |x|≦|xth| is satisfied, the main arithmetic operation controller executes non-popup side image data processing which further judges whether or not the depth position z of the object is z≧0 on the popup side and, when judged as z<0, immediately operates to perform rendering processing on the three-dimensional data of the object under the condition of the second camera setting B in which an included angle is set to be narrower than the included angle of the first camera setting A; and
then, the main arithmetic operation controller performs synthesizing processing of each of the image data that are rendering-processed in the out-of x-axis-threshold-value image data processing, the popup side image data processing, and the non-popup side image data processing, and generates 3D image data for driving the display panel based thereupon.
25. The stereoscopic display image data generating method as claimed in
when it is judged by the correction necessity judging step that the temperature difference ΔT is |ΔT|<|ΔTth| and it is under a temperature environment that requires correction of the parallax amount, the main arithmetic operation controller sets a threshold value xth on an x-axis for making it possible to secure a stereoscopic viewing region that changes according to an extent of the temperature difference ΔT and sets the threshold value xth to become smaller as an absolute value of the ΔT becomes larger;
after execution of this x-position threshold value setting step, the correction environment judging section judges whether the image distributing section is in a state of ΔT<0 showing a contraction state or in a state of ΔT>0 showing an expansion state;
when it is judged by the correction environment judging step that the temperature difference ΔT is ΔT<0 and the image distributing section is in a contraction state after execution of the correction environment judging step, the main arithmetic operation controller specifies a coordinate position x of the object on the x-axis and executes 2D image data processing which performs rendering processing regarding the three-dimensional data of the object that satisfies |x|>|xth| under a condition of two-dimensional camera setting by a single camera placed anew along the z-axis instead of the three-dimensional data;
for the object in a case where the temperature difference ΔT is ΔT<0 and |x|≦|xth| is satisfied, the main arithmetic operation controller further judges whether or not a depth position z of the object is z≧0 on the popup side and, when judged as z ≧0, immediately operates to execute popup side image data processing which performs rendering processing on the three-dimensional data of z≧0 under the condition of the first camera setting A in which a setting position parameter regarding a camera setting of rendering processing that is executed for acquiring the 3D image data from the three-dimensional data is specified in advance;
for the object in a case where the temperature difference ΔT is ΔT<0 and |x|≦|xth| is satisfied, the main arithmetic operation controller further judges whether or not the depth position z of the object is z ≧0 on the popup side and, when judged as z<0, immediately operates to execute non-popup side image data processing which performs rendering processing on the three-dimensional data of z<0 under the condition of the second camera setting B in which an included angle is set to be narrower than the included angle of the first camera setting A; and
then, the main arithmetic operation controller performs synthesizing processing of each of the image data that are rendering processed in the 2D image data processing, the popup side image data processing, and the non-popup side image data processing, and generates 3D image data for driving the display panel based thereupon.
26. The stereoscopic display image data generating method as claimed in
when it is judged by the correction necessity judging step that the temperature difference ΔT is |ΔT|<|ΔTth| and it is under a temperature environment that requires correction of the parallax amount, the main arithmetic operation controller sets a threshold value xth on an x-axis for making it possible to secure a stereoscopic viewing region that changes according to an extent of the temperature difference ΔT and sets the threshold value xth to become smaller as an absolute value of the ΔT becomes larger;
the main arithmetic operation controller specifies a coordinate position x of the object on the x-axis and executes 2D image data processing which performs rendering processing regarding the three-dimensional data of the object that satisfies |x|>|xth| under a condition of two-dimensional camera setting by a single camera placed anew along the z-axis instead of the three-dimensional data;
for the object in which |x|≦|xth| is satisfied for the coordinate position x on the x-axis, the main arithmetic operation controller immediately operates to execute 3D image data processing which performs rendering processing regarding the three-dimensional data under the condition of the first camera setting A in which a setting position parameter regarding a camera setting of rendering processing that is executed for acquiring the 3D image data from the three-dimensional data is specified in advance; and
then, the main arithmetic operation controller performs synthesizing processing of each of the image data that are rendering-processed in the 2D image data processing and the 3D image data processing, and generates 3D image data for driving the display panel based thereupon.
30. The stereoscopic display image data generating method as claimed in
the parallax amount adjusting processing is processing which executes adjustment to change a correction value according to the position within the display screen.
31. The stereoscopic display image data generating method as claimed in
3D image data is generated and outputted by performing prescribed parallax amount correction processing according to ΔT and a contrast difference between a 2D background and a 3D object for driving the display panel.
|
The present invention relates to a stereoscopic display device, a method for generating stereoscopic display image data, and a program therefor. More specifically, the present invention relates to a stereoscopic display device capable for corresponding to temperature changes in use environments, a method for generating stereoscopic display image data, and a program therefor.
In accordance with the demands for present display devices to have sophisticated functions, a special display device capable of stereoscopic image display, viewing angle control, and the like by combining an optical element array such as a lenticular lens, a prism sheet, a diffusion sheet with a display panel using electro-optic element such as liquid crystal has come to be used. An example of such display device is shown in
Among those,
As shown in
As shown in
Further, when the lefty-eye pixels 115a and the right-eye pixels 115b are driven by a drive circuit (not shown) according to a prescribed signal, a left-eye image is formed in a left-eye region 120a and a right-eye image is formed in a right-eye region 120b, respectively, by the cylindrical lenses 101. Thereby, an observer can recognize a stereoscopic image. A typical two-dimensional image display can be provided when the left-eye pixels 115a and the right-eye pixels 115b are driven by a same signal, so that it is the structure that is also capable of achieving two-dimensional image display.
As a material of the lenticular lens sheet 109, an inorganic material such as glass or an organic material such as plastics may be used. However, in general, plastic materials are used often.
As the plastics, used are engineering plastics such as polymethyl methacrylate (PMMA), cyclopolyolefin (COP), polycarbonate (PC), etc.
Further, in general, a glass substrate is used for the display panel. Thus, in the structure as shown in
For a series of issues regarding the changes in the use temperature, Patent Document 1 proposes a combination of the optical distribution module and the display panel described above.
As shown in
Further, Patent Document 4 discloses a technique regarding a display device for measuring a peripheral atmosphere temperature of a light-emitting element, and setting the drive condition of the light-emitting element based thereupon (not shown). This technique is designed in view of the fact that fluctuation of the atmosphere temperature influences the light-emitting property of a light-emitting diode when the light-emitting diode is used as the light-emitting element, and the driving condition of the light-emitting diode is set and used by corresponding to the temperature.
However, there are following inconvenient issues with the related techniques described above. In the case of the display device (
Thus, in order to correct it only with the shielded positions of the light-shielding panel 208, at least ten to hundred times or higher of the resolution with respect to the resolution of a TFT-LCD (liquid crystal display element) 221 is required as the resolution of the light-shielding panel 208.
Thus, the device cost becomes extremely high.
In the case of the display device (
This causes many inconveniences in terms of reduction in the cost, reduction in the weight, flexibility, and the like, which are the great disadvantage for being developed into a product.
In the case of the display device (
Thus, the device cost is extremely increased.
The display device disclosed in Patent Document 4 is a device in which the temperature dependency of the light-emitting diode is improved, and there is no disclosure regarding the temperature property of the lens array related to 3D.
An object of the present invention is to provide a stereoscopic display device, a method for generating stereoscopic display image data, and a program therefor capable of effectively displaying stereoscopic images by corresponding to the environmental condition where the use temperature changes, when a lens eye that is excellent in the productivity and the cost is used.
In order to achieve the foregoing object, as shown in
Among those, the stereoscopic image generating module is provided with: a temperature sensor which detects temperatures of the image distributing section; and a data storage section which stores information regarding an effective linear expansion coefficient difference between the image distributing section and the display panel section when the both are in a fixed state, size of the display panel section, resolution of the unit pixels, a reference temperature, and 3D crosstalk characteristic as parameter information regarding an inherent stereoscopic viewing region of the stereoscopic display panel.
Further, the stereoscopic image generating module includes: a deformation amount calculating section which calculates a temperature difference ΔT between temperature information detected by the temperature sensor and the reference temperature, and calculates a deformation amount that is a contraction amount or an expansion amount which changes due to a change in surrounding environment temperatures of the image distributing section based on the temperature difference ΔT and the information stored in the data storage section; and a main arithmetic operation controller which, when the deformation amount regarding contraction or expansion is calculated by the deformation amount calculating section, generates 3D image data corresponding thereto and outputs the generated data to the display panel driving section for driving the display panel.
In order to achieve the foregoing object, as shown in
In order to achieve the foregoing object, as shown in
In order to achieve the foregoing object, as shown in
In order to achieve the foregoing object, the stereoscopic display image data generating program according to the present invention is used for a stereoscopic display device which includes: a stereoscopic display panel including a display panel section having a plurality of unit pixels and an image distributing section for distributing and outputting visual recognition image data sent out from the display panel section as visual recognition stereoscopic image information towards outside; a display panel driving section which drives the display panel section of the stereoscopic display panel according to 3D image data; and a stereoscopic image generating module including a main arithmetic operation controller which controls actions of the display panel driving section and generates 3D image data for driving the display panel based on three-dimensional data containing depth information captured separately, and the program causes a computer to execute:
In order to achieve the foregoing object, the stereoscopic display information generating program is used for a stereoscopic display device which includes: a stereoscopic display panel including a display panel section constituted with a plurality of unit pixels and an image distributing section for distributing and outputting visual recognition image data outputted from the display panel section as visual recognition stereoscopic image information towards outside; a display panel driving section which drives the display panel section of the stereoscopic display panel; and a stereoscopic image generating module including a main arithmetic operation controller which controls actions of the display panel driving section and generates 3D image data for driving the display panel based on three-dimensional data containing depth information captured separately, and the program causes a computer to execute:
In order to achieve the foregoing object, the stereoscopic display image data generating program is used for a stereoscopic display device which includes: a stereoscopic display panel including a display panel section having a plurality of unit pixels and an image distributing section for distributing and outputting visual recognition image data sent out from the display panel section as visual recognition stereoscopic image information towards outside; a display panel driving section which drives the display panel section of the stereoscopic display panel; and a stereoscopic image generating module which controls actions of the display panel driving section and generates 3D image data for driving the display panel based on three-dimensional data containing depth information, and the program causes the computer to execute:
The present invention is structured to drive the stereoscopic display device panel by generating 3D image data by corresponding even to the temperature changes in the peripheral environments of the stereoscopic display device. Therefore, even when there is a change in the environment temperature, it is possible to display the 3D image in a stable state by corresponding to that.
Thus, the stereoscopic visibility can be improved without giving a sense of uncomfortablenss to the observers.
Hereinafter, each of first to fifth exemplary embodiments according to the present invention will be described in order by referring to
First, before explaining each of the first to fifth exemplary embodiments, a specific example of a stereoscopic image content (3D content) generating method executed in common in each of the first to fifth exemplary embodiments will be described by, referring to
Thereafter, each of the first to fifth exemplary embodiments will be described in a specific manner.
First, an example of the 3D content generating method is shown in
Then, it is so defined that the horizontal direction of the screen face 40 is an x-axis, the direction orthogonal to the x-axis is a y-axis, the direction orthogonal to the xy plane provided by the x-axis and the y-axis is a z-axis, an intersection point 34 is the origin, and the positive and negative directions of the x-, y-, and z-axes are as shown in
In this state, popup image parallax images as in
For example, in a case where the object is placed in the center of the screen, regarding the popup image parallax images of
In a stereoscopic display device using a lens array shown in
The display panel section 11A is constituted with a plurality of pixels acquired by arranging optical modulators in matrix for one and the other substrates 2 and 3 as a pair. In
Then, the observer can observe a prescribed stereoscopic image when the left eye 7a is located within the left-eye region 5a and the right eye 7b is located within the right-eye region 7a.
Further,
In general, a plastic material is used often for the lenticular lens 1 as described above. Further, in general, a glass material is used for the display panel section 11A. In the case of the structure using such typical materials, when there is a change in the use environmental temperature, the lens pitch L shown in
For example, on the low-temperature side, there is generated contraction with which the lens pitch becomes “L−ΔL” as shown in
When the state where both of the display panel section 11A and the lenticular lens 1 are fixed is defined as the effective linear expansion coefficient difference, the effective linear expansion coefficient difference is greater in a case of fixing the lenticular lens 1 locally than in a case of fixing the lenticular lens 1 on the entire face. Further, the effective linear expansion coefficient depends on the fixing material mechanical property value even in the case of fixing it on the entire face.
Furthermore, it is also possible to interpose a polarization plate (not shown) between the display panel section 11A and the lenticular lens 1. In this case, the effective linear expansion coefficient difference depends also on the mechanical property value of the polarization plate material in addition to the above-described fixing method.
Regarding the case of having such temperature changes, changes in the optical model which projects the parallax image to both the left and right eyes of the observer are shown in and
With respect to the optical models of the lens contraction state shown in
In the meantime,
With respect to the optical models of the lens expansion state shown in
In the meantime,
The Inventors conducted experiments regarding whether or not this phenomenon occurs really subjectively. Next, the result thereof will be described hereinafter.
First,
The effective linear expansion coefficient difference of the display panel section 11A and the lenticular lens 1 is 30 ppm.
Note here that the evaluation was done under a condition that the proportion of the size of the parallax image with respect to the entire screen for the X-axis direction defined in
According to the result, the stereoscopic viewing region when observing the popup image decreases largely on the high-temperature side, while the stereoscopic viewing region when observing the depth image decreases largely on the low-temperature side. This is a result that has no conflict with the explanations of
Further, it is also confirmed that the fluctuation of the stereoscopic viewing region for the temperature change becomes smaller as the 3D region becomes smaller. This means that parallax image comes to exist near the center of the screen as the 3D region becomes smaller, so that there is less influence of the lens pitch fluctuation.
Further,
Basically, the stereoscopic viewing region is almost equivalent in a case where the popup parallax amount and the depth parallax amount are the same. In a case where there is no lens pitch fluctuation due to the temperature fluctuation as described above, the difference of the stereoscopic viewing region for the parallax directions is extremely small. It can be seen that the change in the visually recognizable range for the popup and depth parallax directions as shown in
In the meantime, it is also possible to describe the fluctuation in the stereoscopic viewing region for the temperature change by using the concept of 3D crosstalk. Note here that 3D crosstalk is mixture or leak of another viewpoint video into a given viewpoint video. As the factors for determining the 3D crosstalk, there are the pixel structure of the display panel, performances of the image distributing section (image forming performance in case of a lens, slit aperture ratio and the like in case of a barrier), and the like.
However, it is almost within 10%.
Hereinafter, the luminance distribution state of the light emitted from the left and right pixels within the region by having L0 as the center will be described. As going away from L0 towards the left direction, the luminance of the light emitted from the right pixel becomes lower, while the luminance of the light emitted from the left pixel becomes higher. As going away from L0 towards the right direction, the luminance of the light emitted from the left pixel becomes lower, while the luminance of the light emitted from the right pixel becomes higher. L1 in
For verifying the explanations provided heretofore,
When the both eyes shift from the center of the panel to the right direction (−X direction), a right-eye image starts to be viewed at the point where the left eye reaches L2, and a double image starts to appear. When shifted to the right direction (−X direction) further, the luminance of the right-eye video entering the left eye becomes increased. Thus, when the left eye is at the position of L0, the luminance of the right-eye video entering the left eye becomes almost equal to that of the left-eye video, thereby starting to fail as a 3D video. When the left eye shifts to the right direction (−X direction) further, the luminance of the right-eye video becomes higher than that of the left-eye video entering the left eye, thereby starting to enter a pseudoscopy region.
In this exemplary embodiment, as shown in
In
The directions of signs are as shown in
As shown in
Further, the exit direction of the light ray R1 emitted from the −X side of the right-eye focused pixel for displaying the popup image is consistent with the exit direction of the light ray Lr emitted from the +X side of the left-eye focused pixel for displaying the depth image, and the exit direction of the light ray R1 emitted from the −X side of the right-eye focused pixel for displaying the depth image is consistent with the exit direction of the light ray Lr emitted from the +X side of the left-eye focused pixel for displaying the popup image. Thus, at a normal temperature, a 3D crosstalk region L_crst having Lr as the center and a 3D crosstalk region R_crst having R1 as the center are equivalent.
At a normal temperature, when the distance from the panel surface to the intersection point L0 on the +Y side is set as an optimum observing distance, a 3D crosstalk region width at the optimum observing distance in the case of popup shown in
Next, the state of changes in each of the parameters regarding the viewing region when displaying the popup and depth images on the high-temperature side will be described by referring to
In
As shown in
As described above, the light ray Lr emitted from the +X side of the focused left pixel and the light ray R1 emitted from the −X side of the focused right pixel are symmetric with respect to the center of the panel regardless whether it is the popup image or the depth image, so that the light ray mixed width c1 and the no light ray width c2 are the same.
However, when the depth image is observed with a 3D panel as shown in
When displaying the depth image, the +X side of the no light ray width is filled by the light of the left-eye focused pixel, and the −X side is filled by the light of the right-eye focused pixel.
Thus, as shown in
Thus, the stereoscopic viewing region when displaying the popup image is smaller than that of the depth image.
In the meantime, as in the explanation of
In order to verify the explanations above, evaluation experiments were conducted by the Inventors. The results thereof are described by referring to
While the changes in the stereoscopic viewing region and the pseudoscopy free region in the cases of displaying the popup and depth images at the high temperature are described above, the same can be described also in the cases of low temperatures.
As shown in
As shown in
As described above, the light ray Lr emitted from the +X side of the focused left pixel and the light ray R1 emitted from the −X side of the focused right pixel are symmetric with respect to the center of the panel regardless of the popup image or depth image, so that the light ray mixed width c4 and the no light ray width c3 are the same.
Further, light emitted from the right-eye focused pixel is also mixed into the left-eye viewing region b4. Thus, as shown in
When displaying the popup image, the +X side of the no light ray width is filled by the light of the left-eye focused pixel, and the −X side is filled by the light of the right-eye focused pixel. Thus, as shown in
As in the case of high temperatures, the distance from the center C11 of the both eyes when the left eye is at L0 to the center Cr1 of the both eyes when the right eye is at L0 is defined as a pseudoscopy free region.
Therefore, there is a change in the stereoscopic viewing regions of the popup and depth images when there is a change in the temperature, while there is no change in the pseudoscopy free regions of the popup and depth images.
Next, each of first to fifth exemplary embodiments according to the present invention will be described in order by referring to the accompanying drawings.
(First Exemplary Embodiment)
Hereinafter, the first to fifth exemplary embodiments according to the present invention will be described by referring to
First, the entire content of the first exemplary embodiment will be described, and a modification example of the first exemplary embodiment will be described thereafter.
(Basic Structure)
In
As shown in
Those are disposed as illustrated in the drawing. Among those, used as the lenticular lens 1 in the first exemplary embodiment is a lens array type that is formed as a sheet as a whole.
The stereoscopic display device 10 further includes a temperature sensor 21 which detects the temperature of the lenticular lens (image distributing section) 1, and includes a data storage section 25 which stores the stereoscopic viewing region defined based on the effective linear expansion coefficient difference between the lenticular lens 1 and the display panel section 11A, size of the display panel section 11A, resolution of the unit pixels, a reference temperature Tth, a 3D crosstalk property, and the like, which define the parameter information regarding the stereoscopic viewing region intrinsic to the stereoscopic display panel 11A.
Further, the stereoscopic image generating module 22 is constituted by including: a deformation amount calculating section 28 which calculates a temperature difference ΔT between temperature information T detected from the temperature sensor 21 and the reference temperature Tth, and calculates the deformation amount as the contraction amount or the expansion amount that changes due to a change in the peripheral environmental temperature of the lenticular lens (image distributing section) 1 based on the temperature difference ΔT; and a main arithmetic operation controller 31 which, when the three-dimensional data is inputted, performs accumulation processing thereof as the information of the object that is a display target to the data storage section 25 and, when the deformation amount regarding contraction or expansion is calculated by the deformation amount calculating section 28, and generates the display panel driving 3D image data corresponding thereto.
Note here that reference numeral 24 is an input section for inputting a command from the outside to the main arithmetic operation controller 31, necessary data, and the like.
This provides a structure capable of generating the 3D image data by effectively corresponding to the temperature change when there is a change in the peripheral environmental temperature of the lenticular lens 1 and the display panel section 11A.
The stereoscopic image generating module 22 further includes: a camera setting information instruction section 22A which stores in advance a plurality of pieces of camera setting information that specifies parameters of setting positions of a pair of cameras as a condition for rendering processing the three-dimensional data accumulated in the data storage section 25; and a temperature difference judging section 30 which performs an arithmetic operation regarding whether or not the absolute value of the temperature difference ΔT of the detected temperature with respect to the reference temperature Tth is equal to or less than the absolute value of a reference value ΔTth set in advance, and judges whether or not it is a temperature environment that requires correction for the parallax amount specified on the x-axis on an xy plane that is the display face (screen face) of the three-dimensional image containing z-axis information as the depth information. Note here that setting parameters regarding each of the first to third camera settings A, B, C shown in
Thereby, when there is a change in the peripheral environmental temperature described above, it is possible to immediately make judgment regarding necessity of correcting the parallax amount described above by corresponding thereto.
In that case, the main arithmetic operation controller 31 includes a 3D image data generating function 31G which: operates when it is judged by the temperature difference judging section 30 that the temperature difference ΔT is |ΔT|≦|ΔTth| and it is under a temperature environment that does not require correction of the parallax amount; performs rendering processing on the three-dimensional data containing the depth information under the first camera setting A; and generates and outputs 3D image data based on two-dimensional parallax images having the parallax amount determined by the three-dimensional data and the camera setting A for driving the display panel (see
Further, the above-described main arithmetic operation controller 31 is provided with a correction environment judging section 29 which operates when it is judged by the temperature difference judging section 30 that the temperature difference ΔT is |ΔT|>|ΔTth| and it is under a temperature environment that requires correction of the parallax amount to make judgment whether the lenticular lens 1 is in a state of ΔT<0 showing a contraction state or a state of ΔT>0 showing an expansion state (see
Further, as shown in
The contraction-state correction controller 31A includes a popup side image data processing function 31a which operates when it is judged by the correction environment judging section 29 that the lenticular lens 1 is in a contraction state (ΔT<0) to judge whether or not the depth of the object is at a position of z≧0 on the popup side and, when judged that it is located at a position of z≧0, performs rendering processing on the three-dimensional data of z≧0 under the condition of the first camera setting A.
Further, similarly, the contraction-state correction controller 31A includes a non-popup side image data processing function 31b which operates when it is judged that the lenticular lens 1 is in a contraction state (ΔT<0) to judge whether or not the depth of the object is at a position of z≧0 on the popup side and, when judged that it is located at a position of z<0 on the non-popup side, performs rendering processing on the three-dimensional data of z<0 under the condition of the second camera setting B (see
Further, the contraction-state correction controller 31A includes: an image data synthesizing function 31c which performs synthesizing processing on the image data on which rendering processing is performed by the popup side image data processing function 31a and the non-popup side image data processing function 31b, respectively; and a 3D image data generating function 31d (contraction state) which generates and outputs 3D image data based on the synthesized image data for driving the display panel.
Thereby, even when the lenticular lens 1 is in a contraction state, 3D image data can be effectively generated for the object located on the popup side (z≧0) and the non-popup side (z<0) as will be described later.
In the meantime, the expansion-state correction controller 31B of the main arithmetic operation controller 31 includes a non-popup side image data processing function 31e which operates when it is judged by the correction environment judging section 29 that the temperature difference ΔT is ΔT>0 and the lenticular lens 1 is in an expansion state to judge whether or not the object is at a position of z<0 on the non-popup side and, when judged that it is located at a position of z<0, performs rendering processing on the three-dimensional data of z<0 under the condition of the first camera setting A.
Further, similarly, the expansion-state correction controller 31B includes a popup side image data processing function 31f which operates when it is judged that the lenticular lens 1 is in an expansion state (ΔT>0) to judge whether or not the depth of the object is at a position of z<0 on the non-popup side and, when judged that it is located at a position of z≧0, performs rendering processing on the three-dimensional data of z≧0 under the condition of the third camera setting C (see
Further, the expansion-state correction controller 31B includes: an image data synthesizing function 31g which performs synthesizing processing on the image data on which rendering processing is performed by the non-popup side image data processing function 31e and the popup side image data processing function 31f, respectively; and a 3D image data generating function 31h (expansion state) which generates and outputs 3D image data based on the synthesized image data for driving the display panel.
Thereby, even when the lenticular lens 1 is in an expansion state, 3D image data can be effectively generated for the object located on the popup side and the non-popup side as will be described later.
Further, the main arithmetic operation controller 31 described above is provided with a depth image development processing section 22B which develops two-dimensional image information as an object image for the three-dimensional data regarding the object sent into the main arithmetic operation controller 31 and develops the depth information thereof (depth position) as a depth image. Further, the depth image development processing section 22B includes a gradation value specifying function which sets a gradation value for the three-dimensional data by corresponding to the depth information (depth position) by a pixel unit, and specifies the value of the set gradation value by corresponding to the parallax amount of the two-dimensional image information specified on the x-axis.
Note here that the depth image is basically specified to have the gradation value based on the depth information by the pixel unit.
Hereinafter, this will be described in a more specific manner.
(Specific Structure)
Referring to
Among those, the display panel section 11A is a liquid crystal panel on which a plurality of unit pixels are formed in matrix as a whole. When performing stereoscopic display, the unit pixels arranged along a horizontal direction that is in parallel to the direction along which both eyes 7a, 7b of the observer are placed are used as the left-eye pixels 4a and the right-eye pixels 4b alternately. In
As in the case of the first exemplary embodiment, each of the exemplary embodiments described above explains the case where the lenticular lens 1 is used as the image distributing section. However, the image distributing section is not limited only to the lenticular lens 1. For example, it is possible to broadly employ an optical element including a prism sheet on which a prescribed pattern is formed, a reflection sheet, a diffusion sheet, a barrier sheet, etc. Further, as the lens sheet and the barrier sheet, it is also possible to employ an electro-optical element capable of performing refractive index control and light-shielding control by using the liquid crystal or the like.
Further, while each of the exemplary embodiments is described as examples of the case where a liquid crystal panel is mounted as the display panel section 11A, the present invention is not limited only to that. It is possible to broadly employ a display device that is a light modulator including an organic EL panel, an inorganic EL panel, PDP, FED, CRT, etc. Further, while a case of 2-viewpoints regarding the number of viewpoints is described as a way of example, the present invention is not limited only to that. The present invention can be employed also to the case of arbitrary N-viewpoints.
Incidentally, the lenticular lens 1 of the first exemplary embodiment is constituted with a plurality of cylindrical lenses 9 as shown in
The lenticular lens 1 further functions as a distributing module which distributes right lays emitted from each pixel to both eyes of the observer. The left-eye region 5a is formed by the light rays from the left-eye pixels 4a at the both ends of the stereoscopic display panel 11 and the center, and the right-eye region 5b is formed by the light rays from the right-eye pixels 4b. Further, the observer can observe a prescribed stereoscopic image when the left eye 7a is located within the left-eye region 5a and the right eye 7b is located within the right-eye region 7b.
As described above, the display controller 12 includes a function of driving the display panel section 11A of the stereoscopic display panel 11, and a function of generating a stereoscopic parallax image by corresponding to the use environmental temperature detected by the temperature sensor 21.
That is, as shown in
Note here that the temperature sensor 21 is a sensor for detecting the device temperature (particularly the peripheral environmental temperature of the lenticular lens 1). As the temperature sensor 21, it is possible to use a contact type sensor such as a platinum temperature resistor, a thermistor, or a thermocouple, and a noncontact type sensor such as an infrared ray sensor. The device temperature depends largely on the use environmental temperature and the extent of the Joule heat from the electro-optical element and the like within the device.
As described above, the data storage section 25 provided to the stereoscopic image generating module 22 holds the parameter information and the like regarding the stereoscopic viewing region defined based on the temperature information acquired from the temperature sensor 21, the effective linear expansion coefficient difference intrinsic to the stereoscopic display panel, the panel size, the panel resolution, the reference temperature Tth, the 3D crosstalk property, and the like.
As described above, the stereoscopic image generating module 22 includes the function of generating the image data for driving the display panel. As described above, the stereoscopic image generating module 22 is constituted by including: the main arithmetic operation controller 31, a memory (command information storage section 26) which stores in advance various kinds of command information for restricting the action and the arithmetic operation function of the main arithmetic operation controller 31; the above-described data storage section 25 as the data accumulation section; and the deformation amount calculating section 28 which calculates the state of deformation (contraction or expansion) of the lenticular lens 1 and the deformation amount based on the temperature information from the temperature sensor 21.
Further, the stereoscopic image generating module 22 has various functions of: generating 3D image data having a parallax and depth based on the signal from the temperature sensor 21 and the parameter information; generating image data with no parallax (2D image data); synthesizing the 3D image data and the 2D image data; converting the gradation of the depth data; offset processing of the parallax data; and the like. The main function of the stereoscopic image generating module 22 is structured to be executed by the main arithmetic operation controller 31 as will be described later.
Generation of the image data done by the stereoscopic image generating module 22 is performed by reading out the display target data of the data storage section (data accumulating section) 25 by the main arithmetic operation controller 31 and by applying image processing. The display target data is the three-dimensional data containing the depth information, and the rendering processing is applied thereon by the main arithmetic operation controller 31 to generate the two-dimensional image data constituted with parallax images. In this case, 3D data used for stereoscopic display, i.e., the two-dimensional image data for both of the left and right eyes having a parallax, is generated by performing rendering processing, respectively, by setting two virtual viewpoints corresponding to the left and right eyes of the observer.
When generating the image data, it is executed by setting the two virtual viewpoints based on the information detected by the temperature sensor 21 and applying the rendering processing according to the temperature information as will be described later.
When merging the 2D image data where a parallax is provided only to a specific object on a plane display with the 3D image data, the 2D image data used for plane display is generated by setting a single viewpoint corresponding to the center of both eyes of the observer and applying rendering processing in advance, and the 3D image data can be generated by setting the two virtual viewpoints and applying rendering processing according to the temperature information.
The specific processing of such case will be disclosed in a second exemplary embodiment.
Further, it is also possible to generate the depth data as shown in
The depth data is a gray scale image corresponding to the two-dimensional image, in which gradation values based on the depth information are employed to the pixel units. In this case, the gradation values of the depth map are changed in accordance with the temperature information detected by the temperature sensor 21. The operation processing is all executed by the depth image development processing section 22B by being controlled by the main arithmetic operation controller 31 as will be described later.
When providing stereoscopic display by using those image data, the unit pixels of the display panel 11 are alternately used as the right-eye pixel and the left-eye pixel in the horizontal direction.
Note here that a method for generating the three-dimensional data containing the depth information is preferable for generating the image data. However, it is also possible to accumulate the display target data on which the rendering processing is applied based on the camera setting corresponding to the contraction and expansion of the lens to the data storage section 25 in advance, and to selectively read out the display target data based on the temperature information from the temperature sensor. That is, as described above,
When the image data is accumulated in advance in a form of two-dimensional data in this manner, the rendering processing becomes unnecessary. Thus, the load of the main arithmetic operation controller 31 becomes lightened greatly than the method that requires rendering.
Therefore, it is possible to correspond effectively even with devices with low processing capacity and arithmetic operation speed, so that the stereoscopic image generating module (image generating section) 22 can be structured at a low cost. In the case of merging the 2D image data with the 3D image data, the 2D image data may also be accumulated in advance in the same manner.
The stereoscopic image generating module 22 has the function of generating the 2D/3D image data according to the signal from the temperature sensor 21 and outputting it to the display panel driving section 23 in the manner described above.
Note here that, as the 2D/3D image data, the stereoscopic image generating module 22 can output various forms of data such as data acquired by synthesizing images of each view point such as side by side, line by line, and dot by dot, data acquired by combining a center image and a depth image, and data acquired by transmitting videos of each viewpoint in a time series manner.
Further, the display panel driving section 23 has a function of generating signals (synchronizing signals and the like) required for driving the 3D display panel 11. In this case, when the lenticular lens (image distributing section) 1 constituting the 3D display panel 11 is an electro-optical element such as a liquid crystal barrier or a liquid crystal lens, it is possible to employ a structure that includes a function of outputting a prescribed signal to the lenticular lens from the display panel driving section 23 according to the 2D/3D data.
Regarding the main arithmetic operation controller 31 shown in
(Regarding Image Data Correction (Revising Processing))
Next, correction (revising processing) of the 3D image data executed according to the change in the temperature of the lenticular lens 1 will be described.
In
Further,
Thereby, under the lens contraction state, the first exemplary embodiment makes it possible to turn to the state of being able to securely recognize the depth image from the state where the observer can recognize only the popup image but cannot recognize the depth image.
Further,
Thereby, under the lens expansion state, the first exemplary embodiment makes it possible to turn to the state of being able to securely recognize the popup image from the state where the observer conventionally can recognize only the depth image but cannot recognize the popup image.
(Image Data Generating Action)
In order to achieve the optical model disclosed in
In order to simplify the explanation of
First, stereoscopic display is started and, at the same time, the temperature sensor 21 for detecting the temperature of the display device (specifically the lenticular lens 1) is started up.
Then, the difference ΔT between the temperature T of the lenticular lens 1 detected by the temperature sensor 21 and the reference temperature Tth set in advance is calculated by the deformation amount calculating section 28 (
Note here that the camera position ZC is the position of the camera in the direction along the z-axis for the screen face (z=0) 40, and the inter-camera distance XC is the space between the pair of cameras 35a and 35b in the x-axis direction, and the angle in this state between the z-axis and the optical axis of each of the cameras 35a and 35b, i.e., the included angle, is defined as η. In the first exemplary embodiment, an apple object 42 is placed on the far side (z<0) of the screen face 40, and a grape object 43 is placed on the front side (z≧0), respectively. The camera setting A (first camera setting A) is set in accordance with the panel size, the panel resolution, and the like among the parameter information. However, it is also possible to employ a structure with which the camera setting A can be set arbitrarily as necessary or according to the preference of the panel observer.
Then, each of the absolute values of the difference ΔT (the difference between the detected temperature T and the reference temperature Tth) and the judgment threshold value ΔTth is compared to judge whether or not the correction (revising) of the parallax amount is necessary (
When judged in the correction necessity judging step of step S103 as |ΔT|≦|ΔTth|, it is considered that the deformation amount of the lenticular lens 1 due to the change in the temperature is small and that the parallax amount correction is unnecessary. Thus, the three-dimensional data is immediately rendering-processed under the condition of the first camera setting A (
In the meantime, in a case of |ΔT|>|ΔTth|, it is considered that the deformation amount of the lenticular lens 1 due to the change in the temperature is large and that the parallax amount correction is necessary. Thus, in order to detect whether the lenticular lens 1 is in the direction of contraction or the direction of expansion, it is shifted to execute judgment on the sign of ΔT (
Further, in a case where ΔT<0 in step S107 of
In the former case where ΔT<0, i.e., when it is judged that the lenticular lens 1 is in a contraction state, it is judged in step S108 of
In the meantime, in a case where z<0, i.e., when the position of the object with respect to the z-axis is the far side with respect to the screen face 40, the condition of the camera setting B (the second camera setting B) shown in
Note here that, as shown in
The parameters other than ΔT can be treated as constants normally, so that only ΔT is a variable. θ1 becomes smaller as ΔT becomes lager. However, the relation between θ1 and ΔT is not limited only to a linear form but may also be a non-linear form.
Thereby, the parallax amount of the object 42 on the x-axis coordinate becomes smaller from a dimension B as B−β in the left-eye image and becomes smaller from a dimension B as B−β in the right-eye image, thereby providing an image that can be observed even in a lens contraction state as described above in
Then, the image data of
While the rendering processing is executed on the three-dimensional data as the target under the condition of the first camera setting A in step S109 of
In the meantime, in a case of the state of ΔT>0 (i.e., the state where the lenticular lens 1 is expanded with respect to the reference state), it is set to be shifted to step S113 (investigate the depth position of the object).
In step S113, executed is the judgment regarding whether or not the position of the object having the depth information with respect to the z-axis is on the far side than the screen face 40, i.e., where or not z<0.
Then, in a case of z<0, the rendering processing is executed on the three-dimensional data of the object 42 under the condition of the first camera setting A (
Further, in a case of z<0, i.e., when the position of the object with respect to the z-axis is the far side with respect to the screen face 40, a condition of a third camera setting C shown in
Thereby, the 3D image data as shown in
Note here that, the angle θ2 formed between the optical axes of each of the cameras 35a and 35b and the z-axis in the third camera setting C shown in
Thereby, the parallax amount of the object 43 becomes smaller from A as A−α and from A as A—α, thereby providing an image that can be observed even in a lens expansion state as described in
As shown in
Then, the image data of
These are both executed by the main arithmetic operation controller 31.
While the rendering processing is executed on the three-dimensional data as the target under the condition of the first camera setting A in step S114 of
While it is judged in step S108 and S113 that the position of the object having the depth information with respect to the z-axis as the front side z≧0 of the screen face 40 and the far side z<0, the positions are not limited only to such case. It is also possible to judge as the front side z>0 and the far side z≦0 or to judge as the front side z≧0 and the far side z≦0. This also applies in the second and third exemplary embodiments to be described later.
As has been described above, the rendering processing is performed according to the value of the temperature difference ΔT, and the 3D image data acquired in step S105 is transmitted to the stereoscopic display panel 11 via the display panel driving section 23 as the 2D/3D image data (display panel driving data) shown in
Then, judgment regarding update of ΔT is executed (
Note here that step S106 of
Thus, it is not necessary to execute the judgment of step S106 shown in
It is possible to employ a structure with which the number of passages is counted and the observer gives a command to execute a judging action from an operation switch or the like of the stereoscopic display device 10 when it reaches a proper count value or to employ a structure with which a judging action is automatically executed when reaching a prescribed count value.
While the case where there are one each of the objects 42 and 43 having the depth information described in
At the same time, generation of the image data for this example of
Further, while the content of the present invention has been described in the first exemplary embodiment by mainly referring to the example where the three-dimensional data is rendering-processed to develop the parallax image, the present invention is not limited only to that. For example, the result acquired by the rendering processing can be developed into a two-dimensional image and a depth image showing the depth information thereof as shown in
That is, the main arithmetic operation controller 31 of the first exemplary embodiment is provided with the depth image development processing section 22B which develops the two-dimensional image information of the three-dimensional data regarding the object sent into the main arithmetic operation controller 31 as an object image and the depth information (depth position on the z-axis) as a depth image. Further, the depth image development processing section 22B has a function which sets gradation values corresponding to the depth information by the pixel unit for the three-dimensional data and specifies the set gradation values by corresponding to the parallax amount of the two-dimensional image information specified on the x-axis.
In this case, the depth image undergoes the specifying processing by the gradation value specifying function of the depth image development processing section 22B to have the gradation values based on the depth information basically by the pixel unit as described above.
The processing content of the depth image development processing section 22B of this case is shown in
In
It is possible to make the background as the same plane with the screen face 40 by setting the gradation value of a background 46e as 128. It is also possible to set the background as a popup or depth plane by using the gradation values larger or smaller than the gradation value 128.
The depth image developing processing is executed by the depth image development processing section 22B of the main arithmetic operation controller 31.
Similarly,
Further, while the cross method is used for the explanation as the image capturing method for acquiring the parallax images or the depth images, it is also possible to execute the similar processing with a parallel method.
For the stereoscopic display device 10 disclosed in the first exemplary embodiment, the 3D image data generating method disclosed in
Further, regarding the invention of the program, the programmed content may be recorded to a non-transitory recording media such as a DVD, a CD, a flash memory, and the like. In such case, the recorded program is read out and executed by a computer.
With this, it is also possible to achieve the above-described object of the present invention effectively.
Next, the content of the evaluation of the stereoscopic viewing regions under the use environmental temperatures executed by using the method of the first exemplary embodiment will be described.
Note here that the evaluation was done under a condition that the proportion of the size of the parallax image with respect to the entire screen for the X-axis direction defined in
The data having a mixture of the popup and depth images as shown in
This is because the parallax amount is controlled for a specific parallax direction according to the use environmental temperature. It is verified that the use temperature range is greatly improved compared to the case of
In the actual contents, it is rare to provide the 3D region with a large parallax on the entire screen.
It is more common to provide the 3D region with a large parallax in the region of about 40 to 60% with respect to the center of the screen.
Comparing
Further, according to the result, the effective linear expansion coefficient difference that becomes effective at the point over ±15° C. with respect to the 60% 3D region is about 15 ppm. It is therefore found that the first exemplary embodiment is very effective when the effective linear expansion coefficient difference becomes 15 ppm or more.
As described above, with the first exemplary embodiment, whether or not the correction control of the image data outputted in each of the contraction state and the expansion state of the lenticular lens 1 can be judged by the temperature difference judging section 30 promptly. It is designed to subsequently operate the contraction state correction controller 31A or the expansion state correction controller 31B by corresponding to each of the contraction state or the expansion state of the lenticular lens 1, respectively, so that the correction control of the image data can be achieved efficiently by promptly corresponding to the change in the environmental temperature.
This makes it possible to acquire an excellent stereoscopic image display device which can effectively display the stereoscopic image display by the lenticular lens 1 continuously even when there is a change in the environmental temperature of the surroundings.
Further, the stereoscopic image display device can use materials whose linear expansion coefficients are different for the display panel, i.e., a typical plastic substrate can be used as the lenticular lens, and a typical glass substrate can be used as the display panel, so that there is such a merit that a great number of display devices can be supplied at a low cost.
Further, as the 2D/3D data corresponding to the change in the environmental temperature of the surroundings, the stereoscopic image display device can output various forms of data such as data acquired by synthesizing images of each view point such as side by side, line by line, and dot by dot, data acquired by combining a center image and a depth image, and data acquired by transmitting videos of each viewpoint in a time series manner from the stereoscopic image generating module. Thus, the stereoscopic image display device exhibits the flexibility for the interface specification of the display panel driving section, so that it can be employed to wide variety of display devices. This results in achieving high performance of the display panel and to reducing the cost.
While the case of two viewpoints has been described in the first exemplary embodiment, the present invention is not limited only to that. The present invention can also be applied to N-viewpoints in the same manner.
(Modification Example)
Next, a modification example of the first exemplary embodiment will be described by referring to
Note here that same reference numerals are used for the same structural members as those of the first exemplary embodiment.
Meanwhile, in the modification example of the first exemplary embodiment, as shown in
The non-popup side z-value conversion processing function 32b can acquire 3D image data similar to that of the first exemplary embodiment by performing the z-value conversion processing on the three-dimensional data at the time of the first camera setting A based on the included angle information of a pair of cameras under the second camera setting B by taking the z-axis on the depth coordinate under the first camera setting A as the reference.
The correction coefficient α described above is less than a numerical value “1” and, as described above, it can be determined based on the included angle information of the first camera setting A and the included angle information of the second camera setting B. Further, the correction coefficient α is not limited only to that. It is possible to define the coefficient as a constant value regardless of the extent of the z-value as long as it is within a range with which the stereoscopic visibility is not deteriorated for the temperature change. Alternatively, it is also possible to change the coefficient linearly or nonlinearly depending on the extent of the z-value.
Further, instead of the image data synthesizing function 31c disclosed in
Further, in this modification example, the expansion-state correction controller 31B of the first exemplary embodiment described above is also employed. Instead of the expansion-state correction controller 31B, an expansion-state correction controller 32B is provided.
That is, in this modification example, as shown in
The non-popup side z-value conversion processing function 32f can acquire 3D image data similar to that of the first exemplary embodiment by performing the z-value conversion processing on the three-dimensional data at the time of the first camera setting A based on the included angle information of a pair of cameras under the third camera setting C by taking the z-axis on the depth coordinate under the first camera setting A as the reference.
Note here that the extent of the correction coefficient β can be set in the same manner as the case of the correction coefficient α described above.
Further, instead of the 3D image data synthesizing function 31g disclosed in
Thereby, it becomes unnecessary to change the camera setting between the popup-side image data processing function 31a and the non-popup side z-value conversion processing function 32b of the contraction-state correction controller 32A and between the non-popup side image data processing function 31e and the popup-side z-value conversion processing function 32f of the expansion-state correction controller 32B, respectively. Further, the image data synthesizing function becomes unnecessary. Therefore, load on the system side (particularly the main arithmetic operation controller) can be lightened greatly, and the speed of the image processing can be increased as well.
Other structures and the operation effects thereof are the same as the case of the first exemplary embodiment described above.
(Second Exemplary Embodiment)
Next, a second exemplary embodiment of the present invention will be described by referring to
Further,
Note here that same reference numerals are used for the same structural members as those of the first exemplary embodiment.
The second exemplary embodiment is characterized to restrict the camera setting when performing the rendering processing on the three-dimensional data of the object having the depth information that is used in the first exemplary embodiment by the extent of a threshold value (reference value) xth regarding the parallax on the x-axis that is set in accordance with the extent of the difference ΔT.
Hereinafter, this will be provided by taking the contents depicted in the first exemplary embodiment as a presupposition.
(Structure)
First, as in the case of the first exemplary embodiment, the stereoscopic display device according to the second exemplary embodiment includes the display controller 50 which drive-controls the stereoscopic display panel 11. The display controller 50 is provided with the stereoscopic image generating module 50A having the main arithmetic operation controller 51 for restricting the actions of each of the entire structural elements to be described later.
As in the case of the first exemplary embodiment, the main arithmetic operation controller 51 is provided with an x-position threshold value setting section 50B which, when it is judged by the temperature difference judging section 30 that the temperature difference ΔT is |ΔT|>|ΔTth| and it is under a temperature environment that requires correction of the parallax amount, sets the threshold value xth on the x-axis directly related to the correction of the parallax amount to be smaller as the value of the difference ΔT becomes larger, as the threshold value xth which makes it possible to secure the stereoscopic viewing region that changes according to the extent of the temperature difference ΔT.
Further, in order to execute the correction of the parallax amount promptly and accurately, the above-described main arithmetic operation controller 51 is provided with a correction environment judging section 29 which makes judgment whether the lenticular lens 1 as the image distributing module is in a state of ΔT<0 showing a contraction state or a state of ΔT>0 showing an expansion state.
Further, as in the case of the first exemplary embodiment described above, the main arithmetic operation controller 51 includes: a contraction-state correction controller 51A which operates in a case where |ΔT|>|ΔTth| is satisfied and the temperature difference is ΔT is ΔT<0 (when the lenticular lens 1 is being contracted); and an expansion-state correction controller 51B which operates in a case where |ΔT|>|ΔTth| is satisfied and the temperature difference is ΔT is ΔT>0 (when the lenticular lens 1 is being expanded).
Out of those, the contraction-state correction controller 51A executes three data processing functions shown below different from the case of the first exemplary embodiment and synthesizes those to output the 3D image data (synthesized image data) for driving the display panel.
That is, the contraction-state correction controller 51A constituting a part of the main arithmetic operation controller 51 includes an out-of x-axis threshold value image data processing function 51j which operates when it is judged by the temperature environment judging section 28 that the temperature difference ΔT is ΔT<0 and the lenticular lens 1 (image distributing module) is in a contraction state to specify the coordinate position x of the object on the x-axis, and to perform rendering processing on the three-dimensional data of the object that satisfies |x|>|xth| under a condition of a fourth camera setting D that has a narrower included angle than the included angle of the first camera setting A.
Further, the contraction-state correction controller 51A includes a popup side image data processing function 51a which, regarding the object of the case where the temperature difference ΔT is ΔT<0 and |x|≦|xth| is satisfied, further judges whether or not the depth position z of the object is z≧0 on the popup side and, when judged as z≧0, performs rendering processing on the three-dimensional data of z≧0 under the condition of the first camera setting A.
Furthermore, the contraction-state correction controller 51A includes a non-popup side image data processing function 51b which, regarding the object of the case where the temperature difference ΔT is ΔT<0 and |x|≦|xth| is satisfied, further judges whether or not the depth position z of the object is z≧0 on the popup side and, when judged as z<0, performs rendering processing on the three-dimensional data of z<0 under the condition of the second camera setting B.
Further, the contraction-state correction controller 51A includes: an image data synthesizing function 51c which performs synthesizing processing of each image data on which rendering processing is performed by the out-of x-axis threshold value image data processing function 51j, the popup side image data processing function 51a, and the non-popup side image data processing function 51b; and a 3D image data generating function 51d which generates 3D image data based on the synthesized image data, and outputs it for driving the display panel.
Thereby, as in the case of the first exemplary embodiment described above, when the lenticular lens 1 is in a contraction state, the correction control can be done by following the change in the temperature since it is designed to further add, to the synthesizing processing, the image data acquired by setting the prescribed camera setting by classifying the depth position z of the object to the popup side and non-popup side, performing synthesizing processing on the image data acquired thereby, and operating the out-of x-axis threshold value image data processing function 51j. This makes it possible to further decrease the influence of the changes in the temperature, so that the display control can be achieved more effectively than the case of the first exemplary embodiment described above.
Further, an expansion-state output controller 51B constituting a part of the main arithmetic operation controller 51 executes three data processing functions shown below and synthesizes those to effectively output the 3D image data (synthesized image data) for driving the display panel when the lenticular lens 1 is in an expansion state.
That is, the expansion-state output controller 51B includes an out-of x-axis threshold value image data processing function 51k which operates when it is judged by the correction environment judging section 29 that the temperature difference ΔT is LT>0 and the lenticular lens 1 (image distributing module) is in an expansion state to specify the coordinate position x of the object on the x-axis, and performs rendering processing on the three-dimensional data of the object that satisfies |x|>|xth| under a condition of a fifth camera setting E that has a narrower included angle than the included angle of the first camera setting A.
Further, the expansion-state output controller 51B includes a non-popup side image data processing function 51e which, regarding the object of the case where the temperature difference ΔT is ΔT>0 and |x|≦|xth| is satisfied, further judges whether or not the depth position z of the object is z<0 on the non-popup side and, when judged as z<0, performs rendering processing on the three-dimensional data of z<0 under the condition of the first camera setting A.
Furthermore, the expansion-state output controller 51B includes a popup side image data processing function 51f which, regarding the object of the case where the temperature difference ΔT is ΔT>0 and |x|<|xth| is satisfied, further judges whether or not the depth position z of the object is z≧0 on the popup side and, when judged as z≧0, performs rendering processing on the three-dimensional data of z≧0 under the condition of the third camera setting C.
Further, the contraction-state correction controller 51B constituting a part of the main arithmetic operation controller 51 includes: an image data synthesizing function 51g which performs synthesizing processing of each image data on which rendering processing is performed by the out-of x-axis threshold value image data processing function, the non-popup side image data processing function, and the popup side image data processing function; and a 3D image data generating function 51h which generates 3D image data based on the synthesized image data, and outputs it for driving the display panel.
Thereby, as in the case of the first exemplary embodiment described above, even when the lenticular lens 1 is in an expansion state, the correction control can be done by following the change in the temperature since it is designed to further add, to the synthesizing processing, the image data acquired by setting the prescribed camera setting by classifying the depth position z of the object to the popup side and non-popup side, performing synthesizing processing on the image data acquired thereby, and operating the out-of x-axis threshold value image data processing function 51k. This makes it possible to further decrease the influence of the changes in the temperature, so that the display control can be achieved more effectively than the case of the first exemplary embodiment described above.
Note here that the main arithmetic operation controller 51 described above is further provided with a depth image development processing section 22B which develops two-dimensional image information as an object image for the three-dimensional data regarding the object sent into the main arithmetic operation controller 51 and develops the depth information thereof (depth position) z as a depth image.
Further, the depth image development processing section 22B includes a gradation value specifying function which sets a gradation value for the three-dimensional data by corresponding to the depth information (depth position) by a pixel unit, and specifies value of the set gradation value by corresponding to the parallax amount of the two-dimensional image information specified on the x-axis.
Thereby, the depth information of the depth image can be effectively displayed as a 3D image in accordance with the actual circumstance.
Other structures are the same as those of the first exemplary embodiment described above.
(Overall Actions)
Next, the overall actions of the second exemplary embodiment will be described by referring to
Note here that
In
That is, first, the temperature sensor 21 is started up, and the difference ΔT between the detected temperature T of the lenticular lens 1 and the reference temperature Tth (normal temperature in the first exemplary embodiment) set in advance is calculated by the deformation amount calculating section 28 (
Subsequently, the screen face 40 and the camera setting (first camera setting A) as the condition required for the rendering processing are selected (
Thereafter, each of the absolute values of the temperature difference ΔT and the judgment threshold value ΔTth set in advance is compared by the temperature difference judging section 30 to judge whether or not the correction of the parallax amount is necessary (
When judged as |ΔT|<|ΔTth|, the 3D image data generating function 51G is operated, as in the case of the first exemplary embodiment described above, and it is considered that the deformation amount of the lenticular lens 1 due to the change in the temperature is small and that the parallax amount correction is unnecessary. Thus, the three-dimensional data is immediately rendering-processed under the condition of the first camera setting A (
In the meantime, in a case where it is judged in the correction necessity judging step of step S203 as |ΔT|>|ΔTth|, the parallax amount correction is necessary. Thus, for correcting the parallax amount, in the second exemplary embodiment, the threshold value xth on the x-axis directly related to the correction of the parallax amount is set in a form that corresponds to the extent of the temperature difference ΔT described above.
That is, the threshold value xth on the x-axis is a threshold value that defines the first rendering processing range of the three-dimensional data (3D information) on the x-axis, and it is set to become smaller as the value of the temperature difference ΔT becomes larger (
Note here that the stereoscopic viewing region with respect to the use environmental temperature changed depending on the size of the 3D region as shown in the evaluation result (see
For example, in a case where the reference temperature is 25° C. and the use environmental temperature is 0° C. (ΔT=−25° C.), the stereoscopic viewing region in the 85% 3D region is zero. Meanwhile, 60% of the stereoscopic viewing region is secured in the 40% 3D region.
As described, the 3D regions where the stereoscopic viewing region according to the extent of the temperature difference ΔT, i.e., the threshold value xth, can be secured in advance can be defined in a form of LUT (lookup table), a prescribed function, or the like. In a case where the position of the object as the target is at a position on the x-axis larger than the threshold value xth, used is the camera setting with which the parallax becomes as small as possible. Such camera setting is defined as the camera setting D and the camera setting E. This threshold value xth can be determined in accordance with the parameters regarding the stereoscopic viewing region defined based on the effective linear expansion coefficient difference inherent to the stereoscopic display panel, the panel size, the panel resolution, the reference temperature, the 3D crosstalk property, and the like. When the panel size is large in particular, it is effective to reduce the proportion of the threshold value xth with respect to the panel size.
Next, as in step S107 of
The ΔT sign judging step is executed by the correction environment judging section 29.
Then, first, in a case where it is in a lens contraction state of ΔT<0, it is shifted to execute the judgment regarding the values of the position |x| of the object on the x-axis and |xth| (
Now, a case where |x1| and |x2| are smaller than |xth| and a case where |x3| and |x4| are larger than |xth| are assumed, respectively, for the respective x-axis positions x1, x2, x3, and x4 of the objects 42, 43, 43′, and 42′ of
In this case, the procedure is advanced to step S210 of
Then, the camera setting D is selected in step S210, and the rendering processing is performed (
That is, when it is judged in the correction environment judging step (
Then, the objects 42 and 43 of the case where the temperature difference ΔT is ΔT<0 and |x|≦|xth| is satisfied are checked and specified with the judgment of step S209 of
When judged as z≧0, rendering processing is performed on the three-dimensional data of the object 43 that satisfies z≧0 under the condition of the first camera setting A (
Furthermore, regarding the objects 42 and 43 of the case where the temperature difference ΔT is ΔT<0 and |x|≦|xth| is satisfied, it is further judged whether or not the depth position z of the object is z≧0 on the popup side (
Thereby, the 3D image data regarding the object 42 can be acquired as shown in
Subsequently, each piece of the image data 43, 42, 43, and 42 acquired by performing the rendering processing in the out-of x-axis threshold value image data processing step, the popup side image data processing step, and the non-popup side image data processing step is synthesized (
In the case where the z-values (the depth on the z-axis) are the same between the objects 42 and 42 and between the objects 43 and 43, respectively, the parallax C−η, C′−η′ and D−λ, D′−λ′ under |x|>|xth| are smaller than A−α, A′−α′ under |x|≦|xth|.
Then, when it is judged in step S208 of
That is, when it is judged in the correction environment judging step (
Then, regarding the objects 42 and 43 of the case where the temperature difference ΔT is ΔT>0 and |x|≦|xth| is satisfied, it is judged whether or not the depth position z of the object is z<0 on the non-popup side (
Thereby, the 3D image data regarding the object 42 can be acquired as shown in
Similarly, regarding the objects 42 and 43 of the case where the temperature difference ΔT is ΔT≧0 and |x|≦|xth| is satisfied, it is judged whether or not the depth position z of the object is z≧0 on the popup side (
Then, each piece of the image data 43, 42, 43, and 42 acquired by performing the rendering processing in the out-of x-axis threshold value image data processing step, the non-popup side image data processing step, and the popup side image data processing step is synthesized (
In the overall actions of the second exemplary embodiment described above, when the z-values are the same between the objects 42 and 42 and between the objects 43 and 43, respectively, the parallax C−η, C′−η′ and D−λ, D′−λ′ under |x|>|xth| are smaller than B−β, B′−β′ under |x|≦|xth|.
The actions of each of the data processing, the comparison judgment, and the like from step S201 to steps S224 and S305 in the overall actions of the second exemplary embodiment described above may be put into a program to have it achieved by a computer provided to the stereoscopic image generating module 50A.
Other structures and the operation effects thereof are the same as the case of the first exemplary embodiment described above.
The second exemplary embodiment is structured and functions in the manner described above, so that it has the operation effects equivalent to that of the first exemplary embodiment. Further, since the parallax threshold value (reference value) xth on the x-axis is provided, it is possible to promptly correspond to the change in the parallax amount particularly in the left and right directions. This makes it possible to perform correction of the temperature by corresponding to the actual circumstances in a finer manner.
Further, while the case of performing development into the parallax image by the rendering processing is disclosed in the second exemplary embodiment, the present invention is not limited only to that. As in the case of the first exemplary embodiment described above, it is also possible to perform development into a depth image.
Further, in the case of the second exemplary embodiment, it is defined not to increase the parallax amount by corresponding to ΔT for the outer side of the angle of view. Thus, there is an effect that the stereoscopic viewing region can be secured at all times even when the use environmental temperature T changes largely. In particular, when the panel size is large, the panel width becomes larger compared to the interpupillary distance IPD. Thus, the influence of the temperature changes in the outer end of the panel becomes still greater. However, in that case, it is very effective to reduce the proportion of the threshold value xth for the panel size for securing the stereoscopic viewing region. Further, since the parallax amount control is executed for a specific parallax direction according to the use environmental temperature T, there is an effect of making it possible to secure the stereoscopic viewing region without losing the ambience.
Further, while a case of 2-viewpoints regarding the number of viewpoints is disclosed in the second exemplary embodiment, the present invention is not limited only to that. The present invention can be employed also to the case of N-viewpoints in the same manner.
(Modification Example)
Next, a modification example of the second exemplary embodiment will be described by referring to
Note here that same reference numerals are used for the same structural members as those of the second exemplary embodiment.
In the second exemplary embodiment described above, as shown in
Meanwhile, in the modification example, as shown in
Regarding those z-value conversion processing functions, the former out-of x-threshold-value z-value conversion processing function 52j performs z-value conversion (in the direction the value becomes smaller than the original z-value) by multiplying a correction coefficient γ to |z| regardless of the sign of the z-value for the object that satisfies |x|>|xth|. Further, the latter non-popup side image data processing function 52b performs z-value conversion (in the direction the value becomes smaller than the original z-value) by multiplying a correction coefficient δ to |z| of the object that satisfies |x|≦|xth| and z<0.
The correction coefficient γ in the out-of x-threshold-value z-value conversion processing function 52j is less than a numerical value “1”, and it can be determined based on the included angle information of the first camera setting A and the included angle information of the second camera setting D. Further, the correction coefficient δ in the non-popup side image data processing function 52b is also less than a numerical value “1”, and it can be determined based on the included angle information of the first camera setting A and the included angle information of the second camera setting B. Furthermore, the values of the correction coefficients γ and δ are not limited only to those. It is possible to define the coefficients as constant values regardless of the extent of the z-value as long as those are within a range with which the stereoscopic visibility is not deteriorated for the temperature change. Alternatively, it is also possible to change the coefficients linearly or nonlinearly depending on the extent of the z-value.
Further, instead of the image data synthesizing function 51c disclosed in
Further, in this modification example, the expansion-state correction controller 51B of the second exemplary embodiment described above is also employed. Instead of the expansion-state correction controller 51B, an expansion-state correction controller 52B is provided.
That is, in this modification example, as shown in
In other words, employed is the structure which includes the out-of x-threshold-value z-value conversion processing function 52k which performs z-value conversion on the object that satisfies |x|<|xth| by multiplying a correction coefficient ε to |z| value in the direction that makes it smaller than the original z-value instead of the out-of x-threshold-value image data processing function 51k, and further includes the popup-side z-value conversion processing function 52f which performs z-value conversion on the object that satisfies |x|≧|xth| and z≧0 by multiplying a correction coefficient ζ to |z|value in the direction that makes it smaller than the original z-value instead of the popup side image data processing function 51f described above.
Further, instead of the 3D image data synthesizing function 51g disclosed in
Thereby, it becomes unnecessary to change the camera setting among the out-of x-threshold-value z-value conversion processing function 52j, the popup-side image data processing function 51a, and the non-popup side z-value conversion processing function 52b of the contraction-state correction controller 52A and among the out-of x-threshold-value z-value conversion processing function 52k, the non-popup side image data processing function 51e, and the popup-side z-value conversion processing function 52f of the expansion-state correction controller 52B, respectively. Further, the image data synthesizing function becomes unnecessary. Therefore, load on the system side (particularly the main arithmetic operation controller) can be lightened greatly, and the speed of the image processing can be increased as well.
Other structures and the operation effects thereof are the same as the case of the second exemplary embodiment described above.
(Third Exemplary Embodiment)
Next, a third exemplary embodiment of the present invention and modifications examples (1) and (2) thereof will be described by referring to
Note here that same reference numerals are used for the same structural members as those of the first exemplary embodiment.
The third exemplary embodiment is characterized to restrict the camera setting when performing the rendering processing on the three-dimensional data of the object having the depth information that is used in the first exemplary embodiment by the extent of a threshold value (reference value) xth regarding the parallax on the x-axis that is set in accordance with the extent of the difference ΔT, and to perform 2D rendering processing so as to synthesize each piece of those data when exceeding the threshold value.
Hereinafter, this will be described by taking the contents depicted in the first exemplary embodiment as a presupposition.
The entire contents of the third exemplary embodiment will be described first, and the two modification examples of the third exemplary embodiment will be described thereafter.
(Structure)
As in the case of the first exemplary embodiment, the stereoscopic display device according to the third exemplary embodiment includes a display controller 60 which drive-controls the stereoscopic display panel 11. The display controller 60 is provided with a stereoscopic image generating module 60A having a main arithmetic operation controller 61 for restricting the actions of each of the entire structural elements to be described later (see
As in the case of the second exemplary embodiment, the main arithmetic operation controller 61 is provided with an x-position threshold value setting section 50B which sets a threshold value xth on the x-axis used for correction.
The x-position threshold value setting section 50B functions to set the threshold value (correction reference value) xth on x-axis when it is judged by the temperature difference judging section 30 that the temperature difference ΔT is |ΔT|>|ΔTth| and it is under a temperature environment that requires correction of the parallax amount. The threshold value (correction reference value) xth is the threshold value xth on the x-axis which makes it possible to secure the stereoscopic viewing region that changes according to the extent of the temperature difference ΔT, and it is set to become smaller as the value of the difference ΔT becomes larger.
Further, as in the cases of each of the first and second exemplary embodiments, the above-described main arithmetic operation controller 61 is provided with a correction environment judging section 29 which operates when it is judged by the temperature difference judging section 30 that the temperature difference ΔT is |ΔT|>|ΔTth| and it is under a temperature environment that requires correction of the parallax amount to make judgment whether the lenticular lens 1 is in a state of ΔT<0 showing a contraction state or a state of ΔT>0 showing an expansion state in order to execute correction of the parallax amount promptly and accurately according to the circumstances.
Further, as in the cases of each of the first and second exemplary embodiments, the main arithmetic operation controller 61 includes: a contraction-state correction controller 61A which is executed when the lenticular lens 1 is contracted (a state where ΔT<0); and an expansion-state correction controller 61B which is executed when the lenticular lens 1 is expanded (a state where ΔT>0).
Among those, the contraction-state correction controller 61A executes three data processing functions shown below different from each of the cases of the first and second exemplary embodiments and synthesizes those to output the 3D image data (synthesized image data) for driving the display panel.
That is, the contraction-state correction controller 61A constituting a part of the main arithmetic operation controller 61 includes a 2D image data processing function 61j which: operates when it is judged by the temperature environment judging section 29 that the temperature difference ΔT is ΔT<0 (the lenticular lens 1 is in a contraction state) to specify the coordinate position x of the object on the x-axis; and, regarding the object that satisfies |x|>|xth|, performs rendering processing on the two-dimensional data under a two-dimensional camera setting of a single camera that is set anew along the z-axis instead of the three-dimensional data.
Further, the contraction-state correction controller 61A includes a popup side image data processing function 61a which: regarding the object of the case where the temperature difference ΔT is ΔT<0 (a state where the lens 1 is contracted) and |x|≦|xth| is satisfied, further judges whether or not the depth position z of the object is z≧0 on the popup side; and when judged as z≧0, immediately starts up to perform rendering processing on the three-dimensional data under the condition of the first camera setting A.
Furthermore, the contraction-state correction controller 61A includes a non-popup side image data processing function 61b which: regarding the object of the case where the temperature difference ΔT is ΔT<0 and |x|≦|xth| is satisfied, further judges whether or not the depth position z of the object is z≧0 on the popup side; and when judged as z<0, performs rendering processing on the three-dimensional data of z<0 under the condition of the second camera setting B.
Further, the contraction-state correction controller 61A constituting a part of the main arithmetic operation controller 61 includes: an image data synthesizing function 61c which performs synthesizing processing of each image data on which rendering processing is performed by the 2D image data processing function 61j, the popup side image data processing function 61a, and the non-popup side image data processing function 61b; and a 3D image data generating function 61d which generates 3D image data based on the synthesized image data, and outputs it for driving the display panel.
Thereby, even when the lenticular lens 1 is in a contraction state, it is possible to correspond to the change in the temperature of the three-dimensional data of the object located on the popup side and the non-popup side and to correct it effectively. This makes it possible to effectively drive the display panel 11 by the 3D image data containing the 2D image data as will be described later.
Further, the contraction-state correction controller 61B is also structured to specify with the same reference as that of the case of the contraction-state correction controller 61A, to execute three data processing functions shown below, and to synthesize those to output the 3D image data (synthesized image data) for driving the display panel.
That is, the contraction-state correction controller 61B constituting a part of the main arithmetic operation controller 61 includes a 2D image data processing function 61k which: operates when it is judged by the temperature environment judging section 29 that the temperature difference ΔT is ΔT>0 and in an expansion state to specify the coordinate position x of the object on the x-axis; and, regarding the object that satisfies |x|>|xth|, performs 2D rendering processing on the three-dimensional data under a two-dimensional camera setting that corresponds to a single camera that is set along the z-axis instead of the three-dimensional data.
Further, the expansion-state correction controller 61B includes a non-popup side image data processing function 61e which: regarding the object of the case where the temperature difference ΔT is ΔT>0 and |x|≦|xth| is satisfied, further judges whether or not the depth position z of the object is z<0 on the non-popup side; and when judged as z<0, immediately starts up to perform rendering processing on the three-dimensional data under the condition of the first camera setting A.
Furthermore, the expansion-state correction controller 61B includes a popup side image data processing function 61f which: regarding the object of the case where the temperature difference ΔT is ΔT>0 and |x|≦|xth| is satisfied, further judges whether or not the depth position z of the object is z≧0 on the popup side; and when judged as z≧0, performs rendering processing on the three-dimensional data of z≧0 under the condition of the third camera setting C.
Further, the expansion-state correction controller 61B includes: an image data synthesizing processing function 61g which performs synthesizing processing of each image data on which rendering processing is performed by the 2D image data processing function 61k, the non-popup side image data processing function 61e, and the popup side image data processing function 61f; and a 3D image data generating function 61h which generates 3D image data based on the synthesized image data, and outputs it for driving the display panel.
Thereby, even when the lenticular lens 1 is in an expansion state, it is possible to correspond to the change in the temperature of the three-dimensional data of the object located on the popup side and the non-popup side and to correct it effectively. This makes it possible to effectively drive the display panel 11 by the 3D image data containing the 2D image data as will be described later.
Further, the main arithmetic operation controller 61 of the third exemplary embodiment is also provided with a depth image development processing section 22B which develops the two-dimensional image information of the three-dimensional data regarding the object sent into the main arithmetic operation controller 61 as an object image and the depth information (depth position) as a depth image. Further, as in the case of the first exemplary embodiment, the depth image development processing section 22B has a gradation value specifying function which sets gradation values corresponding to the depth information (depth position) by the pixel unit and specifies the set gradation values by corresponding to the parallax amount specified on the x-axis, and it is mounted to effectively function for both the contraction-state correction controller 61A and the expansion-state correction controller 61B.
Other structures are the same as the case of the first exemplary embodiment described above.
(Overall Actions)
Next, the overall actions of the third exemplary embodiment will be described by referring to
Note here that
In
That is, first, the temperature sensor 21 is started up, and the difference ΔT between the detected temperature T of the lenticular lens 1 and the reference temperature Tth (normal temperature in the first exemplary embodiment) set in advance is calculated by the deformation amount calculating section 28 (
Thereafter, each of the absolute values of the temperature difference ΔT and the judgment threshold value ΔTth set in advance is compared by the temperature difference judging section 30 to judge whether or not the correction of the parallax amount is necessary (
When judged as |ΔT|≦|ΔTth|, the 3D image data generating function 51G is operated and it is considered that the change in the temperature of the lenticular lens 1 is small and that the parallax amount correction is unnecessary. Thus, the three-dimensional data is immediately rendering-processed under the condition of the first camera setting A (
In the meantime, in a case where it is judged in the correction necessity judging step of step S303 in
Note here that the stereoscopic viewing region with respect to the use environmental temperature changed depending on the size of the 3D region as shown
As described, the 3D regions where the stereoscopic viewing region according to the extent of the temperature difference ΔT, i.e., the threshold value xth, can be defined in advance in a form of LUT (lookup table), a prescribed function, or the like.
Next, as in step S107 of
In a case where ΔT<0, the lens is in a contraction state. Thus, it is immediately shifted to make judgment regarding values of the position |x| of the object on the x-axis and |xth| of the threshold value xth (
In the third exemplary embodiment, it is so defined that |x1| and |x2| are smaller than |xth|, and |x3| and |x4| are larger than |xth| for the respective x-axis positions x1, x2, x3, and x4 of the objects 42, 43, 43, and 42 of
In this condition, the cameras are set to 2D (for two-dimensional data) as the camera setting condition when it is judged in step S309 that |x|>|xth| is satisfied, i.e., in a case of the objects 43′ and 42′ (
The above contents can be summarized as follows.
That is, when it is judged in the correction necessity judging step (
The threshold value xth is set to become smaller as the value of the absolute value of ΔT described above becomes larger (
Then, when the threshold value xth required for correcting the parallax amount is set, first, the correction environment judging section 29 judges whether the lenticular lens 1 is in a state of ΔT<0 showing a contraction state or in a state of ΔT>0 showing an expansion state (
When it is judged in the correction environment judging step of step S308 that the temperature difference ΔT is ΔT<0 and the lenticular lens 1 is in a contraction state, the coordinate position x of the object on the x-axis is specified.
Then, the specified coordinate position x of the object on the x-axis is compared with the reference value xth (
Then, the object judged to satisfy |x|≦|xth| by comparing the coordinate position x of the object on the x-axis with the reference value xth is subjected to judgment of the position on the z-axis (
For the processing hereafter (
That is, for the object of a case where the temperature difference ΔT is ΔT<0 and |x|≦|xth| is satisfied, it is further judged whether or not the depth position x of the object is z≧0 (
Then, when it is judged that the depth position z of the object is z<0 on the non-popup side by the judgment regarding whether or not the depth position z of the object is z≧0 (
Subsequently, each piece of the image data acquired by performing the rendering processing in the 2D image data processing step, the popup side image data processing step, and the non-popup side image data processing step is synthesized (
Next, returning to step S308 of
In this case, the rendering targets are classified into three as in the case of the lens contraction state by the judgment regarding the values of the position |x| of the object on the x-axis and the threshold value |xth| (
That is, when judged that the temperature difference ΔT is ΔT>0 and in a lens expansion state, the coordinate position x of the object on the x-axis is specified and it is judged whether or not |x|>|xth| is satisfied (
Further, regarding the objects 42 and 43 of the case where the temperature difference ΔT is ΔT>0 and |x|≦|xth| is applied, it is further judged whether or not the depth position z of the object is z<0 on the non-popup side (
Further, regarding the object of the case where the temperature difference ΔT is ΔT>0 and |x|≦|xth| is applied, it is further judged whether or not the depth position z of the object is z≧0 on the popup side.
Then, for the object 43 that is judged to be located at a position of z≧0, the three-dimensional data is specified further by the third camera setting C (
Then, each piece of the image data acquired by performing the rendering processing in the 2D image data processing step, the non-popup side image data processing step, and the popup side image data processing step is synthesized (
In the third exemplary embodiment, the overall actions thereof are described in details.
However, the display panel driving 3D data generating action, i.e., each of the information processing contents of a series of data processing steps starting from the temperature measuring processing of the lenticular lens 1, may be put into a program to have it achieved by a computer provided to the stereoscopic image generating module 60A. The object of the present invention can also be achieved effectively with such structure.
With the third exemplary embodiment as described above, the same operation effects as those of the first exemplary embodiment can be achieved: In addition, it is possible to acquire the image data in which 2D and 3D images are mixed. Further, the 3D region is defined by corresponding to the temperature difference ΔT, so that there is an effect that the stereoscopic viewing region can be secured at all times even when the use environmental temperature changes largely.
Further, since the parallax amount control is executed for a specific parallax direction according to the use environmental temperature, there is an effect of making it possible to secure the stereoscopic viewing region without losing the ambience.
In a case where the positions of the objects on the x-axis exist by going across the threshold value (correction reference value) xth, it is possible to add processing for bringing the z-position in the vicinity of xth that is the border between the 2D and 3D images closer to the screen face (z=0) according to the value of |xth|−|x| by using a linear or nonlinear function in the synthesizing processing of step S314 or step S322. Thereby, natural image data in which 2D and 3D images are mixed can be acquired.
(Modification Example (1))
Next, a modification example (1) of the third exemplary embodiment will be described by referring to
In the third exemplary embodiment, it is also possible to perform z-value conversion processing in the same manner as in the case of the first exemplary embodiment for processing z-axis information showing the depth. This is shown in
Note here that same reference numerals as those of the third exemplary embodiment shown in
As shown in
Regarding those z-value conversion processing functions, the out-of x-threshold-value z=0 conversion processing function 62j performs processing to satisfy z=0 on the object that satisfies |x|>|xth|. Further, the non-popup side z-value conversion processing function 62b performs z-value conversion (in the direction the value becomes smaller than the original z-value) by multiplying a correction coefficient ζ to |z| of the object that satisfies |x|≦|xth| and z<0.
The correction coefficient ζ in the non-popup side z-value conversion processing function 62b is less than a numerical value “1”, and it may be defined as a constant regardless of the extent of the z-value. It is also possible to change the correction coefficient linearly or nonlinearly depending on the extent of the z-value.
Further, instead of the image data synthesizing function 61c disclosed in
Further, in this modification example (1), the expansion-state correction controller 61B of the third exemplary embodiment described above is also employed. Instead of the expansion-state correction controller 61B, an expansion-state correction controller 62B is provided.
That is, in this modification example (1), as shown in
Further, instead of the 3D image data synthesizing function 61g disclosed in
In other words, in this case, it is characterized to include the out-of x-threshold-value z=0 conversion processing function 62k which performs processing to make z=0 on the object that satisfies |x|≦|xth| instead of the two-dimensional image data processing function 61k, and to include the popup-side z-value conversion processing function 62f which performs z-value conversion on by multiplying a correction coefficient x in the direction that makes it smaller than the original z-value to |z| of the object that satisfies |x|>|xth| and z≧0 instead of the popup side image data processing function 61f described above.
Thereby, it becomes unnecessary to change the camera setting among the out-of x-threshold-value z=0 conversion processing function 62j, the popup-side image data processing function 61a, and the non-popup side z-value conversion processing function 62b of the contraction-state correction controller 62A and among the out-of x-threshold-value z=0 conversion processing function 62k, the non-popup side image data processing function 61e, and the popup-side z-value conversion processing function 62f of the expansion-state correction controller 62B, respectively. Further, the image data synthesizing functions 61c and 61g become unnecessary. Therefore, load on the system side (particularly the main arithmetic operation controller) can be lightened greatly, and the speed of the image processing can be increased as well.
Other structures and the operation effects thereof are the same as the case of the second exemplary embodiment described above.
(Modification Example (2))
Next, a modification example (2) of the third exemplary embodiment will be described by referring to
The modification example (2) of the third exemplary embodiment is the same as that disclosed in
Therefore, the contents of the overall actions become simple correspondingly as shown in step S351 to step S356 of
Hereinafter, this will be described.
First, in the modification example (2) of the third exemplary embodiment, a main arithmetic operation controller 63 shown in
As in the case of the third exemplary embodiment, the main arithmetic operation controller 63 is provided with an x-position threshold value setting section 52 which, when it is judged by the temperature difference judging section 30 that the temperature difference ΔT is |ΔT|>|ΔTth| and it is under a temperature environment that requires correction of the parallax amount, sets the threshold value xth on the x-axis which changes according to the extent of the temperature difference ΔT and makes it possible to secure the stereoscopic viewing region. In this case, the threshold value xth on the x-axis is set to be smaller as the value of the difference ΔT becomes larger as in the case of the third exemplary embodiment of
That is, the main arithmetic operation controller 63 includes a 2D image data processing function 63a which specifies the coordinate position x of the object on the x-axis and, regarding the object that satisfies |x|>|xth|, performs rendering processing on the two-dimensional data under a two-dimensional camera setting corresponding to a single camera that is set along the z-axis instead of the three-dimensional data.
Further, the main arithmetic operation controller 63 includes a 3D image data processing function 62b which immediately starts up to perform rendering processing on the three-dimensional data under the condition of the first camera setting A regarding the object of case where the temperature difference |x|≦|xth| is satisfied for the coordinate position x on the x-axis.
Further, the main arithmetic operation controller 63 includes: an image data synthesizing function 63c which performs synthesizing processing of each image data on which rendering processing is performed by the 2D image data processing function 63a and the 3D image data processing function 63b; and a 3D image data generating function 63d which generates 3D image data based on the synthesized image data, and outputs it for driving the display panel. Other structures are the same as those of the above-described third exemplary embodiment shown in
Next, the overall actions of the structural contents will be described.
First, in
Subsequently, as in the case of the third exemplary embodiment, it is judged in a correction necessity judging step of step S503 by the temperature judging section 30 whether or not the temperature difference ΔT satisfies |ΔT|≦|ΔTth|. In a case of “Yes”, correction of the parallax amount is unnecessary. In a case of “No”, it is judged that correction of the parallax amount is necessary.
When it is judged by the temperature difference judging section 30 that the temperature difference ΔT is |ΔT|>|ΔTth| and it is under a temperature environment that requires correction of the parallax amount, the above-described x-position threshold value setting section 52 sets the threshold value xth on the x-axis which makes it possible to secure the stereoscopic viewing region that changes according to the extent of the temperature difference ΔT (
Then, the coordinate positions x on the x-axis regarding each of the objects (e.g., 42, 43, 42, 43) shown in
The data of the objects 42′ and 43′ judged that |x|>|xth| is satisfied is specified by a two-dimensional camera 2D by a single camera (see
Then, rendering processing is performed on the two-dimensional data acquired based on the two-dimensional camera setting 2D (
Subsequently, for the objects 42 and 43 where |c|≦|xth| is satisfied for the coordinate position x on the x-axis, rendering processing is performed on the three-dimensional data of the objects 42 and 43 under the condition of the first camera setting A (
Then, each image data rendering-processed in the 2D image data processing step and the 3D image data processing step is synthesized (
The image generating processing (
Note here that each action of each data processing, comparison judgment, and the like from step S301 to S304 and each action of each data processing, comparison judgment, and the like from step S351 to S359 (i.e., execution contents in each of the steps) of
Further, while the modification example (2) of the third exemplary embodiment has been described by mainly referring to the example where rendering processing is performed to develop into the parallax image, the present invention is not limited only to that. It is also possible to develop into a depth image as in the case of the first exemplary embodiment described above.
Further, as shown in
Therefore, by employing the gradation value specifying function of the depth image development processing section 22B to each of the objects 42, 43, 42, and 43, each of the main arithmetic operation controllers 61, 62, and 63 can develop those as the depth images.
In the modification example (2) of the third exemplary embodiment, it is unnecessary to perform judgment action of the contraction and expansion of the lenticular lens 1 as described above, so that there is an advantage that the 3D image data for driving the display panel can be generated by the simplified data processing of step S351 to step S357 of
Further, in the case of the third exemplary embodiment, the 3D region is defined by corresponding to the temperature difference ΔT as described above. Thus, there is an effect that the stereoscopic viewing region can be secured at all times even when the use environmental temperature changes largely. In particular, when the panel size is large, the panel width becomes larger compared to the interpupillary IPD. Thus, the influence of the temperature changes in the outer end of the panel becomes still greater. However, in that case, it is very effective to reduce the proportion of the threshold value xth for the panel size for securing the stereoscopic viewing region. Further, since the parallax amount control is executed for a specific parallax direction according to the use environmental temperature T, there is an effect of making it possible to secure the stereoscopic viewing region without losing the ambience.
Furthermore, when the object position x is larger than xth in the third exemplary embodiment, 2D processing is performed. Thus, there is a merit of being able to reduce the system load. In addition, the actions of each judgment regarding the lens contraction and expansion are integrated in the modification example. As a result, there is also an advantage of making it possible to simplify the actions, so that the system load can be reduced greatly.
Further, while a case of 2-viewpoints regarding the number of viewpoints is disclosed in the third exemplary embodiment and the modifications examples (1), (2), the present invention is not limited only to that. The present invention can be employed also to the case of N-viewpoints in the same manner.
(Fourth Exemplary Embodiment)
Next, a fourth exemplary embodiment of the present invention and a modification example thereof will be described by referring to
In the fourth exemplary embodiment, a depth map is used as the 3D image data, and gray scale conversion (gradation value correction) of the depth map is executed according to the use environmental temperature to secure the stereoscopic viewing region effectively by corresponding to expansion and contraction of the lenticular lens 1.
Hereinafter, this will be provided by taking the contents depicted in the first exemplary embodiment as a presupposition.
The entire contents of the fourth exemplary embodiment will be described first, and a modification example of the fourth exemplary embodiment will be described thereafter.
(Structure)
As in the case of the first exemplary embodiment, the stereoscopic display device according to the fourth exemplary embodiment includes a display controller 70 which drive-controls a stereoscopic display panel 11. The display controller 70 is provided with a stereoscopic image generating module 70A having a main arithmetic operation controller 71 which individually restricts the actions of each of the entire structural elements to be described later (see
As shown in
Among those, the main arithmetic operation controller 71 includes a 3D image data generating function 71G which operates when it is judged by the temperature difference judging section 30 that the temperature difference ΔT is |ΔT|≦|ΔTth| and it is under a temperature environment that does not require correction of the parallax amount to output two-dimensional 3D image data having the depth information among the image data stored in the data storage section 25 for driving the display panel (see
As in the case of the first exemplary embodiment described above, the main arithmetic operation controller 71 is provided with a correction environment judging section 29 which operates when it is judged by the temperature difference judging section 30 that the temperature difference ΔT is |ΔT|>|ΔTth| and it is under a temperature environment that requires correction of the parallax amount to make judgment whether the lenticular lens 1 is in a state of ΔT<0 showing a contraction state or a state of ΔT>0 showing an expansion state.
Further, as in the case of the first exemplary embodiment described above, the main arithmetic operation controller 71 includes a contraction-state correction controller 71A which operates in a case where the lenticular lens 1 is in a contraction state (ΔT<0), and an expansion-state correction controller 71B which operates in a case where the lenticular lens 1 is in an expansion state (ΔT>0).
Out of those, the contraction-state correction controller 71A is structured to execute two following data processing functions different from the cases of each of the above-described exemplary embodiments, to synthesize the results thereof, and to output the 3D image depth map (synthesized depth map) for driving the display panel.
That is, the contraction-state correction controller 71A constituting a part of the main arithmetic operation controller 70 as shown in
Further, similarly, the contraction-state correction controller 71A includes a gradation value conversion processing function 71b which functions when it is judged by the correction environment judging section 29 that the temperature difference ΔT is ΔT<0 and the lenticular lens 1 is in a contraction state and, when judged that the depth of the object is located at a position of z<0 on the opposite side from the popup-side on the z-axis and the depth gradation is equal to or lower than the intermediate value of the entire gradation, performs gray scale conversion by a first gradation conversion with which a larger gradation value than the original depth information can be acquired and holds the result acquired thereby.
Further, the contraction-state correction controller 71A constituting a part of the main arithmetic operation controller 71 includes: a depth image data synthesizing function 71c which performs synthesizing processing on the depth image data held by the gradation value non-conversion processing function 71a and the gradation value conversion processing function 71b, respectively; and a synthesized depth image data generating function 71d which generates two-dimensional 3D depth image data having the depth based on the synthesized depth image data, and outputs it for driving the display panel.
Thereby, even when the lenticular lens 1 is in a contraction state, it is possible to effectively correct the collected depth information of the objects on the popup side and the non-popup side by corresponding to the change in the temperature and to use it as the 3D depth image data to effectively drive the display panel.
Further, the expansion-state correction controller 71B constituting a part of the main arithmetic operation controller 71 is also structured to execute two following data processing functions and to synthesize the results thereof under the same criterion as the case of the contraction-state correction controller 71, and to output the 3D depth image data (synthesized depth image data) for driving the display panel.
That is, the expansion-state correction controller 71B includes a gradation value non-conversion processing function 71e which: functions when it is judged by the correction environment judging section 29 that the temperature difference ΔT is ΔT>0 and the lenticular lens 1 is in an expansion state to judge whether or not the depth of the object is at a position of z<0 on the non-popup side and the depth gradation is equal to or less than the intermediate value of the entire gradation; and when judged that it is located at a position of z<0 and the depth gradation is equal to or less than the intermediate value of the entire gradation, holds it without performing gray scale conversion.
Further, similarly, the expansion-state correction controller 71B includes a gradation value conversion processing function 71f which: functions when it is judged by the correction environment judging section 29 that the temperature difference ΔT is ΔT>0 and the lenticular lens 1 is in an expansion state to judge whether or not the depth of the object is located at a position of z<0 and whether or not the depth gradation is equal to or less than the intermediate value of the entire gradation; and when judged that the depth of the object is located at a position of z≧0 and the depth gradation is equal to or more than the intermediate value of the entire gradation, performs gray scale conversion by a second gradation conversion with which a smaller gradation value than the original depth information can be acquired, and holds the result acquired thereby.
Further, the expansion-state correction controller 71B constituting a part of the main arithmetic operation controller 71 includes: a depth image data synthesizing function 71g which performs synthesizing processing on the depth image data held by the gradation value non-conversion processing function 71e and the gradation value conversion processing function 71f, respectively; and a synthesized image data generating function 71h which generates two-dimensional 3D depth image data based on the synthesized depth image data, and outputs it for driving the display panel.
Thereby, even when the lenticular lens 1 is in an expansion state, it is possible to effectively correct the collected depth information of the objects on the popup side and the non-popup side by corresponding to the change in the temperature and use it as the 3D depth image data to effectively drive the display panel.
Other structures are the same as the case of the first exemplary embodiment described above.
(Overall Actions)
Next, the overall actions of the fourth exemplary embodiment will be described by referring to
Note here that
As shown in
Then, a depth map A as the target of correction is set, and it is stored to the data storage section 25 as 3D image data (
In the depth map, it is so defined that the maximum gradation width is 256 gradations, 128 gradations located in the center part thereof are defined as the screen face 40 (z-axis is the position of origin 0), the side of the direction smaller than the 128 gradations is defined as the back side (z-axis corresponds to negative), and the side of the direction larger than the 128 gradations is defined as the front side (z-axis corresponds to positive). Such defined information is stored in advance to the data storage section 25.
Then, judgment of depth correction for the temperature difference ΔT is executed. When judged that the correction is unnecessary, the depth map A is employed as it is as the 3D image data.
That is, the absolute values of the temperature difference ΔT calculated by the deformation amount calculating section 28 and the judgment threshold value ΔTth set in advance is compared by the temperature difference judging section 30, and it is judged that the correction of the parallax amount of the 3D image data, i.e., correction of the depth, is necessary in a case of |ΔT|>|ΔTth| (
Meanwhile, when judged in step S403 (the correction necessity judging step) that the temperature difference ΔT is |ΔT| |ΔTth| and it is in the temperature environment that does not require correction of the parallax amount, the 3D image data stored in the data storage section is outputted as the two-dimensional 3D depth map image data having the depth information (
In the meantime, as described above, in a case where it is judged in the correction necessity judging step of step S403 as |ΔT|>|ΔTth| and that correction of the depth is necessary, it is then judged whether the lenticular lens 1 is in a contraction state or in an expansion state (
That is, when it is judged in the correction necessity judging step of step S403 as |ΔT|>|ΔTth| and that it is under the temperature environment that requires correction of the depth, it is judged whether the lenticular lens 1 is in a state of ΔT<0 showing a contraction state or in a state of ΔT>0 showing an expansion state. Then, when the lenticular lens 1 is in a case of ΔT<0 showing a contraction state, correction for the lens contraction state is required as the correction thereof.
The correction of the lens contraction state (ΔT<0) is executed by a following procedure.
Further, in a case where it is judged in the correction environment judging step (
Further, similarly, in a case where it is judged that z on the popup-side of the depth of the object is located at a position of z<0 on the opposite side from the popup-side on the z-axis and the depth gradation is equal to or lower than the intermediate value of the entire gradation under the state where the temperature difference ΔT is ΔT<0 and the lenticular lens 1 is in a contraction state (
Specifically, those actions can be described as follows.
That is, in a case where the correction is required, judgment of lens contraction/expansion is executed in step S406. When the lens is in a contraction state (ΔT<0), the procedure is shifted to step S407. In step S407, it is judged whether or not the position of the object on the z-axis is positive (i.e., the depth gradation value is 128 or more). In a case where the value is 128 or more, the information of the depth map A is employed as it is.
In the meantime, it is judged whether or not the position of the object on the z-axis is negative (i.e., the depth gradation value is 128 or less). The gray scale conversion A (see
In this state, the objects 82a, 82b have the larger gradation value compared to the value of the objects 81a, 81b. Examples of the parameters used for the gray scale conversion A may be ΔT and the contents held to the data storage section 25 (i.e., the effective linear expansion coefficient difference of the materials constituting the display panel, the panel size, the panel resolution, and the 3D stroke). Among those, the parameters other than the temperature difference ΔT can be treated as constants, and a variable is only ΔT.
In the gray scale conversion A, correction processing for increasing the gradation value according to the extent of ΔT is executed. However, it is also possible to employ correction processing according to the original gradation value to increase the gradation correction value as the gradation value of the original depth map A is smaller.
Subsequently, the depth image synthesizing processing function 71c synthesizes the depth image data held in the gradation value non-conversion processing step and the gradation value conversion processing step, respectively (
The processing from step S407 to S409 described above is defined as a gradation processing C section. The action control of the gradation processing C section is executed by the contraction-state correction controller 71A.
Next, in a case of a lens contraction state where the temperature difference ΔT is ΔT>0, the following is executed.
First, in a case where it is judged in the temperature environment judging step that the temperature difference ΔT is ΔT>0 and the lenticular lens 1 is in an expansion state, it is judged whether or not the depth of the object is at a position of z<0 and the depth gradation is equal to or less than the intermediate value of the entire gradation. When judged that it is located at a position of z<0 and the depth gradation is equal to or less than the intermediate value of the entire gradation, it is held without performing gray scale conversion (
Further, in a case where it is judged in the temperature environment judging step that the temperature difference ΔT is ΔT>0 and the lenticular lens 1 is in an expansion state and, at the same time, it is judged that the depth of the object is located at a position of z≧0 and the depth gradation is equal to or less than the intermediate value of the entire gradation in the judgment regarding whether the depth of the object is located at a position of z<0 on the non-popup side, or whether the depth gradation value thereof is equal to or less than the intermediate value of the entire gradation (step S410), gray scale conversion is performed thereon by a second gradation conversion (gray scale conversion B) with which a smaller gradation value than the original depth information is acquired, and the result thereof is held (
Subsequently, the depth image synthesizing processing function 71g synthesizes the depth image data held in the gradation value non-conversion processing step and the gradation value conversion processing step, respectively (
The processing from step S410 to S412 described above is defined as a gradation processing D section. The control of the gradation processing D section is executed by the expansion-state correction controller 71B.
Specifically, those actions can be described as follows.
That is, when the lens is in an expansion state of ΔT>0, first, it is shifted to step S410 of
Further, the gray scale conversion B (step S411) is performed on objects 81c and 81d whose positions on the z-axis are positive (z≧0, i.e., the depth gradation value is 128 or more), for example, to correct the gradation thereof into the gradation corresponding to objects 83c and 83d of
In this case, the objects 83c, 83d have the smaller gradation value compared to the objects 81c, 81d. The parameters used for the gray scale conversion B are the same as the case of the conversion A described above.
In the gray scale conversion B, correction processing for decreasing the gradation value according to the extent of ΔT is executed. However, it is also possible to employ correction processing according to the original gradation value to increase the gradation correction value as the gradation value of the original depth map A is larger. Subsequently, the depth map C as shown in
The processing from step S410 to S412 described above is defined as a gradation processing D section. The action control of the gradation processing D section is executed by the expansion-state correction controller 71B.
Regarding the gradation processing C section and the gradation processing D section shown in the flowchart of
Out of those,
With respect to the depth map A of
Similarly, processing with which the gradation value correction amount of the object 86c located at x3 closer to the screen edge is larger than the object 86d located at x2 closer to the center of the screen is applied on the depth map C shown in
Further,
In this case, when it is assumed that |x1| and |x2| are smaller than |xth| and |x3| and |x4| are larger than |xth| regarding the positions x1 to x4 of the object on the x-axis, the gradations of the object 88a located at x3 and the object 88c located at x4 on the x-axis are 128, respectively, in the depth map B shown in
Similarly, the gradations of the object 89a located at x3 and the object 89c located at x4 on the x-axis are 128, respectively, in the depth map C shown in
Note here that execution contents of each of the steps of the overall actions of the fourth exemplary embodiment described above may be put into a program to have it executed by a computer provided to the stereoscopic image generating module 70A.
As described above, regarding the gradation processing C section and the gradation processing D section shown in the flowchart of
(Modification Example)
Next, a modification example of the fourth exemplary embodiment will be described by referring to
The modification example of the fourth exemplary embodiment is characterized to perform gray scale conversion uniformly on the depth map A regardless of the signs of the object on the z-axis, i.e., regardless of the extent of the value with respect to the gradation value 128 on the plane of z=0 in
This will be described hereinafter.
First, instead of the main arithmetic operation controller 71 of
As shown in
As in the case of the fourth exemplary embodiment described above, the main arithmetic operation controller 72 is provided with a correction environment judging section 29 which operates when it is judged by the temperature difference judging section 30 that the temperature difference ΔT is |ΔT|>|ΔTth| and it is under a temperature environment that requires correction of the parallax amount to make judgment whether the lenticular lens 1 is in a state of ΔT<0 showing a contraction state or a state of ΔT>0 showing an expansion state.
Further, the main arithmetic operation controller 72 includes a gradation value correction control function 72A which increase-controls or decrease-controls the gradation value by corresponding to the judgment result done by the correction environment judging section 29.
The gradation value correction control function 72A includes a gradation value increase conversion processing function 72a which operates when it is judged by the correction environment judging section 29 that the temperature difference ΔT is ΔT<0 and the lenticular lens 1 is in a contraction state to perform gray scale conversion by a third gradation value conversion (gray scale conversion C) on the entire depth map regardless of the depth position of each object with which the larger gradation value than the original depth map can be acquired and to hold it.
Further, the gradation value correction control function 72A of the main arithmetic operation controller 72 includes a gradation value decrease conversion processing function 72b which operates when it is judged by the correction environment judging section 29 that he temperature difference ΔT is ΔT>0 and the lenticular lens 1 is in an expansion state to perform gray scale conversion by a fourth gradation value conversion (gray scale conversion D) on the entire depth map regardless of the depth position of each object with which the smaller gradation value than the original depth map can be acquired and to hold it.
Further, the gradation value correction control function 72A of the main arithmetic operation controller 72 includes a 3D image data generating function 72c which performs 3D depth image processing on the depth image data processed by the gradation value increase conversion processing function 72a and the gradation value decrease conversion processing function 72b, respectively, and outputs it as the 3D depth image processing data for driving the display panel.
Other structures are the same as the case of the fourth exemplary embodiment shown in
Next, the overall actions regarding the above-described structural contents will be described. First, as shown in
A series of steps from step S401 to step S404 (3D image data generating step) and step S405 (update of ΔT) are the same as the case of the fourth exemplary embodiment described above.
As in the case of the fourth exemplary embodiment, in the modification example, it is judged by the temperature judging section 30 whether or not the temperature difference ΔT satisfies |ΔT|≦|ΔTth| in a correction necessity judging step (
In the meantime, when it is judged by the temperature difference judging section 30 that the temperature difference ΔT is |ΔT|>|ΔTth| and it is under a temperature environment that requires correction of the parallax amount, it is then judged by the correction environment judging step 29 whether the lenticular lens 1 is in a state of ΔT<0 showing a contraction state or in a state of ΔT>0 showing an expansion state (
When it is judged in the correction environment judging step (
In the meantime, when it is judged in the judgment of the temperature in step S451 that the temperature difference ΔT is ΔT>0 and the lenticular lens 1 is in an expansion state, the gradation value decrease conversion processing function 72b operates immediately to perform gray scale conversion by the gray scale conversion D as the fourth gradation value conversion on the entire depth map regardless of the depth position of each object with which the smaller gradation value than the original depth map information can be acquired (
That is, in the modification example, the gray scale conversion C is executed in the lens contraction state shown in
Unlike the cases described before, in
Note here that execution contents of each of the steps of the overall actions of the modification example of the fourth exemplary embodiment described above may be put into a program to have it executed by a computer provided to the stereoscopic image generating module 70A.
Further, in the case of the fourth exemplary embodiment including the modification example thereof, the 3D region is defined in the depth map by corresponding to the temperature difference ΔT as described above. Thus, there is an effect that the stereoscopic viewing region can be secured at all times even when the use environmental temperature changes largely. Further, since the gradation amount control is executed for a specific gradation direction according to the use environmental temperature, there is an effect of making it possible to secure the stereoscopic viewing region without losing the ambience. Furthermore, the fourth exemplary embodiment takes the gray scale conversion of the depth as a base. Thus, compared to the case of the above-described exemplary embodiments where the rendering processing by the camera is required, it is possible to use the arithmetic operation device whose performance regarding the processing capacity and arithmetic operation speed required therefore is low. Therefore, there is an advantage that the controller 110 can be structured at a low cost.
Further, while a case of 2-viewpoints regarding the number of viewpoints is disclosed in the fourth exemplary embodiment, the present invention is not limited only to that. The present invention can be employed also to the case of N-viewpoints in the same manner.
(Fifth Exemplary Embodiment)
Next, a fifth exemplary embodiment of the present invention will be described by referring to
Note here that same reference numerals are used for the same structural members as those of the first exemplary embodiment.
In the fifth exemplary embodiment, two virtual viewpoints are set for an object having depth information, and a parallax image generated in advance by performing rendering processing on three-dimensional data of the object and parallax images captured by a stereoscopic camera are accumulated in a form of two-dimensional data. Then, it is characterized to perform offset processing for the parallax direction of the parallax image according to the use environmental temperature and to output it when reading out the accumulated parallax image.
This will be described hereinafter by taking the contents depicted in the first exemplary embodiment as a presupposition.
(Structure)
As in the case of the first exemplary embodiment, the stereoscopic display device according to the fifth exemplary embodiment includes a display controller 110 which drive-controls a stereoscopic display panel 11. The display controller 110 is provided with a stereoscopic image generating module 110A having a main arithmetic operation controller 111 which restricts the actions of each of the entire structural elements to be described later (see
The stereoscopic image generating module 110A includes: a target image data setting section 77 which inputs accumulates a pair of parallax image data A for the right eye and the left eye rendering-processed in advance for generating 3D image data and accumulates those to the data storage section 25; a temperature difference judging section 30 which individually performs an arithmetic operation regarding whether or not the absolute value of the temperature difference ΔT of the detected temperature regarding each of the parallax image data A detected by a temperature sensor 21 with respect to the reference temperature is equal to or less than the absolute value of the reference value ΔTth set in advance, and judges whether or not it is under a temperature environment that requires correction for the parallax amount of each object specified on the x-axis on the xy plane; and the above-described main arithmetic operation controller 111 for restricting the actions of each of those sections.
Among those, the main arithmetic operation controller 111 includes a 3D image data generating function 111G which operates when it is judged by the temperature difference judging section 30 that the temperature difference ΔT is |ΔT|≦|ΔTth| and it is under a temperature environment that does not require correction of the parallax amount to generate two-dimensional 3D image data based on the pair of parallax image data A stored in the data storage section 25 and to output it for driving the display panel (see
As in the case of the first exemplary embodiment described above, the main arithmetic operation controller 111 is provided with a correction environment judging section 29 which operates when it is judged by the temperature difference judging section 30 that the temperature difference ΔT regarding the parallax image data A is |ΔT|>|ΔTth| and it is under a temperature environment that requires correction of the parallax amount to make judgment whether the lenticular lens 1 is in a state of ΔT<0 showing a contraction state or a state of ΔT>0 showing an expansion state.
Further, as in the case of the first exemplary embodiment described above, the main arithmetic operation controller 111 includes: a contraction-state correction controller (contraction-state offset image generating section) 111A which operates when it is judged by the correction environment judging section 29 that the lenticular lens 1 is in a state of ΔT<0 showing a contraction state; and an expansion-state correction controller (expansion-state offset image generating section) 111B which operates when it is judged by the correction environment judging section 29 that the lenticular lens 1 is in a state of ΔT>0 showing an expansion state.
Out of those, specifically, the contraction-state correction controller (contraction-state offset image generating section) 111A includes: an image data offset processing function 111a which performs slight shift processing on the left-eye image data of the parallax image data A in the left direction and the right-eye image data in the right direction with a prescribed offset amount of respective parallax levels; a parallax image data generating function 111b which generates parallax image data B by superimposing the image data acquired by the image offset processing on the respective image data of before the offset processing; and a 3D image data generating function 111c which generates and outputs two-dimensional 3D image data of a case where the temperature difference ΔT is ΔT<0 based on the parallax image data B generated by the parallax image data generating function 111b.
Thereby, when the lenticular lens 1 is in a contraction state (ΔT<0), the correction control is executed to perform slight shift processing on the left-eye image data in the left direction and the right-eye image data in the right direction with a prescribed offset amount of respective parallax levels by corresponding to the extent of the temperature difference ΔT. Thus, the contraction state of the lenticular lens 1 is corrected, so that the stereoscopic display panel 11 can be driven with the same output state as that of the state before being contracted even when the lenticular lens 1 of the stereoscopic display panel 11 is in a contraction state.
Then, when the lenticular lens 1 is in ΔT>0 showing an expansion state, the correction control with which the stereoscopic display panel 11 can be driven with the same output state as that of the state before being expanded is performed as in the case of the contraction state.
That is, the expansion-state offset image data generating section (expansion-state correction controller) 111B operates when it is judged that the temperature difference ΔT is ΔT>0 and the lenticular lens 1 is an expansion state to generate parallax image data by applying the second parallax offset processing C on the parallax image data A.
Specifically, the expansion-state offset image generating section (expansion-state correction controller) 111B includes: an image data offset processing function 111d which performs slight shift processing on the left-eye image data of the parallax image data A in the right direction and the right-eye image data in the left direction with a prescribed offset amount of respective parallax levels; a parallax image data generating function 111e which generates parallax image data by superimposing the image data acquired by the image offset processing on the respective image data of before the offset processing; and a 3D image data generating function 111f which generates and outputs two-dimensional 3D image data based on the parallax image data generated by the parallax image data generating function 111e.
Thereby, when the lenticular lens 1 is in an expansion state (ΔT>0), the correction control is executed to perform slight shift processing on the left-eye image data in the right direction and the right-eye image data in the left direction with a prescribed offset amount of respective parallax levels by corresponding to the extent of the temperature difference ΔT. Thus, the expansion state of the lenticular lens 1 is corrected, so that the stereoscopic display panel 11 can be driven with the same output state as that of the state before being expanded even when the lenticular lens 1 of the stereoscopic display panel 11 is in an expansion state. Other structures are the same as those of the first exemplary embodiment described above.
(Overall Actions)
Next, the overall actions of the fifth exemplary embodiment will be described by referring to
Note here that
As shown in
Then, as the target of correction, a pair of parallax image data A for the right eye and the left eye rendering processed or captured by a stereoscopic camera in advance are set.
Specifically, almost simultaneously with the calculation of the temperature difference ΔT done by a deformation amount calculating section 28, 3D image data constituted with parallax images stored in a data storage section for generating the 3D image data is specified as the target (parallax image data A) of correction by a command from outside (
Then, judgment of parallax amount correction for the temperature difference ΔT is executed by the temperature difference judging section 30. When judged that the correction is unnecessary, the 3D image data generating function 111G of the main arithmetic operation controller 111 immediately starts to perform 3D image data generating processing on the parallax image data A as the target (
Further, when judged that the correction is unnecessary, the state of the correction environment is judged in the next step, and an optimum correction control suited for the correction environment is executed (
This will be described in more details.
First, regarding the judgment of the parallax amount correction for the temperature difference ΔT, absolute values of the temperature difference ΔT calculated by the deformation amount calculating section 28 and the reference value ΔTth set in advance are compared by the temperature difference judging section 30 to judge whether or not the correction of the parallax amount regarding each of the objects specified on the x-axis is necessary (
When judged in the correction necessity judging step that the temperature difference ΔT is |ΔT|≦|ΔTth| and it is under a temperature environment that does not require correction of the parallax amount, the 3D image data generating function 111G is operated as described above to generate two-dimensional 3D image data based on the pair of parallax image data A stored in the data storage section as it is and to output it for driving the display panel (
In the meantime, when judged in the correction necessity judging step of step S503 that the temperature difference ΔT is |ΔT|≦|ΔTth| and it is under a temperature environment that requires correction of the parallax amount, it is then judged by the correction environment judging section 29 whether the lenticular lens 1 is in a state of ΔT<0 showing a contraction state or in an state of ΔT>0 showing an expansion state (
When it is judged in the correction environment judging step of step S506 that the temperature difference ΔT regarding the parallax image data A is ΔT<0 and the lenticular lens 1 is in a contraction state, the contraction-state correction controller 111A of the main arithmetic operation controller 111 immediately operates to execute first parallax offset processing B on the parallax image data A so as to generate parallax image data B (
In the offset image generating step of step S507, specifically, executed are an image data offset processing step in which the image data offset processing function 111a of the main arithmetic operation controller 111 performs shift processing on the left-eye image data of the parallax image data A in the left direction and the right-eye image data in the right direction with a respective prescribed offset amount, and a parallax image data generating step in which the parallax image data generating function 111b operates to generate the parallax image data B by superimposing the image data acquired by each image offset processing on the respective image data of before the offset processing.
Now, regarding the parallax image data B, the processing contents thereof will be described in a specific manner.
Regarding the offset processing B executed when judged that the correction is necessary, the left-eye image is shifted to the left with respect to the parallax image A shown in
The parameters for determining the shift amount e are ΔT and the contents held to a memory of the image generating section 22 (i.e., the effective linear expansion coefficient difference of the materials constituting the display panel 11, the panel size, the panel resolution, and the 3D stroke). Among the materials constituting the display panel 11, the parameters other than ΔT can be treated as constants, and a variable is only ΔT.
The shift amount e can be set according to the extent of the temperature difference ΔT. However, it is preferable to set the shift amount e to become larger as ΔT becomes larger. The left end of the left-eye image and the right end of the right-eye image are unable to be used as the image data for the amount of the width e when the offset processing is applied. Thus, the image data of such part is set to black, for example.
Correspondingly, the image data in the right end of the left-eye image and the left end of the right-eye image for the amount of the width e are set to black.
Therefore, the parallax image acquired after performing the offset processing B is in a form of the parallax image B whose both ends are black images for the width e as shown in
Subsequently, based on the parallax image data B generated in the offset image generating step of step S507, the 3D image data generating function 111c of the contraction-state correction controller 111A generates and outputs the two-dimensional 3D image data (
Then, when it is judged in step S506 (the correction environment judging step) of
In the offset image generating step of step S508, specifically, executed are an image data offset processing step in which the image data offset processing function 111d performs shift processing on the left-eye image data of the parallax image data A in the right direction and the right-eye image data in the left direction with a respective prescribed offset amount, and a parallax image data generating step in which the parallax image data generating function 111e operates to generate the parallax image data C by superimposing the image data acquired by each image offset processing on the respective image data of before the offset processing.
Subsequently, based on the parallax image data C generated in the offset image generating step of step S508, the 3D image data generating function 111f of the expansion-state correction controller 111B generates and outputs the two-dimensional 3D image data (
Now, regarding the parallax image data B, the processing contents thereof will be described in a specific manner.
In the case of the lens expansion state, the procedure of the processing is shifted to the offset processing C of step S508 shown in
The parameters for determining the shift amount f are the same as the case of the shift amount e of
As described, the right end of the left-eye image and the left end of the right-eye image are unable to be used as the image data for the amount of the width f when the offset processing is applied. Thus, the image data of such part is set to black, for example. Correspondingly, the image data in the left end of the left-eye image and the right end of the right-eye image for the amount of the width f are set to black. Therefore, the parallax image acquired after performing the offset processing C is in a form of the parallax image C whose both ends are black images for the width f as shown in
While the black image is inserted to both ends of the image in the fifth exemplary embodiment, the present invention is not limited only to that. For example, a background color of the image can be extracted and used for the both ends of the image. Further, it is also possible to cancel the black image part on the both ends of the image once, and scaling processing to expand w−2e to w as shown in
Note here that execution contents of each of the steps of the overall actions of the fifth exemplary embodiment described above may be put into a program to have it executed by a computer provided to the stereoscopic image generating module 110A.
Other structures and operation effects thereof are the same as the case of the first exemplary embodiment described above.
Further, as described above, the rendering processing is not required in the fifth exemplary embodiment. Thus, compared to the case of the above-described exemplary embodiments where the rendering processing is required, it is possible to use the arithmetic operation device whose performance regarding the processing capacity and arithmetic operation speed required therefore are low. Therefore, there is an advantage that the controller 110 can be structured at a low cost. Further, it is very effective for a case where photographed contents acquired by using a twin-lens reflex camera are used.
Further, while a case of 2-viewpoints regarding the number of viewpoints is described in the fifth exemplary embodiment, the present invention is not limited only to that. The present invention can be employed also to the case of N-viewpoints in the same manner. The same processing can be done also for photographed contents acquired by using a four-lens reflex camera.
(Sixth Exemplary Embodiment)
Next, a sixth exemplary embodiment of the present invention will be described by referring to
The sixth exemplary embodiment is characterized to: convert depth information of a 3D object having the depth information to a parallax amount of two-dimensional image information by using a camera setting parameter; accumulate in advance parallax amount adjusting LUT signals to which different changing properties of the stereoscopic viewing region when displaying a popup object and a depth object according to changes in the use environmental temperature are reflected; and execute correction processing for the parallax amount of the two-dimensional image information according to the temperature detected by a temperature sensor and the parallax amount adjusting LUT signals.
(Structure)
As in the cases of all the exemplary embodiments described above, the stereoscopic display device includes a display controller 120 which drive-controls a stereoscopic display panel 11. The display controller 120 is provided with a stereoscopic image generating module 120A having a main arithmetic operation controller 121 which restricts the actions of each of the entire structural elements to be described later.
The stereoscopic image generating module 120A includes: a target image data setting section 77 which inputs 3D image data of an object having the depth information or two-dimensional image data rendering-processed in advance (center image data) and depth map data corresponding thereto and accumulates those to the data storage section 25; a parallax amount adjusting signal storage section 33 which accumulates the LUT signals for performing parallax amount correction processing according to the use environmental temperature; a temperature difference judging section 30 which individually performs an arithmetic operation regarding whether or not the absolute value of the temperature difference ΔT detected by a temperature sensor 21 with respect to the reference temperature is equal to or less than the absolute value of the reference value ΔTth set in advance, and judges whether or not it is a temperature environment that requires correction for the parallax amount of each object specified on the x-axis on the xy plane; and the above-described main arithmetic operation section 121 for controlling the actions of each of those sections.
Among those, the arithmetic operation controller 121 is shown in
Further, the main arithmetic operation controller 121 includes: a function 121a which operates when it is judged by the temperature difference judging section 30 that the temperature difference ΔT is |ΔT|>|ΔTth| and it is under a temperature environment that does not require correction of the parallax amount to adjust the parallax amount of the two-dimensional image information according to the parallax amount adjusting LUT signal that corresponds to the temperature detected by the temperature sensor 21; a function 121b which generates parallax images according to the corrected parallax amount; and a function 121c which generates 3D image data according to the generated parallax images, and outputs it for driving the display panel. Note here that the parallax amount adjusting LUT signals to which different changing properties of the stereoscopic viewing region when displaying a popup object and a depth object according to changes in the use environmental temperature are reflected can also be generated by using calculated values based on the emitted light rays from the stereoscopic display panel, the actual subjective evaluation values, or the like.
In the sixth exemplary embodiment, the correction amounts for the parallax amounts within a range with which stereoscopic images can be viewed according to all the useable environmental temperatures are put into a single LUT signal, so that it becomes unnecessary to execute the step of judging whether the lenticular lens is in an expansion state or a contraction state based on the signs of ΔT and judgment regarding popup and depth by comparing the depth information and the screen distance. Therefore, the processing speed can be increased further.
(Overall Actions)
Next, the overall actions of the sixth exemplary embodiment will be described by referring to
Note here that
As shown in
Then, the screen face (display face) setting and the camera setting required for the rendering processing condition are done (
Then, the depth map image corresponding to the inputted 3D object depth information and the two-dimensional image data rendering-processed in advance is converted to the parallax amount of the two-dimensional image information by using the set camera information A and the screen face 40 (
The two-dimensional image information parallax amount calculation step calculates the parallax amount Δu of the two-dimensional image information by a pixel unit by using only the depth information of the z-axis, unlike the case of the rendering processing which generates a two-dimensional image through projection conversion or the like of the three-dimensional data specified by the three axes of x, y, and z described above. While the calculation method thereof varies depending on the image capturing method of the stereoscopic camera, a following expression is used for the case of the cross capturing method.
Note here that Δu is the 2D image information parallax amount by a pixel unit, XC is the inter-camera distance, FOV is the viewing angle of the camera, z is the distance between the 3D object and the camera in the z-axis direction, ZC is the distance between the camera and the screen in the z-axis direction.
While the case of the cross capturing method is described herein, the cases of using other capturing methods such as a parallel capturing method, a shift sensor method, and the like can be handled in the same manner according to the respective equations thereof.
Hereinafter, the definition of Δu will be described in details by using
From (1/ZC−1/z) included in Equation (1), the parallax amount Δu of the pixel corresponding to an object (z<ZC) on the front side than the screen face is a negative value, the parallax amount Δu of the pixel corresponding to an object (z>ZC) on the farther side than the screen face is a positive value, and the parallax amount Δu of the pixel corresponding to an object (z=ZC) on the screen face is 0.
Then, the temperature difference judging section 30 judges the parallax amount correction for the temperature difference ΔT (
In the meantime, when judged that |ΔT|>|ΔTth| and the correction is necessary, the parallax amount of the two-dimensional image information is converted to the parallax amount that is optimum to the temperature detected by the temperature sensor 21 by a pixel unit according to the parallax amount adjusting LUT signal (
Then, parallax images are generated from the adjusted parallax amount of the two-dimensional image information (
Hereinafter, an example of the parallax amount correction executed based on the parallax amount adjusting LUT signal will be described in details by using
First, the environmental temperature T including the lenticular lens 1 is measured by the temperature sensor 21, and the temperature difference ΔT with respect to the reference temperature Tth is calculated by the deformation amount calculating section 28 (
Then, the camera parameters accumulated in the camera setting information storage section are read out to the main arithmetic operation controller 121 (
Note here that Δu2 and Δu4 are negative values, and Δu1 and Δu3 are positive values.
Then, when judged in the correction necessity judging step (
In the meantime, when judged that the correction is necessary, the parallax amount of the two-dimensional image information is converted to the parallax amount that is optimum to the temperature detected by the temperature sensor 21 by a pixel unit according to the parallax amount adjusting LUT signal (
(Example for Generating LUT Signal)
As described above, the parallax amount adjusting LUT signal can be generated from the subjective evaluation acquired from an evaluation test regarding the dependency of the stereoscopic viewing region on the temperature, theoretical calculation values regarding the display light rays from the stereoscopic display panel, or the like.
As a way of example, a method for generating the LUT signal from the evaluation test regarding the dependency of the stereoscopic viewing region on the temperature will be described by using
Then, an expected value of the stereoscopic viewing region due to the change in the temperature is decided as a correction target. While this correction target is set arbitrarily according to the use environment of the stereoscopic display device, application thereof, and the like, the stereoscopic viewing region at a normal temperature is set as the correction target herein. That is, in order to secure the stereoscopic viewing region of the normal temperature even when there is a change in the use environmental temperature, the parallax amount of the two-dimensional image information is adjusted to the optimum parallax amount.
When the parallax amount is positive in
Further, when there is no parallax amount corresponding to the stereoscopic viewing region completely matches the stereoscopic viewing region of the normal temperature found from the actual measurement data under a given use environmental temperature, the optimum parallax amount is calculated by executing average value processing, round-off processing, or the like by referring to the parallax amount corresponding to the value closest to the stereoscopic viewing region of the normal temperature. For example, when the use environmental temperature is at 45° C., there is no parallax amount corresponding to the 70% stereoscopic viewing region for the object whose parallax amount is −15 pixels found in the actual measurement data. However, the evaluation result of the stereoscopic viewing region of the object whose parallax amount is −15 pixels is 80%, so that the stereoscopic viewing region can be returned to the data of the normal temperature by adjusting the object whose parallax amount is −15 pixels to the object of −12 pixels. The generated LUT signal is shown in
Next, the contents of the evaluation of the stereoscopic viewing region for the use environmental temperature executed by using the method of the sixth exemplary embodiment will be described.
Note here that execution contents of each of the steps of the overall actions of the sixth exemplary embodiment described above may be put into a program to have it executed by a computer provided to the stereoscopic image generating module 120A. Other structures and operation effects thereof are the same as the case of the first exemplary embodiment described above.
Further, the judging step of the popup and depth objects is not required in the sixth exemplary embodiment. Thus, compared to the case of the above-described exemplary embodiments, it is possible to use the arithmetic operation device whose performance regarding the processing capacity and arithmetic operation speed required therefore is low. Therefore, there is an advantage that the controller 120 can be structured at a low cost.
Other structures and operation effects thereof are the same as the case of the first exemplary embodiment described above.
(Modification Example (1))
Next, a modification example (1) of the sixth exemplary embodiment will be described. The LUT signal shown in
In order to prevent such correction error, two smallest measurement positions (p0, p1) are set along the x-axis on the display screen as shown in
Note here that those are defined as LUT0 and LUT1. The LUT0 signal is generated based on the evaluation result of the stereoscopic viewing region for the object located at the p0 position, and it is shown in
Then, a correction amount most suited for an arbitrary position p1 on the x-axis of the display screen is interpolated based on the acquired LUT0 signal and the LUT signal 1. As a correction method, it is possible to use linear, N-order (N is a natural number of 2 or larger), Gaussian functions, or the like. Correction using a linear function is described hereinafter as a way of example. In a case where the object having the parallax amount Δu1 is located at the position of p0 shown in
The temperature difference judging section 30 judges the parallax amount correction for the temperature difference ΔT (
In the meantime, when judged that the correction is necessary, a plurality of parallax amount adjusting signals, i.e., LUT0 signal, LUT1 signal, - - - , accumulated in advance to the parallax amount adjusting LUT signal storage section and the x-axis coordinates p0, p1, - - - on the display screen corresponding to each of the LUT signals are substituted to Equation (2) to calculate the optimum parallax amount for a given pixel at an arbitrary x-axis coordinate within the display screen (
In a case where those other than the linear function is used as the correction method, it is possible to generate the LUT signals that correspond to two or more measurement positions to improve the correction accuracy. With the modification example (1), while the LUT signals are increased, there is an advantage that a prescribed stereoscopic viewing region can be secured even when the display screen is in a large scale, in addition to securing the stereoscopic viewing region of a 3D object at an arbitrary position within the display screen.
(Modification Example (2))
Next, a modification example (2) of the sixth exemplary embodiment will be described by referring to
However, as shown in the fifth exemplary embodiment, it can also be applied to parallax images generated in advance by performing rendering processing and to two-dimensional data having no depth information such as parallax images captured by a stereoscopic camera. A case of using the two-dimensional data will be described hereinafter.
Subsequently, for the parallax images generated in advance by performing rendering processing and the two-dimensional data having no depth information such as parallax images captured by a stereoscopic camera, corresponding pixels in the left-eye image and the right-eye image are searched by using image processing techniques such as block matching, SIFT (Scale-invariant feature transform), image division, and the like.
An example of a corresponding pixel searching method by the block matching technique will be described hereinafter.
Step S623 to step S628 shown in
With the modification example (2), image data having no depth information can be utilized. Thus, the camera setting shown in
(Seventh Exemplary Embodiment)
Next, a seventh exemplary embodiment of the present invention will be described by referring to
The seventh exemplary embodiment is characterized to adjust the parallax amount of 3D image data according to the temperature difference ΔT as depicted in all the above-described exemplary embodiments and to adjust the parallax amount of the 3D image data according to the contrast difference between the 2D background and the 3D object (see
In terms of the light ray geometrics described by using the 3D crosstalk concept in
This will be described hereinafter by taking the contents depicted in the first exemplary embodiment as a presupposition. First, as in the case of the first exemplary embodiment, the stereoscopic display device according to the seventh exemplary embodiment includes a display controller 130 which drives a stereoscopic display panel. The display controller 130 is provided with a stereoscopic image generating module 130A having a main arithmetic operation controller 131 which restricts the actions of each of the entire structural elements to be described later (see
The main arithmetic operation controller 131 is provided with a 2D/3D image preprocessing section 34 which calculates the 2D/3D contrast difference for correcting the parallax amount according to the extent of the contrast difference between the 2D background and the 3D object when it is judged by the temperature difference judging section 30 that the temperature difference ΔT is |ΔT|>|ΔTth| and it is under a temperature environment that requires correction of the parallax amount. As the 2D contrast used for calculating the 2D/3D contrast difference, it is possible to calculate a 2D image region that overlaps on the image acquired by performing rendering processing on the 3D object and to use a value such as a gradation minimum value, a gradation average value, or the like for that region. Further, as the 2D contrast, it is also possible to simply use a value such as a gradation minimum value, a gradation average value, or the like of the entire image of the 2D background.
As in the case of the first exemplary embodiment, the main arithmetic operation controller 131 is provided with a correction environment judging section 29 which judges whether the lenticular lens 1 as the image distributing module is in a state of ΔT<0 showing a contraction state or a state of ΔT>0 showing an expansion state.
Further, as in the case of the first exemplary embodiment described above, further, as in the case of the first exemplary embodiment described above, the main arithmetic operation controller 131 includes a contraction-state correction controller 131A which operates when it is judged that |ΔT|>|ΔTth| and the temperature difference ΔT is ΔT<0 (when the lenticular lens 1 is contracted), and an expansion-state correction controller 131B which operates when it is judged that |ΔT|>|ΔTth| and the temperature difference ΔT is ΔT>0 (when the lenticular lens 1 is expanded).
Out of those, the contraction-state correction controller 131A is structured to execute a popup image processing function 131a and a non-popup image processing function 131b according to the 2D/3D contrast difference, to synthesize those functions, and to output the 3D image data (synthesized image data) for driving the display panel.
That is, the contraction-state correction controller 131A constituting a part of the main arithmetic operation controller 131 includes a popup side image data processing function 131a which operates when it is judged by the temperature environment judging section 28 that the temperature difference ΔT is ΔT<0 and the lenticular lens 1 (image distributing module) is in a contraction state to further judge whether or not the depth position z of the object is z≧0 on the popup side, and to perform rendering processing on the three-dimensional data of the object that satisfies z≧0 under the condition of the first camera setting A.
The contraction-state correction controller 131A includes a non-popup image data processing function 131b which operates in a case where the temperature difference ΔT is ΔT<0 to judge whether or not the depth position z of the object is z≧0 on the popup side and, when judged as z<0, performs rendering processing on the three-dimensional data according to the 2D/3D contrast difference under a condition of a sixth camera setting G having the contrast difference Δcrst between the 2D background and the 3D object outputted from the 2D/3D image preprocessing section 34 as a parameter.
Further, the contraction-state correction controller 131A includes: an image data synthesizing function 131c which performs synthesizing processing on the image data on which rendering processing is performed by the popup side image data processing function 131a and the non-popup side image data processing function 131b that uses the 2D/3D contrast difference threshold value; and a 3D image data generating function 131d which generates 3D image data based on the synthesized image data, and outputs it for driving the display panel.
Further, the expansion-state correction controller 131B is structured to effectively output the 3D image data (synthesized image data) for driving the display panel in a state where the lenticular lens 1 is expanded by executing two following data processing functions and synthesizing those.
That is, the expansion-state correction controller 131B includes a non-popup side image data processing function 131e which operates when it is judged by the correction environment judging section 29 that the temperature difference ΔT is ΔT>0 and the lenticular lens 1 (image distributing module) is in an expansion state to further judge whether or not the depth position z of the object is z≧0 on the popup side and, when judged as z<0, performs rendering processing on the three-dimensional data of the object that satisfies z<0 under the condition of the first camera setting A.
Further, the expansion-state correction controller 131B includes a popup image data processing function 131f which operates in a case where the temperature difference ΔT is ΔT≧0 to judge whether or not the depth position z of the object is z≧0 on the popup side and, when judged as z≧0, performs rendering processing on the three-dimensional data under a condition of a seventh camera setting G having the contrast difference Δcrst between the 2D background and the 3D object outputted from the 2D/3D image preprocessing section 34 as a parameter.
Further, the expansion-state correction controller 131B constituting a part of the main arithmetic operation controller 131 includes: an image data synthesizing function 131g which performs synthesizing processing on the image data on which rendering processing is performed by the non-popup side image data processing function 131e, the popup side image data processing function 131f that uses the 2D/3D contrast difference threshold value, and the popup-side image data processing function; and a 3D image data generating function 131h which generates 3D image data based on the synthesized image data, and outputs it for driving the display panel.
Thereby, the prescribed camera setting is done by setting the depth position z of the object separately for the popup side and non-popup side as in the case of the first exemplary embodiment according to the contraction/expansion of the lenticular lens 1, and the image data acquired thereby is synthesized. Further, the image data acquired by operating the image data processing 131b and 131f using the 2D/3D contrast threshold value is added to the synthesizing processing. Therefore, still more effective correction than the case of the first exemplary embodiment described above can be acquired.
Next, the overall actions of the seventh exemplary embodiment will be described by referring to
Note here that
In
That is, first, the temperature sensor 21 is started up, and the difference ΔT between the detected temperature T of the lenticular lens 1 and the reference temperature Tth (normal temperature in the first exemplary embodiment) set in advance is calculated by the deformation amount calculating section 28 (
Thereafter, each of the absolute values of the temperature difference ΔT and the judgment threshold value ΔTth set in advance is compared by the temperature difference judging section 30 to judge whether or not the correction of the parallax amount is necessary.
Then, when judged that the temperature difference is |ΔT|<|ΔTth|, the 3D image data generating function 131G is operated as in the case of the first exemplary embodiment and it is considered that the deformation amount of the lenticular lens 1 due to the change in the temperature is small and that the parallax amount correction is unnecessary. Thus, the three-dimensional data is immediately rendering-processed under the condition of the first camera setting A. Subsequently, it is converted to a parallax image for driving the display panel, and the 3D image data as shown in
In the meantime, in a case where it is judged in the correction necessity judging step of step S703 as |ΔT|>|ΔTth|, the parallax amount correction is necessary. Thus, in order to detect whether the lenticular lens 1 is in a direction of contraction or in a direction of expansion, the procedure is shifted to judgment of the signs of ΔT. The ΔT sign judging action is executed by the correction environment judging section 29 of the stereoscopic image generating module 131A as described above.
Then, in step S705 of
Further, in a case of ΔT>0, it is judged that the lenticular lens 1 is in an expansion state compared to the reference state. Thus, the procedure is shifted to step S711. In both cases, executed is the next processing where the depth position of the object is investigated.
Out of those, when judged as the former case of ΔT<0, i.e., judged that the lenticular, lens 1 is in a contraction state, it is judged in step S706 of
Further, in a case of z≧0, rendering processing is executed on the three-dimensional data of the objects 43 and 43′ shown in
In the meantime, in a case of z<0, i.e., when the position of the object with respect to the z-axis is on the farther side than the screen face 40, it is necessary to take the influence of the contrast difference between the 2D background and the 3D object on the stereoscopic viewing region into consideration. Thus, rendering processing is performed on the object of z<0 by the camera setting G having the contrast difference Δcrst between the 2D background and the 3D object as a parameter. Thereby, 3D image data regarding the objects 43′ and 43 can be acquired as shown in
There is a tendency that the stereoscopic viewing region is decreased as the contrast difference Δcrst between the 2D background and the 3D object increases by the actual measurement data in
θ—G=f(θ—A, Δcrst) Equation (3)
As a condition (1), it is necessary that the function value θ_G of f(θ_A, Δcrst) to be smaller than the included angle θ_A of the camera setting A where the correction is unnecessary. Further, as a condition (2), it is necessary for the function f(θ_A, Δcrst) to narrow the function value θ_G as Δcrst increases.
For calculating θ_G, it is possible to use a function that is reciprocal proportion to the absolute value Δcrst of the contrast of the 2D background and the 3D object by taking the included angle θ_A of the first camera setting A as shown in Equation (4). Alternatively, as shown in Equation (5), it is also possible to use a function with which θ_G becomes linear relation with the absolute value Δcrst of the contrast of the 2D background and the 3D object. Further, in order to secure to satisfy the two conditions described above, an argument k may be adopted into the function (3) as in the cases shown in Equation (4) and Equation (5).
The reciprocal proportion to the absolute value Δcrst of the contrast of the 2D background and the 3D object and the camera setting G having the included angle θ_G as a linear function are described above as a way of example. However, the present invention is not limited to those. It is also possible to acquire θ_G of the camera setting G by using Gaussian, quadratic function, or high-order function having the contrast difference Δcrst of the 2D background and the 3D object as a parameter.
While the explanations are provided above based on the first exemplary embodiment, it is also within the scope of the present invention to calculate the optimum depth value according to a depth function having the contrast Δcrst of the 2D background and the 3D object as the parameter in the fourth exemplary embodiment and to calculate the optimum parallax amount according to a parallax amount function having the contrast Δcrst of the contrast of the 2D background and the 3D object as the parameter in the sixth exemplary embodiment.
Then, the image data regarding the objects 43′, 43 acquired by performing the rendering processing in step S708 of
When it is assumed that the contrast difference between the objects 42′, 42 and the 2D background in the back side thereof becomes |Δcrst_42′|>|Δcrst_42| in the case shown in
While an example of correcting the parallax amount according to the contrast difference Δcrst of the 2D background and the 3D object for the object of z<0 under the condition of ΔT<0 is described, it is also possible to execute the same processing for the object of z>0.
In the latter case where ΔT>0, i.e., when the lenticular lens 1 is in an expansion state, it is judged in step S711 of
Further, in a case of z<0, the rendering processing is executed on the three-dimensional data of the objects 42, 42′ shown in
In the meantime, in a case of z>0, i.e., when the position of the object with respect to the z-axis is on the front side than the screen face 40 (see
Then, the image data regarding the objects 42′, 42 acquired by performing the rendering processing in step S712 of
When it is assumed that the contrast difference between the objects 42′, 42 and the 2D background in the back side thereof becomes |Δcrst_43′|>|Δcrst_43| in the case shown in
While an example of correcting the parallax amount according to the contrast difference Δcrst of the 2D background and the 3D object for the object of z>0 under the condition of ΔT>0 is described, it is also possible to execute the same processing for the object of z<0.
(Modification Example)
While the case of acquiring the optimum correction amount by using the functions having the contrast difference Δcrst of the 2D background and the 3D object as the parameter is described above, it is also possible to perform interpolation only on the object in which the 2D/3D contrast difference is large. In that case, the 2D/3D image preprocessing 34 also includes a function which calculates the 2D/3D contrast difference, and sets the threshold value for judging whether or not it is necessary to perform correction for the 3D object.
As in the case of the first exemplary embodiment, the main arithmetic operation controller 132 shown in
Out of those, the contraction-state correction controller 132A is structured to execute a popup image processing function 132a and a non-popup image processing function 132b that uses the 2D/3D contrast difference, to synthesize those functions, and to output the 3D image data (synthesized image data) for driving the display panel.
That is, the contraction-state correction controller 132A constituting a part of the main arithmetic operation controller 132 includes a popup image data processing function 132a which operates when it is judged by the temperature environment judging section 28 that the temperature difference ΔT is ΔT<0 and the lenticular lens 1 (image distributing module) is in a contraction state to further judge whether or not the depth position z of the object is z≧0 on the popup side, and performs rendering processing on the three-dimensional data of the object that satisfies z under the condition of the first camera setting A.
The contraction-state correction controller 132A operates in a case where the temperature difference ΔT is ΔT<0 to judge whether or not the depth position z of the object is z≧0 on the popup side and, when judged as z<0, compares the contrast difference Δcrst between the 2D background and the 3D object outputted from the 2D/3D image preprocessing section 34 with a prescribed 2D/3D contrast difference threshold value Δcrst_th. For the object in which |Δcrst|<|Δcrst_th| is satisfied, rendering processing is performed on the three-dimensional data under the second camera setting B whose included angle is set to be narrower than that of the first camera setting A. Further, there is provided a non-popup image data processing function 132a which performs rendering processing on the three-dimensional data for the object in which |Δcrst|≧|Δcrst_th| is satisfied by using the 2D/3D contrast difference threshold value under a condition of an eighth camera setting J whose included angle is set still narrower than the second camera setting B.
Further, the contraction-state correction controller 132A includes: an image data synthesizing function 132c which performs synthesizing processing on the image data on which rendering processing is performed by the popup image data processing function 132a and the non-popup image data processing function 132b that uses the 2D/3D contrast difference threshold value; and a 3D image data generating function 132d which generates 3D image data based on the synthesized image data, and outputs it for driving the display panel.
Further, the expansion-state correction controller 132B constituting a part of the main arithmetic operation controller 132 is structured to output the 3D image data (synthesized image data) for driving the display panel in a state where the lenticular lens 1 is expanded by executing two following data processing functions and synthesizing those.
That is, the expansion-state correction controller 132B includes a non-popup side image data processing function 132e which operates when it is judged by the correction environment judging section 29 that the temperature difference ΔT is ΔT>0 and the lenticular lens 1 (image distributing module) is in an expansion state to further judge whether or not the depth position z of the object is z≧0 on the popup side and, when judged as z<0, performs rendering processing on the three-dimensional data of the object that satisfies z<0 under the condition of the first camera setting A.
Further, the contraction-state correction controller 132B operates in a case where the temperature difference ΔT is ΔT≧0 to judge whether or not the depth position z of the object is z≧0 on the popup side and, when judged as z≧0, compares the contrast difference Δcrst between the 2D background and the 3D object outputted from the 2D/3D image preprocessing section 34 with a prescribed 2D/3D contrast difference threshold value Δcrst_th. For the object in which |Δcrst|<|Δcrst_th| is satisfied, rendering processing is performed on the three-dimensional data under the second camera setting C whose included angle is set to be larger than that of the first camera setting A. Further, there is provided a non-popup image data processing function 132f which performs rendering processing on the three-dimensional data of the objects in which |Δcrst|≧|Δcrst_th| is satisfied by using the 2D/3D contrast difference threshold value under a condition of a ninth camera setting K whose included angle is set still larger than that of the third camera setting C.
Further, the expansion-state correction controller 132B constituting a part of the main arithmetic operation controller 132 includes: an image data synthesizing function 132g which performs synthesizing processing on the image data on which rendering processing is performed by the non-popup side image data processing function 132e, the popup side image data processing function 132f that uses the 2D/3D contrast difference threshold value, and the popup-side image data processing function; and a 3D image data generating function 132h which generates 3D image data based on the synthesized image data, and outputs it for driving the display panel.
Thereby, the prescribed camera setting is done by setting the depth position z of the object separately for the popup side and non-popup side as in the case of the first exemplary embodiment according to the contraction/expansion of the lenticular lens 1, and the image data acquired thereby is synthesized. Further, the image data acquired by operating the image data processing 132b and 132f using the 2D/3D contrast threshold value is added to the synthesizing processing. Therefore, still more effective correction than the case of the first exemplary embodiment described above can be achieved.
Next, the overall actions of the seventh exemplary embodiment will be described by referring to
In
That is, first, the temperature sensor 21 is started up, and the difference ΔT between the detected temperature T of the lenticular lens 1 and the reference temperature Tth (normal temperature in the first exemplary embodiment) set in advance is calculated by the deformation amount calculating section 28. Subsequently, the screen face 40 and the camera setting (first camera setting A) as the condition required for the rendering processing are selected.
Thereafter, each of the absolute values of the temperature difference ΔT and the judgment threshold value ΔTth set in advance is compared by the temperature difference judging section 30 to judge whether or not the correction of the parallax amount is necessary.
Then, when judged that the temperature difference is |ΔT|<|ΔTth|, the 3D image data generating function 132G is operated as in the case of the first exemplary embodiment and it is considered that the deformation amount of the lenticular lens 1 due to the change in the temperature is small and that the parallax amount correction is unnecessary. Thus, the three-dimensional data is immediately rendering-processed under the condition of the first camera setting A. Subsequently, it is converted to parallax images for driving the display panel, and the 3D image data is generated and outputted.
In the meantime, in a case where it is judged in the correction necessity judging step of step S′703 as |ΔT|>|ΔTth|, the parallax amount correction is necessary. Thus, in order to detect whether the lenticular lens is in a direction of contraction or in a direction of expansion, the procedure is shifted to judgment of the signs of ΔT. The ΔT sign judging action is executed by the correction environment judging section 29 described above.
Then, in step S′705 of
Further, in a case of ΔT>0, it is judged that the lenticular lens 1 is in an expansion state compared to the reference state. Thus, the procedure is shifted to step S′714. In both cases, executed is the next processing where the depth position of the object is investigated.
Out of those, when judged as the former case of ΔT<0, i.e., judged that the lenticular lens 1 is in a contractions state, it is judged in step S′706 of
Further, rendering processing is executed on the three-dimensional data of z≧0 under the condition of the first camera setting A, and 3D image data can be acquired.
In the meantime, in a case of z<0, correction is further performed by using Δcrst_th on the object in which the contrast difference between the 2D background and the 3D object is large. The correction method thereof will be described hereinafter.
The rendering processing is performed on the 3D object that satisfies z<0 and |Δcrst|≧|Δcrst_th| under the condition of the second camera setting B whose included angle is set to be narrower than that of the first camera setting A.
The rendering processing is performed on the 3D object that satisfies z<0 and |Δcrst|≧|Δcrst_th| under the condition of the eighth camera setting J whose included angle is set to be narrower than that of the second camera setting B. The threshold value |Δcrst_th| can be defined by a form of LUT (Lookup table), a function, or the like by referring to the actual measurement showing the dependency between the 2D/3D contrast difference and the stereoscopic viewing region shown in
In the latter case of ΔT>0, i.e., when the lenticular lens 1 is in an expansion state, it is judged in step S′714 of
Then, the rendering processing is executed on the three-dimensional data of the object of z<0 under the condition of the first camera setting A. Thereby, the 3D image data can be acquired.
In the meantime, in a case of z>0, i.e., when the position of the object with respect to the z-axis is on the front side than the screen face 40, it is necessary to take the influence of the contrast difference between the 2D background and the 3D object on the stereoscopic viewing region into consideration.
Rendering processing is performed on the object that satisfies z>0 and |Δcrst|Δcrst_th| by the third camera setting C whose included angle is set to be still larger than that of the first camera setting A.
Inversely, rendering processing is performed on the object that satisfies z<0 and |Δcrst|≧|Δcrst_th| by the ninth camera setting K whose included angle is set to be still larger than that of the third camera setting C.
Then, the image data acquired by performing the rendering processing in step S′716, step S′718, and step S′720 of
The actions of each of the data processing, the comparison judgment, and the like from step S′701 to steps S′723 in the overall actions of the seventh exemplary embodiment described above may be put into a program to have it achieved by a computer provided to the stereoscopic image generating module 131.
The seventh exemplary embodiment is structured and functions in the manner described above, so that it has the operation effects equivalent to that of the first exemplary embodiment. Further, it is designed to take the influence of the contrast difference between the 2D background and the 3D object on the stereoscopic viewing region and to provide the threshold value of the contrast difference between the 2D background and the 3D object, thereby providing an advantage that it is possible perform correction of the temperature by corresponding to the actual circumstances in a still finer manner.
Other structures and operation effects thereof are the same as those of the first exemplary embodiment described above.
While the case of performing development into the parallax image by performing rendering processing on the 3D data having the depth information is disclosed above, the present invention is not limited only to that. As in the case of the first exemplary embodiment described above, it is also possible to develop the data into a depth image. Further, as described in the fifth exemplary embodiment, it can also be applied to parallax images generated in advance by performing rendering processing and to two-dimensional data such as parallax images captured by a stereoscopic camera.
Each of the first to seventh exemplary embodiments according to the present invention has been described above. All of those exemplary embodiments provide the possibility of using the lenticular lens 1 and the display panel 11A constituting the stereoscopic display panel 11 by assembling and unifying those even when there is a difference between the thermal expansion coefficients thereof. Thus, the present invention largely contributes to reduce the cost of the entire device, to reduce the weight, and to increase the flexibility without losing the ambience.
While the present invention has been described heretofore by referring to the embodiments (and EXAMPLES), the present invention is not limited only to the embodiments (and EXAMPLES). Various changes and modifications occurred to those skilled in the art can be applied to the structures and details of the present invention without departing from the scope of the present invention.
This application claims the Priority right based on Japanese Patent Application No. 2009-276439 filed on Dec. 4, 2009 and the disclosure thereof is hereby incorporated by reference in its entirety.
The display device according to the present invention directed to the lenticular lens sheet can be effectively applied to all the stereoscopic display devices such as liquid crystal and other electro-optical elements. It is extremely effective for thin-type stereoscopic display devices in particular, and exhibits a high multiplicity of uses.
1 Image distributing section (lenticular lens)
4a Left-eye pixel
4b Right-eye pixel
5a Left-eye region
5b Right-eye region
7a Observer's left eye
7b Observer's right eye
8 Stereoscopic viewing region
10 Stereoscopic display device
11 Stereoscopic display panel
11A Display panel section
12, 50, 60, 70, 110 Display controller
21 Temperature sensor
22, 50A, 60A, 70A, 110A Stereoscopic image generating module
22A Camera setting information storage section
22B Depth image development processing section
23 Display panel driving section
24 Input section
25 Data storage section
26 Command information storage section
28 Deformation amount calculating section
29 Correction environment judging section
30 Temperature difference judging section
31, 51, 61, 62, 63, 71, 72, 111, 121, 131 Main arithmetic operation controller
31A, 51A, 61A, 62A, 63A, 71A, 72A, 111A, 121A, 131A Contraction-state correction controller
31B, 51B, 61B, 62B, 63B, 71B, 72B, 111B, 121B, 131B Expansion-state correction controller
31a, 31f, 51a, 51f, 61a, 61f, 131a, 131f, 132a, 132f Popup side image data processing function
31b, 31e, 51b, 51e, 61b, 61e, 131e, 131b, 132e, 132b Non-popup side image data processing function
31c, 31g, 51c, 51g, 61c, 61g, 131c, 131g Image data synthesizing function
31d, 31h, 31G, 51d, 51h, 51G 61d, 61h, 61G, 62d, 62G, 121G, 121c, 122G, 122c, 131G, 131d, 131h, 132G, 132d, 132h 3D image data generating function
32b, 52b, 62b Non-popup side z-value conversion processing function
32c, 32g Entire region image data collective processing function
32f, 52f, 62f Popup-side z-value conversion processing function
33 Parallax amount adjusting LIT signal storage section
34 2D/3D image preprocessing section
82 Popup object
83 Depth object
35a Left-eye camera
35b Right-eye camera
40 Screen face (display screen)
42, 42′ Depth-side (z<0) object
43, 43′ Front-side (z≧0) object
46a-46d, 47a-47d, 48a-48d, 81a-81d, 82a-82d, 83a-83d, 84a-84d, 85a-85d, 86a-86d, 87a-87d, 88a-88d, 89a-89d, 91a-91d, 92a-92d, 93a-93d Objects on depth map
46e, 47e, 48e, 81e, 82e, 83e, 84e, 85e, 86e, 87e, 88e, 89e, 91e, 92e, 93e Background on depth map
50 Controller
50B X-position threshold value setting section
51a First viewpoint pixel
51b Second viewpoint pixel
51c Third viewpoint pixel
51d Fourth viewpoint pixel
52a First viewpoint region
52b Second viewpoint region
52c Third viewpoint region
52d Fourth viewpoint region
51j, 51k Out-of x-axis-threshold-value image data processing function
52e, 52g, 62c, 62g Entire region image data collective processing function
52j, 52k Out-of x-axis-threshold-value z-value conversion processing function
61j, 61k, 62a 2D image data processing function
62A Image correction control function
62b 3D image data processing function
62j, 62k Out-of x-axis-threshold-value z=0 processing function
71a, 71f Gradation value non-conversion processing function
71b, 71e Gradation value conversion processing function
71c, 71g Depth image data synthesizing function
71d, 71h, 71G, 72c, 72G 111c, 111f, 111G 3D depth image data generating function
72A Gradation value correction control function
72a Gradation value increase conversion processing function
72b Gradation value decrease conversion processing function
77 Target image data setting section
111a, 111d Image data offset processing function
111b, 111e, 121b, 122e Parallax image data generating function
111s Offset image generating function
121a Parallax amount adjusting function according to LUT signal
122d Parallax amount adjusting function according to LUT signal and x-axis coordinate
Sakamoto, Michiaki, Shigemura, Koji, Wu, Di
Patent | Priority | Assignee | Title |
10552973, | Nov 14 2016 | SAMSUNG ELECTRONICS CO , LTD | Image vision processing method, device and equipment |
11335020, | Oct 17 2017 | ORBBEC INC | Method and system for correcting temperature error of depth camera |
Patent | Priority | Assignee | Title |
8049772, | Oct 27 2005 | CORTLAND CAPITAL MARKET SERVICES LLC, AS THE SUCCESSOR COLLATERAL AGENT | Temperature compensation for the differential expansion of an autostereoscopic lenticular array and display screen |
20070097502, | |||
20070109401, | |||
20080284844, | |||
20100033556, | |||
JP2005189864, | |||
JP2006184900, | |||
JP2008067095, | |||
JP2009016384, | |||
JP2009157301, | |||
JP2009514030, | |||
JP2009521137, | |||
JP3816813, | |||
JP9189883, | |||
WO2012046655, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Dec 03 2010 | NLT TECHNOLOGIES, LTD. | (assignment on the face of the patent) | / | |||
Jun 15 2012 | SHIGEMURA, KOJI | NLT TECHNOLOGIES, LTD | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 028411 | /0198 | |
Jun 15 2012 | WU, DI | NLT TECHNOLOGIES, LTD | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 028411 | /0198 | |
Jun 15 2012 | SAKAMOTO, MICHIAKI | NLT TECHNOLOGIES, LTD | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 028411 | /0198 |
Date | Maintenance Fee Events |
Mar 03 2017 | ASPN: Payor Number Assigned. |
May 22 2019 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
May 29 2023 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
Date | Maintenance Schedule |
Dec 01 2018 | 4 years fee payment window open |
Jun 01 2019 | 6 months grace period start (w surcharge) |
Dec 01 2019 | patent expiry (for year 4) |
Dec 01 2021 | 2 years to revive unintentionally abandoned end. (for year 4) |
Dec 01 2022 | 8 years fee payment window open |
Jun 01 2023 | 6 months grace period start (w surcharge) |
Dec 01 2023 | patent expiry (for year 8) |
Dec 01 2025 | 2 years to revive unintentionally abandoned end. (for year 8) |
Dec 01 2026 | 12 years fee payment window open |
Jun 01 2027 | 6 months grace period start (w surcharge) |
Dec 01 2027 | patent expiry (for year 12) |
Dec 01 2029 | 2 years to revive unintentionally abandoned end. (for year 12) |