An electronic zoom image input method that enables zooming without declining the resolution by receiving an input image transmitted through a fixed focal distance optical system having a function of compressing the circumferential part of the input image by means of a photo detector with a uniform pixel density and subjecting the received image to image correction and conversion to obtain an output image. Three dimensional image input system is realized by preparing each image input system of both left and right view with this electronic zoom image input method.
|
0. 18. A 3d electronic zoom imaging method comprising: providing a right zoom output image, and providing a left zoom output image, wherein each of said providing steps is carried out using said electronic zoom imaging method as claimed in claim 13.
0. 42. A 3d electronic zoom imaging method comprising: providing a right zoom output image, and providing a left zoom output image, wherein each of said providing steps is carried out using said electronic zoom imaging method as claimed in claim 37.
0. 30. A 3d electronic zoom imaging apparatus comprising: a right image input optical system and a left image input optical system wherein each of said right image input optical system and said left image input optical system includes an associated electronic zoom imaging apparatus as claimed in claim 25.
0. 37. An electronic zoom imaging method, comprising:
forming a compressed input image using an input image compressing optical system, the compression of the input image being a function of distance from a central part thereof such that the compression of the input image increases as the distance from the central part increases;
receiving the compressed input image and providing data representing the compressed input image using an image sensor; and
converting and correcting the data representing the compressed input image to produce output data representing a standard angle image and wide angle image, a length of the wide angle image being at least twice a length of the standard angle image, wherein a resolution of the wide angle image is higher in a central portion than a resolution of the standard angle image and the same at an outer edge.
0. 13. An electronic zoom imaging method, comprising:
forming a compressed input image using a fixed focus input image compressing optical system, the compression of the input image being a function of distance to a circumferential part thereof such that the compression of the input image increases as the distance to the circumferential part decreases,
receiving the compressed input image and providing data representing the compressed input image using an image sensor, and
converting and correcting the data representing the compressed input image to produce output data representing a standard angle image and wide angle image, a length of the wide angle image being at least twice a length of the standard angle image, wherein a resolution of the wide angle image is higher in a central portion than a resolution of the standard angle image and the same at an outer edge.
0. 48. An electronic zoom imaging method, comprising:
forming a compressed input image using an input image compressing optical system, the compression of the input image being a function of distance from a central part thereof such that the compression of the input image increases according to a logarithmic function as the distance from the central part increases;
receiving the compressed input image and providing data representing the compressed input image using an image sensor; and
converting and correcting the data representing the compressed input image to produce output data representing a standard angle image and wide angle image, a length of the wide angle image being at least twice a length of the standard angle image, wherein a resolution of the wide angle image is higher in a central portion than a resolution of the standard angle image and the same at an outer edge.
0. 24. An electronic zoom imaging method, comprising:
forming a compressed input image using a fixed focus input image compressing optical system, the compression of the input image being a function of distance to a circumferential part thereof such that the compression of the input image increases according to a logarithmic function as the distance to the circumferential part decreases;
receiving the compressed input image and providing data representing the compressed input image using an image sensor; and
converting and correcting the data representing the compressed input image to produce output data representing a standard angle image and wide angle image, a length of the wide angle image being at least twice a length of the standard angle image, wherein a resolution of the wide angle image is higher in a central portion than a resolution of the standard angle image and the same at an outer edge.
0. 25. An electronic zoom imaging apparatus, comprising:
an input image compressing optical system configured to form a compressed input image, the compression of the input image being a function of distance from a central part thereof such that the compression of the input image increases as the distance from the central part increases;
an image sensor configured to receive the compressed input image and to provide data representing the compressed input image; and
a conversion unit connected to said image sensor for converting and correcting the data representing the compressed input image to produce output data representing a standard angle image and wide angle image, a length of the wide angle image being at least twice a length of the standard angle image, wherein a resolution of the wide angle image is higher in a central portion than a resolution of the standard angle image and the same at an outer edge.
0. 36. An electronic zoom imaging apparatus, comprising:
an input image compressing optical system configured to form a compressed input image, the compression of the input image being a function of distance from a central part thereof such that the compression of the input image increases according to a logarithmic function as the distance from the central part increases;
an image sensor configured to receive the compressed input image and to provide data representing the compressed input image; and
a conversion unit connected to said image sensor for converting and correcting the data representing the compressed input image to produce output data representing a standard angle image and wide angle image, a length of the wide angle image being at least twice a length of the standard angle image, wherein a resolution of the wide angle image is higher in a central portion than a resolution of the standard angle image and the same at an outer edge.
1. An electronic zoom image input method that enables zooming without degrading the resolution, by imaging apparatus, comprising:
a fixed focus input image compressing optical system configured to form a compressed zoom input image having a function of compressing, the compression of the input image more largely as it moves being a function of distance to the a circumferential part, thereof such that the compression of the input image increases as the distance to the circumferential part decreases;
an image sensor configured to receive the compressed zoom input image with reduced input image plane area providing preferably uniform pixel density, and a conversion unit for the processing of the zoom image converting and correcting of to provide data representing the compressed zoom input image to reproduce zoom output images; and
a conversion unit connected to said image sensor for converting and correcting the data representing the compressed input image to produce output data representing a standard angle image and wide angle image, a length of the wide angle image being at least twice a length of the standard angle image, wherein a resolution of the wide angle image is higher in a central portion than a resolution of the standard angle image and the same at an outer edge.
2. An electronic zoom image input method that enables zooming without degrading the resolution, by imaging apparatus, comprising:
a fixed focus input image compressing optical system configured to form a compressed zoom imput image, the compression of the input image having being a function of compressing the distance to a circumferential part, thereof such that the compression of the input image in increases according to a logarithmic function, as the distance to the circumferential part decreases;
an image sensor configured to receive the compressed zoom input image with reduced and to provide data representing the compressed input image plane area,; and a conversion unit for the processing of the zoom connected to said image sensor for converting and correcting of the data representing the compressed zoominput image to reproduce zoom output images. produce output data representing a standard angle image and wide angle image, a length of the wide angle image being at least twice a length of the standard angle image, wherein a resolution of the wide angle image is higher in a central portion than a resolution of the standard angle image and the same at an outer edge.
3. An electronic zoom image input method imaging apparatus as claimed in
4. An electronic zoom image input method imaging apparatus as claimed in
5. An electronic zoom image input method imaging apparatus as claimed in
a first optical system configured for a non-zoom imaging apparatus; and
an attachment optical system mounted onto said first optical system.
6. An electronic zoom image input method imaging apparatus as claimed in
7. A 3d electronic zoom image input method whose imaging apparatus comprising: a right image input optical system and a left image input optical systems are organized by fixed focus input image compressing optical systems of the wherein each of said right image input optical system and said left image input optical system includes an associated electronic zoom image input method imaging apparatus as claimed in
0. 8. An electronic zoom imaging apparatus as claimed in claim 1, wherein said image sensor has a substantially uniform pixel density.
0. 9. An electronic zoom imaging apparatus as claimed in claim 1, wherein said fixed focus input image compressing optical system includes a fixed position optical element.
0. 10. An electronic zoom imaging apparatus as claimed in claim 1, wherein the compression of the input image is a function of distance such that the compression of the input image increases from a center part of the input image to the circumferential part with a continuous gradation.
0. 11. An electronic zoom imaging apparatus as claimed in claim 1, wherein the compression of the input image is a function of distance such that the compression of the input image increases non-linearly as the distance to the circumferential part decreases along a particular direction.
0. 12. An electronic zoom imaging apparatus as claimed in claim 1, wherein the compression of the input image is a function of distance such that the compression of the input image increases non-linearly as the distance to the circumferential part decreases along a first direction and as the distance to the circumferential part decreases along a second direction.
0. 14. An electronic zoom imaging method as claimed in claim 13, wherein the compression of the input image is limited to being a function of distance along a vertical axis and a function of distance along a horizontal axis.
0. 15. An electronic zoom imaging method as claimed in claim 13, wherein the compression of the input image is a function of distance in all directions, and said fixed focus input image compressing optical system is configured to further compress the circumferential part of the input image in regions neighboring a vertical axis and a horizontal axis so that the circumferential part of the input image is substantially rectangular-shaped.
0. 16. An electronic zoom imaging method as claimed in claim 13, wherein the input image compressing optical system includes: a first optical system that is configured for non-zoom imaging, and an attachment optical system that is mounted onto the first optical system.
0. 17. An electronic zoom imaging method as claimed in claim 13, further comprising: changing a focal length by mounting a fixed focus attachment conversion lens onto the fixed focus input image compressing optical system, thereby changing a zooming range provided by said electronic zoom imaging method.
0. 19. An electronic zoom imaging method as claimed in claim 13, wherein receiving the compressed input image uses an image sensor having a substantially uniform pixel density.
0. 20. An electronic zoom imaging method as claimed in claim 13, wherein forming the compressed input image uses a fixed focus input image compressing optical system that includes a fixed position optical element.
0. 21. An electronic zoom imaging method as claimed in claim 13, wherein the compression of the input image is a function of distance such that the compression of the input image increases from a center part of the input image to the circumferential part with a continuous gradation.
0. 22. An electronic zoom imaging method as claimed in claim 13, wherein the compression of the input image is a function of distance such that the compression of the input image increases non-linearly as the distance to the circumferential part decreases along a particular direction.
0. 23. An electronic zoom imaging method as claimed in claim 13, wherein the compression of the input image is a function of distance such that the compression of the input image increases non-linearly as the distance to the circumferential part decreases along a first direction and as the distance to the circumferential part decreases along a second direction.
0. 26. An electronic zoom imaging apparatus as claimed in claim 25, wherein the compression of the input image is limited to being a function of the distance from the central part along a vertical axis and a function of the distance from the central part along a horizontal axis.
0. 27. An electronic zoom imaging apparatus as claimed in claim 25, wherein the compression of the input image is a function of the distance from the central part in all directions, and said input image compressing optical system is configured to further compress a circumferential part of the input image in regions neighboring a vertical axis and a horizontal axis so that the circumferential part of the input image is substantially rectangular-shaped.
0. 28. An electronic zoom imaging apparatus as claimed in claim 25, wherein said input image compressing optical system is comprised of: a first optical system that is configured for a non-zoom imaging apparatus, and an attachment optical system that is mounted onto said first optical system.
0. 29. An electronic zoom imaging apparatus as claimed in claim 25, further comprising: an attachment conversion lens that is mounted onto said input image compressing optical system to change its combined focal length thereby changing a zooming range of said electronic zoom imaging apparatus.
0. 31. An electronic zoom imaging apparatus as claimed in claim 25, wherein said image sensor has a substantially uniform pixel density.
0. 32. An electronic zoom imaging apparatus as claimed in claim 25, wherein said input image compressing optical system is a fixed focus input image compressing optical system.
0. 33. An electronic zoom imaging apparatus as claimed in claim 25, wherein the compression of the input image is a function of the distance from the central part such that the compression of the input image increases from the central part to a circumferential part of the input image with a continuous gradation.
0. 34. An electronic zoom imaging apparatus as claimed in claim 25, wherein the compression of the input image is a function of the distance from the central part such that the compression of the input image increases non-linearly as the distance from the central part increases along a particular direction.
0. 35. An electronic zoom imaging apparatus as claimed in claim 25, wherein the compression of the input image is a function of the distance from the central part such that the compression of the input image increases non-linearly as the distance from the central part increases along a first direction and as the distance from the central part increases along a second direction.
0. 38. An electronic zoom imaging method as claimed in claim 37, wherein the compression of the input image is limited to being a function of the distance from the central part along a vertical axis and a function of the distance from the central part along a horizontal axis.
0. 39. An electronic zoom imaging method as claimed in claim 37, wherein the compression of the input image is a function of the distance from the central part in all directions, and said input image compressing optical system is configured to further compress a circumferential part of the input image in regions neighboring a vertical axis and a horizontal axis so that the circumferential part of the input image is substantially rectangular-shaped.
0. 40. An electronic zoom imaging method as claimed in claim 37, wherein the input image compressing optical system includes: a first optical system that is configured for non-zoom imaging, and an attachment optical system that is mounted onto the first optical system.
0. 41. An electronic zoom imaging method as claimed in claim 37, further comprising: changing a focal length by mounting an attachment conversion lens onto the input image compressing optical system, thereby changing a zooming range provided by said electronic zoom imaging method.
0. 43. An electronic zoom imaging method as claimed in claim 37, wherein said step of receiving the compressed input image uses an image sensor having a substantially uniform pixel density.
0. 44. An electronic zoom imaging method as claimed in claim 37, wherein said step of forming the compressed input image uses a fixed focus input image compressing optical system.
0. 45. An electronic zoom imaging method as claimed in claim 37, wherein the compression of the input image is a function of the distance from the central part such that the compression of the input image increases from the central part to a circumferential part of the input image with a continuous gradation.
0. 46. An electronic zoom imaging method as claimed in claim 37, wherein the compression of the input image is a function of the distance from the central part such that the compression of the input image increases non-linearly as the distance from the central part increases along a particular direction.
0. 47. An electronic zoom imaging method as claimed in claim 37, wherein the compression of the input image is a function of the distance from the central part such that the compression of the input image increases non-linearly as the distance from the central part increases along a first direction and as the distance from the central part increases along a second direction.
|
This invention relates to a electronic zoom image input method, that can obtain the zoom image through the fixed focal length image input optical lens, without degrading the zoom image resolution.
Image input systems such as cameras or camcoders, zoom lenses that can vary their focal length are used widely to obtain zoom images, conventionally.
However, as the zoom lens is highly precision instrument, it is expensive and also large in size. Especially, for the digital zoom cameras that have been required to be small size and low price, conventional zoom lenses were obstacles for these requirements. Furthermore, as image input devices or image sensors such as CCDs have been becoming small in size recently, smaller and shorter focal length zoom lenses have been required for cameras that use these devices.
But, it is very difficult to realize the wide angle zoom lens in short focal length, as it become very small and complicated.
On the other hand, in the case of three-dimensional(3D) zoom image input, accurately synchronized zoom action between two zoom lenses for the left and right images become necessary. As such a synchronized zoom action has to be achieved precisely all in mechanical at the conventional zoom lens, it becomes a very complicated and expensive apparatus. Consequently, the introduction of zoom lens to 3D image input has been very difficult.
Sometimes, in digital cameras, it is called as the electronic telephoto zooming to expand simply a part of the input image electronically. But it differs from a real zoom action, because the resolution of the zoom image is degraded along with its expansion.
This invention realized a all electronic zoom image input method that do not use conventional optical zoom lens, without degrading the image resolution. And also it solved issues that conventional optical zoom lens had.
The electronic zoom image input method of this invention has a fixed focal length lens that has the function of compressing circumferential part of the input image (it is called as the compressing optical system, thereafter) in combination with a usual image input device with the uniformly aligned pixel. And the output zoom image is realized without degrading image resolution throughout the full zooming range, by processing the image of this compressed input image.
And, an electronic zoom image input method that simplify the zoom image processing by applying the compression optical system that compresses the input image only to the vertical and horizontal directions is introduced.
Also, a compression optical system is introduced that compresses the area close to the vertical and horizontal center axes of the input image, in addition to the compression of the circumferential part of the input image to all direction. It realizes an electronic zoom image input method with much smaller image sensor area.
Furthermore, this compression optical system can be composed as the attachment lens. Conventional digital cameras can be changed to zoom camera systems of this invention, by mounting this attachment compression lens to them.
Attachment conversion lenses have been commonly used to change the equivalent focal length of conventional cameras. In the same way, the focal length of the compression optical system can be changed by mounting the conventional attachment conversion lens to the compression optical system. As the result, a different zooming range can be realized by attaching this attachment conversion lens to this invented method.
3D-image input system can be realized easily, by constructing each image input system of both left and right picture with the electronic zoom image input method of this invention. Because, the accurately synchronized zoom action between the two zoom systems can be easily done by electronic operation in this invention.
Functions of each items of this invention are explained, next.
Usually, in a camera including the digital camera and the camcorder, the zoom image of wide angle or telephoto view is obtained through the zoom lens, by changing its equivalent focal length.
On the other hand, at the electronic image sensor such as CCD, it is possible to expand or compress a part of the input image on the image plane of the image sensor, by processing the image data electronically.
Accordingly, applying this image data processing method, it becomes possible to realize an equivalent zoom function, by changing the area that corresponds to the output image to be taken out from the input image plane of the image sensor.
For example, to change an zoom image from a standard view image to a wide angle view image, the image data of wider area on input image plane that corresponds to the wide angle image is taken out, and is processed as the output image of the wide angle view. In this case, if the area of the zoom input image plane is used proportional to the angle of the view image, the area that is needed to cover the wide angle image becomes very large.
And, if the telephoto view image area on the image plane is taken out as the telephoto output image, its needed area becomes small. But as the number of pixel is reduced by this reduced area, the resolution of the output image becomes degraded. And this method to obtain the telephoto zoom image is used in the conventional digital camera named as the electronic zooming with the sacrifice of degraded resolution.
This indicates that the wider angle view image requires the larger area of input image plane that accompanies higher image resolution as the output image. Because, as the pixel is uniform in density, the larger area on the image plane has more image data. Conversely, the area of input image plane of the wide angle image can be compressed to keep its resolution same to that of the narrower angle image such as the standard angle image.
Accordingly, in the image input system with fixed focal length optical lens and with conventional uniform pixel image sensor, it becomes possible to compose an electronic zoom image input method that has a remarkably suppressed area of the input image plane, by preparing the optical system that compresses the circumferential part of the input image that corresponds to the wide angle part of the input image.
The image through the fixed focal length optical system is a fixed data, having exact correspondence between the object scene and its image. These zoom image information can be freely reproduced as the fixed output zoom image, by the data processing of the image conversion and correction.
For example, to obtain the wide angle output image, the image data of its circumferential part is directly used, because this part has been already compressed at the input image. And the image data of its central part is compressed to the reduced size that corresponds to the narrower area at the wide angle output image. Because this part corresponds to the narrower view image such as the standard view image, and occupies the smaller area at the wide angle output image. As the result, the wide angle output image that has the same resolution to the standard view image is realized with minimum increase of input image area.
It is one of the most important features of this invention that the image sensor with conventional uniform pixel density is used in this invented method, which is made possible by applying non-linear compression of the image data to the compression optical system. And this made it easy to manufacture the sensor, and also easy to process the image data.
However, the pixel of the sensor is not necessarily uniform, and it is also possible to apply non-uniform pixel device. Furthermore, although the invention is explained mainly about the 2-dimension input image plane, the input image plane that is explained here includes even the case of the 1-dimension image sensor that composes the 2-dimension input image plane by scanning it mechanically.
In general, the electronic image data can be easily processed as is treated here. And the zoom output image that is reproduced from the input image data of this electronic image input method can be easily and accurately realized by converting and correcting it electronically.
As the fixed focal length optical system that is introduced to this invented zoom method is a fixed optical system, the input image that passed the optical system is also a fixed image. Accordingly, the compression or distortion pattern and the quantity of the image can also be exactly fixed. And the original correct input image can be reproduced by processing the compressed image that contains the fixed amount of compression and distortion as described above.
The ultra wide-angle optical system as the fish-eye lens that compresses the image uniformly, tends to contain large amount of distortion. As its input image is also fixed one including its distortion through the fixed ultra wide-angle compressing optical system, an ultra wide-angle zoom input image system can be composed by combining the ultra wide-angle optical system to the compressing optical system of this invention, where converting and correcting the wide zoom input image is done simultaneously.
Conventionally, there have been proposals of image sensors called silicone retina. But these sensors have pixels with reduced density at the circumferential part of them, and don't have the zoom function preserving the same image resolution. Consequently, they are different at all from this invention in purpose and in principle.
This invented method is embodied as the image input apparatus equipped with the optical system hat has the function of compressing the circumferential part of the input image. This optical system can also be realized as an attachment lens, that is to be attached to the optical lens of the usual image input apparatus. Accordingly, it is possible to realize the electronic zoom image input method of this invention, by adding this attachment optical system to the conventional image input apparatus such as the photo camera or the camcorder.
Pixels of the electronic image sensor such as CCD are generally arranged uniformly along the length and breadth direction on the image plane. A simplified compressing optical system is introduced that limits the compression of the input image only to the vertical and horizontal direction, in accordance with the direction of the pixel arrangement. And it also results in reducing the amount of the image data processing. By the introduction of this compressing optical system, an electronic zoom input image method, that simplified the image compressing process only to the length and breadth direction, is realized.
At the electronic zoom image input system of this invention, the input image is compressed largely as it moves to its circumferential part. In the case that the rectangular object view is compressed to all the direction, its input image of the area in the diagonal line direction is largely compressed, because this area is at a longer distance away from the central point of the image. On the contrary, its image of the area near in the vertical or horizontal axis line direction is compressed small, because this area is at a shorter distance away from the central point of the image. As the result, the rectangular object view is compressed to a barrel shaped image.
Accordingly, if the area near in the vertical and horizontal axis line direction of this image is compressed furthermore, the barrel shaped input image can be compressed to rectangular shaped one. This rectangular image fits well to the form of the input image plane of the image sensor, and can realize the reduction of the image area itself.
Conventionally, to get a wide range of variable-power optical system, the plural number of zoom lenses that have the different range of focal length has been used, because it is difficult to cover all the power range with one zoom lens.
But, the zooming range of the invented electronic zoom image input method can be changed by adding a conventional attachment fixed focal length lens in front of the compressing optical system. Accordingly, at the electronic zoom image input system of this invention, the zoom action of a wider power range becomes possible by mounting conventional magnifying or telephoto attachment converter lenses with fixed focal length, in front of the compressing optical system of the invention.
The electronic zoom image input system of this invention is appropriately applied to the 3D zoom image input system, which has been very difficult to realize by the conventional zoom lens.
Conventionally, the optical system with two zoom lenses that are interlocked mechanically for 3D-images of the right and left view, has been used to realize the 3D zoom image. Where, these two zoom lenses that are combined mechanically, have to be operated simultaneously and accurately for synchronized zooming and accompanied focusing. It has been very complicated and difficult to realize the zoom operation mechanically.
But, at the electronic zoom image input method of this invention, both of these 3D image input optical systems of the right and left view can be realized by fixed focal length optical systems requiring no zooming and no focusing operations mechanically.
Furthermore, the zoom action can be easily realized by interlocking both image input systems of this invention electronically, because the zoom operation is all done electronically without including any mechanical action.
Details of this invention are explained with figures attached.
It is the case that the compression of the image of its circumferential part is limited only to the vertical and horizontal direction.
1A shows the object view of the zoom input image. At the view of 1A, the standard angle view 1AS is settled as the basic angle of view that provides the standard size and the resolution of the output image of this zoom system. And the zoom images of the object view are taken in, as the zoom image changes to wider angle view, from the intermediate angle view 1AM to the more wide angle view 1AW that is expected to have the output image of the same size and resolution to 1AS.
Also, 1B shows the input image at the input image plane of this image sensor, that is formed a compressed zoom image of object scene 1A, by passing the compressing optical system that has the function of compressing the circumferential part of the image.
In order to preserve these output images to the same size and resolution to the standard angle view, it is possible to compress the image area of the circumferential part of the image that corresponds to the outside part of the standard angle view. Accordingly, the input image on the input image plane of the image sensor with uniform pixel density can be compressed more largely to the vertical and horizontal direction as it moves to the circumferential part.
Here in
For example, if the case that the wide angle scene 1AW is settled 4-times wider in length than the standard angle scene 1AS, the size of the wide angle input image 1BW at the input image plane of the image sensor is reduced to about 2 times that of the standard angle input image 1BS in length. It indicates that by the image compression of the invention, a wide zoom image data 4-times wider in length can be reduced to about the half of that in length comparing to the case without the compression, preserving the same image resolution to the standard angle input image 1BS. And the size of the input image plane is reduced to about the half (½) in length and to quarter (¼) in area, comparing to the case that no compression is applied.
Strictly to say, as the compression power at the inner part of the 4-times wide angle image becomes gradually low as it moves toward its central part comparing to that of the circumferential part. As the result the total compression power decreases slightly. Accordingly, the area of the wide-angle image increases slightly than 2 times actually.
The corrected output zoom image 1C is finally obtained from the compressed zoom image, after the processing of the image conversion and correction. In this case, the corrected output zoom image 1CS, 1CM, 1CW corresponds to the object view 1AS, 1AM, 1AW respectively with the same image resolution.
Comparing to the standard angle input image data, the wider angle input image data has the same resolution at its outer edge, and has higher image resolution at its inner part as it moves to its center. Accordingly, the wide-angle zoom output image can be realized at the same resolution to the standard angle image through the image processing of reducing the image data of its inner part.
Although, comparing to the basic standard angle image, the resolution of the corrected wide angle output image may increase or decrease slightly in local depending upon the local variation of the degree of compression, the increase of the input image area of the image sensor can be restrained by the electronic zoom input system of this invention.
As the compressing optical system is that of a fixed focal length, the compressed zoom input image is the fixed image, including its containing distortion. So, it is possible to obtain the correct output image, by the accurate converting and correcting process of the compressed image.
Even if there is some deviation in the degree of compression of the compressing optical lens of this invention, its influence is limited to the slight change of the image resolution. Because, the output image itself is obtained as a corrected one by the reverse conversion of the fixed image compression mode. And its distortion does not relate directly to the image compression mode itself.
Furthermore, aspherical lenses like this compression lens can be easily realized by materials such as plastic lenses, nowadays.
In
Conventionally, Cinema Scope has been well known in movie that compresses and enlarges the image of the screen in horizontal direction. The image at Cinema Scope is simply compressed and enlarged in proportional to horizontal direction to obtain the enlarged screen. Consequently, it is entirely different system in purpose and in principle from the electronic zoom image input method of this invention that realizes the zoom function through the data processing with non-linear image compression.
This optical system compresses largely at the outer side of the input image in concentric circle. As the result, the object view 4A is compressed through this compressing optical system to the barrel shaped compressed input image 4B. Just like the case of
As this compressed zoom input image is also the fixed electronic data through the fixed compression optical system, the accurate image processing of correcting or converting the compressed zoom input image to the corrected output zoom image can be easily done. Through the image processing the output zoom image 4C is obtained. Where the output image of standard angle view 4CS, the intermediate angle view 4CM, and the wide angle view 4CW corresponds to the input image of object view 4AS, 4AM, and 4AW respectively. And these output images preserve the same image resolution to the standard view image 4CS.
By preparing a compressing optical system that compresses the swelled part of the image 4B further more, a compressed zoom input image that has a rectangular shaped outline can be realized. Namely, by the image compression that compresses further at the neighboring area of the vertical and horizontal center axes 5XV and 5XH of 5A, the object scene 5A is compressed to the compressed zoom input image 5B that has the smaller area than 4B and the rectangle shaped outline.
And the standard angle view 5AS, the intermediate angle view 5AM, and the wide angle view 5AW of 5A is compressed to the compressed zoom input image 5BS,5BM, and 5BW of 5B respectively.
Furthermore, the output zoom image 5C is obtained through the image processing where the input image of object scene 5AS,5AM, and 5AW are reproduced as the corrected output zoom image 5CS,5CM, and 5CW respectively. The electronic zoom image input method of
It is also same to that of
The image of the object view 6A is taken in through the compressing optical system 6L as the compressed zoom input image 6B at the input image plane of the image sensor 61. The image data of the input image 6B is changed to the digital image signal by the image signal control unit 62.
This digital signal can be reproduced to the original object view image of any angle, through the image processing of the conversion from the compressed zoom input image at the conversion unit 63. These zoom images are taken out from the output unit 65 as the output image 66 or the output signal.
The output image data that is processed to a fixed angle of zoom image is stored at the memory unit 64. But the compressed zoom input image data of the input image plane can also be stored at the memory unit 64 directly. If the image data is stored as the compressed image data, it become possible to take out any angle of zoom output image from the compressed image data with the same image resolution by processing the stored image data at the memory unit 64.
At first, the image compressing method of this invention is explained by a simple example of the compressed input image 1B of
The compressed zoom input image 1B in
To simplify the explanation,
Also, the 3-times wide input image area that is enclosed by the wide line S3 is shown between S2 and S4 in
For example, when the zoom input image is expanded from 3-times wide angle image to 4-times wide angle image, the area that is newly expanded at the compressed zoom input image is that surrounded by S4 and S3. It includes the area on diagonal line S44, areas arranged to the horizontal direction S43,S42,S41, and areas arranged to the vertical direction S34,S24,S14.
The area of S43,S42,and S41 is 4/3 times. 2-times, and 4 times larger comparing to S44 respectively, as it approaches to the vertical center axis 7XV. As the image sensor is composed of uniform density pixels, the size of the image area is proportional to that of the image data. And these image area have more image data in proportional to their area. The image area described above is arranged S44,S43, S42,S41 in horizontal direction as is shown in
However, the required image data for these image areas that are necessary to realize the 4-times wide angle zoom output image are just same to that of standard angle S44. And it is shown for the each image areas of S43,S42,S41, as the area of oblique line that is equivalent to the area of S44. This indicates that to maintain the same output image resolution, the area of these image area can be reduced to that of S44. Accordingly, the area of S43,S42,S41 can be reduced to ¾, ½, ¼ respectively.
The image area S34,S24,S14 that are arranged in vertical direction to the horizontal center axis 7XH, can be also reduced by the same way as described above for horizontal direction.
By the same way as described above about the image areas of S4 for 4-times wide angle zoom input image, it is possible to reduce the size of image areas of S3 for the 3-times wide angle zoom input image, and also that of S2 for 2-times wide angle zoom input image respectively.
In
To simplify the explanation of this zoom function, it has been explained for the case that the zoom power changes in step in integer such as 2,3,4-times. But, the actual zooming function is done continuously. And the compression of the zoom image is also changed continuously. As the compressed input image of a zoom-power always contains the lower-power zoom image part in its inner area, the area of the compressed image actually increases slightly than that described above.
By taking the continuous change of the zooming power in calculation, the increase of the area of the zoom input image plane for the zoom-power N becomes to the natural logarithm N (InN) in length. And the area increases slightly comparing to the case explained above that estimated the zoom-power changes in step.
These factors to increase the area is shown by the dotted line, and the increased area is also shown by the oblique lattice line in
As the result, the minimum data area to realize the electronic zooming with constant resolution is shown in
The compressed zoom input image that is composed by these compression is finally shown
The compressed zoom image of
As is explained in
The optical system 8LV is shown in
The compressing optical system of
If the function of the vertical and horizontal cylindrical convex lens is added to 8LV and 8LH respectively, the output image from the optical system 8B can be compressed to be adjusted to the size of image sensor, by compressing the image to the vertical and horizontal direction freely through the cylindrical lens.
These optical functions or lenses that compose the optical system can be combined to a composite lens as a plastic lens.
It became possible to realize the simple zoom image by the electronic zoom image input method of this invention without degrading the zoom image resolution it does not use the conventional zoom lens, and provides the simple fixed focus length lens.
This zooming method of the invention made it possible to use the simple fixed focal length lens and conventional small size image sensor with uniform pixel. And the remarkably small size and low cost zoom image input system that could not realized hitherto, is materialized by this invention.
Furthermore, it became possible to realize the extremely small and low cost 3D-camera by combining two electronic zoom image input system of this invention electronically, that had been very expensive, large, and complicated one conventionally combining two optical zoom lenses. This invention made the conventional optical 3D-zoom lens system absolutely unnecessary that needed two optical zoom lenses combined mechanically.
This electronic zoom image input system of the invention materialized the strong features of small size, low cost, and the 3D-zoom function to the market.
In the remarkably progressing multi-media era, zoom imaging system such as the zoom camera has been strongly required to be more small sized, low cost, and versatile. This invention realized just to solves these issues that could not fulfilled hitherto. Accordingly, this invention accomplish the great contribution to the progress of the coming multi-media era.
Shimizu, Eriko, Shimizu, Kyozo
Patent | Priority | Assignee | Title |
10101636, | Dec 31 2012 | DigitalOptics Corporation | Auto-focus camera module with MEMS capacitance estimator |
10586307, | Jan 28 2010 | Pathway Innovations and Technologies, Inc | Capturing real-time video with zooming capability and scanning high resolution still images of documents using the same apparatus |
11055817, | Jan 28 2010 | Pathway Innovations and Technologies, Inc. | Capturing real-time video with zooming capability and scanning high resolution still images of documents using the same apparatus |
8508751, | Jan 28 2010 | Pathway Innovations and Technologies, Inc | Capturing real-time video with zooming capability and scanning high resolution still images of documents using the same apparatus |
9001268, | Aug 10 2012 | NAN CHANG O-FILM OPTOELECTRONICS TECHNOLOGY LTD | Auto-focus camera module with flexible printed circuit extension |
9007520, | Aug 10 2012 | NANCHANG O-FILM OPTOELECTRONICS TECHNOLOGY LTD | Camera module with EMI shield |
9525807, | Dec 01 2010 | NAN CHANG O-FILM OPTOELECTRONICS TECHNOLOGY LTD | Three-pole tilt control system for camera module |
9817206, | Mar 10 2012 | DigitalOptics Corporation | MEMS auto focus miniature camera module with fixed and movable lens groups |
9888181, | Feb 28 2014 | Sharp Kabushiki Kaisha | Camera module and image capturing apparatus with shake correction of image capturing lens or image sensor |
Patent | Priority | Assignee | Title |
4527201, | Mar 29 1983 | PANAVISION INTERNATIONAL, L P | Zoom indicating apparatus for video camera or the like |
4554585, | Aug 12 1983 | RCA Corporation | Spatial prefilter for variable-resolution sampled imaging systems |
4897722, | Apr 07 1988 | GENERAL ELECTRIC COMPANY, A CORP OF NY | Widescreen television transmission system utilizing conventional equipment including a camera and VCR |
4962429, | Jan 19 1988 | U S PHILIPS CORPORATION, A CORP OF DE | Television camera having an increased resolution in a portion of the field of view |
5124840, | Jun 08 1989 | Portable viewing apparatus | |
5175616, | Aug 04 1989 | HER MAJESTY THE QUEEN, AS REPRESENTED BY THE MINISTER OF NATIONAL DEFENSE OF HER MAJESTY S CANADIAN GOVERNMENT | Stereoscopic video-graphic coordinate specification system |
5309241, | Jan 24 1992 | Bae Systems Information and Electronic Systems Integration INC | System and method for using an anamorphic fiber optic taper to extend the application of solid-state image sensors |
5432404, | Dec 10 1993 | HITACHI CONSUMER ELECTRONICS CO , LTD | Apparatus for detecting a geometric distortion of an image on a display device |
5537149, | Apr 22 1992 | JVC Kenwood Corporation | Display device |
5668666, | Jan 05 1995 | Nikon Corporation | Zoom lens with an anamorphic converter |
5673086, | Oct 05 1990 | Canon Kabushiki Kaisha | Image aspect ratio conversion processing apparatus |
5696560, | Jul 25 1994 | Magma, Inc. | Motion picture distribution system |
5905530, | Aug 24 1992 | Canon Kabushiki Kaisha | Image pickup apparatus |
5909312, | Oct 02 1996 | AVAGO TECHNOLOGIES GENERAL IP SINGAPORE PTE LTD | Phase-only filter for generating an arbitrary illumination pattern |
5956091, | Aug 07 1992 | British Broadcasting Corporation | Method of showing 16:9 pictures on 4:3 displays |
5959669, | Dec 31 1993 | Canon Kabushiki Kaisha | Image pickup apparatus having standard-resolution and high-resolution photographing modes |
JP4011467, | |||
JP5176212, | |||
JP7015660, | |||
JP7067025, | |||
JP8234275, | |||
JP8307753, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Dec 15 1997 | DigitalOptics Corporation Europe Limited | (assignment on the face of the patent) | / | |||
Sep 10 2010 | Tessera Technologies Hungary Kft | Tessera Technologies Ireland Limited | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 025391 | /0011 | |
Jul 13 2011 | Tessera Technologies Ireland Limited | DigitalOptics Corporation Europe Limited | CHANGE OF NAME SEE DOCUMENT FOR DETAILS | 027294 | /0253 |
Date | Maintenance Fee Events |
Nov 12 2012 | REM: Maintenance Fee Reminder Mailed. |
Mar 18 2013 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
Mar 18 2013 | M1555: 7.5 yr surcharge - late pmt w/in 6 mo, Large Entity. |
Sep 29 2016 | M1553: Payment of Maintenance Fee, 12th Year, Large Entity. |
Date | Maintenance Schedule |
Nov 08 2014 | 4 years fee payment window open |
May 08 2015 | 6 months grace period start (w surcharge) |
Nov 08 2015 | patent expiry (for year 4) |
Nov 08 2017 | 2 years to revive unintentionally abandoned end. (for year 4) |
Nov 08 2018 | 8 years fee payment window open |
May 08 2019 | 6 months grace period start (w surcharge) |
Nov 08 2019 | patent expiry (for year 8) |
Nov 08 2021 | 2 years to revive unintentionally abandoned end. (for year 8) |
Nov 08 2022 | 12 years fee payment window open |
May 08 2023 | 6 months grace period start (w surcharge) |
Nov 08 2023 | patent expiry (for year 12) |
Nov 08 2025 | 2 years to revive unintentionally abandoned end. (for year 12) |