Provided is a ranging apparatus or the like capable of high-accuracy ranging. The image sensor, comprising multiple pixels, wherein the pixels comprises a ranging pixel including a light collecting member, a waveguide, and first and second photoelectric conversion units, wherein: the first and second units are arranged along a first direction; when a region decentered from a center of pupil in a second direction opposite to the first direction is a first pupil region, a region decentered in the first direction is a second pupil region, a region located in the second direction is a first region, and a region located in the first direction is a second region, the collecting member collects lights passed through the first and second pupil regions to the second and first regions; and the waveguide guides lights collected in the second and first regions toward the first and second units.
|
1. An image sensor, comprising multiple pixels, the multiple pixels including at least one pixel in which a light collecting member, a waveguide including a core and a clad, a first photoelectric conversion unit, and a second photoelectric conversion unit are disposed, wherein
the first photoelectric conversion unit and the second photoelectric conversion unit are arranged in order along a first direction in the one pixel,
a region decentered from a center of a pupil of an imaging optical system in a direction opposite to the first direction is referred to as a first pupil region, a region decentered in the first direction is referred to as a second pupil region, a region located inside the waveguide and located in the direction opposite to the first direction with respect to a center axis of the core is referred to as a first region, and a region located inside the waveguide and located in the first direction with respect to the center axis of the core is referred to as a second region,
the light collecting member is configured to collect a light flux that has passed through the first pupil region and a light flux that has passed through the second pupil region to the second region and to the first region, respectively, and
the waveguide is configured to guide light collected in the second region and light collected in the first region toward the first photoelectric conversion unit and toward the second photoelectric conversion unit disposed in the one pixel, in which the waveguide is mounted, respectively.
3. The image sensor according to
4. The image sensor according to
a tapered waveguide having a taper shape in which an aperture size reduces from an imaging optical system side toward a waveguide side.
5. The image sensor according to
6. The image sensor according to
P0P2/(P0−P2)≦L≦2P0P2/(P0−P2) where P0 and P2 represent a period in a 0th-order mode and a period in a 2nd-order mode, respectively, of the waveguide with respect to a wavelength of light to be detected by the first photoelectric conversion unit and the second photoelectric conversion unit.
7. The image sensor according to
where λ represents a wavelength of light to be detected by the first photoelectric conversion unit and the second photoelectric conversion unit, W represents a width of the core in a plane in which the multiple pixels are arranged, and n0 represents a refractive index of the core.
8. The image sensor according to
9. The image sensor according to
the multiple first pixels are arranged so as to interpose three or less of the multiple second pixels therebetween.
10. The image sensor according to
12. An imaging apparatus, comprising:
the image sensor according to
an imaging optical system for forming an image of a ranging target on the image sensor.
|
1. Field of the Invention
The present invention relates to an image sensor, and a ranging apparatus and an imaging apparatus including the same.
2. Description of the Related Art
In a digital still camera or a video camera, technologies for detecting distances for automatic focusing (AF) are known. With regard to such technologies for detecting distances for AF, Japanese Patent Application Laid-Open No. 2009-158800 proposes a ranging apparatus in which a part of pixels of an image sensor have a ranging function and the detection is made by a phase difference system. The phase difference system is a method of comparing images of light fluxes that have passed through different regions on a pupil of an imaging optical system, and employing triangulation using stereo images to detect a distance. With this method, unlike the case of a related-art contrast system, it is not necessary to move a lens to measure the distance, and thus high-speed and high-accuracy AF is possible. Further, real-time AF is possible when moving images are taken.
As a configuration example of a ranging pixel, a configuration illustrated in
However, in
The present invention has been made in view of the above-mentioned problems, and has an object to provide a ranging apparatus or the like that is capable of ranging in high accuracy.
According to one embodiment of the present invention, there is provided an image sensor, including multiple pixels, in which at least one of the multiple pixels includes a ranging pixel having a light collecting member, a waveguide having a core and a clad, a first photoelectric conversion unit, and a second photoelectric conversion unit, in which the first photoelectric conversion unit and the second photoelectric conversion unit are arranged in the stated order along a first direction, in which, when a region decentered from a center of a pupil of an imaging optical system in a direction opposite to the first direction is a first pupil region, a region decentered in the same direction as the first direction is a second pupil region, a region located inside the waveguide and located in the direction opposite to the first direction with respect to a center axis of the core is a first region, and a region located inside the waveguide and located in the same direction as the first direction with respect to the center axis of the core is a second region, the light collecting member is configured to collect a light flux that has passed through the first pupil region and a light flux that has passed through the second pupil region to the second region and to the first region, respectively, and in which the waveguide is configured to guide light collected in the second region and light collected in the first region toward the first photoelectric conversion unit and toward the second photoelectric conversion unit, respectively.
Further, according to one embodiment of the present invention, there is provided a ranging apparatus, including the above-described image sensor.
Further, according to one embodiment of the present invention, there is provided an imaging apparatus, including: the above-described image sensor; and an imaging optical system for forming an image of a ranging target on the image sensor.
According to one embodiment of the present invention, the ranging apparatus that is capable of ranging in high accuracy can be achieved.
Further features of the present invention will become apparent from the following description of exemplary embodiments with reference to the attached drawings.
The present invention provides the following configuration in a structure in which first and second photoelectric conversion units of a ranging pixel are arranged in the stated order along a first direction. A light collecting member collects a light flux that has passed through a pupil region that is decentered in a direction opposite to the first direction to a region located in the same direction as the first direction with respect to a center axis of a core of a waveguide, and the waveguide guides the light in this region toward the first photoelectric conversion unit. On the other hand, the light collecting member collects a light flux that has passed through a pupil region that is decentered in the first direction to a region located in the direction opposite to the first direction with respect to the center axis of the core of the waveguide, and the waveguide guides the light in this region toward the second photoelectric conversion unit. With such a configuration, an adverse effect to high-accuracy ranging to be caused by crosstalk light can be suppressed.
A ranging apparatus according to an embodiment of the present invention is described with reference to the drawings. The ranging apparatus may be applied to, for example, imaging apparatus such as a digital still camera, a digital video camera, and a live view camera, and a digital distance measuring device. Further, in the following, description is made with reference to the drawings. In principle, components having like functions are denoted by like reference symbols throughout the drawings, and repetitive description thereof is omitted as much as possible.
As a first embodiment of the present invention, a configuration example of a ranging apparatus is described with reference to
A pixel for acquiring information necessary for ranging is called a ranging pixel. The image sensor 102 includes multiple pixels, and a ranging pixel 103 is arranged in at least part of the multiple pixels. The image sensor 102 includes multiple ranging pixels 103 arranged in an x direction. In
The substrate 114 is made of a material that performs absorption in the wavelength band to be detected, which is for example Si. The substrate 114 is subjected to ion implantation or the like to form the photoelectric conversion units 104 and 105 in at least partial regions inside the substrate 114. The photoelectric conversion units 104 and 105 are provided in order along a +x direction corresponding to a first direction (x direction is orthogonal to z direction). The ranging pixel 103 is configured to acquire light fluxes 121L and 121R from pupil regions 120L and 120R, which are decentered in directions opposite to each other along the x direction with respect to a center of a pupil 120 of the imaging optical system 101, by the different photoelectric conversion units 104 and 105. The ranging pixel 103 includes wiring (not shown).
Ranging Principle
As illustrated in
The microlens 110 collects light in the regions 122R and 122L of the waveguide. Thus, the light can be converted into a waveguide mode having a decentered electric field distribution to propagate through the waveguide. By appropriately setting the length of the waveguide 111 in the z direction and the position of each of the photoelectric conversion units, light collected in the light collect regions 122R and 122L can be guided to the photoelectric conversion units 104 and 105 located on sides opposite to the light collect regions 122R and 122L along the x direction, respectively. The light fluxes that have reached the photoelectric conversion units 104 and 105 are converted into electrons to output to the signal processing unit (not shown). The images of light fluxes that have passed through different pupil regions are detected by the multiple photoelectric conversion units 104 and 105, and signals for subject ranging are output by a known method to detect the subject distance. In this manner, high-accuracy ranging is possible. By using the characteristic that the waveguide modes inside the waveguide differ, even when the pixel is particularly small, the light fluxes that have passed through different pupil regions can be guided to different photoelectric conversion units, to thereby enable high-accuracy ranging. The ranging is performed as follows, for example. A relative misalignment amount between a subject image signal 1 and a subject image signal 2 corresponding to signals detected by the respective photoelectric conversion units 104 and 105 of each of the multiple ranging pixels 103 becomes an image displacement amount. The image displacement amount can be calculated by a known method, and the image displacement amount can be converted into a defocus amount through a known mathematical expression. Further, based on the focal distance of the imaging optical system 101, the focusing position on the subject side, which is optically conjugate with the image sensor 102, can be calculated. Further, based on the magnification relationship of the imaging optical system 101, the defocus amount on the image side can be converted into the defocus amount on the subject side. The sum of the defocus amount on the subject side and the distance from the imaging optical system 101 to the focusing position on the subject side are calculated to calculate the distance to the subject. As described above, by calculating the defocus amount, the distance to the subject can be calculated.
Reason why Pupil Division Performance Improves
The reason why high-accuracy ranging is possible by the ranging pixel 103 even when the crosstalk light varies depending on the ranging condition is described. In
As described above, in the ranging apparatus of the present invention, at least a part of the pixels of the image sensor is the ranging pixel 103 including the light collecting member 110, the waveguide 111, and the multiple photoelectric conversion units 104 and 105. The first photoelectric conversion unit 104 and the second photoelectric conversion unit 105 are arranged in order in the first direction (+x direction). In this case, a pupil region decentered from the center of the pupil in a direction opposite to the first direction is referred to as the first pupil region 120L, and a region decentered in the same direction as the first direction is referred to as the second pupil region 120R. Further, a region in the waveguide core 112 located in the direction opposite to the first direction with respect to the center axis 115 is referred to as the first region 122L, and a region therein located in the same direction as the first direction with respect thereto is referred to as the second region 122R. The light collecting member 110 is configured to collect the light flux from the first pupil region 120L to the second region 122R, and collect the light flux from the second pupil region 120R to the first region 122L. The waveguide 111 is configured to guide the light in the second region 122R toward the first photoelectric conversion unit 104, and guide the light in the first region 122L toward the second photoelectric conversion unit 105. With such a configuration, even when the ranging condition changes and the crosstalk light varies, the influence on the pupil division performance can be reduced, and high-accuracy ranging is possible.
Light Collecting Position of Light Collecting Member
It is preferred that the ranging pixel of the present invention be configured so that the light collecting member (microlens 110 or the like) collects light to a position separated from a light exit end 127 of the waveguide on a light incident end 126 side as much as possible. It is desired that the light collecting position of the light collecting member be located on the incident end 126 side with respect to a position at the half of the length of the waveguide 111, and more desired that the light collecting position of the light collecting member be located at the position of the incident end 126 of the waveguide. By providing the light collecting position at a position separated from the exit end 127 as much as possible, the length of the waveguide 111 in the propagation direction (z direction) can be reduced, and the image sensor can be more easily formed.
Length of Waveguide
As illustrated in
P=P0P2/(P0−P2) (Expression 1)
A period Pm of each mode light can be calculated with use of a general characteristic equation in the waveguide analysis based on the refractive index and shape of a medium constituting the waveguide 111 and the wavelength of light to be waveguided. In the ranging pixel of the present invention, it is desired that the light collecting member (microlens 110 or the like) be configured so that its light collecting position becomes the position at the incident end 126 of the waveguide 111, and the length L of the waveguide 111 in the propagation direction (z direction) is in a range of the following Expression 2. L also refers to a length of the waveguide in a direction perpendicular to a direction in which the multiple pixels are arranged.
P0P2/(P0−P2)≦L≦2P0P2/(P0−P2) (Expression 2)
This reason is described. Light collected by the light collecting member is converted into waveguide mode light whose electric field strongly concentrates in the region in which light is collected at the incident end 126. As the waveguide mode light propagates, the waveguide mode light changes its light collect region in which the electric field strongly concentrates with the period represented by Expression 1 described above. When the length L of the waveguide 111 is set within the range represented by Expression 2 described above, the electric field concentrated in the light collect region at the incident end 126 is propagated inside the waveguide to a region located opposite to the light collect region in the first direction at the light exit end 127 corresponding to the waveguide lower end, and the light can be guided to a region therebelow where the photoelectric conversion unit 104 or 105 is present. With such a configuration, the incident light fluxes from different pupil regions (different directions) can be selectively guided to different photoelectric conversion units.
When the waveguide 111 is approximated to a planar waveguide, by solving a characteristic equation of the following Expression 3, a standardized effective refractive index bm of each mode can be obtained, and the period Pm can be calculated based on the following Expression 4. Note that, λ represents a wavelength of incident light (detection light), W represents a width of the core 112 in the x direction, n0 and n1 represent a refractive index of the core 112 and a refractive index of the clad 113, respectively, and m represents an order of the mode.
In a condition in which the detection light is in a visible wavelength band and 0th-order to 2nd-order waveguide modes are relatively dominant due to a configuration defined by the width W and the refractive index n0 of the waveguide core 112 in a plane in which the pixels are arranged, the following settings are preferred. That is, the length L of the waveguide 111 in the propagation direction (z direction) is desired to be in a range of the following Expression 5 based on Expression 2 to Expression 4. When such a range is taken, in a visible wavelength band, the incident light fluxes from different pupil regions (different directions) can be selectively guided to different photoelectric conversion units.
For example, when the wavelength of the detection light is 550 nm, the refractive indexes of the media constituting the core 112 and the clad 113 of the waveguide 111 are 1.8 and 1.5, respectively, and the width of the core 112 is 800 nm, the periods in the 0th-order and 2nd-order modes are 309 nm and 343 nm, respectively. When the length L of the waveguide 111 is set within the range of 3.9 μm to 5.3 μm in accordance with Expression 5, the incident light fluxes from different pupil regions (different directions) can be selectively guided to different photoelectric conversion units.
Scattering Member
In the ranging apparatus of the present invention, as illustrated in
When the width of the scattering member 140 is too small with respect to the wavelength of light to be detected, the waveguide mode cannot be affected, and when the width thereof is too large, part of light is reflected or scattered to cause light loss. It is desired that the width of the scattering member 140 be about 0.1 time to 2 times for the wavelength of the light to be detected. The width of the region of the core 112 beside the scattering member 140 is desired to have a size that constitutes a multi-mode waveguide in which multiple intrinsic modes are present with respect to the light to be detected by the photoelectric conversion unit. By configuring this region to have many high-order intrinsic modes, the waveguide mode is more easily propagated, and light can be efficiently guided.
Light Collecting Member: Tapered Waveguide
In the ranging pixel in the ranging apparatus of the present invention, the light collecting member may be a member other than a microlens. As illustrated in
Color Filter
A color filter may be provided to each pixel. For example, in the configuration of
Arrangement of Ranging Pixels
In the configuration of this embodiment, when the ranging pixels 103 are arranged in all of the pixels of the image sensor 102 as illustrated in
Alternatively, the ranging pixels 103 may be discretely arranged and an imaging pixel 160 may be arranged therebetween as illustrated in
Alternatively, as illustrated in
A wiring member for transmitting an electric signal acquired by the photoelectric conversion unit may be provided to the clad part of the waveguide of each pixel. This provides an effect of blocking part of crosstalk light that propagates through the clad of the waveguide, and thus the influence of the crosstalk light can be reduced.
Further, the light collecting member 110 may be provided to the rear surface side (−z side) of the substrate 114, to thereby obtain a rear surface irradiation type configuration in which the waveguide 111 is formed in the substrate 114. With such a configuration, light that has entered the substrate from the rear side (light propagating in the +z direction) is detected. Wiring and the like can be arranged on the front side of the substrate 114 so as to avoid blocking of the propagation of incident light due to the wiring and the like. Further, spatial limitation due to the wiring and the like is alleviated, and hence the waveguide 111 can be more freely shaped. In this manner, incident light can be efficiently guided to the photoelectric conversion unit.
Imaging System
As illustrated in
Now, an operation example of the imaging apparatus 170 such as a digital camera is described. Note that, the following is only an example. The operation flow after the main power of the imaging apparatus 170 is turned on and a shutter button (not shown) is pressed halfway to be in a so-called half-push state is described. First, information (focal distance, diaphragm value, and the like) of the imaging optical system 101 is read out and stored in the recording device 174. Next, the focus is adjusted. That is, based on the subject image signal output from the image sensor 102, the defocus amount is calculated with use of the ranging procedure. Then, based on the calculated defocus amount, whether or not the imaging optical system 101 is in the focusing state is determined. When the imaging optical system 101 is out of focus, the imaging optical system 101 is driven to a focusing position based on the defocus amount, and then the process returns to the first step. When it is determined that the imaging optical system 101 is in focus, it is determined whether or not a shutter is released (that is, the shutter button is pressed all the way down) by the operation of the shutter button. When it is determined that the shutter is not released, the process returns to the first step and the above-mentioned processing is repeated. When it is determined that the shutter is released, the subject image signal is read out from the image sensor 102 and stored in the recording device 174. The stored subject image signal is subjected to development processing, and thus an observation image can be formed. Further, by applying the ranging procedure to the stored subject image signal, a subject distance image (subject distance distribution) that corresponds to the observation image can be formed.
As described above, the light collecting member, the waveguide, and the multiple photoelectric conversion units are provided in the pixel, and the shape, medium, and arrangement of the light collecting member and the waveguide are appropriately set. In this manner, light can be separated in accordance with an incident angle. Even when the crosstalk light varies depending on the ranging condition, a high-accuracy ranging signal can be acquired, and hence the ranging apparatus that can measure a distance with high accuracy can be achieved.
Considering application of the present invention to a digital camera or the like, the present invention may be regarded as a ranging apparatus that is used for a single-lens reflex camera or the like to perform dedicatedly the ranging separately from an imaging part for taking a subject image, or may be regarded as an apparatus suitable for so-called imaging surface ranging that also performs the ranging with use of the imaging part. As described above, with use of the distance detected by the present invention, a distance distribution (distance map) that corresponds to an image obtained by the imaging apparatus can be formed. Further, the amount of blur of the subject in the image depends on the defocus amount, and hence by performing processing based on the distance distribution with respect to the obtained image, image processing such as arbitrary blur adding processing, refocus processing (processing of focusing at an arbitrary position) after imaging and the like can be appropriately performed.
While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.
This application claims the benefit of Japanese Patent Application No. 2013-094813, filed Apr. 27, 2013, which is hereby incorporated by reference herein in its entirety.
Patent | Priority | Assignee | Title |
10204943, | Aug 10 2016 | Canon Kabushiki Kaisha | Image sensor, method of manufacturing the same, and camera with pixel including light waveguide and insulation film |
Patent | Priority | Assignee | Title |
7522801, | Apr 14 2006 | FUJIFILM Corporation | Semiconductor device and semiconductor device manufacturing method |
20100245656, | |||
20120133809, | |||
20130277541, | |||
20140071319, | |||
JP2009158800, | |||
RE44637, | Jun 10 2004 | Round Rock Research, LLC | Method of fabricating an imaging device for collecting photons |
WO2012099262, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Apr 07 2014 | IKEMOTO, KIYOKATSU | Canon Kabushiki Kaisha | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 033470 | /0461 | |
Apr 10 2014 | Canon Kabushiki Kaisha | (assignment on the face of the patent) | / |
Date | Maintenance Fee Events |
Aug 12 2019 | REM: Maintenance Fee Reminder Mailed. |
Jan 27 2020 | EXP: Patent Expired for Failure to Pay Maintenance Fees. |
Date | Maintenance Schedule |
Dec 22 2018 | 4 years fee payment window open |
Jun 22 2019 | 6 months grace period start (w surcharge) |
Dec 22 2019 | patent expiry (for year 4) |
Dec 22 2021 | 2 years to revive unintentionally abandoned end. (for year 4) |
Dec 22 2022 | 8 years fee payment window open |
Jun 22 2023 | 6 months grace period start (w surcharge) |
Dec 22 2023 | patent expiry (for year 8) |
Dec 22 2025 | 2 years to revive unintentionally abandoned end. (for year 8) |
Dec 22 2026 | 12 years fee payment window open |
Jun 22 2027 | 6 months grace period start (w surcharge) |
Dec 22 2027 | patent expiry (for year 12) |
Dec 22 2029 | 2 years to revive unintentionally abandoned end. (for year 12) |