Techniques are described for digital conversion of pixel signals in a CMOS image sensor (cis). The cis includes column-parallel analog-to-digital converters (ADCs), each having a programmable gain amplifier (pga) supporting n gain settings. Each ADC can execute, for each gain setting (Gn) of the n gain settings, a respective reset phase conversion to obtain a respective baseline offset (BOn) associated with the Gn. A pre-decision value can be determined as a function of a pixel signal, the pre-decision value corresponding to a selected one of the gain settings (Gs). The pixel signal can be converted by using the pre-decision value to set a gain of the pga to the Gs and obtaining a signal offset (SO). A digital pixel output can be computed for the pixel signal as a function of the SO and the BOs, wherein the BOs is the BOn corresponding to the Gs.
|
13. A method for generating digital pixel-wise outputs from a CMOS image sensor (cis) the method comprising:
receiving a pixel signal at a programmable gain amplifier (pga) coupled with a pixel output of the cis, the pixel output being one of a plurality of pixel outputs of the cis, each coupled with an associated one of a plurality of pgas, each pga having n gain settings, n being an integer greater than 1;
executing, for each gain setting (Gn) of the n gain settings, a respective reset phase conversion to obtain a respective baseline offset (BOn) associated with the Gn;
determining a pre-decision value as a function of a pixel signal, the pre-decision value corresponding to a selected one of the gain settings (Gs);
converting the pixel signal by using the pre-decision value to set a gain of the pga to the Gs and obtaining a signal offset (SO); and
computing a digital pixel output for the pixel signal as a function of the SO and the BOs, wherein the BOs is the BOn corresponding to the Gs.
1. A programmable-gain analog-to-digital converter system for use with a CMOS image sensor (cis), the system comprising:
a programmable gain amplifier (pga) configured to receive a pixel signal from a pixel output of a CMOS image sensor (cis), the pixel output being one of a plurality of pixel outputs of the cis, each coupled with an associated one of a plurality of pgas, each pga having n gain settings, n being an integer greater than 1; and
a processor coupled with the pga, and configured to:
execute, for each gain setting (Gn) of the n gain settings, a respective reset phase conversion to obtain a respective baseline offset (BOn) associated with the Gn;
determine a pre-decision value as a function of a pixel signal, the pre-decision value corresponding to a selected one of the gain settings (Gs);
convert the pixel signal by using the pre-decision value to set a gain of the pga to the Gs and obtaining a signal offset (SO); and
compute a digital pixel output for the pixel signal as a function of the SO and the BOs, wherein the BOs is the BOn corresponding to the Gs.
12. A CMOS image sensor (cis) comprising:
an array of pixels, each comprising a photodetector circuit configured to record a pixel signal level responsive to being exposed to an amount of light during an exposure window, the array having a plurality of pixel rows and a plurality of pixel columns;
a plurality of column-parallel analog-to-digital converters (ADCs), each ADC coupled with a respective one of the plurality of pixel columns, each ADC comprising:
a programmable gain amplifier (pga) configured to receive a pixel signal from a pixel output of a CMOS image sensor (cis), the pixel output being one of a plurality of pixel outputs of the cis, each coupled with an associated one of a plurality of pgas, each pga having n gain settings, n being an integer greater than 1; and
a processor coupled with the pga, and configured to:
execute, for each gain setting (Gn) of the n gain settings, a respective reset phase conversion to obtain a respective baseline offset (BOn) associated with the Gn;
determine a pre-decision value as a function of a pixel signal, the pre-decision value corresponding to a selected one of the gain settings (Gs);
convert the pixel signal by using the pre-decision value to set a gain of the pga to the Gs and obtaining a signal offset (SO); and
compute a digital pixel output for the pixel signal as a function of the SO and the BOs, wherein the BOs is the BOn corresponding to the Gs.
2. The system of
3. The system of
4. The system of
the pga comprises an operational amplifier having an input node to receive the pixel signal via an input capacitor network, and an output node coupled by a feedback path with the input node via a feedback capacitor network having a plurality of feedback capacitors;
the gain of the pga is determined according to a capacitance ratio between the input capacitor network and the feedback capacitor network; and
the processor is configured to set the gain of the pga by selectively switching some or all of the feedback capacitors into the feedback path to adjust total capacitance of the feedback capacitor network.
5. The system of
the feedback capacitor network comprises a first feedback capacitor coupled with the input node via a first switch and coupled with the output node via a second switch, the first switch and the second switch being always closed, such that the first feedback capacitor is always in the feedback path; and
the feedback capacitor network comprises a second feedback capacitor coupled with the input node via a third switch and coupled with the output node via a fourth switch, the third switch and the fourth switch operated in accordance with the gain setting, such that the third switch and the fourth switch are both closed according to the pga being in a first of the n gain settings, and the third switch and the fourth switch are both open according to the pga being in a second of the n gain settings.
6. The system of
a comparator having a first input comparator node coupled with a pga output signal that is generated by the pga, a second input comparator node coupled with a reference voltage, and an output comparator node to output a first comparator value when the pga output signal is higher than the reference voltage and to output a second comparator value when the reference voltage is higher than the pga output signal; and
a counter coupled with the comparator and configured to stop counting responsive to detecting a change from the first comparator value to the second comparator value, and to output a count value.
7. The system of
setting the gain of the pga according to the Gn, the pga generating the pga output signal responsive to the pixel signal being in an auto-zeroing (AZ) mode;
ramping up the reference voltage from a low reference level to an AZ threshold level, the low reference level being below a predetermined lowest level for the pga output signal, and the AZ threshold level being above the pga output signal; and
triggering the counter to begin counting along with a beginning of the ramping up, such that the count value upon stopping the counting indicates the BOn corresponding to the Gn.
8. The system of
a latch having a latch input coupled with the output comparator node and a latch output coupled with a pga gain control,
wherein the processor is configured to determine the pre-decision value by:
setting the gain of the pga according to a high-gain setting, the pga generating the pga output signal responsive to the pixel signal being in a transfer signal (TS) mode;
setting the reference voltage to a TS threshold level; and
triggering the latch, at a pre-decision enable time, to record a value at the output comparator node as the pre-decision value, such that the pre-decision value directs selection of one of the gain settings for the pga via the pga gain control.
9. The system of
10. The system of
setting the gain of the pga according to the Gs responsive to determining the pre-decision value, the pga generating the pga output signal responsive to the pixel signal being in a transfer signal (TS) mode;
ramping up the reference voltage from a low reference level to a high reference level, the low reference level being below a predetermined lowest level for the pga output signal, and the high reference level being above a predetermined highest level for the pga output signal; and
triggering the counter to begin counting along with a beginning of the ramping up, such that the count value upon stopping the counting indicates the SO.
11. The system of
across all the n gain settings, SO has a full-scale range of 0 to (2{circumflex over ( )}M)−1;
a first of the gain settings is associated with a first portion of the full-scale range extending from 0 to a first intermediate value of the full-scale range;
a second of the gain settings is associated with a second portion of the full-scale range extending from a second intermediate value of the full-scale range to 2{circumflex over ( )}M)−1, the second portion overlapping the first portion;
the counter has a base counter resolution of K bits, wherein K=M−X; and
converting the pixel signal comprises:
with Gs corresponding to the first of the gain settings, the counter is configured to represent values from 0 to 2{circumflex over ( )}K)−1, the first intermediate value being less than 2{circumflex over ( )}K)−1; and
with Gs corresponding to the second of the gain settings, the counter is configured to represent values from 2{circumflex over ( )}X to (2{circumflex over ( )}M)−1, the second intermediate value being greater than 2{circumflex over ( )}X.
14. The method of
15. The method of
16. The method of
the executing the respective reset phase conversion, the determining the pre-decision value, and the converting the pixel signal are performed using a comparator and a counter;
the comparator has a first input comparator node coupled with a pga output signal that is output by the pga, a second input comparator node coupled with a reference voltage, and an output comparator node to output a first comparator value when the pga output signal is higher than the reference voltage and to output a second comparator value when the reference voltage is higher than the pga output signal; and
the counter is configured to stop counting responsive to detecting a change from the first comparator value to the second comparator value, and to output a count value.
17. The method of
setting the gain of the pga according to the Gn, the pga generating the pga output signal responsive to the pixel signal being in an auto-zeroing (AZ) mode;
ramping up the reference voltage from a low reference level to an AZ threshold level, the low reference level being below a predetermined lowest level for the pga output signal, and the AZ threshold level being above the pga output signal; and
triggering the counter to begin counting along with a beginning of the ramping up, such that the count value upon stopping the counting indicates the BOn corresponding to the Gn.
18. The method of
setting the gain of the pga according to a high-gain setting, the pga generating the pga output signal responsive to the pixel signal being in a transfer signal (TS) mode;
setting the reference voltage to a TS threshold level; and
triggering a latch, at a pre-decision enable time, to record a value at the output comparator node as the pre-decision value.
19. The method of
setting the gain of the pga according to the Gs responsive to determining the pre-decision value, the pga generating the pga output signal responsive to the pixel signal being in a transfer signal (TS) mode;
ramping up the reference voltage from a low reference level to a high reference level, the low reference level being below a predetermined lowest level for the pga output signal, and the high reference level being above a predetermined highest level for the pga output signal; and
triggering the counter to begin counting along with a beginning of the ramping up, such that the count value upon stopping the counting indicates the SO.
20. The method of
across all the n gain settings, SO has a full-scale range of 0 to 2{circumflex over ( )}M)−1;
a first of the gain settings is associated with a first portion of the full-scale range extending from 0 to a first intermediate value of the full-scale range;
a second of the gain settings is associated with a second portion of the full-scale range extending from a second intermediate value of the full-scale range to 2{circumflex over ( )}M)−1, the second portion overlapping the first portion;
the counter has a base counter resolution of K bits, wherein K=M−X; and
converting the pixel signal comprises:
with Gs corresponding to the first of the gain settings, the counter is configured to represent values from 0 to 2{circumflex over ( )}K)−1, the first intermediate value being less than 2{circumflex over ( )}K)−1; and
with Gs corresponding to the second of the gain settings, the counter is configured to represent values from 2{circumflex over ( )}X to 2{circumflex over ( )}M)−1, the second intermediate value being greater than 2{circumflex over (X)}.
|
The invention relates generally to digital image sensors. More particularly, embodiments relate to pixel-wise gain-adjusted digital conversion using programmable gain amplifiers (PGAs) in complementary metal-oxide semiconductor (CMOS) digital image sensors.
Many electronic devices include cameras and other features that rely on digital image sensors. For example, most modern smartphones include one or more digital cameras that rely on digital image sensing hardware and software to capture and process images. Such applications often perform image sensing using a complementary metal-oxide semiconductor (CMOS) image sensor (CIS). Over time, consumers have desired increased performance from these image sensors, including higher resolution and lower noise. Further, particularly in portable electronic devices (e.g., with fixed battery capacity), it has been desirable to provide such features without adversely impacting power consumption and dynamic range. For example, analog power drives a significant, if not dominant, part of the power consumption of a modern CIS. As such, implementing a high-performance CIS in a portable electronic device can involve designing analog-to-digital converters (ADCs) and other components within strict power efficiency and noise constraints.
Embodiments provide pixel-wise, programmable gain, digital conversion of pixel signals in a CMOS image sensor (CIS). The CIS includes column-parallel analog-to-digital converters (ADCs), each having a programmable gain amplifier (PGA) supporting N gain settings. Each ADC can execute, for each gain setting (Gn) of the N gain settings, a respective reset phase conversion to obtain a respective baseline offset (BOn) associated with the Gn. A pre-decision value can be determined as a function of a pixel signal, the pre-decision value corresponding to a selected one of the gain settings (Gs). The pixel signal can be converted by using the pre-decision value to set a gain of the PGA to the Gs and obtaining a signal offset (SO). A digital pixel output can be computed for the pixel signal as a function of the SO and the BOs, wherein the BOs is the BOn corresponding to the Gs.
The accompanying drawings, referred to herein and constituting a part hereof, illustrate embodiments of the disclosure. The drawings together with the description serve to explain the principles of the invention.
In the appended figures, similar components and/or features can have the same reference label. Further, various components of the same type can be distinguished by following the reference label by a second label that distinguishes among the similar components. If only the first reference label is used in the specification, the description is applicable to any one of the similar components having the same first reference label irrespective of the second reference label.
In the following description, numerous specific details are provided for a thorough understanding of the present invention. However, it should be appreciated by those of skill in the art that the present invention may be realized without one or more of these details. In other examples, features and techniques known in the art will not be described for purposes of brevity.
Many electronic devices include cameras and other features that rely on digital image sensors. For example, most modern smartphones include one or more digital cameras that rely on digital image sensing hardware and software to capture and process images. Such applications often perform image sensing using a complementary metal-oxide semiconductor (CMOS) image sensor (CIS).
Over time, consumers have desired increased performance from these image sensors, including higher resolution (e.g., larger arrays with larger numbers of pixels 110) and lower noise. For example, some modern CISs include arrays with over 100 million pixels. Further, particularly in portable electronic devices (e.g., with fixed battery capacity), it has been desirable to provide such features without adversely impacting power consumption and dynamic range. For example, analog power drives a significant, if not dominant, part of the power consumption of a modern CIS, and consumers can be sensitive to features that reduce battery life. As such, implementing a high-performance CIS in a portable electronic device can involve designing analog-to-digital converters (ADCs) and other components within strict power efficiency and noise constraints. Some conventional implementations achieve desirable levels of power and noise, with desirable amounts of dynamic range, by using programmable gain amplifiers (PGAs) to adjust gain at a pixel level.
As described above, each row of pixels 110 is sequentially shifted to the column-parallel ADCs 125 for readout. Accordingly, after each sequential shifting, each ADC 125 is provided with a pixel signal 205 corresponding to the output from a particular pixel 110 after having been shifted down its column until reaching the column-parallel ADC 125. As illustrated, the pixel signal 205 is received at an input of the PGA 220. The PGA 220 includes an operational amplifier 210 having an input capacitor network 207 (shown as a single fixed capacitor, C1) at its input, and having a feedback capacitor network 209 (shown as a single variable capacitor, C2) coupled between its output and its input to form a feedback path. In such a configuration, the total gain of the amplifier corresponds to the ratio of C1 to C2 (C1/C2, or −C1/C2, depending on the implementation). Thus, a PGA output signal 215 seen at the output of the PGA 220 corresponds to the pixel signal 205 amplified by the PGA 220 in accordance with the gain applied by the PGA 220. The coupling from PGA output signal 215 to the comparator input is DC in the plot, but it can be either DC or AC, depending on an implementation.
As described herein, when each row of pixels 110 is read by the column-parallel ADCs 125, the read-out by each ADC 125 includes a reset (or “auto-zeroing”) phase and a signal (or “transmit,” or “TX/signal”) phase. Each ADC 125 includes a programmable gain amplifier (PGA) 220. During the reset phase, a number of reset phase conversions are performed to obtain respective baseline offsets associated with multiple gains settings for the PGA 220. For example, the PGA 220 may support a high-gain setting and a low-gain setting, and/or the PGA 220 may support any suitable additional or alternative gain settings. During the signal phase, a pixel signal 205 output from the pixel 110 is estimated to determine a pre-decision value, and the pre-decision value corresponds to a selected one of the gain settings supported by the PGA 220. The gain of the PGA 220 can then be set in accordance with pre-decision value (i.e., using the corresponding gain setting), and the pixel signal 205 can be converted by the PGA 220 to obtain a signal offset. The signal offset and the respective baseline offset corresponding to the selected gain setting can then be used to compute a digital pixel output for the pixel signal 205.
As illustrated, the ADC 125 can include an ADC processor 290 to direct implementation of various features. The processor 290 can include any suitable processor, such as a central processing unit (CPU), an application-specific integrated circuit (ASIC), an application-specific instruction-set processor (ASIP), a graphics processing unit (GPU), a physics processing unit (PPU), a digital signal processor (DSP), a field-programmable gate array (FPGA), a programmable logic device (PLD), a controller, a microcontroller unit, a reduced instruction set (RISC) processor, a complex instruction set processor (CISC), a microprocessor, or the like, or any combination thereof, or any portion thereof. The processor 290 can control some or all components of the ADC 125. For example, the processor 290 can control operations of the PGA 220 by controlling whether it receives the pixel output signal 205 directly or some other signal (e.g., an auto-zero signal), and by selecting the gain setting to be used by the PGA 220 (e.g., directly, by controlling one or more other signals, by responding to one or more other signals, etc.). Similarly, as described herein, the processor 290 can control operation of a comparator 230 (e.g., by controlling ramping up of a reference voltage signal 233 at a comparator 230 input), of a latch 270 (e.g., by actuating and de-actuating an enable signal 273), of a counter 250 (e.g., by controlling a clocking signal 253), etc. Though not explicitly shown, some implementations further have one or more additional types of storage, such as registers, latches, solid state memories, etc., on which to store various threshold values, baseline offset values, signal offset values, and other suitable information; and memory operation relating to such storage can be controlled by the processor 290.
In effect, at each pixel readout, a pixel signal level can be estimated to obtain a pre-decision, and the pre-decision can be used for pixel-wise adjustment of the PGA gain. For example, high gain is applied to low-level signals to reduce noise, and low gain is applied to high-level signals to avoid overloading components. Present day high-end CIS (CMOS image sensor) is moving into higher resolution and lower noise. At the same time, power consumption and dynamic range are wanted not to be compromised, especially in mobile devices. Analog power is a significant, if not dominant, part of the CIS power consumption, therefore, power efficient and low noise ADC design is critical in a high performance CIS product. Implementations of embodiments described herein can provide a reduction in readout noise, while maintaining high dynamic range, relaxing downstream circuits, and reducing overall power (as compared to implementations without a PGA gain stage).
Conventional CIS implementations tend to use a fixed gain amplifier, or an amplifier having gain that is programmed by a system once for a whole image, or the like. In limited cases, conventional CIS approaches have included some pixel-wise gain adjustment. However, such conventional implementations tend to have various limitations, such as pronounced linearity errors. Further, such conventional implementations tend to rely on adding complex hardware, tend not to be robust with changes in operating conditions (e.g., over time and temperature), and tend to contribute to other undesirable effects (e.g., vertical fixed-pattern noise).
For the sake of added clarity,
After the baseline offset is obtained, the signal phase begins, and the actual pixel signal 325 is passed through to the PGA. A pre-decision sub-phase is triggered by a pre-decision enable signal 350. The PGA is maintained in its high-gain state, and the PGA output signal 335 is monitored in relation to a pre-decision threshold level 337 (e.g., set by an external limit circuit). If the pixel signal 325 is a low-light signal (represented by pixel signal 325 settling to level 325a), the PGA output signal 335 will tend not to reach the pre-decision threshold level 337 even at high gain. However, if the pixel signal 325 is a high-light signal (represented by pixel signal 325 settling to level 325b), the PGA output signal 335 will tend briefly to exceed the pre-decision threshold level 337 at high gain. A pre-decision output signal 340 is generated responsive to this pre-decision sub-phase (e.g., as a logic HIGH, indicated by curve 340b, for high-light signals, and as a logic LOW, indicated by curve 340a, for low-light signals). The gain of the PGA is set responsive to this pre-decision output signal 340. For example, estimation of the signal as low-light results in a pre-decision that drives a high-gain setting for the PGA, and estimation of the signal as high-light results in a pre-decision that drives a low-gain setting for the PGA.
These gain adjustments are then applied to the PGA and reflected in the PGA output signal 335, as indicated. For example, in a low-light condition, the PGA output signal 335 tracks the low-light pixel signal 325a with high gain applied by the PGA (shown as curve 335a); in a high-light condition, the PGA output signal 335 tracks the high-light pixel signal 325b with high gain applied by the PGA (shown as curve 335b). The pixel signal 325 can then be converted using the adjusted gain setting. Again, the reference voltage 330 can be ramped up and compared against the PGA output signal 335 to obtain a count that indicates a signal offset for the PGA output signal 335 (illustrated by counter output signal 345).
Notably, this signal offset level corresponds to the pixel signal 325 level, but also includes the baseline offset of the PGA determined in the reset phase. Some approaches mitigate this effect by effectively subtracting out the baseline offset during the final conversion of the signal. However, such subtracting tends to generate linearity error. For example, the baseline offset is conventionally determined using a high-gain setting for the PGA, but the PGA may manifest a different baseline offset when in a low-gain setting. If the digital conversion is ultimately performed using the low-gain setting, the conversion offset may be different from the baseline offset.
For example,
Some conventional approaches seek to compensate for the relative large linearity error 415. For example, two well-controlled signals are used to calibrate the offset difference and gratio_err, and calibration codes are individually stored for each ADC. Digital correction is carried out during real-time image capturing readout. Such compensation tends to be complex and involves additional correction hardware. Further, such compensation tends not to be robust with offset shifts over temperature and time of use. Moreover, un-canceled analog offset and gain error can contribute to vertical fixed-pattern noise (FPN) due to mismatch between column ADCs, many applications have strict FPN design constraints (e.g., required to be 20 dB below, 0.1× in magnitude, the related pixel random noise level). Because of these practical limitations, conventional techniques are considered to be unattractive for practical image sensor product implementations.
Embodiments described herein provide a novel approach for pixel-wise gain-adjusted conversion that avoids limitations of conventional approaches.
The PGA 220 can include N possible gain settings, where N is an integer greater than one. To avoid over-complicating the figure, the timing diagram 500 and description assume that N is two, such that the PGA 220 includes two gain settings: a high-gain setting, and a low-gain setting. At the start of the reset phase, the PGA 220 can be set to a first of its gain settings. In the illustrated case, the PGA 220 is first set to a low-gain setting, as illustrated by PGA gain setting signal 550. The reset signal 510 forces the pixel signal 205 to a predefined reset value, and an auto-zero signal 520 forces the PGA output signal 215 to a different predefined low level (auto-zeroing circuits not shown in plot for simplicity). As described above, the PGA output signal 215 does not drop to zero to provide proper bias for circuits and margin for some natural offset and auto-zeroing error. This offset is a baseline offset of the PGA 220 when set to the first gain setting.
As shown in
After the pixel signal 205 and the PGA output signal 215 settle to their auto-zero levels in the first gain setting condition, the reference voltage 233 at the input to the comparator 230 is triggered to begin ramping up (e.g., after starting at zero, or some known voltage level below the auto-zeroed PGA output signal 215). Concurrently, the counter 250 can begin counting, as indicated by counter output signal 255. As the reference voltage 233 ramps up, it is compared against the auto-zeroed PGA output signal 215. The comparator output signal 235 can flip in response to the reference voltage 233 reaching (e.g., crossing) the level of the auto-zeroed PGA output signal 215. For example, the comparator output signal 235 can transition from ‘1’ to ‘0’, or from ‘0’ to ‘1’, generating a transition edge. This transition edge can trigger the counter 250 to cease counting. Upon ceasing counting, the counter output signal 255 (e.g., a final binary count, etc.) corresponds to a first baseline offset 560a of the auto-zeroed PGA output signal 215 corresponding to the PGA 220 being set to the first gain setting. This first baseline offset 560a can be stored in a register, memory location, or in any suitable manner.
Subsequently, the above reset phase conversion (i.e., setting the PGA 220 to a particular gain setting and obtaining a respective baseline offset 560 corresponding to that gain setting) can be repeated for each of the N gain settings supported by the PGA 220. In the illustrated case, the PGA 220 is switched to a second (e.g., high) gain setting as illustrated by PGA gain setting signal 550. In this configuration, the reference voltage 233 at the input to the comparator 230 is reset to an initial level and again triggered to begin ramping up; and the counter 250 is concurrently triggered to reset and restart counting, as indicated by counter output signal 255. In the same manner as described for the first gain setting, the comparator 230 and the counter 250 are used to obtain and record a second baseline offset 560b of the auto-zeroed PGA output signal 215 corresponding to the PGA 220 being set to the second gain setting. By using the same comparator 230, the same counter 250, the same reference voltage 233 and corresponding ramp slope, the same counter clock signal 253, etc., implementations can ensure that each respective baseline offset 560, though obtained and recorded under different gain conditions, are otherwise comparable.
After the multiple respective baseline offsets 560 are obtained, the signal phase begins, and the actual pixel signal 205 is passed through to the PGA 220. A pre-decision sub-phase is used to estimate the pixel signal 205 to generate a pre-decision for controlling the gain setting of the PGA 220. In some embodiments, rather than using an externally set pre-decision threshold level (e.g., as in
During this sub-phase, the pre-decision enable signal 273 can enable the latch 270 to record the value of the comparator output signal 235. As such, when the pre-decision enable signal 273 is no longer actuated, the latch 270 has the pre-decision output signal 275 at its output, which corresponds to the comparison between the PGA output signal 215 and the pre-decision threshold level 530 as indicated by the comparator output signal 235. For example, if the PGA output signal 215 crosses the pre-decision threshold level 530 during the time when the pre-decision enable signal 273 is actuated, the pre-decision output signal 275 can be latched to a ‘1’ (e.g., logic HIGH, indicated by curve 540b); if the PGA output signal 215 does not cross the pre-decision threshold level 530 during the time when the pre-decision enable signal 273 is actuated, the pre-decision output signal 275 can be latched to a ‘0’ (e.g., logic LOW, indicated by curve 540a).
The gain of the PGA 220 is set responsive to this pre-decision output signal 275. For example, a low-light pixel signal 205 following curve 525a results in a pre-decision output signal 275 of level 540a, thereby driving a high-gain setting for the PGA 220 (shown as 555a); a high-light pixel signal 205 following curve 525b results in a pre-decision output signal 275 of level 540b, thereby driving a low-gain setting for the PGA 220 (shown as 555b). These gain adjustments are then applied to the PGA 220 and reflected in the PGA output signal 215, as indicated. For example, in a low-light condition, the PGA output signal 215 tracks the low-light curve 525a with high gain applied by the PGA 220 (shown as curve 535a); in a high-light condition, the PGA output signal 215 tracks the high-light curve 525b with high gain applied by the PGA 220 (shown as curve 535b).
The pixel signal 205 can then be converted using the adjusted gain setting (e.g., indicated by PGA gain setting signal 550 at level 555a or level 555b). Again, the reference voltage 233 can be ramped up and compared against the PGA output signal 215, and a counter can be used to indicate a converted level of the PGA output signal 215 as a signal offset 570. As described above, this signal offset 570 corresponds to a level of the pixel signal 205, but also includes the baseline offset 560 of the PGA 220 corresponding to the gain setting used in the conversion. The baseline offset 560 contribution can be subtracted out of the final conversion to obtain a converted pixel output (DN). For example, digital correlated double sampling (CDS) is used to compute DN as a difference between the signal offset 570 (SO) and the baseline offset 560 (BO) divided by an ideal gain ratio (IGR). Notably, as each supported gain setting is associated with a respective obtained and recorded baseline offset 560, the CDS can be performed using the baseline offset 560 corresponding to the gain setting that was used in the conversion. For example, for gain setting Gn, the final digital CDS operation can be calculated as: DN=(SO−BOn)/GM. Embodiments can use a same reference ramp slope for all conversions to eliminate any slope matching issue. Because the digital CDS result is the difference between two conversion results generated at the same signal path configuration with the same offset (i.e., the respective BO used for the signal conversion is the same one that is canceled by the CDS operation), the baseline offset is canceled without the linearity error described above with reference to conventional approaches.
As described herein, the PGA 220 can be designed to support multiple gain settings.
As illustrated, the feedback capacitor network 209 can include a set of multiple capacitors 610 in parallel, each configured to be selectively switched into or out of the network. In some implementations, the capacitors 610 are unit capacitors implemented as either MOM (Metal-Oxide-Metal) or MIM (Metal-Insulator-Metal) capacitors for matching purposes. For example, the feedback capacitor network 209 includes a first feedback capacitor 610a (C2a) and a second feedback capacitor 610b (C2b). In a low gain setting (e.g., illustrated in
The feedback capacitors 610 can be switched into or out of the feedback path in any suitable manner. For example, some or all of the feedback capacitors 610 can have a switch 615 on one or both sides. In some implementation, the first feedback capacitor 610a is always in the feedback path and is not coupled via switches (switches 615a and 615b are not included in the circuit). However, inclusion of the switches even in such a fixed path can help ensure proper matching between the parallel legs of the feedback capacitor network, resulting in better performance. In some implementations, each feedback capacitor 610 includes a switch 615 only on one of its sides (e.g., switched 615a and 615c, or switches 615b and 615d, are removed). However, including switches on both sides of the feedback capacitors 610 can improve analog performance in some implementations. Though no control signal is explicitly shown, the switches 615 can be controlled in any suitable manner. In some implementations, referring to
Designing the PGA 220 as shown in
The pixel signal in a CIS is generated by electrons collected in the pixel photodiode over an exposure time. The collected electron signal has inherent shot noise with a variance level equal to the number of electrons (NE) and a relative error of sqrt(NE)/NE=sqrt(NE). As a rule of thumb, a linearity error of 20 dB below (e.g., 0.1× the magnitude of) the shot noise is insignificant and can be tolerated. For example,
In some embodiments, a carefully selected gain ratio can facilitate certain counter-related features.
Suppose, for example, that the full scale range of the signal output (including both the first range and the second range) corresponds to a 12-bit counter range (i.e., values from 0000000000002 to 1111111111112, or 010 to 409510). The least significant bits (e.g., two or more) may be needed to describe signal output values in the first range, but the first range may never approach anything close to the top of the 12-bit range. However, if it can be predicted that the second range will always begin at a level with an inherent shot noise level well above the least significant bits such as 112, the additional resolution provided by those least significant bits may be unnecessary to described the second range. As such, embodiments can use such knowledge relating to the pre-decision output signal 275 to relax counter requirements. As illustrated, rather than using a 12-bit counter, a 10-bit counter is shown. When operating in the high-gain mode, the 10-bit counter can be used to represent values from decimal ‘0’ (‘0000000000’) to decimal ‘1023’ (‘1111111111’), though the first range is likely much smaller. When operating in the low-gain mode, the output of the same 10-bit counter can be shifted by two bits. As such, the all counter output values are effectively treated like the output of a 12-bit counter with the two least significant bits fixed (e.g., at ‘0’). For example, in such a configuration, a counter value of ‘0000000000’ now can represent a decimal value of ‘4’, and a counter value of ‘1111111111’ can represent a decimal value of ‘4095’. In this way, the 10-bit counter can effectively have a 12-bit resolution. Further, the quantization noise in the counter is relaxed by four times, and the number of counter transitions is reduced to one-fourth for signals larger than the threshold level, therefore reducing the digital counting power to roughly one-fourth.
At stage 908, embodiments execute, for each gain setting (Gn) of the N gain settings, a respective reset phase conversion to obtain a respective baseline offset (BOn) associated with the Gn. In some embodiments, executing the respective reset phase conversion at stage 908 includes, iteratively, for each Gn: setting the gain of the PGA according to the Gn, the PGA generating the PGA output signal responsive to the pixel signal being in an auto-zeroing (AZ) mode; ramping up a reference voltage from a low reference level to an AZ threshold level, the low reference level being below a predetermined lowest level for the PGA output signal, and the AZ threshold level being above the PGA output signal; and triggering a counter to begin counting along with a beginning of the ramping up, such that the count value upon stopping the counting indicates the BOn corresponding to the Gn.
At stage 912, embodiments determine a pre-decision value as a function of a pixel signal, the pre-decision value corresponding to a selected one of the gain settings (Gs). In some embodiments, determining the pre-decision value at stage 912 includes: setting the gain of the PGA according to a high-gain setting, the PGA generating the PGA output signal responsive to the pixel signal being in a transfer signal (TS) mode; setting the reference voltage to a TS threshold level (e.g., corresponding to a pre-decision threshold level times the gain of the PGA according to the high-gain setting); and triggering a latch, at a pre-decision enable time, to record a value at the output comparator node as the pre-decision value.
At stage 916, embodiments convert the pixel signal by using the pre-decision value to set a gain of the PGA to the Gs and obtaining a signal offset (SO). In some embodiments, converting the pixel signal at stage 916 includes setting the gain of the PGA according to the Gs responsive to determining the pre-decision value, the PGA generating the PGA output signal responsive to the pixel signal being in a transfer signal (TS) mode; ramping up the reference voltage from a low reference level to a high reference level, the low reference level being below a predetermined lowest level for the PGA output signal, and the high reference level being above a predetermined highest level for the PGA output signal; and triggering the counter to begin counting along with a beginning of the ramping up, such that the count value upon stopping the counting indicates the SO.
At stage 920, embodiments compute a digital pixel output for the pixel signal as a function of the SO and the BOs, wherein the BOs is the BOn corresponding to the Gs. In some embodiments, the computing at stage 920 comprises performing digital correlated double sampling (CDS), such that the digital pixel output relates to a difference between the SO and the BOs.
It will be understood that, when an element or component is referred to herein as “connected to” or “coupled to” another element or component, it can be connected or coupled to the other element or component, or intervening elements or components may also be present. In contrast, when an element or component is referred to as being “directly connected to,” or “directly coupled to” another element or component, there are no intervening elements or components present between them. It will be understood that, although the terms “first,” “second,” “third,” etc. may be used herein to describe various elements, components, these elements, components, regions, should not be limited by these terms. These terms are only used to distinguish one element, component, from another element, component. Thus, a first element, component, discussed below could be termed a second element, component, without departing from the teachings of the present invention. As used herein, the terms “logic low,” “low state,” “low level,” “logic low level,” “low,” or “0” are used interchangeably. The terms “logic high,” “high state,” “high level,” “logic high level,” “high,” or “1” are used interchangeably.
As used herein, the terms “a”, “an” and “the” may include singular and plural references. It will be further understood that the terms “comprising”, “including”, having” and variants thereof when used in this specification, specify the presence of stated features, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, elements, components, and/or groups thereof. In contrast, the term “consisting of” when used in this specification, specifies the stated features, steps, operations, elements, and/or components, and precludes additional features, steps, operations, elements and/or components. Furthermore, as used herein, the words “and/or” may refer to and encompass any possible combinations of one or more of the associated listed items.
While the present invention is described herein with reference to illustrative embodiments, this description is not intended to be construed in a limiting sense. Rather, the purpose of the illustrative embodiments is to make the spirit of the present invention be better understood by those skilled in the art. In order not to obscure the scope of the invention, many details of well-known processes and manufacturing techniques are omitted. Various modifications of the illustrative embodiments, as well as other embodiments, will be apparent to those of skill in the art upon reference to the description. It is therefore intended that the appended claims encompass any such modifications.
Furthermore, some of the features of the preferred embodiments of the present invention could be used to advantage without the corresponding use of other features. As such, the foregoing description should be considered as merely illustrative of the principles of the invention, and not in limitation thereof. Those of skill in the art will appreciate variations of the above-described embodiments that fall within the scope of the invention. As a result, the invention is not limited to the specific embodiments and illustrations discussed above, but by the following claims and their equivalents.
Patent | Priority | Assignee | Title |
Patent | Priority | Assignee | Title |
9429470, | Jul 04 2014 | Ricoh Company, Ltd. | Opto-electronic converter, image reading device, and image forming apparatus |
20140070074, | |||
20160249005, | |||
WO2016194622, | |||
WO2017222653, | |||
WO2019050606, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Jan 14 2020 | WANG, XIAODONG | SHENZHEN GOODIX TECHNOLOGY CO , LTD | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 051596 | /0369 | |
Jan 15 2020 | Shenzhen Goodix Technology Co., Ltd. | (assignment on the face of the patent) | / |
Date | Maintenance Fee Events |
Jan 15 2020 | BIG: Entity status set to Undiscounted (note the period is included in the code). |
Date | Maintenance Schedule |
Nov 09 2024 | 4 years fee payment window open |
May 09 2025 | 6 months grace period start (w surcharge) |
Nov 09 2025 | patent expiry (for year 4) |
Nov 09 2027 | 2 years to revive unintentionally abandoned end. (for year 4) |
Nov 09 2028 | 8 years fee payment window open |
May 09 2029 | 6 months grace period start (w surcharge) |
Nov 09 2029 | patent expiry (for year 8) |
Nov 09 2031 | 2 years to revive unintentionally abandoned end. (for year 8) |
Nov 09 2032 | 12 years fee payment window open |
May 09 2033 | 6 months grace period start (w surcharge) |
Nov 09 2033 | patent expiry (for year 12) |
Nov 09 2035 | 2 years to revive unintentionally abandoned end. (for year 12) |