When displaying a plurality of gain setting values on a setting screen, an apparatus performs control so as to display each of the gain setting values in a display style that makes identifiable a noise level generated as a result of amplification of a signal based on each of the gain setting values.
|
11. A method for controlling a display of a gain setting value, the method comprising:
converting light into a signal;
performing control so as to display a plurality of gain setting values on a setting screen;
selecting a gain setting value from the plurality of gain setting values; and
amplifying the signal according to the selected gain setting value,
wherein the plurality of gain setting values is each displayed on the setting screen in a display style that makes identifiable a noise level generated as a result of the amplification of the signal.
16. A non-transitory computer-readable storage medium storing a program for executing the method, the method comprising:
converting light into a signal;
performing control so as to display a plurality of gain setting values on a setting screen;
selecting a gain setting value from the plurality of gain setting values; and
amplifying the signal according to the selected gain setting value,
wherein the plurality of gain setting values is each displayed on the setting screen in a display style that makes identifiable a noise level generated as a result of the amplification of the signal.
1. An apparatus comprising:
a conversion unit configured to convert light into a signal;
an amplification unit configured to amplify the signal;
a processor; and
a memory storing a program which, when executed by the processor, causes the apparatus to:
perform control so as to display a plurality of gain setting values on a setting screen; and
select a gain setting value from the plurality of gain setting values,
wherein the amplification unit amplifies the signal according to the selected gain setting value, and the plurality of gain setting values is each displayed on the setting screen in a display style that makes identifiable a noise level generated as a result of the amplification of the signal.
2. The apparatus according to
3. The apparatus according to
4. The apparatus according to
5. The apparatus according to
6. The apparatus according to
wherein the gain setting values are displayed in the display style that makes the noise level identifiable according to a result of the determination.
7. The apparatus according to
8. The apparatus according to
9. The apparatus according to
10. The apparatus according to
wherein the plurality of gain setting values is displayed in a display style that makes selectable a gain setting value having a noise level different from a noise level of a gain setting value set on the other apparatus by a smaller amount than a threshold value.
12. The method according to
13. The method according to
14. The method according to
wherein the gain setting values are displayed in the display style that makes the noise level identifiable according to a result of the determination.
15. The method according to
17. The non-transitory computer-readable storage medium according to
18. The non-transitory computer-readable storage medium according to
19. The non-transitory computer-readable storage medium according to
wherein the gain setting values are displayed in the display style that makes the noise level identifiable according to a result of the determination.
20. The non-transitory computer-readable storage medium according to
|
The aspect of the embodiments relates to an apparatus used for again adjustment of a video image, a method for controlling it, and a program.
In a case where a camera includes a plurality of amplifiers and a video signal is amplified using the amplifiers, conventionally, a gain of one of the amplifiers has been taken into consideration to change a gain of another amplifier according thereto (Japanese Patent Application Laid-Open No. 11-331690).
Further, a camera operator can set an amplification amount of a video amplifier by selecting any from choices expressed as International Organization for Standardization (ISO) sensitives or gains on the camera (Canon EOS C300 Instruction Manual Firmware ver. 1.1.8.1.00 and Firmware ver. 2.1.9.1.00, pages 65 to 67, November 2017).
When the video signal is amplified using the plurality of amplifiers, the following issue may arise. There is a difference between the amount of a change in the amplification factor of each of the amplifiers and the amount of a change in a noise level generated along therewith, and therefore a noise feeling may considerably change even when a difference is small between the setting value after the ISO sensitivity or the gain is changed and the original setting value. However, the camera operator cannot recognize the change in the noise feeling in advance, which causes noise different from the expected result to be generated in the video image. As a result, the camera operator undesirably ends up in an imaging failure.
According to an aspect of the embodiments, an apparatus includes a conversion unit configured to convert light into a signal, an amplification unit configured to amplify the signal, a processor, and a memory storing a program which, when executed by the processor, causes the apparatus to perform control so as to display a plurality of gain setting values on a setting screen, and select a gain setting value from the plurality of gain setting values, wherein the amplification unit amplifies the signal according to the selected gain setting value, and the plurality of gain setting values is each displayed on the setting screen in a display style that makes identifiable a noise level generated as a result of the amplification of the signal.
Further features of the disclosure will become apparent from the following description of exemplary embodiments with reference to the attached drawings.
In the following description, exemplary embodiments of the disclosure will be described in detail, by way of example, with reference to the drawings. However, components and elements that will be described in these exemplary embodiments are merely cited as examples, and are not intended to limit the scope of the disclosure to them.
A first exemplary embodiment will be described. First, an imaging apparatus according to the present exemplary embodiment will be described with reference to
In the present exemplary embodiment, an imaging apparatus operator performs an input operation via an operation unit 118 of the imaging apparatus to select an amplification amount (a gain setting value) of a video amplifier from choices expressed as a plurality of International Organization Standards (ISO) sensitivities or gains, thereby determining it. For example, when feeling that the video image is dark, the imaging apparatus operator makes the selection so as to increase the ISO sensitivity or the gain, thereby increasing the gain setting value to amplify the luminance of the video image, thus being able to brighten the video image. Further, the imaging apparatus operator can set a step size of a value to which the ISO sensitivity or the gain can be set by performing an input operation via the operation unit 118 of the imaging apparatus, and the choices for the value of the ISO sensitivity or the gain (the gain setting value) according to the set step size are displayed on a setting screen.
The control unit 115 performs gain control on a column amplifier 103 of the image sensor 100 and a digital amplifier 111 of the digital signal processing circuit 110 based on the gain setting value. As the gain control will be described in detail below, a program regarding the gain control is stored in a read only memory (ROM) 116 in advance and is loaded into a random access memory (RAM) 117 after the imaging apparatus is powered on, and the control unit 115 causes the various kinds of circuits to operate according to this program, by which the gain control is performed. Further, the RAM 117 is also used when a program for performing various kinds of image processing is loaded or when other calculation processing is performed.
The image sensor 100 is an element for converting light into an electric signal. The image sensor 100 includes a plurality of pixels including a photoelectric conversion unit 101, and an analog electric signal generated in the photoelectric conversion unit 101 is delivered through a vertical output line 102 and is amplified in terms of a signal level thereof by the column amplifier 103 provided for each column. The column amplifier 103 functions to amplify the analog electric signal, uses a large gain division step, and has discrete gains. The amplification factor (the gain) of the column amplifier 103 is determined based on the gain setting value set by the input operation performed by the imaging apparatus operator and the specifications of the program regarding the gain control.
The analog electric signal amplified by the column amplifier 103 is delivered through a horizontal shift register 104 and is input to an output amplifier 105. The output amplifier 105 also often has discrete gains similarly to the column amplifier 103. In the present exemplary embodiment, assume that the gain of the output amplifier 105 is a fixed value.
The analog electric signal amplified by the output amplifier 105 is input to the analog signal processing circuit 106. The analog electric signal input to the analog signal processing circuit 106 is subjected to a calculation of a difference between a reference level and the signal level in a correlated double sampling circuit (CDS) 107, by which a noise component is removed therefrom.
The analog electric signal output from the CDS 107 is input to an analog signal amplifier (a programmable gain amplifier (PGA)) 108. The PGA 108 can perform gain control using a further fine gain compared to, for example, the column amplifier 103 and the output amplifier 105 provided in the image sensor 100, but the gain of the PGA 108 is assumed to be a fixed value in the present exemplary embodiment.
The analog electric signal amplified by the PGA 108 is converted from the analog signal into a digital signal by an analog-digital (A/D) conversion circuit (ADC) 109, and, after that, is output from the analog signal processing circuit 106 and input to the digital signal processing circuit 110. The imaging apparatus has been described referring to the example in which the analog signal processing circuit 106 is configured separately from the image sensor 100 in the present exemplary embodiment, but the analog signal processing circuit 106 may be configured to be included in the image sensor 100. For example, the gain processing and/or the analog/digital conversion processing may be performed inside the image sensor 100.
The digital signal processing circuit 110 performs gain processing using the digital amplifier 111 and performs image processing such as a gamma correction and contour enhancement on the input digital electric signal using an image processing unit 112. The digital amplifier 111 has an extremely fine gain division step compared to the analog amplifiers such as the column amplifier 103 and the output amplifier 105 provided in the image sensor 100, and therefore can make a fine gain adjustment according to the gain setting value set based on the input operation performed by the imaging apparatus operator. The imaging apparatus has been described referring to the example in which the digital signal processing circuit 110 is configured separately from the image sensor 100 in the present exemplary embodiment, but the digital signal processing circuit 110 may be included in the image sensor 100.
The digital electric signal output from the digital signal processing circuit 110 is output by, for example, being recorded into a recording unit 113 or being displayed on a display unit 114.
A graphic interface 119 generates a display image such as a video image and a menu setting screen displayed on the display unit 114. The display image will be described in detail below.
An external interface 120 connects to an external apparatus such as another imaging apparatus or a display device, and transmits and receives a display image such as a video image and a menu setting screen and information such as imaging settings.
Next, the gain control according to the present exemplary embodiment will be described with reference to
The vertical axis represents an analog gain indicating the gain of the column amplifier 103 of the image sensor 100, a digital gain indicating the gain of the digital amplifier 111 of the digital signal processing circuit 110, and a noise level generated in the video image from the top in this order. The noise level is a sum of a noise level generated in the video image due to an increase in the gain of the column amplifier 103 and a noise level generated in the video image due to an increase in the gain of the digital amplifier 111. The gain has been and will be described using the analog gain of the column amplifier 103 and the digital gain of the digital amplifier 111 as an example of the gain in the present exemplary embodiment, but is not limited thereto. The present exemplary embodiment can be similarly applied when amplifiers having a difference in a change in the noise level generated at the time of the gain increase (amplification) are used in combination.
For example, when the gain setting increases from the state of 0 dB to +1 dB to +2 dB, . . . to +5 dB according to the input operation performed by the imaging apparatus operator, the gain of the digital gain gradually increases as indicated in the graph illustrated in
Then, when the gain setting reaches +6 dB, the digital gain is switched from 6 dB to 0 dB at the same time as the analog gain switched from 0 dB to +6 dB. At this time, because the gain based on the digital gain, which is a main cause for deteriorating the noise level while the gain setting value is 0 dB to +5 dB, becomes zero, the noise level suddenly reduces and is improved when the gain setting reaches +6 dB. The noise amplified when the gain is applied based on the analog gain is noise generated before the analog electric signal is input to the analog gain, and therefore the noise level is less amplified compared to the digital gain.
In the present exemplary embodiment, the range of the gain to which the digital gain can be set is assumed to be 0 dB to 6 dB, and the imaging apparatus performs control so as to switch the gain to the gain of the analog gain (+6 dB) when the gain setting value reaches 6 dB. Due to this control, the present exemplary embodiment allows the imaging apparatus to achieve an increase in the dynamic range, a gain adjustment with high precision (the number of steps), and the improvement of the noise feeling while preventing a sudden change in the luminance in the video image.
However, the gain control working as illustrated in
In the present exemplary embodiment, when the imaging apparatus operator adjusts the amplification amount of the video amplifier by selecting the ISO sensitivity or the gain, the imaging apparatus notifies the imaging apparatus operator of the change in the noise level generated as a result this adjustment. Next, an example of an operation therefor will be described with reference to
The operation illustrated in the flowchart of
In step S301, the control unit 115 receives an instruction for starting the adjustment of the ISO sensitivity or the gain in response to an input operation performed by the imaging apparatus operator via the operation unit 118. For example, the imaging apparatus operator performs an input operation via the operation unit 118, by which a setting menu including a plurality of items settable on the imaging apparatus is displayed, and an item corresponding to the adjustment of the ISO sensitivity or the gain is selected therefrom and is determined.
Then, in step S302, the control unit 115 determines whether to display noise level information indicating the change in the noise level on the setting screen in response to an input operation performed by the imaging apparatus operation via the operation unit 118. For example, the control unit 115 displays a dialog screen inquiring whether to display the noise level information on the display unit 114, and stores a result of a selection that the imaging apparatus operator makes by performing the input operation via the operation unit 118 into the ROM 116 in advance. Then, the control unit 115 makes the determination of step S302 by referring to the enablement/disablement of the display of the noise level information stored in the ROM 116. Alternatively, the control unit 115 may determine the enablement/disablement of the display of the noise level information according to the imaging mode set to the imaging apparatus. More specifically, examples of such an imaging mode include a bracketing imaging mode of continuously capturing a plurality of images while changing the parameters, and a 360-degree image capturing mode or a panorama imaging mode of capturing a plurality of images and combining them into one image. When the imaging apparatus is set to an imaging mode leading to an issue if the noise level is different among a plurality of captured video images, like these examples, the control unit 115 determines to “enable” the display of the noise level information.
If determining to display the noise level information on the setting screen (YES in step S302), in step S303, the control unit 115 acquires the noise level information indicating the noise level corresponding to the gain setting value from the RAM 117. Then, in step S304, the control unit 115 performs display control so as to display a setting screen like examples illustrated in
On the other hand, if determining not to display the noise level information on the setting screen (NO in step S302), in step S305, the control unit 115 performs control so as to display the setting screen on the display unit 114 without displaying the noise level information.
If any gain setting value is selected from the plurality of gain setting values displayed on the setting screen and is determined in response to the input operation performed by the imaging apparatus operator via the operation unit 118 (YES in step S306), the control unit 115 ends the present processing.
Then, the imaging apparatus determines the amplification factors (the gains) of the analog gain and the digital gain based on the gain setting value determined in step S306 and the specifications of the program regarding the gain control, and performs the gain control working as described above.
In the present exemplary embodiment, the enablement/disablement of the display of the noise level information is determined in step S302 before the setting screen is displayed in step S304 or S305. However, the display control is not limited thereto, and may be performed so as to determine the enablement/disablement of the display of the noise level after displaying the setting screen and switch the content displayed on the setting screen according to the determination result.
Next, the examples of the setting screen displayed in step S304 according to the present exemplary embodiment will be described with reference to
In
In
In
In
In
In
In
In
Further, the ISO sensitivity may be presented instead of the gain as the gain setting value on the setting screen. In this case, the information about the gain in
The control unit 115 may detect the operation state of the imaging apparatus, and perform control so as not to display the setting screen for adjusting the ISO sensitivity or the gain on the display unit 114 if the imaging apparatus is in the process of imaging and recording. This control allows the imaging apparatus to prevent a change in the noise generated in the video image in the middle of imaging.
A second exemplary embodiment will be described as a configuration in which the imaging apparatus notifies the imaging apparatus operator of a difference from the noise level of the gain setting value selected immediately before that as the change in the noise level generated as a result of the adjustment of the gain setting, when the amplification amount of the video amplifier is set by selecting the ISO sensitivity or the gain. The present exemplary embodiment will be described, omitting the descriptions of configurations shared with the first exemplary embodiment.
The operation illustrated in the flowchart of
Then, in step S513, the control unit 115 displays the setting screen on the display unit 114 while changing the display style for each gain setting value according to the calculated difference. For example, in
Further, the control unit 115 may perform control so as to display a gain setting value having a noise level different from the noise level of the currently selected gain setting value by a smaller amount than a threshold value on the setting screen if the imaging apparatus is in the process of imaging and recording. This control allows the imaging apparatus to prevent a change in the noise generated in the video image in the middle of imaging.
A third exemplary embodiment will be described regarding an operation in which the imaging apparatus notifies the imaging apparatus operator for the purpose of adjusting the noise level to a level similar to another imaging apparatus in a case where the imaging apparatus is capable of communicating with the other imaging apparatus.
The operation illustrated in the flowchart of
If the imaging apparatus is not set so as to adjust the noise level to a similar level (NO in step S802) or if the difference is not greater than the threshold value (NO in step S805), the control unit 115 ends the present processing.
The first to third exemplary embodiments have been described assuming that the imaging apparatus performs the above-described operation, but can also be realized similarly on another electronic apparatus, such as a personal computer, a smart-phone, and a tablet terminal. Further, the above-described exemplary embodiments may be realized by a plurality of electronic apparatuses instead of a single electronic apparatus. For example, a tablet terminal may include a communication unit capable of communicating with an imaging apparatus, a display unit, and an operation unit, and acquire the choices for the gain setting value of the ISO sensitivity or the gain adjustable on the imaging apparatus and the noise level information for each gain setting value from the imaging apparatus via the communication unit. Then, the tablet terminal can display the setting screen on the display unit, determine the gain setting value in response to an input operation performed by a tablet terminal operator via the operation unit, and transmit the determined gain setting value to the imaging apparatus via the communication unit. The imaging apparatus performs the gain control according to the gain setting value received from the tablet terminal and the specifications of the program regarding the gain control.
According to an aspect of the embodiments, it is possible to achieve the advantageous effect of allowing the imaging apparatus operator to adjust the desired ISO sensitivity or gain while recognizing the change in the noise feeling due to the amplification of the video signal when the camera amplifies the video signal using the plurality of amplifiers.
Embodiment(s) of the disclosure can also be realized by a computer of a system or apparatus that reads out and executes computer executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be referred to more fully as a ‘non-transitory computer-readable storage medium’) to perform the functions of one or more of the above-described embodiment(s) and/or that includes one or more circuits (e.g., application specific integrated circuit (ASIC)) for performing the functions of one or more of the above-described embodiment(s), and by a method performed by the computer of the system or apparatus by, for example, reading out and executing the computer executable instructions from the storage medium to perform the functions of one or more of the above-described embodiment(s) and/or controlling the one or more circuits to perform the functions of one or more of the above-described embodiment(s). The computer may comprise one or more processors (e.g., central processing unit (CPU), micro processing unit (MPU)) and may include a network of separate computers or separate processors to read out and execute the computer executable instructions. The computer executable instructions may be provided to the computer, for example, from a network or the storage medium. The storage medium may include, for example, one or more of a hard disk, a random-access memory (RAM), a read only memory (ROM), a storage of distributed computing systems, an optical disk (such as a compact disc (CD), digital versatile disc (DVD), or Blu-ray Disc (BD)™), a flash memory device, a memory card, and the like.
While the disclosure has been described with reference to exemplary embodiments, it is to be understood that the disclosure is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.
This application claims the benefit of Japanese Patent Application No. 2020-111381, filed Jun. 29, 2020, which is hereby incorporated by reference herein in its entirety.
Kimura, Takayuki, Sano, Genjiro
Patent | Priority | Assignee | Title |
Patent | Priority | Assignee | Title |
10911684, | Apr 24 2018 | Canon Kabushiki Kaisha | Image processing apparatus and control method thereof |
6603508, | Nov 19 1997 | Ricoh Company, LTD | Method, system, and computer readable medium for controlling a digital camera to avoid blurring of a photograph |
9160902, | Mar 15 2012 | Casio Computer Co., Ltd. | Imaging apparatus equipped with image gain adjustment function |
20130242128, | |||
20160112644, | |||
20170099380, | |||
20190327423, | |||
JP2517153, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
May 07 2021 | SANO, GENJIRO | Canon Kabushiki Kaisha | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 056755 | /0479 | |
May 11 2021 | KIMURA, TAKAYUKI | Canon Kabushiki Kaisha | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 056755 | /0479 | |
Jun 10 2021 | Canon Kabushiki Kaisha | (assignment on the face of the patent) | / |
Date | Maintenance Fee Events |
Jun 10 2021 | BIG: Entity status set to Undiscounted (note the period is included in the code). |
Date | Maintenance Schedule |
Mar 01 2025 | 4 years fee payment window open |
Sep 01 2025 | 6 months grace period start (w surcharge) |
Mar 01 2026 | patent expiry (for year 4) |
Mar 01 2028 | 2 years to revive unintentionally abandoned end. (for year 4) |
Mar 01 2029 | 8 years fee payment window open |
Sep 01 2029 | 6 months grace period start (w surcharge) |
Mar 01 2030 | patent expiry (for year 8) |
Mar 01 2032 | 2 years to revive unintentionally abandoned end. (for year 8) |
Mar 01 2033 | 12 years fee payment window open |
Sep 01 2033 | 6 months grace period start (w surcharge) |
Mar 01 2034 | patent expiry (for year 12) |
Mar 01 2036 | 2 years to revive unintentionally abandoned end. (for year 12) |