The present disclosure relates to an address sub-sampling apparatus and method, and an image sensor employing the same. An address sub-sampling apparatus includes a counting unit that generates a binary address of n bits, n being a natural number larger than 2. The address sub-sampling apparatus also includes an address conversion unit that sub-samples the binary address of n bits to output a sub-sampled address having first, second and third bit groups, wherein the sub-sampled address is arranged in order of the third, the first and the second bit groups from the MSB (Most Significant bit). The first bit group, which is a combination of digits in the sub-sampled address corresponding to the number of addresses to be skipped, being set as “0”, the second bit group, which includes the LSB (Least Significant bit) corresponding to bits of the binary address, and the third bit group, which includes the MSB being set to shift address subtracted by the number of bits in the first bit group from the MSB in the binary address.
|
11. An address sub-sampling method, comprising:
generating a binary address of n bits, n being a natural number larger than 2; and
sub-sampling the binary address of n bits to output a sub-sampled address that is provided in such a way that third, first, and second bit groups of the sub-sampled addresses are arranged in sequence from the MSB (Most Significant bit), the first bit group, which is a combination of digits in the sub-sampled address corresponding to the number of addresses to be skipped, being set as “0”, the second bit group, which includes the LSB (Least Significant bit) corresponding to bits of the binary address, and the third bit group, which includes the MSB being set to shift address subtracted by the number of bits in the first bit group from the MSB in the binary address.
1. An address sub-sampling apparatus, comprising:
a counting unit that generates a binary address of n bits, n being a natural number larger than 2; and
an address conversion unit that sub-samples the binary address of n bits to output a sub-sampled address having first, second and third bit groups, wherein the sub-sampled address is arranged in order of the third, the first and the second bit groups from the MSB (Most Significant bit), the first bit group, which is a combination of digits in the sub-sampled address corresponding to the number of addresses to be skipped, being set as “0”, the second bit group, which includes the LSB (Least Significant bit) corresponding to bits of the binary address, and the third bit group, which includes the MSB being set to shift address subtracted by the number of bits in the first bit group from the MSB in the binary address.
12. A sub-sampling method for use in an image sensor, comprising:
generating a first binary address of x bits in synchronization with a preset data clock signal, and generating a second binary address of y bits in synchronization with a preset line clock signal, both x and y being natural numbers larger than 2; and
sub-sampling the first and the second binary addresses to output first and second sub-sampled addresses that are provided in such a way that third, first, and second bit groups of each of the first and the second sub-sampled addresses are arranged in sequence from the MSB (Most Significant bit), the first bit group, which is a combination of digits in the sub-sampled address corresponding to the number of addresses to be skipped, being set as “0”, the second bit group, which includes the LSB (Least Significant bit) corresponding to bits of the binary address, and the third bit group, which includes the MSB being set to shift address subtracted by the number of bits in the first bit group from the MSB in the binary address.
5. An image sensor of line scanning manner, comprising:
a first counting unit that generates a first binary address of x bits in synchronization with a preset data clock signal, x being a natural number larger than 2;
a first address conversion unit that sub-samples the first binary address of x bits to provide a first sub-sampled address having first, second and third bit groups;
a second counting unit that generates a second binary address of y bits in synchronization with a preset line clock signal, y being a natural number larger than 2; and
a second address conversion unit that sub-samples the second binary address of y bits to output a second sub-sampled address having first, second and third bit groups,
wherein each of the first and the second sub-sampled addresses is arranged in order of the third, the first and the second bit groups from the MSB (Most Significant bit), the first bit group, which is a combination of digits in the sub-sampled address corresponding to the number of addresses to be skipped, being set as “0”, the second bit group, which includes the LSB (Least Significant bit) corresponding to bits of the binary address, and the third bit group, which includes the MSB being set to shift address subtracted by the number of bits in the first bit group from the MSB in the binary address.
2. The apparatus of
3. The apparatus of
4. The apparatus of
6. The image sensor of
7. The image sensor of
a first multiplexing unit that selects a first sub-sampling mode from a first plurality of predetermined sub-sampling modes provided from the first binary address of x bits; and
a second multiplexing unit that selects a second sub-sampling mode from a second plurality of predetermined sub-sampling modes provided from the second binary address of y bits,
wherein each of the first and the second address conversion units performs sub-sampling operations in accordance with the selected first and second sub-sampling modes, respectively.
8. The image sensor of
9. The image sensor of
10. The image sensor of
13. The method of
14. The method of
|
An address sub-sampling technique is disclosed. More particularly, an address sub-sampling apparatus and method, and an image sensor employing the same are disclosed.
Sub-sampling is also called sampling reduction or MUSE (Multiple sUb-nyquist Sampling Encoding) system. An image displayed on TV, for example, may be divided into two regions: a moving region and a still region. In the moving region, the image may not be sharp and there may also be blurring at a boundary part thereof. In addition, moving objects may have a low resolution. In view of the characteristics of the human eye, moving objects having a low resolution may not be sensed well by the human eye. Based on such characteristics, each image on TV in the MUSE system may be divided into a still region and a moving region, each of which uses different encoding techniques. The bandwidth of an original MUSE signal is 32 MHz where, in each of the above two regions, it is decreased by ¼ resulting in a bandwidth of 8 MHz. The MUSE signal is transmitted over a satellite transmission band of 27 MHz after FM modulating it. In other words, in the moving region, samples of the MUSE signal are compressed by ¼ using sub-sampling and line misalignment sub-sampling at a horizontal axis. In the still region, samples of the MUSE signal are compressed by ½ by performing field misalignment sub-sampling, and field misalignment sub-sampling is performed once again at the time axis based on the concept that there is no picture change between adjacent frames. As a result, in both the moving region and the still region, pixels may be compressed by ¼, and then the ¼ compressed analog samples may be FM modulated to broadcast them over an artificial satellite channel of 27 MHz.
Sub-sampling in an image sensor that is carried out during, for example, view finder or quick view operations may be used to increase rate of frame, while allowing the deterioration of resolution of a broader picture. For this sub-sampling operation, various modes may be provided based upon the design specification. In the pixel array structure, which provides a basic RGB (Red, Green, Blue) Bayer pattern, four pixels are composed as a basic unit. Sub-sampling is generally represented by m×n (herein, m and n are even numbers), where m is the number of addresses to be outputted and n is the number of addresses to be skipped.
For example, in the case of sub-sampling of 2×4, if it is assumed that the start address is “0”, addresses to be outputted are in the order of 0, 1, 6, 7, 12, 13. Thus, 2, 3, 4, 5, 8, 9, 10, and 11 are addresses to be skipped. In such a case, when skipping from 1 to 6, the immediate next address would follow without any loss in view of time. However, the conventional method does not apply the skip function as described above, but masks output data in case addresses exist that need to be skipped. Thus, the conventional method has the shortcoming that it does not utilize the advantages of sub-sampling at the time axis.
In accordance with one aspect, an address sub-sampling apparatus includes a counting unit that generates a binary address of N bits, N being a natural number larger than 2. The address sub-sampling apparatus also includes an address conversion unit that sub-samples the binary address of N bits to output a sub-sampled address having first, second and third bit groups. The sub-sampled address is arranged in order of the third, the first and the second bit groups from the MSB (Most Significant Bit). The first bit group, which is a combination of digits in the sub-sampled address corresponding to the number of addresses to be skipped, being set as “0”, the second bit group, which includes the LSB (Least Significant Bit) corresponding to bits of the binary address, and the third bit group, which includes the MSB being set to shift the address subtracted by the number of bits in the first bit group from the MSB in the binary address.
In accordance with another aspect, an image sensor of line scanning manner, includes a first counting unit that generates a first binary address of X bits in synchronization with a preset data clock signal, X being a natural number larger than 2. The image sensor also includes a first address conversion unit that sub-samples the first binary address of X bits to provide a first sub-sampled address having first, second and third bit groups, and a second counting unit that generates a second binary address of Y bits in synchronization with a preset line clock signal, Y being a natural number larger than 2. The image sensor further includes a second address conversion unit that sub-samples the second binary address of Y bits to output a second sub-sampled address having first, second and third bit groups, wherein each of the first and the second sub-sampled addresses is arranged in order of the third, the first and the second bit groups from the MSB. The first bit group, which is a combination of digits in the sub-sampled address corresponding to the number of addresses to be skipped, being set as “0”, the second bit group, which includes the LSB corresponding to bits of the binary address, and the third bit group, which includes the MSB being set to shift the address subtracted by the number of bits in the first bit group from the MSB in the binary address.
In accordance with yet another aspect, an address sub-sampling method includes generating a binary address of N bits, N being a natural number larger than 2. The address sub-sampling method also includes sub-sampling the binary address of N bits to output a sub-sampled address that is provided in such a way that third, first, and second bit groups of the sub-sampled address are arranged in sequence from the MSB. The first bit group, which is a combination of digits in the sub-sampled address corresponding to the number of addresses to be skipped, being set as “0”, the second bit group, which includes the LSB corresponding to bits of the binary address, and the third bit group, which includes the MSB being set to shift the address subtracted by the number of bits in the first bit group from the MSB in the binary address.
In accordance with yet another aspect, a sub-sampling method for use in an image sensor includes generating a first binary address of X bits in synchronization with a preset data clock signal, and generating a second binary address of Y bits in synchronization with a preset line clock signal, both X and Y being natural numbers larger than 2. The sub-sampling method for use in an image sensor also includes sub-sampling the first and the second binary addresses to output first and second sub-sampled addresses that are provided in such a way that third, first, and second bit groups of each of the first and the second sub-sampled addresses are arranged in sequence from the MSB. The first bit group, which is a combination of digits in the sub-sampled address corresponding to the number of addresses to be skipped, being set as “0”, the second bit group, which includes the LSB corresponding to bits of the binary address, and the third bit group, which includes the MSB being set to shift the address subtracted by the number of bits in the first bit group from the MSB in the binary address.
A binary address 2N of N bits provided from a counter is sub-sampled to output a sub-sampled address having first, second and third bit groups, wherein the sub-sampled address is arranged in order of the third, the first and the second bit groups from the MSB. The first bit group, which is a combination of digits in the sub-sampled address corresponding to the number of addresses to be skipped, being set as “0”. The second bit group, which includes the LSB corresponds to bits of the binary address, and the third bit group, which includes the MSB is set to shift the address subtracted by the number of bits in the first bit group from the MSB in the binary address.
The sub-sampling mode may be performed in real time by implementing an address conversion device using small-sized logic circuits that employ a bit shifting manner and inserts “0” into a specific bit.
In addition, the address sub-sampling apparatus may further include a multiplexer (MUX) 11 that selects one of a plurality of predetermined sub-sampling modes in accordance with the binary address (20˜2N−1) of N bits. For purposes of illustration, the multiplexer 11 shown in
As described above, the binary address of N bits includes 20˜2N−1. Therefore, if it is assumed that the sub-sampling processes are performed m×n times (herein, m is the number of addresses to be outputted and n is the number of addresses to be skipped), m+n should be equal to or smaller than N−1, and m and n should both be even numbers. Thus, all possible modes are 0×0(1), 21×21, 21×22, . . . , 2×2N−21(2N−1), 22× mode (2N−2), . . . , 2N−2× mode (22), 2N−1× mode (21), and, therefore, the selectable mode number is 2N−1, which is obtained by adding all of them through the use of a geometric series operation.
The address conversion block 12 converts the binary address (20˜2N−1) into a sub-sampled address, which is formed in such a manner that third, first, and second bit groups of the binary address are arranged in sequence from the MSB (Most Significant Bit). That is, the first bit group, which is a combination of digits in the sub-sampled address corresponding to the number of addresses to be skipped, is set as “0”, the second bit group, which includes the LSB (Least Significant Bit), is set as the bits of the binary address from the counter 10, and the third bit group, which includes the MSB, shifts the address subtracted by the number of bits in the first bit group from the MSB in the binary address from the counter 10.
Details of the address sub-sampling process are given below. The following represents an algorithm of 10-bit addresses that is implemented by using known Verilog code:
wire [N−1:0] 0by0 = Counter [N−1:0]];
wire [N−1:0] 2By2 = {Counter [N−2:2]}, 1’b0, Counter [0]};
Wire [N−1:0] 4by4 = {Counter [N−2:2]}, 1’b0, Counter [1:0]};
wire [N−1:0] 8by8 = {Counter [N−2:3]}, 1’b0, Counter [2:0]};
wire [N−1:0] 16by16 = {Counter [N−2:4]}, 1’b0, Counter [3:0]};
wire [N−1:0] 2By6 = {Counter [N−3:1]}, 2’b00, Counter [0]};
wire [N−1:0] 2By14 = {Counter [N−4:1]}, 3’b000, Counter[0]};
wire [N−1:0]2by30 = {Counter [N−5:1]}, 4’b0000, Counter[0]};
case(subsamp)
//<=8 ×1 Mux
‘Zero Address=0by0;
//0 × Sub-sampling mode
‘One Address=2by2;
//2 ×2 Sub-sampling mode
‘Two Address=4by4;
//4 ×4 Sub-sampling mode
‘Three Address=8by8;
//8 × 8 Sub-sampling mode
‘Four Address=16by16;
//16 ×16 Sub-sampling mode
‘Five Address=2by6;
//2 ×6 Sub-sampling mode
‘Six Address=2by14;
//2 ×14 Sub-sampling mode
‘Seven Address=2by30;
//2 ×30 Sub-sampling mode
The above algorithm is represented in Verilog code for performing the sub-sampling operation, and is implemented to synthesize digital logic circuits. Specifically, the address conversion block 12 receives the binary address of N bits outputted from the counter 10 and performs bit operations to generate each sub-sampled address, thereby providing corresponding sub-sampled addresses in accordance with eight (Zero to Seven) predetermined sub-sampling modes as described above.
As is known in the art, Verilog code is classified by wire sentence and case sentence, wherein the wire sentence performs bit operations on the outputs from the counter 10. For example, in the case of sub-sampling of 2By2 (2×2) mode(1), 2×2 of wire sentence is set in such a way that the upper bits [N−2:1] of the output from the counter 10 correspond to bits [N−1:1] of 2By2. In other words, the remaining address, which is subtracted by the number of bits in the first bit group to be set as “0”, is shifted from the MSB in the output of the counter 10.
The first bit group, which consists of a combination (21) of digits in the address to be sub-sampled, which is equal to the number (2) of addresses to be skipped, bit [1] of 2By2, is set as “0” (1′b0). The lower bit[0] of the output from the counter 10 corresponds to “0” of 2By2 (Counter[0]). That is, the second bit group including the LSB is set as the bit applied to the counter 10.
In the case of sub-sampling of 2By30, 2By30 of the wire sentence sets in such a way that upper bits [N−5:1] of the output from the counter 10 correspond to bit [N−1:5] of 2By30, bits [4:1] of 2By30 are fixed to “0”, and lower bit [0] of the counter 10 corresponds to bit [0] of 2By2. One of the mode signals from 0by0 to 2By30 obtained by doing so is selectively output from the multiplexer 11, and depends on sub-sampling given by the case sentence. Although an embodiment using the Verilog language is illustratively given for the sake of simplicity, other languages such as VHDL (Very-High speed integrated Description Language), etc. may be used.
Referring to
Referring to
Referring to
The image sensor further includes a second counter 40b, which is operated in synchronization with a line clock signal (Clk.l), that generates a binary address (20˜2Y−1) of Y (herein, Y is a natural number larger than 2) bits, and a second address conversion block 42b that sub-samples the binary address (20˜2Y−1) from the second counter 40b to provide a sub-sampled address [Y-1:0], i.e., row address.
As illustrated in
The first and the second address conversion blocks 40a and 40b convert the binary addresses of 20˜2X−1 and 20˜2Y−1into sub-sampled addresses, column address and row address, which are made in such a way that the third, the first, and the second bit groups are arranged in sequence from the MSB thereof. The first bit group, which is a combination of digits in the sub-sampled address corresponding to the number of addresses to be skipped, is set as “0”, the second bit group corresponds to bits of the binary address from the counter, and in the third bit group including the MSB, the address subtracted by the number of bits in the first bit group from the MSB in the address from the counter is shifted to upper bits.
In general, since the image sensor supports operation of line scan manner, as mentioned above, the first counter 40a, the first multiplexer 41a, and the first address conversion block 42a generate the column address, and the second counter 40b, the second multiplexer 41b, and the second address conversion block 42b produce the row address. The first counter 40a, which is a circuit for generating the column address [X−1:0] is operated based on the rate of output of the data, i.e., in synchronization with the data clock signal (Clk.d), and the second counter 40b, which is a circuit for generating the row address [Y-1:0] is operated based on the rate of output of the data, i.e., in synchronization with the line clock signal (Clk.l).
The line clock signal (Clk.l) and the data clock signal (Clk.d) have the relationship of Eq. (1) as follows:
Clk.l=tblank+(Wc×Clk.d) Eq.(1),
wherein “tblank,” which is the time difference between lines, represents a time interval from completion of scanning of a line to before issuing of line clock signal required for scanning of a next line. In addition, the time “tblank” includes a time taken for CDS (Correlated Double Sampling), etc.
Specifically, referring to Eq. (1), the line clock signal (Clk.l) has a period that is calculated by adding the time (tblank) between the lines to a value that is obtained by multiplying the width of the column of a pixel arrangement block by the data clock signal (Clk.d). For instance, if it is assumed that VGA (Video Graphics Array) is capable of representing 256 colors and its resolution is 640×480, the period of the line clock signal (Clk.l) is longer than that of the data clock signal (Clk.d) since the line clock signal is obtained by adding an additional time to a value that is derived by multiplying the period of the data clock by 640. Further, the fist address conversion block 42a and the second address conversion block 42b employ circuits having the same concept except that the number of bits of addresses is different from each other.
The sub-sampling method of the image sensor will be omitted here for the purpose of simplicity because it may be implemented in the same manner as the inventive sub-sampling described above. As a result, since the address conversion blocks are designed using a small-sized digital logic circuit and may perform the sub-sampling mode in real time, users have access to a wide range of products and may easily support the back-end processing such as, for example, image signal process, image compression, software process, etc.
While the present disclosure has been described with respect to the particular embodiments, it will be apparent to those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the disclosure as defined in the following claims.
Patent | Priority | Assignee | Title |
7773451, | Jul 19 2007 | Zi San Electronics Corp. | Circuit for transforming address |
Patent | Priority | Assignee | Title |
4206503, | Jan 10 1978 | Honeywell Information Systems Inc. | Multiple length address formation in a microprogrammed data processing system |
5124812, | Jan 06 1989 | Sanyo Electric Co., Ltd. | Digital recording and reproducing apparatus for muse signal |
5208660, | Jul 29 1989 | Sharp Kabushiki Kaisha | Television display apparatus having picture-in-picture display function and the method of operating the same |
6961338, | Apr 25 2000 | Sony Corporation | Demultiplexer for handling different multiplexed data formats |
20010000819, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Sep 10 2003 | Hynix Semiconductor Inc. | (assignment on the face of the patent) | / | |||
Nov 14 2003 | JO, WAN-HEE | Hynix Semiconductor Inc | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 014813 | /0232 | |
Oct 04 2004 | Hynix Semiconductor, Inc | MagnaChip Semiconductor, Ltd | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 016216 | /0649 | |
Feb 17 2009 | MagnaChip Semiconductor, Ltd | U S BANK NATIONAL ASSOCIATION, AS COLLATERAL TRUSTEE | AFTER-ACQUIRED INTELLECTUAL PROPERTY KUN-PLEDGE AGREEMENT | 022277 | /0133 | |
May 14 2009 | MagnaChip Semiconductor, Ltd | Crosstek Capital, LLC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 022764 | /0270 | |
May 27 2009 | U S BANK NATIONAL ASSOCIATION, AS COLLATERAL TRUSTEE | MagnaChip Semiconductor, Ltd | PARTIAL RELEASE OF SECURITY INTEREST | 023075 | /0054 | |
Jul 18 2011 | Crosstek Capital, LLC | Intellectual Ventures II LLC | MERGER SEE DOCUMENT FOR DETAILS | 026637 | /0632 |
Date | Maintenance Fee Events |
Oct 22 2008 | ASPN: Payor Number Assigned. |
Feb 23 2010 | ASPN: Payor Number Assigned. |
Feb 23 2010 | RMPN: Payer Number De-assigned. |
Sep 23 2011 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
Dec 29 2015 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
Dec 18 2019 | M1553: Payment of Maintenance Fee, 12th Year, Large Entity. |
Date | Maintenance Schedule |
Jul 01 2011 | 4 years fee payment window open |
Jan 01 2012 | 6 months grace period start (w surcharge) |
Jul 01 2012 | patent expiry (for year 4) |
Jul 01 2014 | 2 years to revive unintentionally abandoned end. (for year 4) |
Jul 01 2015 | 8 years fee payment window open |
Jan 01 2016 | 6 months grace period start (w surcharge) |
Jul 01 2016 | patent expiry (for year 8) |
Jul 01 2018 | 2 years to revive unintentionally abandoned end. (for year 8) |
Jul 01 2019 | 12 years fee payment window open |
Jan 01 2020 | 6 months grace period start (w surcharge) |
Jul 01 2020 | patent expiry (for year 12) |
Jul 01 2022 | 2 years to revive unintentionally abandoned end. (for year 12) |