A pixel-data processing circuit adapted to resize pixel data in a first vertically processing mode is reconfigurable to operate in a nonresizing mode, wherein each mode receives pixel data at a first pixel rate and outputs pixel data at a different pixel rate. In one particular example embodiment, pixels are received at two pixels per cycle and output to a storage unit at one pixel per cycle. In a first operational resizing mode, the embodiment includes vertically processing pixel data including polyphase filtering and line-buffering the pixel data, resizing the received pixel data by circulating the data in the line buffers and by filtering the circulated data for the polyphase filtering, and presenting resized pixel data for storage at the first pixel rate. In a second operational nonresizing mode, the pixel data is processed by double-line buffering the pixel data, bypassing the polyphase filtering, and presenting nonresized pixel data for storage at the rate of one pixel per cycle. Using a control circuit, the pixel-data processing circuit can switch between the first operational resizing mode and the second operational nonresizing mode.
|
28. A reconfigurable data processing circuit, comprising:
a storage unit adapted to receive and store processed data at a first rate; a processing circuit including a data-manipulation circuit and a line-buffer circuit that receives data at another rate that is different than the first rate, the processing circuit having a first operational mode in which the data is manipulated by circulating the data through the line buffers and the data-manipulation circuit, and wherein manipulated data is output for storage in the storage unit at the first rate; and a logic circuit configured and arranged to cause the processing circuit to switch between the first operational mode and a second operational mode in which data is received at the other pixel rate, the received data is processed by double-buffering the data in the line-buffer circuit, the data-manipulation circuit is bypassed, and data is output for storage in the storage unit at the first pixel rate.
19. A method of pixel-data processing using a pixel-data processing circuit having at least one scaling mode, comprising:
receiving and storing processed pixel data at a first pixel rate; in a first operational resizing mode in which pixel data is received at another pixel rate that is different than the first pixel rate, vertically processing pixel data including polyphase filtering and line-buffering the pixel data, resizing the received pixel data by circulating the data in the line buffers and by filtering the circulated data for the polyphase filtering, and presenting resized pixel data for storage at the first pixel rate; in a second operational nonresizing mode in which pixel data is received at the other pixel rate, processing the received pixel data by double-line buffering the pixel data, bypassing the polyphase filtering, and presenting nonresized pixel data for storage at the first pixel rate; and switching between the first operational resizing mode and the second operational nonresizing mode.
1. A reconfigurable pixel-data processing circuit having at least one scaling mode, comprising:
a storage unit adapted to receive and store processed pixel data at a first pixel rate; a vertical processing circuit including a polyphase filter and a line-buffer circuit, the vertical processing circuit having a first operational resizing mode in which pixel data is received at another pixel rate that is different than the first pixel rate, the received pixel data is resized by circulating the data in the line buffers and by filtering the circulated data using the polyphase filter, and resized pixel data is output for storage in the storage unit at the first pixel rate; and a logic circuit configured and arranged to cause the vertical processing circuit to switch between the first operational resizing mode and a second operational nonresizing mode in which pixel data is received at the other pixel rate, the received pixel data is processed by double-buffering the data in the line-buffer circuit, filtering using the polyphase filter is bypassed, and nonresized pixel data is output for storage in the storage unit at the first pixel rate.
13. A reconfigurable pixel-data processing circuit having at least one scaling mode, comprising:
storage means for receiving and storing processed pixel data at a first pixel rate; vertical processing means for vertically processing pixel data, the vertical processing means including a polyphase filter and a line-buffer circuit, the vertical processing means having a first operational resizing mode in which pixel data is received at another pixel rate that is different than the first pixel rate, the received pixel data is resized by circulating the data in the line buffers and by filtering the circulated data using the polyphase filter, and resized pixel data is output for storage in the storage means at the first pixel rate; and means for causing the vertical processing means to switch between the first operational resizing mode and a second operational nonresizing mode in which pixel data is received at the other pixel rate, the received pixel data is processed by double-buffering the data in the line buffer circuit, filtering using the polyphase filter is bypassed, and nonresized pixel data is output for storage in the storage means at the first pixel rate.
14. A reconfigurable pixel-data processing circuit having at least one scaling mode, comprising:
a storage unit adapted to receive and store processed pixel data at one pixel per cycle; a vertical processing circuit including a polyphase filter, a line-buffer circuit including at least twelve line buffers and a control circuit adapted to circulate data through the line-buffer circuit, the vertical processing circuit having a first operational resizing mode in which pixel data is received at two pixels per cycle, the control circuit causes the data to be resized by circulating the pixel data through the line-buffer circuit and by filtering the circulated data using the polyphase filter, and wherein the resized pixel data is output for storage in the storage unit at one pixel per cycle; and a logic circuit configured and arranged to cause the vertical processing circuit to switch between the first operational resizing mode and a second operational nonresizing mode in which pixel data is received at the other pixel rate, the received pixel data is processed by double-buffering the data using two of the line buffers, filtering using the polyphase filter is bypassed, and nonresized pixel data is output for storage in the storage unit at one pixel per cycle.
2. The reconfigurable pixel-data processing circuit of
3. The reconfigurable pixel-data processing circuit of
4. The reconfigurable pixel-data processing circuit of
5. The reconfigurable pixel-data processing circuit of
6. The reconfigurable pixel-data processing circuit of
7. The reconfigurable pixel-data processing circuit of
8. The reconfigurable pixel-data processing circuit of
9. The reconfigurable pixel-data processing circuit of
10. The reconfigurable pixel-data processing circuit of
11. The reconfigurable pixel-data processing circuit of
12. The reconfigurable pixel-data processing circuit of
15. The reconfigurable pixel-data processing circuit of
16. The reconfigurable pixel-data processing circuit of
17. The reconfigurable pixel-data processing circuit of
18. The reconfigurable pixel-data processing circuit of
20. The method of
21. The method of
23. The method of
24. The method of
26. The method of
27. The method of
|
|||||||||||||||||||||||||||
The present invention is directed to video signal processing and, more particularly, to video signal processing which employs a vertical pixel signal processing block, such as a polyphase filter.
Computer arrangements, including microprocessors and digital signal processors, have been designed for a wide range of applications and have been used in virtually every industry. For a variety of reasons, many of these applications have been directed to processing video data and have demanded minimal levels of power consumption and compactness. Some applications have further demanded a high-speed computing engine that can perform effectively on a real-time or near real-time basis. Many of these video-processing applications have required a data-signal processing circuit that is capable of performing multiple functions at ever-increasing speeds.
Increasing the power and versatility of such computing engines, however, can undermine other important goals. For example, faster computing engines consume more power and circuit real estate, whereas the ideal engine minimizes both power consumption and the amount of circuitry required to implement the computing engine.
Moreover, providing versatility and high power typically exacerbates the circuit real estate problem by requiring various types of processing circuitry, each specialized and selectively activated for different processing functions. This phenomena can be appreciated when comparing, for instance, relatively-slow general-purpose processing in video applications versus specialized video-signal filter processing used for compressing and decompressing video data in real time. Because the specialized processing circuitry is typically optimized to keep up with the real-time speeds of the video data, it is often difficult to provide a single video-data processing circuit that is adequately versatile without providing seemingly excess circuitry useful only for limited applications.
As a more particular example, many video-signal processing applications employ specialized video-signal filters for vertical signal processing which uses a specialized video-data filter known as a "polyphase" filter. In video-processing applications, a polyphase filter is used to resize pixels by manipulating data stored to represent the horizontal and vertical lines used to refresh the display. In such applications, expansion or up-sampling ("zoom-factor" greater than one) is achieved by increasing the ratio of the number of output pixels to the number of input pixels; whereas, compression or down-sampling ("zoom-factor" less than one) is achieved by decreasing the ratio of the number of output pixels to the number of input pixels.
Due to their different functions, the type of circuit used for such general purpose video signal processing is different than the type of filtering circuit used for expanding or compressing video data. For video-data expansion, a polyphase filter typically receives the data representing multiple pixels at a first pixel rate (e.g., two pixels per cycle), and processes the pixel data by circulating it through a dozen or so line buffers. The exact manner of circulation through the line buffers depends on the scaling factor. Using the many line buffers to circulate the data and effect an appropriate delay, the polyphase filter is able to output the data to a storage unit a slower pixel rate (e.g., one pixel per cycle).
During processing when the data is not being resized, the polyphase filter and its arrangement of circular line buffers is not needed. Thus, another circuit is used to present the multiple pixels at the same rate in which they are received; thus, if the multiple pixels are received at two pixels per cycle, then they are passed to the storage unit at two pixels per cycle. The storage unit for this processing mode is larger than the storage unit that receives data from the polyphase filter; using the above example two pixels per cycle pixel rate, the storage unit for this processing mode must be twice as large.
The present invention is directed to the above-mentioned goal of minimizing the amount and types of circuits required to implement these respective modes of pixel-data resizing and other types of pixel-data processing.
Various aspects of the present invention are directed to generic de-coupling of input and output rates of sampling data when line buffers are used, and in a more specific application to a reconfigurable pixel-data processing circuit in which line buffers are used for both a vertically pixel processing mode and a nonresizing processing mode.
Consistent with one specific example embodiment, the present invention is directed to a pixel-data processing circuit being adapted to resize pixel data in a first vertically processing mode and to be reconfigured to operate in a nonresizing mode, wherein each mode receives pixel data at a first pixel rate and outputs pixel data at a different pixel rate.
In another particular example embodiment, pixels are received at two pixels per cycle and output to a storage unit at one pixel per cycle. In a first operational resizing mode, the embodiment includes vertically processing pixel data including polyphase filtering and line-buffering the pixel data, resizing the received pixel data by circulating the data in the line buffers and by filtering the circulated data for the polyphase filtering, and presenting resized pixel data for storage at the first pixel rate. In a second operational nonresizing mode, the pixel data is processed by double-line buffering the pixel data, bypassing the polyphase filtering, and presenting nonresized pixel data for storage at the rate of one pixel per cycle. Using a control circuit, the pixel-data processing circuit can switch between the first operational resizing mode and the second operational nonresizing mode.
Other example embodiments of the present invention are respectively directed to various other related aspects including method, circuit, and system-based implementations of such processing.
The above summary of the present invention is not intended to describe each illustrated embodiment or every implementation of the present invention. The figures and the detailed description that follow more particularly exemplify these embodiments.
The invention may be more completely understood in consideration of the following detailed description of various embodiments of the invention in connection with the accompanying drawings, in which:
While the invention is amenable to various modifications and alternative forms, specifics thereof have been shown by way of example in the drawings and will be described in detail. It should be understood, however, that the intention is not to limit the invention to the particular embodiments described. On the contrary, the intention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the invention as defined by the appended claims.
The present invention is believed to be highly applicable to methods and arrangements for pixel processing where vertical pixel-data scaling is one of the modes of operation, and in applications involving generic de-coupling of input and output rates of sampling data when line buffers are used. The invention has been found to be particularly advantageous for pixel processing arrangements requiring or benefiting from use of the same line-buffers for operational modes including both vertical pixel-data scaling and non-scaling. While the present invention is not necessarily limited to such applications, an appreciation of various aspects of the invention is best gained through a discussion of examples in such an environment.
Consistent with a general embodiment, the present invention is implemented in the form of a reconfigurable data processing circuit having a data-manipulation circuit and line-buffer circuits that are used for applications such as scan-rate conversion where a typical frame rate, e.g., 50-60 frames per second, is increased for resizing and other purposes. The reconfigurable data processing circuit outputs data at a first rate while receiving data to be processed at another, different rate. The processing circuit includes a data-manipulation circuit and a line-buffer circuit that receives data at the other rate, and the processing circuit uses the data-manipulation circuit in a first operational mode to manipulate the data by circulating the data through the line buffers and the data-manipulation circuit. The manipulated data is then output for storage in the storage unit at the first rate. A logic circuit is used to cause the processing circuit to switch between the first operational mode and a second operational mode in which data is received at the other pixel rate, the received data is processed by double-buffering the data in the line-buffer circuit, the data-manipulation circuit is bypassed, and data is output for storage in the storage unit at the first pixel rate.
According to another example embodiment of the present invention, the invention is directed to a method for using line buffers in a vertical processing unit during a mode in which pixel data is vertically processed and then re-using a subset of the line buffers in a mode in which the vertically processing stages are bypassed but, in each mode, pixel data is received and output at different pixel rates. A particular implementation of the present invention employs a programmable processing circuit that is programmed to perform both modes of operation and to switch between the modes in response to an external command. The method performs the bypass operation without increasing the hardware cost and the design complexity, and does add line buffers for the storage unit but rather re-uses the existing line buffers for de-coupling the input rate of two pixels per cycle. The double buffering mechanism is performed at the vertical processing stage as well as the storage units. However, the vertical processing stage uses four fixed line buffers and the storage unit uses two line buffers. The invention saves buffer area in the storage and re-uses the vertical processing buffer for bypass operation.
Consistent with the above-described method,
In a more particular example embodiment, vertical processing is implemented to perform vertical linear or non-linear sampling for a video signal input, and an 8-tap, 64-phase polyphase filter is used for expansion and compression operations. The line buffers in vertical processing are circulated depending on the scaling factor and geometrical position of output sampling pixels. In this regard, the polyphase filter can be adapted to filter the same pixels during the expansion operation. During the compression operation, some lines of pixels can be skipped. The line buffers are mainly used for de-coupling the input rate of incoming pixels for the scaling operation as well as the bypass mode of the vertical processing unit to the output pixels.
In
The circuitry 120 also includes logic that is configured and arranged to cause the vertical processing circuit to switch between the first-mentioned resizing mode and a second mode in which the pixel data is not scaled. Via programming or another external prompt, the circuitry 120 disables the operation of the polyphase filter (114 and 116 of
An optional dithering circuit 130 is used, when the application requires, to dither the data from nine bits to eight bits before the data is presented to the storage unit 112.
Accordingly, various embodiments have been described as example implementations of the present invention for saving hardware and offsetting complexity in pixel-data processing applications. In various implementations of the present invention, the number of line buffers required is reduced significantly, there is no extra cost in terms of hardware or design complexity, and throughput is not adversely affected by the bypass operation.
The present invention should not be considered limited to the particular examples described above. Various modifications, equivalent processes, as well as numerous structures to which the present invention may be applicable fall within the scope of the present invention, as fairly set forth in the appended claims.
Guo, Shaori, Lin, Chien-Hsin, Lee, Gwo Giun, Rathnam, Selliah
| Patent | Priority | Assignee | Title |
| 7119845, | Oct 10 2001 | Texas Instruments Incorporated | Image resizing system and method |
| 7834873, | Aug 25 2006 | Intel Corporation | Display processing line buffers incorporating pipeline overlap |
| 8102399, | May 23 2005 | SHENZHEN XINGUODU TECHNOLOGY CO , LTD | Method and device for processing image data stored in a frame buffer |
| Patent | Priority | Assignee | Title |
| 5587742, | Aug 25 1995 | Panasonic Corporation of North America | Flexible parallel processing architecture for video resizing |
| 6031546, | Jun 19 1995 | Canon Kabushiki Kaisha | Image processing apparatus and method |
| 6219464, | Nov 08 1995 | TAMIRAS PER PTE LTD , LLC | Source data interpolation method and apparatus |
| 6281873, | Oct 09 1997 | Semiconductor Components Industries, LLC | Video line rate vertical scaler |
| 6600495, | Jan 10 2000 | Koninklijke Philips Electronics N V | Image interpolation and decimation using a continuously variable delay filter and combined with a polyphase filter |
| EP807922, | |||
| WO230115, |
| Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
| Oct 15 2001 | LIN, CHIEN-HSIN | Koninklijke Philips Electronics N V | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 012502 | /0278 | |
| Oct 19 2001 | GUO, SHAORI | Koninklijke Philips Electronics N V | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 012502 | /0278 | |
| Oct 23 2001 | LEE, GWO GIUN | Koninklijke Philips Electronics N V | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 012502 | /0278 | |
| Oct 25 2001 | RATHNAM, SELLIAH | Koninklijke Philips Electronics N V | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 012502 | /0278 | |
| Oct 26 2001 | Koninklijke Philips Electronics N.V. | (assignment on the face of the patent) | / | |||
| Nov 17 2006 | Koninklijke Philips Electronics N V | NXP B V | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 018635 | /0787 | |
| Feb 07 2010 | NXP | NXP HOLDING 1 B V | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 023928 | /0489 | |
| Feb 08 2010 | TRIDENT MICROSYSTEMS EUROPE B V | TRIDENT MICROSYSTEMS FAR EAST LTD | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 023928 | /0552 | |
| Feb 08 2010 | NXP HOLDING 1 B V | TRIDENT MICROSYSTEMS FAR EAST LTD | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 023928 | /0552 | |
| Apr 11 2012 | TRIDENT MICROSYSTEMS FAR EAST LTD | ENTROPIC COMMUNICATIONS, INC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 028153 | /0530 | |
| Apr 11 2012 | TRIDENT MICROSYSTEMS, INC | ENTROPIC COMMUNICATIONS, INC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 028153 | /0530 |
| Date | Maintenance Fee Events |
| Dec 31 2007 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
| Mar 05 2012 | REM: Maintenance Fee Reminder Mailed. |
| Apr 25 2012 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
| Apr 25 2012 | M1555: 7.5 yr surcharge - late pmt w/in 6 mo, Large Entity. |
| Feb 26 2016 | REM: Maintenance Fee Reminder Mailed. |
| Jul 20 2016 | EXP: Patent Expired for Failure to Pay Maintenance Fees. |
| Date | Maintenance Schedule |
| Jul 20 2007 | 4 years fee payment window open |
| Jan 20 2008 | 6 months grace period start (w surcharge) |
| Jul 20 2008 | patent expiry (for year 4) |
| Jul 20 2010 | 2 years to revive unintentionally abandoned end. (for year 4) |
| Jul 20 2011 | 8 years fee payment window open |
| Jan 20 2012 | 6 months grace period start (w surcharge) |
| Jul 20 2012 | patent expiry (for year 8) |
| Jul 20 2014 | 2 years to revive unintentionally abandoned end. (for year 8) |
| Jul 20 2015 | 12 years fee payment window open |
| Jan 20 2016 | 6 months grace period start (w surcharge) |
| Jul 20 2016 | patent expiry (for year 12) |
| Jul 20 2018 | 2 years to revive unintentionally abandoned end. (for year 12) |