Memories that are configurable to operate in either a banked mode or a bit-separated mode. The memories include a plurality of memory banks; multiplexing circuitry; input circuitry; and output circuitry. The input circuitry inputs at least a portion of a memory address and configuration information to the multiplexing circuitry. The multiplexing circuitry generates read data by combining a selected subset of data corresponding to the address from each of the plurality of memory banks, the subset selected based on the configuration information, if the configuration information indicates a bit-separated mode. The multiplexing circuitry generates the read data by combining data corresponding to the address from one of the memory banks, the one of the memory banks selected based on the configuration information, if the configuration information indicates a banked mode. The output circuitry outputs the generated read data from the memory.
|
16. A method for writing data to a memory that is configurable to operate in either a banked mode or a bit-separated mode, the method comprising:
inputting write data to multiplexing circuitry;
inputting at least a portion of a memory address to the multiplexing circuitry;
inputting configuration information to the multiplexing circuitry;
if the configuration information indicates a bit-separated mode:
writing a selected subset of the write data to each of a plurality of memory banks, the subset selected by the multiplexing circuitry based on the configuration information; and
if the configuration information indicates a banked mode:
writing the write data to a selected one of the plurality of memory banks, the one of the plurality of memory banks selected by the multiplexing circuitry based on the configuration information.
6. A method for reading data from a memory configurable to operate in either a banked mode or a bit-separated mode, the method comprising:
inputting at least a portion of a memory address to multiplexing circuitry;
inputting configuration information to the multiplexing circuitry;
if the configuration information indicates a bit-separated mode:
generating read data by combining a selected subset of data corresponding to the address from each of a plurality of memory banks, the subset selected by the multiplexing circuitry based on the configuration information;
if the configuration information indicates a banked mode:
generating the read data by combining data corresponding to the address from one of the memory banks, the one of the memory banks selected by the multiplexing circuitry based on the configuration information; and
outputting the generated read data from the memory.
11. A memory that is configurable to operate in either a banked mode or a bit-separated mode, the memory comprising:
a plurality of memory banks;
multiplexing circuitry; and
input circuitry configured to input write data to the multiplexing circuitry, to input at least a portion of a memory address to the multiplexing circuitry, and to input configuration information to the multiplexing circuitry;
the multiplexing circuitry configured to, if the configuration information indicates a bit-separated mode:
write a selected subset of the write data to each of the plurality of memory banks, the subset selected based on the configuration information; and
the multiplexing circuitry further configured to, if the configuration information indicates a banked mode:
write the write data to a selected one of the plurality of memory banks, the one of the memory banks selected based on the configuration information.
1. A memory configurable to operate in either a banked mode or a bit-separated mode, the memory comprising:
a plurality of memory banks;
multiplexing circuitry; and
input circuitry configured to input at least a portion of a memory address to the multiplexing circuitry, and to input configuration information to the multiplexing circuitry;
the multiplexing circuitry configured to, if the configuration information indicates a bit-separated mode:
generate read data by combining a selected subset of data corresponding to the address from each of the plurality of memory banks, the subset selected based on the configuration information;
the multiplexing circuitry further configured to, if the configuration information indicates a banked mode:
generate the read data by combining data corresponding to the address from one of the memory banks, the one of the memory banks selected based on the configuration information; and
output circuitry configured to output the generated read data from the memory.
2. The memory of
3. The memory of
4. The memory of
5. The memory of
7. The method of
8. The method of
9. The method of
10. The method of
12. The memory of
13. The memory of
14. The memory of
15. The memory of
17. The method of
18. The method of
19. The method of
20. The method of
|
Computer memory devices, such as static random access memory, (SRAM), dynamic random access memory (DRAM), and the like, are typically organized using multiple banks.
Data stored in computer memory devices is susceptible to various sources of error. Errors sometimes occur in data stored in memory due to flaws in the design of the memory or its associated circuitry, component breakage, or other defects. Such errors are referred to as “hard errors.” On the other hand, errors sometimes occur in the data in the absence of design flaws, breakage or defects. Such errors are referred to as “soft errors.”
In some cases, soft errors occur due to particle strikes on the physical structure of the memory, such as where an alpha particle or cosmic ray secondary neutron strikes a semiconductor structure which stores an information bit in the memory. Such particle strikes change (or “flip”) the value of the bit in some cases, resulting in a single-bit error in the item of data of which the bit forms a part. For example, if the flipped bit is a binary digit of a value stored in memory, the particle strike results in a single-bit error in the value. In some cases, a particle strike can change the value of two (or more) adjacent structures storing bits of information, potentially changing the value of both bits. In cases where both changed bits are part of the same item of data, this results in a multiple-bit error. For example, if the flipped bits are binary digits of the same value stored in memory, the particle strike results in a multiple-bit error in the value.
Various techniques are available to address soft errors, including error correcting codes (ECC). Typical ECCs are able to correct single-bit errors, and to detect (but not correct) multiple-bit errors.
A more detailed understanding can be had from the following description, given by way of example in conjunction with the accompanying drawings wherein:
Some implementations provide a memory that is configurable to operate in either a banked mode or a bit-separated mode. The memory includes a plurality of memory banks; multiplexing circuitry; input circuitry; and output circuitry. The input circuitry inputs at least a portion of a memory address to the multiplexing circuitry, and inputs configuration information to the multiplexing circuitry. The multiplexing circuitry generates read data by combining a selected subset of data corresponding to the address from each of the plurality of memory banks, the subset selected based on the configuration information, if the configuration information indicates a bit-separated mode. The multiplexing circuitry generates the read data by combining data corresponding to the address from one of the memory banks, the one of the memory banks selected based on the configuration information, if the configuration information indicates a banked mode. The output circuitry outputs the generated read data from the memory.
Some implementations provide a method for reading data from a memory that is configurable to operate in either a banked mode or a bit-separated mode. The method includes inputting at least a portion of a memory address to multiplexing circuitry, and inputting configuration information to the multiplexing circuitry. The method also includes generating read data by combining a selected subset of data corresponding to the address from each of a plurality of memory banks, the subset selected by the multiplexing circuitry based on the configuration information, if the configuration information indicates a bit-separated mode. The method also includes generating the read data by combining data corresponding to the address from one of the memory banks, the one of the memory banks selected by the multiplexing circuitry based on the configuration information, if the configuration information indicates a banked mode. The method also includes outputting the generated read data from the memory.
Some implementations provide a memory that is configurable to operate in either a banked mode or a bit-separated mode. The memory includes a plurality of memory banks; multiplexing circuitry; and input circuitry. The input circuitry inputs write data to the multiplexing circuitry, inputs at least a portion of a memory address to the multiplexing circuitry, and inputs configuration information to the multiplexing circuitry. The multiplexing circuitry writes a selected subset of the write data to each of the plurality of memory banks, the subset selected based on the configuration information, if the configuration information indicates a bit-separated mode. The multiplexing circuitry writes the write data to a selected one of the plurality of memory banks, the one of the memory banks selected based on the configuration information, if the configuration information indicates a banked mode.
Some implementations provide a method for writing data to a memory that is configurable to operate in either a banked mode or a bit-separated mode. The method includes inputting write data to multiplexing circuitry; inputting at least a portion of a memory address to the multiplexing circuitry; and inputting configuration information to the multiplexing circuitry. The method also includes writing a selected subset of the write data to each of a plurality of memory banks, the subset selected by the multiplexing circuitry based on the configuration information, if the configuration information indicates a bit-separated mode. The method also includes writing the write data to a selected one of the plurality of memory banks, the one of the plurality of memory banks selected by the multiplexing circuitry based on the configuration information, if the configuration information indicates a banked mode.
In various alternatives, the processor 102 includes a central processing unit (CPU), a graphics processing unit (GPU), a CPU and GPU located on the same die, or one or more processor cores, wherein each processor core can be a CPU or a GPU. In various alternatives, the memory 104 is located on the same die as the processor 102, or is located separately from the processor 102. The memory 104 includes a volatile or non-volatile memory, for example, random access memory (RAM), dynamic RAM, or a cache.
The storage 106 includes a fixed or removable storage, for example, a hard disk drive, a solid state drive, an optical disk, or a flash drive. The input devices 108 include, without limitation, a keyboard, a keypad, a touch screen, a touch pad, a detector, a microphone, an accelerometer, a gyroscope, a biometric scanner, or a network connection (e.g., a wireless local area network card for transmission and/or reception of wireless IEEE 802 signals). The output devices 110 include, without limitation, a display, a speaker, a printer, a haptic feedback device, one or more lights, an antenna, or a network connection (e.g., a wireless local area network card for transmission and/or reception of wireless IEEE 802 signals).
The input driver 112 communicates with the processor 102 and the input devices 108, and permits the processor 102 to receive input from the input devices 108. The output driver 114 communicates with the processor 102 and the output devices 110, and permits the processor 102 to send output to the output devices 110. It is noted that the input driver 112 and the output driver 114 are optional components, and that the device 100 will operate in the same manner if the input driver 112 and the output driver 114 are not present. The output driver 116 includes an accelerated processing device (“APD”) 116 which is coupled to a display device 118. The APD accepts compute commands and graphics rendering commands from processor 102, processes those compute and graphics rendering commands, and provides pixel output to display device 118 for display. As described in further detail below, the APD 116 includes one or more parallel processing units to perform computations in accordance with a single-instruction-multiple-data (“SIMD”) paradigm. Thus, although various functionality is described herein as being performed by or in conjunction with the APD 116, in various alternatives, the functionality described as being performed by the APD 116 is additionally or alternatively performed by other computing devices having similar capabilities that are not driven by a host processor (e.g., processor 102) and provides graphical output to a display device 118. For example, it is contemplated that any processing system that performs processing tasks in accordance with a SIMD paradigm may perform the functionality described herein. Alternatively, it is contemplated that computing systems that do not perform processing tasks in accordance with a SIMD paradigm performs the functionality described herein.
The APD 116 executes commands and programs for selected functions, such as graphics operations and non-graphics operations that may be suited for parallel processing. The APD 116 can be used for executing graphics pipeline operations such as pixel operations, geometric computations, and rendering an image to display device 118 based on commands received from the processor 102. The APD 116 also executes compute processing operations that are not directly related to graphics operations, such as operations related to video, physics simulations, computational fluid dynamics, or other tasks, based on commands received from the processor 102.
The APD 116 includes compute units 132 that include one or more SIMD units 138 that perform operations at the request of the processor 102 in a parallel manner according to a SIMD paradigm. The SIMD paradigm is one in which multiple processing elements share a single program control flow unit and program counter and thus execute the same program but are able to execute that program with different data. In one example, each SIMD unit 138 includes sixteen lanes, where each lane executes the same instruction at the same time as the other lanes in the SIMD unit 138 but can execute that instruction with different data. Lanes can be switched off with predication if not all lanes need to execute a given instruction. Predication can also be used to execute programs with divergent control flow. More specifically, for programs with conditional branches or other instructions where control flow is based on calculations performed by an individual lane, predication of lanes corresponding to control flow paths not currently being executed, and serial execution of different control flow paths allows for arbitrary control flow.
The basic unit of execution in compute units 132 is a work-item. Each work-item represents a single instantiation of a program that is to be executed in parallel in a particular lane. Work-items can be executed simultaneously as a “wavefront” on a single SIMD processing unit 138. One or more wavefronts are included in a “work group,” which includes a collection of work-items designated to execute the same program. A work group can be executed by executing each of the wavefronts that make up the work group. In alternatives, the wavefronts are executed sequentially on a single SIMD unit 138 or partially or fully in parallel on different SIMD units 138. Wavefronts can be thought of as the largest collection of work-items that can be executed simultaneously on a single SIMD unit 138. Thus, if commands received from the processor 102 indicate that a particular program is to be parallelized to such a degree that the program cannot execute on a single SIMD unit 138 simultaneously, then that program is broken up into wavefronts which are parallelized on two or more SIMD units 138 or serialized on the same SIMD unit 138 (or both parallelized and serialized as needed). A scheduler 136 performs operations related to scheduling various wavefronts on different compute units 132 and SIMD units 138.
The parallelism afforded by the compute units 132 is suitable for graphics related operations such as pixel value calculations, vertex transformations, and other graphics operations. Thus in some instances, a graphics pipeline 134, which accepts graphics processing commands from the processor 102, provides computation tasks to the compute units 132 for execution in parallel.
The compute units 132 are also used to perform computation tasks not related to graphics or not performed as part of the “normal” operation of a graphics pipeline 134 (e.g., custom operations performed to supplement processing performed for operation of the graphics pipeline 134). An application 126 or other software executing on the processor 102 transmits programs that define such computation tasks to the APD 116 for execution.
Memory bandwidth and/or power consumption can be optimized or otherwise traded off versus reliability against soft errors using multiple banks of memory.
Memory 300 stores memory entries in rows and columns of memory devices (e.g., RAM). In this example, memory 300 includes two banks 310, 320 of such memory devices. Memory 300 also includes row decoders 390, 395 and column multiplexers 380, 385. Memory devices are selected for access (e.g., reading in this example) by addressing the row and column at which each of the desired memory devices are located in memory 300.
A memory device is readable, for example, by inputting address bits of the corresponding row or rows to row decoders 390, 395, and by addressing the corresponding column or columns to column multiplexers 380, 385. In this example, the address bits are portions of an address of a memory entry stored in memory 300.
The address or portion of an address applied to row decoders 390, 395 is referred to as a row address, and the address or portion of an address applied to column multiplexers 380, 385 is referred to as a column address. In this example, the bits of the row address set decoding circuitry in the row decoders 390, 395 to select a particular row or rows of banks 310 and 320 for reading, and the bits of the column address set multiplexing circuitry in the column multiplexers 380, 385 to select a particular column or columns of banks 310 and 320 for reading.
The information stored in memory devices at the corresponding row and column addresses is output from memory 300 to bank multiplexers 397, which are addressed to select the output from bank 310 or bank 320. Bank multiplexers 397 output the information as read data 399.
The address or portion of an address applied to bank multiplexers 397 is referred to as a bank index. Because there are two banks in this example, the bank index is a single bit. However any suitable number of bits is usable in other implementations. In some implementations, the bank index is the least significant bit (LSB) of the address of the desired memory entry. Bank multiplexers 397 are located outside of memory 300 in this example. However in some implementations bank multiplexers 397 are located inside of memory 300.
To illustrate an example operation, two memory entries 330, 340 are stored in banks 310 and 320 respectively, and it is desired to read memory entry 330. Memory entry 330 is stored completely in memory devices in even columns of a single row of bank 310, interleaved with other memory entries. Memory entry 340 is stored completely in bank 320 (i.e., in memory devices at column and row addresses corresponding to memory entry 330). In this example, a subset of address bits corresponding to the row address of memory entry 330 is input to row decoder 390 and a different subset of the address bits corresponding to the column address of memory entry 330 is input to column multiplexer 380. In this example, column multiplexers 380 include several 2:1 multiplexers which each select either an odd column, or even column, of bank 310. Accordingly, the column address for memory entry 330 is used to set each multiplexer of column multiplexers 380 to output from memory devices in the even columns of bank 310, illustrated in
Because memory entry 330 is stored completely in bank 310, memory entry 330 is read by inputting a subset of address bits corresponding to the bank index to bank multiplexers 397, which sets all of the multiplexers of bank multiplexers 397 to output read data 399 from bank 310 only. This is illustrated in
In some implementations, configuring a cache memory for independent access to banks 310, 320 increases memory bandwidth by facilitating simultaneous access to a different memory entry in the other bank (e.g., by adding a second output data bus and a second set of bank multiplexers). This concept is extendible to any suitable number of banks. The number of banks accessible independently in a memory is referred to as the banking of the memory.
In the example of
Reliability against soft errors due to particle strikes can be optimized or otherwise traded off versus reliability against soft errors using multiple banks of memory.
Memory 400 stores memory entries in memory devices in rows and columns of memory banks (e.g., RAM), and is similar or identical to memory 300.
Memory entry 430 is stored partly in bank 410 and partly in bank 420, interleaved with other memory entries 440, 450 and 460. Memory entry 440 is also stored partly in bank 410 and partly in bank 420, interleaved with other memory entries 430, 450 and 460.
To illustrate an example operation, two memory entries 430, 440 are spread across two banks in order to increase bit separation (i.e., to further “space out” the bits of the memory entry), which reduces the chances of a double-bit error in some cases. Memory entries 430 and 440 share row and column addresses and are both stored in both banks 410, 420.
In this example, a subset of address bits corresponding to the row address of memory entry 430 is input to row decoders 490, 495, and a different subset of the address bits corresponding to the column address of memory entry 430 is input to column multiplexers 480, 485. In this example, column multiplexers 480, 485 include several 2:1 multiplexers which each select either an odd column, or even column, of banks 410, 420. Accordingly, the column address for memory entry 430 is used to set each multiplexer of column multiplexers 480, 485 to output from the even columns of banks 410, 420, illustrated in
Because memory entry 430 is stored in memory devices at every other even column of bank 410 and the alternate even columns of bank 420, as shown in
If it were desired to read memory entry 450, the bank index would set all of the multiplexers of bank multiplexers 497 to the opposite select values. Thus, the leftmost multiplexer of bank multiplexers 497 would be set to output from bank 420; e.g., by a select value of “1”. The next leftmost multiplexer of bank multiplexers 497 would be set to output from bank 410; e.g., by a select value of “0”, and so forth. The bank index is only one bit of the memory address in this example because the bit separation of each memory entry requires only two select settings for bank multiplexers 497; e.g., “0101” or “1010”. In other implementations, any suitable number of bits is usable for the bank index.
In some cases, configuring a cache memory for simultaneous access to both of banks 410, 420 in this way increases the power needed to access each memory entry, and/or reduces memory bandwidth as compared with memory 300, by requiring memory entries 430 and 440 to both be accessed any time one is accessed.
In the example of
Some implementations provide further bit separation by spreading each memory entry over more than two banks. For example,
In this example, a subset of address bits corresponding to the row address of memory entry 530 is input to row decoders 590, 593, 595, 597, and a different subset of the address bits corresponding to the column address of memory entry 530 is input to column multiplexers 580, 583, 585, 587. In this example, column multiplexers 580, 583, 585, 587 include several 2:1 multiplexers which each select either an odd column, or even column, of banks 510, 515, 520, 525. Accordingly, the column address for memory entry 530 is used to set each multiplexer of column multiplexers 510, 515, 520, 525 to output from the even columns of banks 510, 515, 520, 525, illustrated in
Because memory entry 530 is stored in different even columns of banks 510, 515, 520, 525, as shown in
In the example of
In some cases, if memory 500 were configured (or reconfigured) for independent access of the four banks, 510, 515, 520, 525 (i.e., with a banking of 4), memory 500 would increase memory performance in terms of bandwidth and/or power consumption as compared with memory 400. For example, if memory entry 530 were stored in even rows of bank 510 only, memory entry 530 could be read by inputting a bank index to bank multiplexers 598 which sets each multiplexer of bank multiplexers 599 to output memory entry 530 from a different even column of bank 510 only. In this example, each multiplexer of bank multiplexers 598 would be set to a decimal value of 0 (or a binary value of “00”). It is noted that because there are four banks, for banked operation, there are four possible combinations of bank multiplexer settings for bank multiplexers 599 (e.g., all set to 0, all set to 1, all set to 2, and all set to 3 (decimal). Accordingly, the bank index, for banked operation, requires at least two bits (e.g., binary 00, 01, 10, 11 corresponding to decimal values 0, 1, 2, 3).
In some cases, configuring memory 500 for independent access to an entry in one of banks 510, 515, 520, 525 in this way increases memory bandwidth by facilitating simultaneous access to a different memory entry in a different bank. Such implementations may include additional hardware, such as additional sets of bank multiplexers similar to bank multiplexers 598.
In some cases, the choice of whether to configure a memory for independent bank access as in
Memory 600 includes bank 610 and bank 620. The rows and columns of banks 610 and 620 are accessed by inputting a subset of the bits of memory address 630 or memory address 635 to row decoders and column multiplexers of banks 610 and 620 respectively. Each of banks 610, 620 outputs the bits stored at memory lines and columns corresponding to address 630 and 635, respectively, to bank multiplexer 640 and bank multiplexer 650.
Bank multiplexer 640 outputs read data 645 which includes each even bit of the output from either bank 610 or bank 620, depending on mux select signal 660. Bank multiplexer 650 outputs read data 655 which includes each odd bit of the output from either bank 610 or bank 620, depending on mux select signal 670. Read data 645 and read data 655 are combined to provide the result of a memory lookup at address 630. Bank multiplexers 640, 650 are shown as two units merely for ease of description. It is noted that corresponding multiplexing could alternately be described as a single unit which includes multiple multiplexers (similar to bank multiplexers 397, 497, 598 as shown and described in
Mux select signals 660, 670 are generated by configuration circuitry 680 based on bank index signal 685, and independent banking enable (IBE) signal 690. In this example, bank index signal 685 is a subset of the address bits (e.g., one bit) of address 630 or address 635, depending on which address is being used in the operation. Independent banking enable signal 690 sets configuration circuitry 680 to use bank index signal 685 either as a bank select (for banked operation, as in
In this example, independent banking enable signal 690 sets memory 600 to operate in either a banked mode, or a bit separation mode. Because there are two modes in this example, independent banking enable signal 690 is one bit wide. Bank index 685 sets which bank output is selected by multiplexers 640 and 650 in conditions where independent banking enable signal 690 configures memory 600 to operate in banked mode, and sets which bits are output from corresponding row addresses of both bank 610 and bank 620 in conditions where independent banking enable signal 690 configures memory 600 to operate in increased bit separation mode. Because there are two banks in this example, bank index 685 is one bit wide. Table 1 illustrates the possible combinations of bank index signal 685 and independent banking enable signal 690 for the example of
TABLE 1
Mux 640
Independent
Outputs Even
Mux 650 Outputs
Banking
Bank
Bits of the
Odd Bits of the
Enable 690
Index 685
Output from:
Output from:
0
0
Bank 610
Bank 610
0
1
Bank 620
Bank 620
1
0
Bank 610
Bank 620
1
1
Bank 620
Bank 610
Table 1 illustrates that bank index 685 selects which bank outputs the addressed memory for banked operation (as in
Independent banking enable 690 is generated in any suitable manner. For example, memory 600 is instantiable in different processors intended for distribution to server customers desiring higher reliability and gaming users desiring higher performance. In some cases, independent banking enable 690 is hard wired to the appropriate level in each processor to set memory 600 for banked or bit separation mode. In another example, memory 600 is instantiable in a processor that is intended for both server customers and gaming users. In some cases, independent banking enable 690 is permanently set to the appropriate value via fusing, or is made configurable by tying it to a suitable register or pin. In cases where banking enable 690 is made configurable, its value is settable, for example, in a basic input-output system (BIOS), dynamically by a software application, or in any other suitable manner.
Bank index 685 is generated in any suitable manner. For example, in some implementations, memory management hardware asserts the appropriate value of bank index 685 for a particular memory access. In some implementations, bank index 685 is a least significant bit, or other bit, of address 630 or 635, depending on which address is asserted for the current operation. In bit-separated operation, both address 630 and 635 will have the same value, as both of banks 610 and 620 must be accessed to recover data stored in bit separated manner across banks 610 and 620. In banked operation, address 630 and 635 will have different values, as different data from each of banks 610 and 620 is simultaneously accessible some implementations. The bank index 685 will be the same for both addresses however, since both addresses must indicate banked operation to read data from one bank.
It is noted that while memory 600 is configurable between a configuration with a banking of 2 and a bit separation of 2, and a configuration with no banking and a bit separation of 4, as described above, other implementations are configurable with different bankings and/or bit separations. For example, other implementations provide configurability between a configuration with a banking of 4 and a bit separation of 2, and a configuration with no banking and a bit separation of 8. In such implementations, the corresponding bank index would be 2 bits wide to accommodate selection among 4 banks, or of bits from among 8 different memory entries across the 4 banks. The independent banking enable signal would remain one bit wide however, to select between the two possible configurations (i.e., banked mode and bit separated mode).
Memory 700 stores memory entries in rows and columns of memory devices (e.g., RAM). In this example, memory 700 includes two banks 710, 720 of such memory devices. Memory 700 also includes row decoders 790, 795 and column demultiplexers 780, 785. Memory devices are selected for access (e.g., writing in this example) by addressing the row and column at which each of the desired memory devices are located in memory 700.
A memory device is writable, for example, by inputting address bits corresponding to a row or rows to row decoders 790, 795, and by inputting address bits corresponding to a column or columns to column input demultiplexers 780, 785. In this example, the address bits are portions of an address of a memory entry to be written to memory 700.
The address or portion of an address applied to row decoders 790, 795 is referred to as a row address, and the address or portion of an address applied to column input demultiplexers 780, 785 can be referred to as a column address. In this example, the bits of the row address set decoding circuitry in the row decoders 790, 795 to select a particular row or rows of banks 710 and 720 for writing, and the bits of the column address set demultiplexing circuitry in the column demultiplexers 780, 785 to select a particular column or columns of banks 710 and 720 for writing.
The information to be stored at the corresponding row and column in memory 700 (i.e., write data 799) is input to write drivers 797, 798, which are addressed to select either bank 710 or bank 720 for input. Write drivers 797, 798 are shown as two units merely for ease of description. It is noted that a corresponding write mask could alternately be described as a single unit which includes multiple write drivers, or could be described in terms of a plurality of separate write drivers. The address or portion of an address applied as a select signal to write drivers 797, 798 is referred to as a bank index. Because there are two banks in this example, the bank index is a single bit. However any suitable number of bits is usable in other implementations. In some implementations, the bank index is the least significant bit (LSB) of the address of the desired memory entry. Write drivers 797, 798 are located outside of memory 700 in this example. However in some implementations write drivers 797, 798 are located inside of memory 700.
To illustrate an example operation, it is desired to write the write data 799 as a memory entry 730, which is to be stored completely in even columns of a single row of bank 710, interleaved with other memory entries. A different memory entry 740 is stored completely in bank 720 (i.e., at column and row addresses corresponding to memory entry 730). In this example, a subset of address bits corresponding to the row address for memory entry 730 is input to row decoder 790 and a different subset of the address bits corresponding to the column address of memory entry 730 is input to column input demultiplexer 780. In this example, column input demultiplexers 780 include several 1:2 demultiplexers which each select either an odd column, or even column, of bank 710. Accordingly, the column address for memory entry 730 is used to set each demultiplexer of column input demultiplexers 780 to write to the even columns of bank 710, illustrated in
Because write data 799 is to be stored completely in bank 710 at memory entry 730, write data 799 is written to memory entry 730 by inputting a bank index as a select signal to write drivers 797, 798 which sets all of the demultiplexers of write drivers 797, 798 to input the information to be stored at memory entry 730 to bank 710 only. This is illustrated in
If it were instead desired to write the write data 799 to a memory entry in an increased bit-separation mode, at every other even column of bank 720, and the alternate even columns of bank 730 (similar to
Memory 800 includes bank 810 and bank 820. The rows and columns of banks 810 and 820 are both accessed by inputting a subset of the bits of memory address 830 or memory address 835 to row decoders and column multiplexers of banks 810 and 820 respectively.
Each of banks 810, 820 stores write data 899 to memory devices at memory lines and columns corresponding to address 830 and 835, respectively, via write drivers 840.
Write drivers 840 input write data 899 to either bank 810 or bank 820 (or both), depending on enable signals 860 and 870. Write drivers 840 are shown as two units merely for ease of description. It is noted that a corresponding write mask could alternately be described as a single unit which includes multiple write drivers, or could be described in terms of a plurality of separate write drivers.
Write driver select signals 860, 870 are generated by configuration circuitry 880 based on bank index signal 885, and independent banking enable (IBE) signal 890. In this example, bank index signal 885 is a subset of the address bits (e.g., one bit) of address 830 or address 835, depending on which address is being used in the operation. Independent banking enable signal 890 sets configuration circuitry 880 to use bank index signal 885 either as a bank select (as in the analogous banked read operation of
In this example, independent banking enable signal 890 sets memory 800 to operate in either a banked mode, or an increased bit separation mode. Because there are two modes in this example, independent banking enable signal 890 is one bit wide. Bank index 885 sets which bank is written to by write drivers 840 in conditions where independent banking enable signal 890 configures memory 800 to operate in banked mode, and sets which bits are written to corresponding row addresses of both bank 810 and bank 820 in conditions where independent banking enable signal 890 configures memory 800 to operate in increased bit separation mode. Because there are two banks in this example, bank index 885 is one bit wide. Table 1 illustrates the possible combinations of bank index signal 885 and independent banking enable signal 890.
TABLE 2
Write Drivers
Write Drivers
Independent
840 Input Even
840 Input Odd
Banking
Bank
Bits of Write
Bits of Write
Enable 890
Index 885
Data 899 to:
Data 899 to:
0
0
Bank 810
Bank 810
0
1
Bank 820
Bank 820
1
0
Bank 810
Bank 820
1
1
Bank 820
Bank 810
Table 2 illustrates that bank index 885 selects to which bank write data 899 is written for banked operation (as in the analogous read operation in
Independent banking enable 890 is generated in any suitable manner. For example, memory 800 is instantiable in different processors intended for distribution to server customers, desiring higher reliability, and gaming users, desiring higher performance. In some cases, independent banking enable 890 is hard wired to the appropriate level in each processor to set memory 800 for banked or bit separation mode. In another example, memory 800 is instantiable in a processor that is intended for both server customers and gaming users. In some cases, independent banking enable 890 is permanently set to the appropriate value via fusing, or is made configurable by tying it to a suitable register or pin. In cases where banking enable 890 is made configurable, its value is settable, for example, in a basic input-output system (BIOS), dynamically by a software application, or in any other suitable manner.
Bank index 885 is generated in any suitable manner. For example, in some implementations, memory management hardware asserts the appropriate value of bank index 885 for a particular memory access. In some implementations, bank index 885 is a least significant bit, or other bit, of address 830 or 835, depending on which address is asserted for the current operation. In bit-separated operation, both address 830 and 835 will have the same value, as both of banks 810 and 820 must be accessed to write data in bit separated manner across banks 810 and 820. In banked operation, address 830 and 835 will have different values, as different data is writable to each of banks 810 and 820 simultaneously in some implementations. The bank index 885 will be the same for both addresses however, since both addresses must indicate banked operation to read data from one bank.
It is noted that, typically, the configuration circuitry 880, including the output and input signal lines, is the same circuitry used for the corresponding read operations (i.e., is the same as configuration circuitry 680 as shown and described with respect to
It is noted that while memory 800 is configurable between a configuration with a banking of 2 and a bit separation of 2, and a configuration with no banking and a bit separation of 4, as described above, other implementations are configurable with different bankings and/or bit separations. For example, other implementations provide configurability between a configuration with a banking of 4 and a bit separation of 2, and a configuration with no banking and a bit separation of 8. In such implementations, the corresponding bank index would be 2 bits wide to accommodate selection among 4 banks, or of bits from among 8 different memory entries across the 4 banks. The independent banking enable signal would remain one bit wide however, to select between the two possible configurations (i.e., banked mode and bit separated mode).
For example,
Memory 900 includes bank 910 and bank 920. For read operations, read data 930 is read from bank 910, bank 920, or both, depending on whether memory 900 is operating in banked or bit-separated mode. For write operations, write data 970 is written to bank 910, bank 920, or both, depending on whether memory 900 is operating in banked or bit-separated mode.
To output read data 930 from bank 910 in banked mode (similar to the operation of
Similarly, to output read data 930 from bank 920 in banked mode, bits of address 960 are input to a row decoder and column multiplexers of bank 920, configuring bank 920 to output read data 930 from a subset of the data devices in bank 920 to bank multiplexers 945. Bank multiplexers are configured by configuration signals 950 to output read data 930 from bank 920 only, based on the banked mode of operation and a bit or bits of the address 960 corresponding to a bank index. In some implementations, different read data can be output from each bank simultaneously in banked mode.
To output read data 930 from banks 910, 920 in bit-separated mode (similar to the operation of
To input write data 970 to bank 910 in banked mode (similar to the operation of
Similarly, to input write data 970 to bank 920 in banked mode, bits of address 960 are input to a row decoder and column multiplexers of bank 920, configuring bank 920 to input write data 970 to a subset of the data devices in bank 920. A write mask 990, which includes various write drivers, is configured by configuration signals 950 to input write data 970 to bank 920 only, based on the banked mode of operation and a bit or bits of the address 960 corresponding to a bank index.
To input write data 970 to both banks 910, 920 in bit-separated mode (also described with respect to
It is noted that in various implementations, various components described herein are implemented, considered, or otherwise described as on or off the memory as desired. For example, write masks 980, 990, bank multiplexers 945, and configuration signals 950 can be considered to be a part of memory 900 as shown, or could be considered to be external to memory 900, either in fact (e.g., implemented on a separate die) and/or logically.
In step 1005, the memory is cleared as part of a system boot, memory flush, or another suitable action. In some implementations, this is performed in order to avoid corruption in data stored in the memory. In step 1010, an input configuration information is input to multiplexing circuitry (or any suitable selection circuitry as further described herein).
On a condition 1020 that the configuration information indicates bit-separated operation (e.g., by an independent banking enable signal as discussed herein), a memory address is input to the memory banks in step 1030, and data is read from the memory in a read mode, or written to the memory in a write mode, in step 1040. For read mode, read data is generated at step 1040 by combining a subset of the output data from each of the memory banks. For example, if there are two memory banks and a bit separation of 2, odd bits from one of the banks are combined with even bits of the other bank to generate the read data, and the read data is output from the memory. Which of the bits are combined are also based on the configuration information (e.g., the bank index as discussed herein). For write mode, write data is written to the memory in step 1040 by writing bits of the write data to appropriate locations in each of the memory banks. For example, if there are two memory banks and a bit separation of 2, odd bits of the write data are written to one of the memory banks, and even bits of the write data are written to the other memory bank. The appropriate locations in each of the memory banks are based on the configuration information, as discussed herein.
On condition 1045 that a mode change occurs from bit-separated operation to banked operation, the flow returns to step 1005 where memory is flushed. Otherwise, the flow returns to step 1030, where the next memory address is input to the memory banks. Without implying any other steps to be strictly necessary, it is noted that in some implementations the mode is set at boot time, or during manufacturing, and there is no run-time mode change condition 1045.
On condition 1020 that the configuration information does not indicate bit-separated operation (i.e., indicates a banked operation condition 1050, e.g., by an independent banking enable signal), a memory address is input to a subset of the memory banks (e.g., only one bank) in step 1060, and data is read from the memory in a read mode, or written to the memory in a write mode, in step 1070. For clarity, it is noted that since there are only two modes of operation (i.e., banked and bit-separated) condition 1050 always indicates banked operation on condition 1020 that the configuration indication does not indicate bit-separated operation. Accordingly, there is no negative condition to condition 1050. For read mode, in an example where there are two banks, read data is generated at step 1070 by selecting both even and odd bits from only one of the banks, and the read data is output from the memory. Which of the banks is read from is also based on the configuration information (e.g., a bank index as discussed herein). For write mode, write data is written to the memory in step 1070 by writing bits of the write data to even and odd bits in only one of the banks Which of the banks is written to is also based on the configuration information (e.g., a bank index as discussed herein).
On condition 1075 that a mode change occurs from banked operation to bit-separated operation, the flow returns to step 1005 where memory is flushed. Otherwise, the flow returns to step 1060, where the next memory address is input to the subset of the memory banks Without implying any other steps to be strictly necessary, it is noted that in some implementations the mode is set at boot time, or during manufacturing, and there is no run-time mode change condition 1075.
It should be understood that many variations are possible based on the disclosure herein. Although features and elements are described above in particular combinations, each feature or element can be used alone without the other features and elements or in various combinations with or without other features and elements.
The methods provided can be implemented in a general purpose computer, a processor, or a processor core. Suitable processors include, by way of example, a general purpose processor, a special purpose processor, a conventional processor, a digital signal processor (DSP), a plurality of microprocessors, one or more microprocessors in association with a DSP core, a controller, a microcontroller, Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) circuits, any other type of integrated circuit (IC), and/or a state machine. Such processors can be manufactured by configuring a manufacturing process using the results of processed hardware description language (HDL) instructions and other intermediary data including netlists (such instructions capable of being stored on a computer readable media). The results of such processing can be creating masks that are then used in a semiconductor manufacturing process to manufacture a processor which implements features of the disclosure.
The methods or flow charts provided herein can be implemented in a computer program, software, or firmware incorporated in a non-transitory computer-readable storage medium for execution by a general purpose computer or a processor. Examples of non-transitory computer-readable storage mediums include a read only memory (ROM), a random access memory (RAM), a register, cache memory, semiconductor memory devices, magnetic media such as internal hard disks and removable disks, magneto-optical media, and optical media such as CD-ROM disks, and digital versatile disks (DVDs).
Patent | Priority | Assignee | Title |
Patent | Priority | Assignee | Title |
5590134, | Aug 24 1992 | Texas Instruments Incorporated | Test circuits and method for integrated circuit having memory and non-memory circuits by accumulating bits of a particular logic state |
9584696, | Mar 24 2015 | DEUTSCHE BANK AG NEW YORK BRANCH, AS COLLATERAL AGENT | Imaging systems with embedded data transmission capabilities |
20070214335, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Nov 11 2019 | Advanced Micro Devices, Inc. | (assignment on the face of the patent) | / | |||
Nov 11 2019 | SCHREIBER, RUSSELL J | Advanced Micro Devices, INC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 051182 | /0484 |
Date | Maintenance Fee Events |
Nov 11 2019 | BIG: Entity status set to Undiscounted (note the period is included in the code). |
Date | Maintenance Schedule |
Mar 22 2025 | 4 years fee payment window open |
Sep 22 2025 | 6 months grace period start (w surcharge) |
Mar 22 2026 | patent expiry (for year 4) |
Mar 22 2028 | 2 years to revive unintentionally abandoned end. (for year 4) |
Mar 22 2029 | 8 years fee payment window open |
Sep 22 2029 | 6 months grace period start (w surcharge) |
Mar 22 2030 | patent expiry (for year 8) |
Mar 22 2032 | 2 years to revive unintentionally abandoned end. (for year 8) |
Mar 22 2033 | 12 years fee payment window open |
Sep 22 2033 | 6 months grace period start (w surcharge) |
Mar 22 2034 | patent expiry (for year 12) |
Mar 22 2036 | 2 years to revive unintentionally abandoned end. (for year 12) |