Systems and methods for upgrading qos levels of older transactions based on the presence of higher level qos transactions in a given queue. A counter may be maintained to track the number of transactions in a queue that are assigned a corresponding qos level. Each separate qos level can have a corresponding counter. When a transaction is received by the queue, the counter corresponding to the qos level of the transaction is incremented. When a transaction leaves the queue, the transaction is upgraded to the highest qos level with a non-zero counter. Also, when the transaction leaves the queue, the counter corresponding to the original qos level of the transaction is decremented.

Patent
   9053058
Priority
Dec 20 2012
Filed
Dec 20 2012
Issued
Jun 09 2015
Expiry
Apr 01 2033
Extension
102 days
Assg.orig
Entity
Large
5
122
currently ok
7. A method comprising:
selecting a first transaction for transmission out of a queue;
detecting an indication that there are one or more younger transactions in the queue that have a higher qos level than the first transaction;
upgrading a quality of service (qos) level of the first transaction responsive to detecting said indication; and
reading the first transaction out of the queue with the upgraded qos level.
20. An apparatus comprising:
a queue, wherein the queue is configured to store a plurality of transactions;
one or more counters, wherein each counter is configured to track a number of transactions in the queue at a corresponding quality of service (qos) level; and
wherein the apparatus is configured to upgrade a qos level of a given transaction selected for dequeueing responsive to determining a younger transaction enqueued in the queue has a higher qos level.
13. A method comprising:
maintaining a plurality of counters to track a number of transactions in a queue at each quality of service (qos) level of a plurality of qos levels;
selecting a given transaction in the queue for de-queuing, the given transaction having a first qos level;
identifying one or more of said counters with a non-zero value that correspond to qos levels higher than the first qos level; and
upgrading a qos level of the given transaction to a highest qos level that corresponds to the one or more counters.
1. A link interface unit comprising:
a queue, wherein the queue is configured to store a plurality of transactions; and
control logic, wherein the control logic is coupled to the queue, and wherein the control logic is configured to:
maintain a first counter to track a number of transactions with a first quality of service (qos) level that are stored in the queue; and
upgrade a qos level of a given transaction to the first qos level responsive to:
reading the given transaction out of the queue, wherein the given transaction has a qos level lower than the first qos level; and
determining a value of the first counter is non-zero.
2. The link interface unit as recited in claim 1, wherein the first qos level is a highest possible qos level.
3. The link interface unit as recited in claim 2, wherein the control logic is further configured to:
increment the first counter responsive to receiving a transaction with the first qos level at the queue; and
decrement the first counter responsive to reading a transaction with an original qos level equal to the first qos level out of the queue.
4. The link interface unit as recited in claim 3, wherein the control logic is further configured to:
maintain a second counter to track a number of transactions with a second qos level that are stored in the queue, wherein the second qos level is below the first qos level; and
upgrade a qos level of a given transaction to the second qos level responsive to:
reading the given transaction out of the queue, wherein the given transaction has a qos level lower than the second qos level;
determining a value of the second counter is non-zero; and
determining a value of the first counter is zero.
5. The link interface unit as recited in claim 2, wherein the link interface unit comprises a transmit unit and a receive unit, wherein the queue and the control logic are located in the receive unit, and wherein the receive unit is configured to forward the given transaction to a given agent after upgrading the qos level of the given transaction to the first qos level.
6. The link interface unit as recited in claim 1, wherein the control logic is further configured to upgrade the qos level of the given transaction to the first qos level responsive to receiving a sideband signal set to the first qos level.
8. The method as recited in claim 7, wherein transactions may be assigned any of a plurality of qos levels.
9. The method as recited in claim 8, wherein the plurality of qos levels include green, yellow, and red.
10. The method as recited in claim 8, further comprising maintaining a counter for each upper-level qos level, and wherein detecting said indication comprises checking if any counters corresponding to the upper-level qos levels have a non-zero value.
11. The method as recited in claim 10, further comprising incrementing a counter corresponding to a first upper-level qos level responsive to receiving a given transaction at the queue, wherein the given transaction is assigned the first upper-level qos level.
12. The method as recited in claim 11, further comprising decrementing the counter corresponding to the first upper-level qos level responsive to reading the given transaction out of the queue.
14. The method as recited in claim 13, further comprising incrementing a given counter responsive to receiving a transaction with a corresponding qos level at the queue.
15. The method as recited in claim 14, further comprising decrementing the given counter responsive to reading a transaction with an original qos level equal to the corresponding qos level out of the queue.
16. The method as recited in claim 15, wherein the queue is located in a receive unit of a first link interface unit.
17. The method as recited in claim 16, wherein the transaction received by the receive unit of the first link interface unit is sent from a transmit unit of a second link interface unit.
18. The method as recited in claim 13, further comprising:
receiving a first transaction with a first qos level at the queue;
incrementing a first counter corresponding to the first qos level;
reading the first transaction out of the queue;
upgrading the first transaction to a second qos level responsive to determining a second counter corresponding to the second qos level is non-zero; and
decrementing the first counter.
19. The method as recited in claim 18, wherein the second qos level is higher than the first qos level, and wherein the second counter corresponds to a highest qos level with a non-zero counter.
21. The apparatus as recited in claim 20, wherein each transaction is assigned a qos level.
22. The apparatus as recited in claim 21, wherein the apparatus is further configured to upgrade a qos level of a first transaction to a first qos level responsive to determining the first qos level is a highest qos level with a non-zero counter.
23. The apparatus as recited in claim 22, wherein a sideband signal is set to a qos level lower than the first qos level.
24. The apparatus as recited in claim 22, wherein a first counter corresponding to the first qos level remains the same and wherein a second counter corresponding to the qos level of the first transaction is decremented when the first transaction is read out of the queue.

1. Field of the Invention

The present invention relates generally to the field of computer systems, and in particular to methods and mechanisms for upgrading quality-of-service (QoS) levels of memory transactions.

2. Description of the Related Art

To prioritize some transactions over other transactions in the movement through a system on chip (SoC) fabric, a quality-of-service (QoS) mechanism may be implemented such that an agent generating a transaction may also provide information representing the QoS associated with that transaction. In a typical scenario, arbiters and queues in the path of a memory request or transaction containing QoS information should be capable of processing that information or forwarding the information to a subsequent circuit which is then capable of processing it. In addition, logic implemented in a SoC should be able to efficiently upgrade or push older transactions when younger transactions with a higher QoS level are waiting behind the older transactions. In some cases, transactions may be stored in a queue, and logic may be utilized to search the queue's existing transactions when a new transaction is received by the queue. However, repeating these searches every time a new transaction is received by the queue is inefficient in terms of power consumption.

Systems and methods for upgrading the QoS level of transactions in a queue are contemplated.

In one embodiment, a system on chip (SoC) may be configured to process transactions according to the QoS level of the transaction. The SoC may include one or more queues throughout the bus fabric of the SoC, and these queues may store a plurality of transactions that are traversing the SoC between various agents. Each queue may be configured to upgrade older transactions based on the presence of younger transactions with a higher QoS level in the queue.

In one embodiment, a transaction being read out of the queue may be upgraded by the presence of a younger transaction with a higher QoS level in the queue. Each transaction may include an assigned QoS level. As transactions are received by the queue, a counter may be incremented based on the QoS level of the transaction. There may be a counter for each possible QoS level. Then, when a transaction is being read out of the queue, the transaction may be upgraded to the highest QoS level with a non-zero counter value. Also, when the transaction is read out of the queue, the counter corresponding to the original QoS level of the transaction may be decremented. This mechanism allows the queue to avoid having to perform power-intensive searches for every new transaction that enters the queue.

These and other features and advantages will become apparent to those of ordinary skill in the art in view of the following detailed descriptions of the approaches presented herein.

The above and further advantages of the methods and mechanisms may be better understood by referring to the following description in conjunction with the accompanying drawings, in which:

FIG. 1 is a block diagram illustrating one embodiment of a portion of an integrated circuit (IC).

FIG. 2 is a block diagram of one embodiment of a pair of link interface units (LIUs).

FIG. 3 illustrates a pair of tables of QoS levels and pushed QoS field encodings.

FIG. 4 is a block diagram illustrating one embodiment of a portion of a receive unit within a link interface unit.

FIG. 5 is another block diagram illustrating one embodiment of a portion of a receive unit within a link interface unit.

FIG. 6 is a table showing how to escalate an original QoS level of a transaction in accordance with one embodiment.

FIG. 7 is a generalized flow diagram illustrating one embodiment of a method for determining whether to upgrade the QoS level of a transaction.

FIG. 8 is a block diagram of one embodiment of a system.

FIG. 9 is a block diagram of one embodiment of a computer readable medium.

In the following description, numerous specific details are set forth to provide a thorough understanding of the methods and mechanisms presented herein. However, one having ordinary skill in the art should recognize that the various embodiments may be practiced without these specific details. In some instances, well-known structures, components, signals, computer program instructions, and techniques have not been shown in detail to avoid obscuring the approaches described herein. It will be appreciated that for simplicity and clarity of illustration, elements shown in the figures have not necessarily been drawn to scale. For example, the dimensions of some of the elements may be exaggerated relative to other elements.

This specification includes references to “one embodiment”. The appearance of the phrase “in one embodiment” in different contexts does not necessarily refer to the same embodiment. Particular features, structures, or characteristics may be combined in any suitable manner consistent with this disclosure. Furthermore, as used throughout this application, the word “may” is used in a permissive sense (i.e., meaning having the potential to), rather than the mandatory sense (i.e., meaning must). Similarly, the words “include”, “including”, and “includes” mean including, but not limited to.

Terminology. The following paragraphs provide definitions and/or context for terms found in this disclosure (including the appended claims):

“Comprising.” This term is open-ended. As used in the appended claims, this term does not foreclose additional structure or steps. Consider a claim that recites: “An apparatus comprising a processor unit . . . . ” Such a claim does not foreclose the apparatus from including additional components (e.g., a memory device, input device, etc.).

“Configured To.” Various units, circuits, or other components may be described or claimed as “configured to” perform a task or tasks. In such contexts, “configured to” is used to connote structure by indicating that the units/circuits/components include structure (e.g., circuitry) that performs the task or tasks during operation. As such, the unit/circuit/component can be said to be configured to perform the task even when the specified unit/circuit/component is not currently operational (e.g., is not on). The units/circuits/components used with the “configured to” language include hardware—for example, circuits, memory storing program instructions executable to implement the operation, etc. Reciting that a unit/circuit/component is “configured to” perform one or more tasks is expressly intended not to invoke 35 U.S.C. §112, sixth paragraph, for that unit/circuit/component. Additionally, “configured to” can include generic structure (e.g., generic circuitry) that is manipulated by software and/or firmware (e.g., an FPGA or a general-purpose processor executing software) to operate in manner that is capable of performing the task(s) at issue. “Configured to” may also include adapting a manufacturing process (e.g., a semiconductor fabrication facility) to fabricate devices (e.g., integrated circuits) that are adapted to implement or perform one or more tasks.

“First,” “Second,” etc. As used herein, these terms are used as labels for nouns that they precede, and do not imply any type of ordering (e.g., spatial, temporal, logical, etc.). For example, in a memory controller having five ports, the terms “first” and “second” ports can be used to refer to any two of the five ports.

“Based On.” As used herein, this term is used to describe one or more factors that affect a determination. This term does not foreclose additional factors that may affect a determination. That is, a determination may be solely based on those factors or based, at least in part, on those factors. Consider the phrase “determine A based on B.” While B may be a factor that affects the determination of A, such a phrase does not foreclose the determination of A from also being based on C. In other instances, A may be determined based solely on B.

Referring now to FIG. 1, a block diagram illustrating one embodiment of a portion of an integrated circuit (IC) is shown. In the illustrated embodiment, IC 10 includes processor complex 20, level 0 fabric mux 18, level 1 fabric muxes 22A-N, masters 24, 26, 28, and 30, memory controller 16, and memory physical interface circuits (PHYs) 12 and 14. It is noted that IC 10 may also include many other components not shown in FIG. 1. In various embodiments, IC 10 may also be referred to as a system on chip (SoC), an application specific integrated circuit (ASIC), or an apparatus. Clock sources, such as phase lock loops (PLLs), and power sources are not shown for ease of illustration. Components shown within IC 10 may be coupled to each other using any suitable bus and/or interface mechanism.

Processor complex 20 may include any number of central processing units (CPUs) (not shown), a supporting cache hierarchy including a level two (L2) cache (not shown), and a variety of other components and logic. The CPU(s) of processor complex 20 may include circuitry to execute instructions defined in an instruction set architecture. Specifically, one or more programs comprising the instructions may be executed by the CPU(s). Any instruction set architecture may be implemented in various embodiments. For example, in one embodiment, the ARM™ instruction set architecture (ISA) may be implemented. The ARM instruction set may include 16-bit (or Thumb) and 32-bit instructions. Other exemplary ISA's may include the PowerPC™ instruction set, the MIPS™ instruction set, the SPARC™ instruction set, the x86 instruction set (also referred to as IA-32), the IA-64 instruction set, etc.

In various embodiments, level 0 fabric mux 18 and level 1 fabric muxes 22A-N may constitute a communication fabric (or fabric) for providing a top-level interconnect for IC 10. In various embodiments, different types of traffic may flow independently through the fabric. The independent flow may be accomplished by allowing a single physical fabric bus to include a number of overlaying virtual channels, or dedicated source and destination buffers, each carrying a different type of traffic. Each channel may be independently flow controlled with no dependence between transactions in different channels. In other embodiments, the fabric shown in FIG. 1 may include one or more other units, two or more units may be combined into a single unit, and/or one or more units may be omitted.

As shown in FIG. 1, communication between many of the components of IC 10 may be facilitated by link interface units (LIUs). LIUs may be interspersed throughout the fabric and logic of IC 10 in various locations. Each LIU may provide a point-to-point communications link between two agents in IC 10. The LIU may provide buffering and may manage the credit-based flow control mechanism for subchannels of traffic between the various agents of IC 10. As shown in FIG. 1, IC 10 may include the following LIU pairs, LIUs 32 and 34, 36 and 38, 40 and 42, 44 and 46, 48 and 50, and 52 and 54. In other embodiments, LIUs may be located in other components and/or one or more of the LIU pairs shown in FIG. 1 may be omitted. In one embodiment, the various LIUs of IC 10 may be identical to each other. In another embodiment, some of the LIUs within IC 10 may differ from other LIUs. For example, the size of buffers and the control logic within a LIU may be configured differently from other LIUs.

In various embodiments, IC 10 may also include circuitry in the fabric to ensure coherence among different masters and other I/O devices. This circuitry may include cache coherency logic employing a cache coherency protocol to ensure data accessed by each master is kept up to date. An example of a cache coherency protocol includes the MOESI protocol with the Modified (M), Owned (O), Exclusive (E), Shared (S), and Invalid (I) states.

Masters 24-30 are representative of any number and type of components which may be coupled to the fabric of IC 10. For example, masters 24-30 may include one or more cameras, flash controllers, display controllers, media controllers, graphics units, and/or other devices. Masters 24-30 are also representative of any number of I/O interfaces or devices and may provide interfaces to any type of peripheral device implementing any hardware functionality included in the system. For example, any of the masters 24-30 may connect to audio peripherals such as microphones, speakers, interfaces to microphones and speakers, audio processors, digital signal processors, mixers, etc. Other I/O devices may include interface controllers for various interfaces external to IC 10, including interfaces such as Universal Serial Bus (USB), peripheral component interconnect (PCI) including PCI Express (PCIe), serial and parallel ports, general-purpose I/O (GPIO), a universal asynchronous receiver/transmitter (uART), a FireWire interface, an Ethernet interface, an analog-to-digital converter (ADC), a DAC, and so forth. Other I/O devices may also include networking peripherals such as media access controllers (MACs).

Memory controller 16 may include any number of memory ports and may include circuitry configured to interface to memory. For example, memory controller 16 may be configured to interface to dynamic random access memory (DRAM) such as synchronous DRAM (SDRAM) (including mobile versions of the SDRAMs such as mDDR3, etc., and/or low power versions of the SDRAMs such as LPDDR2, etc.), RAMBUS DRAM (RDRAM), double data rate (DDR) SDRAM, DDR2 SDRAM, Rambus DRAM (RDRAM), static RAM (SRAM), GDDR4 (Graphics Double Data Rate, version 4) SDRAM, GDDR5 (Graphics Double Data Rate, version 5) SDRAM, etc. Memory controller 16 may also be coupled to memory physical interface circuits (PHYs) 12 and 14. Memory PHYs 12 and 14 are representative of any number of memory PHYs which may be coupled to memory controller 16. Memory PHYs 12 and 14 may be configured to interface to memory devices (not shown). Memory PHYs 12 and 14 may handle the low-level physical interface to the memory devices. For example, the memory PHYs 12 and 14 may be responsible for the timing of the signals, for proper clocking to synchronous DRAM memory, etc.

It is noted that other embodiments may include other combinations of components, including subsets or supersets of the components shown in FIG. 1 and/or other components. While one instance of a given component may be shown in FIG. 1, other embodiments may include two or more instances of the given component. Similarly, throughout this detailed description, two or more instances of a given component may be included even if only one is shown, and/or embodiments that include only one instance may be used even if multiple instances are shown. In addition, in other embodiments, the connections between components of IC 10 may differ from those shown in FIG. 1. For example, direct connections between components may be used for components that are not directly connected in FIG. 1, and components with direct connections in FIG. 1 may instead connect via one or more other components.

Turning now to FIG. 2, a block diagram of one embodiment of a pair of link interface units (LIUs) is shown. Agents 60 and 62 may be connected together and may communicate via LIU 64 and LIU 70. Each LIU may include a receive unit and a transmit unit. For example, LIU 64 may include transmit unit 66 and receive unit 68 and LIU 70 may include transmit unit 74 and receive unit 72. The receive units 68 and 72 may include buffering (not shown) and QoS upgrade logic (not shown) for upgrading the QoS levels of transactions that are being pushed by younger transactions with a higher QoS level.

The transmit units 66 and 74 may receive transactions from agents 60 and 62, respectively, and then transmit these transactions on the fabric link to the corresponding receive unit. Receive units 68 and 72 may receive transactions from the fabric link and then transmit these transactions to their host agent. The transmit units 66 and 74 may receive credits from receive units 72 and 74, respectively, and then the buffer management may be managed by receive units 72 and 74. The transmit units 66 and 74 may provide credit availability to the agents and the agents may arbitrate between the different virtual channels (VCs) accordingly.

Referring now to FIG. 3, a pair of tables 80 and 82 are shown illustrating a definition of a set of original QoS levels and a set of pushed QoS field encodings, respectively, for one embodiment. Other embodiments may include additional or substitute levels, and other embodiments may include additional levels in combination with a subset of the illustrated levels. As illustrated by the arrow pointing downward next to the table 80 in FIG. 2, the table 80 illustrates the QoS levels within a set in increasing priority. That is, the green QoS level is the lowest priority QoS level, the yellow QoS level is the medium priority QoS level, and the red QoS level is the highest priority QoS level. A source may assign a QoS level to a given transaction based on the priority of the given transaction.

Generally speaking, a transaction may comprise a memory request, and the term “memory request” is not limited to requests that are ultimately responded to by memory, but can also include requests that are satisfied by a cache. It is noted that the terms “memory request”, “transaction”, and “memory operation” may be used interchangeably throughout this disclosure.

The green, yellow, and red QoS levels may reflect relative levels of urgency from a source. That is, as the amount of time before data is needed by the source to prevent erroneous operation decreases, the QoS level assigned to each transaction increases to indicate the higher urgency. By treating transactions having higher urgency with higher priority, data may be returned to the source more quickly and may thus aid the correct operation of the source.

For example, a display pipe may initiate the reading of frame data from memory for the next frame to be displayed in the vertical blanking interval for the display. The frame is not actually displayed until the end of the vertical blanking interval, and thus the display pipe may use the green level during this time period. As the frame begins to be displayed (i.e. the display controller begins reading frame pixels from the display pipe output), the display pipe may raise the QoS level of frame data read operations to the memory to the yellow level. For example, if the amount of frame data that is read ahead of the current pixel being displayed reduces below a first threshold, the level may be raised to yellow. At a second threshold (lower than the first threshold), the display pipe may raise the QoS level of memory operations to red.

Transactions may be escalated from a low QoS level to a high QoS level based on a variety of criteria or triggers. When a transaction with an original low QoS level is escalated to a higher QoS level, the transaction may be assigned one of the QoS field encodings shown in table 82. For example, a transaction may be originally assigned a green QoS level, and this transaction may be pushed to a yellow QoS level somewhere along the path to its destination. Therefore, this transaction may be assigned a yellow pushing green (YPG) QoS field encoding. Similarly, if a transaction with an original QoS level of green is pushed to a red QoS level, this transaction may be assigned a red pushing green (RPG) QoS field encoding. Still further, if a transaction with an original QoS level of yellow is pushed to a red QoS level, this transaction may be assigned a red pushing yellow (RPY) QoS field encoding. In one embodiment, various arbiters within the bus fabric of the SoC may treat RPG and RPY transactions as the equivalent of red transactions. Also, arbiters may treat YPG transactions as the equivalent of yellow transactions.

It will be understood that the QoS levels shown in tables 80 and 82 of FIG. 3 are merely illustrative and should not be construed as implying any limitations upon the scope of the methods and mechanisms described herein. While the rest of this disclosure will be described in terms of transactions being assigned QoS levels from the tables 80 and 82, it is to be understood that other QoS schemes may be employed in other embodiments with more or fewer than three different QoS levels. Furthermore, other embodiments may represent the different QoS levels with designators other than colors.

Turning now to FIG. 4, a block diagram illustrating one embodiment of a portion of a receive unit within a link interface unit is shown. Receive unit 90 includes queue 92 and transaction counting logic implemented with counters 94 and 96. Receive unit 90 may also include other logic not shown in FIG. 4 for ease of illustration. Queue 92 is representative of any size of queue, with the capacity for storing any number of transactions. Yellow counter 94 may be configured to track the number of transactions in queue 92 which have a QoS level of yellow. The QoS level of yellow could be an original level of yellow or a pushed level of yellow. Red counter 96 may be configured to track the number of transactions in queue 92 which have a QoS level of red. The QoS level of red could be an original level of red or a pushed level of red.

Yellow counter 94 may be incremented whenever a transaction with a QoS attribute of yellow is received and stored in queue 92. Similarly, red counter 96 may be incremented whenever a transaction with a QoS attribute of red is received and stored in queue 92. Also, when a yellow QoS level transaction exits queue 92, yellow counter 94 may decrement. Likewise, when a red QoS level transaction exits queue 92, red counter 96 may decrement. In this way, yellow counter 94 and red counter 96 may stay up to date with an accurate count of the number of yellow transactions and red transactions, respectively, currently stored in queue 92. It is noted that yellow counter 94 will not be decremented if a green transaction is upgraded to yellow when leaving queue 92. Only transactions that had a yellow QoS level when they entered queue 92 will cause yellow counter 94 to be decremented when they leave queue 92. This property may also apply to red counter 96.

Referring now to FIG. 5, another block diagram of one embodiment of a portion of a receive unit of a link interface unit is shown. The receive unit 100 may include control logic for generating an effective QoS level for transactions that are being read out of a queue (not shown). In one embodiment, a sideband QoS signal may also be received by receive unit 100. However, in some embodiments, the sideband QoS signal may not be included. In one embodiment, each of the different color QoS levels may be represented by a unique encoding value, and the colors shown in FIG. 5 may represent their corresponding encoding value.

Logic unit 102 may determine if the yellow QoS counter (not shown) is non-zero or if the sideband QoS signal (SB_QoS) is set to yellow. If either of these cases is true, then logic unit 102 may generate a select signal for mux 106 to select the yellow QoS level. If both cases are false, then logic unit 102 may generate a select signal for mux 106 to select the green QoS level. Similarly, logic unit 104 may determine if the red QoS counter (not shown) is non-zero or if sideband QoS signal is set to red. If either of these cases is true, then logic unit 104 may generate a select signal for mux 108 to select the red QoS level. If both cases are false, then logic unit 104 may generate a select signal for mux 108 to select the QoS level output from mux 106. In one embodiment, the output of mux 108 may be coupled to register 110, and then the output of register 110 may be the effective QoS level of a transaction being read out of the queue. The effective QoS level may be coupled to an upgrade mechanism (not shown) for assigning the effective QoS level to a transaction leaving the queue. For other embodiments, with other numbers of QoS levels besides three, receive unit 100 may include additional logic units to determine if the other counters corresponding to these QoS levels are non-zero or if the sideband QoS signal is set to any of these other QoS levels.

When a transaction is read out of the queue, then the control logic shown in FIG. 5 may be activated to determine whether to upgrade the QoS level of the selected transaction. It is noted that the control logic shown in FIG. 5 is only one possible implementation of determining whether and how to upgrade the QoS level of a given transaction. In other embodiments, the logic may differ from that shown in FIG. 5. For example, in another embodiment, the sideband signal, the status of all upper level QoS level counters, and the current QoS level of the selected transaction may be inputs to a lookup table. The lookup table may generate an effective QoS level output which is equivalent to the output generated by the logic block diagram shown in FIG. 5. Also, in some embodiments, the logic shown in FIG. 5 may be implemented in software. Generally speaking, any combination of hardware and/or software may be utilized to implement a QoS level upgrade determination mechanism.

Turning now to FIG. 6, one embodiment of a table showing how to escalate an original QoS level of a transaction based on the calculated effective QoS level is shown. The left-most column of table 120, with the heading of “Original QoS”, represents the QoS level of a given transaction when the given transaction first entered the queue. This may differ from the actual source QoS level that was assigned to the transaction by the requesting agent responsible for generating the transaction. For example, in one scenario, a given transaction may have a source QoS level of green assigned by its requesting agent, but the given transaction may be pushed to yellow at some point in the path being traversed to the transaction's destination. After being pushed to a QoS level of yellow, if the given transaction is received and stored in a queue, the given transaction will be considered to have a QoS level of Push Yellow (PushY) rather than the original QoS level of green.

The three right-most columns designate the type of QoS level escalation that may be performed based on the status of the upper-level QoS level counters and sideband signal. The effective QoS level is equal to green (G) if all of the upper-level QoS level counters are zero and the sideband signal is not asserted. The effective QoS level is equal to yellow (Y) if the red QoS level counter is zero and if either (1) the yellow QoS level counter is non-zero or (2) the sideband signal is set to yellow. The effective QoS level is equal to red (R) if the red QoS level counter is non-zero or if the sideband signal is set to red.

Referring now to FIG. 7, one embodiment of a method 130 for determining whether to upgrade the QoS level of a transaction is shown. For purposes of discussion, the steps in this embodiment are shown in sequential order. It should be noted that in various embodiments of the method described below, one or more of the elements described may be performed concurrently, in a different order than shown, or may be omitted entirely. Other additional elements may also be performed as desired.

In one embodiment, a transaction may be selected for transmission from a queue (block 132). The queue may have any number of entries for storing any number of transactions. Each entry may store the transaction and the assigned QoS level of the transaction. Next, control logic may check the status of the counters for all QoS levels that are higher than the QoS level of the selected transaction, and the control logic may also check the status of the sideband signal (conditional block 134).

If there are no non-zero counters for QoS levels above the assigned QoS level of the transaction and the sideband signal is not asserted at a higher QoS level (conditional block 134, “no” leg), then the assigned QoS level of the transaction may remain the same (block 136). If there is a non-zero counter for a QoS level above the assigned QoS level of the transaction or if there is a received sideband signal at a higher QoS level (conditional block 134, “yes” leg), then the QoS level of the transaction may be upgraded to the QoS level of the highest non-zero counter or the sideband signal, whichever is highest (block 138). For example, in one scenario, using the QoS levels shown in tables 80 and 82 in FIG. 3, if the current QoS level of the transaction is green, if the highest non-zero counter is the yellow QoS level counter, and if the sideband signal is red, then the transaction may be upgraded to red.

Next, the transaction may be read out of the queue (block 140). Also, the counter corresponding to the original QoS level assigned to the transaction when it was enqueued may be decremented (block 142). For example, if a transaction had a QoS level of yellow upon entering the queue, and then the QoS level of the transaction was upgraded to red, the yellow counter may be decremented and the red counter may remain the same. After block 142, method 130 may end.

Turning now to FIG. 8, a block diagram of one embodiment of a system 150 is shown. As shown, system 150 may represent chip, circuitry, components, etc., of a desktop computer 160, laptop computer 170, tablet computer 180, cell phone 190, television 200 (or set top box configured to be coupled to a television), or otherwise. In the illustrated embodiment, the system 150 includes at least one instance of IC 10 (of FIG. 1) coupled to an external memory 152.

IC 10 is coupled to one or more peripherals 154 and the external memory 152. A power supply 156 is also provided which supplies the supply voltages to IC 10 as well as one or more supply voltages to the memory 152 and/or the peripherals 154. In various embodiments, power supply 156 may represent a battery (e.g., a rechargeable battery in a smart phone, laptop or tablet computer). In some embodiments, more than one instance of IC 10 may be included (and more than one external memory 152 may be included as well).

The memory 152 may be any type of memory, such as dynamic random access memory (DRAM), synchronous DRAM (SDRAM), double data rate (DDR, DDR2, DDR3, etc.) SDRAM (including mobile versions of the SDRAMs such as mDDR3, etc., and/or low power versions of the SDRAMs such as LPDDR2, etc.), RAMBUS DRAM (RDRAM), static RAM (SRAM), etc. One or more memory devices may be coupled onto a circuit board to form memory modules such as single inline memory modules (SIMMs), dual inline memory modules (DIMMs), etc. Alternatively, the devices may be mounted with IC 10 in a chip-on-chip configuration, a package-on-package configuration, or a multi-chip module configuration.

The peripherals 154 may include any desired circuitry, depending on the type of system 150. For example, in one embodiment, peripherals 154 may include devices for various types of wireless communication, such as wifi, Bluetooth, cellular, global positioning system, etc. The peripherals 154 may also include additional storage, including RAM storage, solid state storage, or disk storage. The peripherals 154 may include user interface devices such as a display screen, including touch display screens or multitouch display screens, keyboard or other input devices, microphones, speakers, etc.

Referring now to FIG. 9, one embodiment of a block diagram of a computer readable medium 210 including one or more data structures representative of the circuitry included in IC 10 (of FIG. 1) is shown. Generally speaking, computer readable medium 210 may include any non-transitory storage media such as magnetic or optical media, e.g., disk, CD-ROM, or DVD-ROM, volatile or non-volatile memory media such as RAM (e.g. SDRAM, RDRAM, SRAM, etc.), ROM, etc., as well as media accessible via transmission media or signals such as electrical, electromagnetic, or digital signals, conveyed via a communication medium such as a network and/or a wireless link.

Generally, the data structure(s) of the circuitry on the computer readable medium 210 may be read by a program and used, directly or indirectly, to fabricate the hardware comprising the circuitry. For example, the data structure(s) may include one or more behavioral-level descriptions or register-transfer level (RTL) descriptions of the hardware functionality in a high level design language (HDL) such as Verilog or VHDL. The description(s) may be read by a synthesis tool which may synthesize the description to produce one or more netlists comprising lists of gates from a synthesis library. The netlist(s) comprise a set of gates which also represent the functionality of the hardware comprising the circuitry. The netlist(s) may then be placed and routed to produce one or more data sets describing geometric shapes to be applied to masks. The masks may then be used in various semiconductor fabrication steps to produce a semiconductor circuit or circuits corresponding to the circuitry. Alternatively, the data structure(s) on computer readable medium 210 may be the netlist(s) (with or without the synthesis library) or the data set(s), as desired. In yet another alternative, the data structures may comprise the output of a schematic program, or netlist(s) or data set(s) derived therefrom. While computer readable medium 210 includes a representation of IC 10, other embodiments may include a representation of any portion or combination of portions of IC 10 (e.g., link interface unit 22).

It should be emphasized that the above-described embodiments are only non-limiting examples of implementations. Numerous variations and modifications will become apparent to those skilled in the art once the above disclosure is fully appreciated. It is intended that the following claims be interpreted to embrace all such variations and modifications.

Wong, Kevin C., Balkan, Deniz, Saund, Gurjeet S.

Patent Priority Assignee Title
10438275, Sep 28 2016 PayPal, Inc Method, medium, and system for managing de-queueing operations of transaction queues
10510108, Sep 28 2016 PayPal, Inc Method, medium, and system for managing queueing and de-queueing operations of transaction queues
10545701, Aug 17 2018 Apple Inc. Memory arbitration techniques based on latency tolerance
10885502, Sep 28 2016 PayPal, Inc Using disbursement signals at payment systems
11093887, Sep 28 2016 PayPal, Inc Managing disbursement signals at payment systems
Patent Priority Assignee Title
3311885,
5581703, Jun 29 1993 GOOGLE LLC Method and apparatus for reserving system resources to assure quality of service
5649110, Nov 07 1994 ENTERASYS NETWORKS, INC Traffic shaping system with virtual circuit table time stamps for asynchronous transfer mode networks
5742772, Nov 17 1995 Alcatel Lucent Resource management system for a broadband multipoint bridge
6047051, Nov 11 1996 Nokia Technologies Oy Implementation of charging in a telecommunications system
6092095, Jan 08 1996 Smart Link Ltd. Real-time task manager for a personal computer
6184906, Jun 30 1997 ATI Technologies, Inc. Multiple pipeline memory controller for servicing real time data
6295281, May 16 1997 HEWLETT-PACKARD DEVELOPMENT COMPANY, L P Symmetric flow control for ethernet full duplex buffered repeater
6324616, Nov 02 1998 HEWLETT-PACKARD DEVELOPMENT COMPANY, L P Dynamically inhibiting competing resource requesters in favor of above threshold usage requester to reduce response delay
6425060, Jan 05 1999 International Business Machines Corporation Circuit arrangement and method with state-based transaction scheduling
6597691, Sep 01 1998 CAVIUM INTERNATIONAL; MARVELL ASIA PTE, LTD High performance switching
6628609, Apr 30 1998 Nortel Networks Limited Method and apparatus for simple IP-layer bandwidth allocation using ingress control of egress bandwidth
6738881, Jun 09 1999 Texas Instruments Incorporated Multi-channel DMA with scheduled ports
6754179, Jun 13 2000 AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE LIMITED Real time control of pause frame transmissions for improved bandwidth utilization
6784890, Mar 02 1998 Intel Corporation Accelerated graphics port expedite cycle throttling control mechanism
6804757, Oct 12 2001 META PLATFORMS TECHNOLOGIES, LLC Method and apparatus for scheduling requests using ordered stages of scheduling criteria
6859438, Feb 03 1998 ARISTA NETWORKS, INC Policy based quality of service
6947970, Dec 19 2000 Intel Corporation; Intel Corp Method and apparatus for multilevel translation and protection table
6965563, Sep 28 2000 Western Digital Technologies, INC Resource reservation system in a computer network to support end-to-end quality-of-service constraints
7017020, Jul 16 1999 AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE LIMITED Apparatus and method for optimizing access to memory
7047366, Jun 17 2003 EMC IP HOLDING COMPANY LLC QOS feature knobs
7145904, Jan 03 2002 Integrated Device Technology, inc Switch queue predictive protocol (SQPP) based packet switching technique
7146468, Apr 24 2002 IP-First, LLC. Cache memory and method for handling effects of external snoops colliding with in-flight operations internally to the cache
7155554, Nov 02 2004 META PLATFORMS TECHNOLOGIES, LLC Methods and apparatuses for generating a single request for block transactions over a communication fabric
7161904, Jun 04 2002 GOOGLE LLC System and method for hierarchical metering in a virtual router based network switch
7274700, May 18 2002 Electronics and Telecommunications Research Institute Router providing differentiated quality of service (QoS) and fast internet protocol packet classifying method for the router
7277975, Nov 02 2004 META PLATFORMS TECHNOLOGIES, LLC Methods and apparatuses for decoupling a request from one or more solicited responses
7293136, Aug 19 2005 EMC IP HOLDING COMPANY LLC Management of two-queue request structure for quality of service in disk storage systems
7346063, Jul 08 1998 AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE LIMITED Memory management unit for a network switch
7350028, May 21 1999 Intel Corporation Use of a translation cacheable flag for physical address translation and memory protection in a host
7353310, May 09 2003 Invensas Corporation Hierarchical memory access via pipelining with deferred arbitration
7469309, Dec 12 2005 Nvidia Corporation Peer-to-peer data transfer method and apparatus with request limits
7480304, Dec 29 2004 Alcatel Lucent Predictive congestion management in a data communications switch using traffic and system statistics
7496777, Oct 12 2005 Oracle America, Inc Power throttling in a memory system
7535898, Nov 06 2003 Intel Corporation Distributed switch memory architecture
7539143, Aug 11 2003 NetApp, Inc Network switching device ingress memory system
7548545, Dec 14 2007 NANT HOLDINGS IP, LLC Disaggregated network management
7562213, Sep 16 2003 Cisco Technology, Inc. Approaches for applying service policies to encrypted packets
7570651, Jun 16 2004 Intel Corporation High-performance reconfigurable interconnect for concurrent operation of multiple systems
7593329, Oct 29 2004 AVAGO TECHNOLOGIES GENERAL IP SINGAPORE PTE LTD Service aware flow control
7596139, Nov 17 2000 AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE LIMITED Backplane interface adapter with error control and redundant fabric
7621162, Dec 30 2003 Alcatel Lucent Hierarchical flow-characterizing multiplexor
7647444, Mar 13 2007 Oracle America, Inc Method and apparatus for dynamic hardware arbitration
7653069, Dec 30 2005 Intel Corporation Two stage queue arbitration
7660931, May 18 2001 Broadcom Corporation System on a chip for networking
7675925, Apr 01 1998 Mosaid Technologies Incorporated Method and apparatus for providing a packet buffer random access memory
7675926, May 05 2004 Cisco Technology, Inc. Hierarchical QoS behavioral model
7715377, Jan 03 2002 Integrated Device Technology, Inc. Apparatus and method for matrix memory switching element
7716395, Dec 29 2006 Intel Corporation Low latency mechanism for data transfers between a media controller and a communication device
7725657, Mar 21 2007 TAHOE RESEARCH, LTD Dynamic quality of service (QoS) for a shared cache
7801045, Jun 19 2007 WSOU Investments, LLC Hierarchical rate limiting with proportional limiting
7948883, Jul 12 2007 Cisco Technology, Inc Applying router quality of service on a cable modem interface on a per-service-flow basis
7979552, Feb 13 2004 Oracle International Corporation Programmatic instantiation, provisioning, and management of fabric-backplane enterprise servers
7990858, Apr 27 2006 AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE LIMITED Method, device and system of scheduling data transport over a fabric
8074028, Mar 12 2007 Citrix Systems, Inc Systems and methods of providing a multi-tier cache
8077608, Jan 17 2006 Marvell Israel (M.I.S.L.) Ltd. Quality of service marking techniques
8218538, Feb 13 2004 Oracle International Corporation Storage gateway configuring and traffic processing
8314807, Sep 16 2010 Apple Inc. Memory controller with QoS-aware scheduling
8493863, Jan 18 2011 Apple Inc. Hierarchical fabric control circuits
8607022, Dec 17 2010 Apple Inc. Processing quality-of-service (QoS) information of memory transactions
8631213, Sep 16 2010 Apple Inc.; Apple Inc Dynamic QoS upgrading
8649286, Jan 18 2011 Apple Inc. Quality of service (QoS)-related fabric control
20020095498,
20020181395,
20030093633,
20030202517,
20040017820,
20040081093,
20040141516,
20040210695,
20040246891,
20050052992,
20050060456,
20050081009,
20050141427,
20050246441,
20050249220,
20060013133,
20060029089,
20060064494,
20060092944,
20060104298,
20060140119,
20070011396,
20070109968,
20070294418,
20080069125,
20080159129,
20080181234,
20080192764,
20080215786,
20080244135,
20080298397,
20080316921,
20080320254,
20090010152,
20090043920,
20090070771,
20090147731,
20090172318,
20090207866,
20090228535,
20090279559,
20090287865,
20090323540,
20100049913,
20100278195,
20100318713,
20110110237,
20110173393,
20110197038,
20110276972,
20110302345,
20120063313,
20120072678,
20120124591,
20120185062,
20120265937,
20130054766,
20130132682,
20130159633,
CN101419579,
////
Executed onAssignorAssigneeConveyanceFrameReelDoc
Dec 13 2012BALKAN, DENIZApple IncASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS 0295300357 pdf
Dec 13 2012WONG, KEVIN C Apple IncASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS 0295300357 pdf
Dec 18 2012SAUND, GURJEET S Apple IncASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS 0295300357 pdf
Dec 20 2012Apple Inc.(assignment on the face of the patent)
Date Maintenance Fee Events
May 14 2015ASPN: Payor Number Assigned.
Nov 22 2018M1551: Payment of Maintenance Fee, 4th Year, Large Entity.
Nov 23 2022M1552: Payment of Maintenance Fee, 8th Year, Large Entity.


Date Maintenance Schedule
Jun 09 20184 years fee payment window open
Dec 09 20186 months grace period start (w surcharge)
Jun 09 2019patent expiry (for year 4)
Jun 09 20212 years to revive unintentionally abandoned end. (for year 4)
Jun 09 20228 years fee payment window open
Dec 09 20226 months grace period start (w surcharge)
Jun 09 2023patent expiry (for year 8)
Jun 09 20252 years to revive unintentionally abandoned end. (for year 8)
Jun 09 202612 years fee payment window open
Dec 09 20266 months grace period start (w surcharge)
Jun 09 2027patent expiry (for year 12)
Jun 09 20292 years to revive unintentionally abandoned end. (for year 12)