An example method for a first host to perform traffic replication in a software-defined networking (SDN) environment may include obtaining control information that includes a first identifier associated with a first replication domain to which the first host and a second host are assigned, and a second identifier associated with a second replication domain to which a third host is assigned. In response to detecting, from a virtualized computing instance, a packet that requires replication, the method also includes, generating a first encapsulated packet by encapsulating the packet with a first outer header that includes the first identifier, generating a second encapsulated packet by encapsulating the packet with a second outer header that includes the first identifier or the second identifier, and sending the first encapsulated packet to the second host, and the second encapsulated packet to third host to cause the third host to perform replication within the second replication domain.
|
1. A method for a first host to perform traffic replication in a software-defined networking (SDN) environment that includes the first host, a second host and a third host, wherein the method comprises:
obtaining control information that includes a first identifier associated with a first replication domain to which the first host and the second host are assigned, and a second identifier associated with a second replication domain to which the third host is assigned; and
in response to detecting, from a virtualized computing instance, a packet that requires replication,
based on the control information, generating a first encapsulated packet by encapsulating the packet with a first outer header that is addressed to the second host and includes the first identifier;
based on the control information, generating a second encapsulated packet by encapsulating the packet with a second outer header that is addressed to the third host and includes the first identifier or the second identifier; and
sending the first encapsulated packet to the second host, and the second encapsulated packet to third host to cause the third host to perform replication within the second replication domain.
8. A non-transitory computer-readable storage medium that includes a set of instructions which, in response to execution by a processor of a first host, cause the processor to perform a method of traffic replication in a software-defined networking (SDN) environment that includes the first host, a second host and a third host, wherein the method comprises:
obtaining control information that includes a first identifier associated with a first replication domain to which the first host and the second host are assigned, and a second identifier associated with a second replication domain to which the third host is assigned; and
in response to detecting, from a virtualized computing instance, a packet that requires replication,
based on the control information, generating a first encapsulated packet by encapsulating the packet with a first outer header that is addressed to the second host and includes the first identifier;
based on the control information, generating a second encapsulated packet by encapsulating the packet with a second outer header that is addressed to the third host and includes the first identifier or the second identifier; and
sending the first encapsulated packet to the second host, and the second encapsulated packet to third host to cause the third host to perform replication within the second replication domain.
15. A first host configured to perform traffic replication in a software-defined networking (SDN) environment that includes the first host, a second host and a third host, wherein the first host comprises:
a processor; and
a non-transitory computer-readable medium having stored thereon instructions that, when executed by the processor, cause the processor, and perform the following:
obtain control information that includes a first identifier associated with a first replication domain to which the first host and the second host are assigned, and a second identifier associated with a second replication domain to which the third host is assigned; and
in response to detecting, from a virtualized computing instance, a packet that requires replication,
based on the control information, generate a first encapsulated packet by encapsulating the packet with a first outer header that is addressed to the second host and includes the first identifier;
based on the control information, generate a second encapsulated packet by encapsulating the packet with a second outer header that is addressed to the third host and includes the first identifier or the second identifier; and
send the first encapsulated packet to the second host, and the second encapsulated packet to third host to cause the third host to perform replication within the second replication domain.
2. The method of
configuring the second outer header of the second encapsulated packet to include a source virtual tunnel endpoint (VTEP) address associated with the first host and a destination VTEP address associated with the third host, wherein both the source VTEP address and the destination VTEP address are associated with a same subnet.
3. The method of
configuring the second outer header of the second encapsulated packet to include a replicate flag that indicates to the third host that replication within the second replication domain is required, and an identifier associated with a logical overlay network on which the virtualized computing instance is located.
4. The method of
configuring the first outer header of the first encapsulated packet to include a source VTEP address associated with the first host and a destination VTEP address associated with the second host, wherein both the source VTEP address and the destination VTEP address are associated with different subnets.
5. The method of
receiving the control information from a network management entity that is configured to assign, based on an assignment policy, the first host and the second host to the first replication domain and the third host to the second replication domain.
6. The method of
assigning a higher priority to the second encapsulated packet compared to the first encapsulated packet by sending the second encapsulated packet to the third host prior to sending the first encapsulated packet to the second host.
7. The method of
determining that the packet requires replication based on an inner header of the packet that is addressed to a destination address associated with multiple recipients, or an unknown recipient.
9. The non-transitory computer-readable storage medium of
configuring the second outer header of the second encapsulated packet to include a source virtual tunnel endpoint (VTEP) address associated with the first host and a destination VTEP address associated with the third host, wherein both the source VTEP address and the destination VTEP address are associated with a same subnet.
10. The non-transitory computer-readable storage medium of
configuring the second outer header of the second encapsulated packet to include a replicate flag that indicates to the third host that replication within the second replication domain is required, and an identifier associated with a logical overlay network on which the virtualized computing instance is located.
11. The non-transitory computer-readable storage medium of
configuring the first outer header of the first encapsulated packet to include a source VTEP address associated with the first host and a destination VTEP address associated with the second host, wherein both the source VTEP address and the destination VTEP address are associated with different subnets.
12. The non-transitory computer-readable storage medium of
receiving the control information from a network management entity that is configured to assign, based on an assignment policy, the first host and the second host to the first replication domain and the third host to the second replication domain.
13. The non-transitory computer-readable storage medium of
assigning a higher priority to the second encapsulated packet compared to the first encapsulated packet by sending the second encapsulated packet to the third host prior to sending the first encapsulated packet to the second host.
14. The non-transitory computer-readable storage medium of
determining that the packet requires replication based on an inner header of the packet that is addressed to a destination address associated with multiple recipients, or an unknown recipient.
16. The first host of
configure the second outer header of the second encapsulated packet to include a source virtual tunnel endpoint (VTEP) address associated with the first host and a destination VTEP address associated with the third host, wherein both the source VTEP address and the destination VTEP address are associated with a same subnet.
17. The first host of
configure the second outer header of the second encapsulated packet to include a replicate flag that indicates to the third host that replication within the second replication domain is required, and an identifier associated with a logical overlay network on which the virtualized computing instance is located.
18. The first host of
configure the first outer header of the first encapsulated packet to include a source VTEP address associated with the first host and a destination VTEP address associated with the second host, wherein both the source VTEP address and the destination VTEP address are associated with different subnets.
19. The first host of
receive the control information from a network management entity that is configured to assign the first host and the second host to the first replication domain and the third host to the second replication domain based on an assignment policy.
20. The first host of
assign a higher priority to the second encapsulated packet compared to the first encapsulated packet by sending the second encapsulated packet to the third host prior to sending the first encapsulated packet to the second host.
21. The first host of
determine that the packet requires replication based on an inner header of the packet that is addressed to a destination address associated with multiple recipients, or an unknown recipient.
|
The present application claims the benefit of U.S. Provisional Application No. 62/574,208, filed Oct. 19, 2017, which is incorporated herein by reference in its entirety.
Unless otherwise indicated herein, the approaches described in this section are not admitted to be prior art by inclusion in this section.
Virtualization allows the abstraction and pooling of hardware resources to support virtual machines in a Software-Defined Networking (SDN) environment, such as a Software-Defined Data Center (SDDC). For example, through server virtualization, virtual machines running different operating systems may be supported by the same physical machine (e.g., referred to as a “host”). Each virtual machine is generally provisioned with virtual resources to run an operating system and applications. The virtual resources may include central processing unit (CPU) resources, memory resources, storage resources, network resources, etc.
Through SDN, benefits similar to server virtualization may be derived for networking services. For example, logical overlay networks that are decoupled from the underlying physical network infrastructure may be provided. The logical overlay networks may be provisioned, changed, stored, deleted and restored programmatically without having to reconfigure the underlying physical hardware architecture, thereby improving network utilization and facilitating configuration automation. In practice, traffic replication may be performed by a host in the SDN environment when handling broadcast, unknown unicast and multicast (BUM) traffic, etc. However, traffic replication generally creates a lot of burden on the computing and network resources in the SDN environment.
In the following detailed description, reference is made to the accompanying drawings, which form a part hereof. In the drawings, similar symbols typically identify similar components, unless context dictates otherwise. The illustrative embodiments described in the detailed description, drawings, and claims are not meant to be limiting. Other embodiments may be utilized, and other changes may be made, without departing from the spirit or scope of the subject matter presented here. It will be readily understood that the aspects of the present disclosure, as generally described herein, and illustrated in the drawings, can be arranged, substituted, combined, and designed in a wide variety of different configurations, all of which are explicitly contemplated herein.
Challenges relating to traffic replication will now be explained in more detail using
In the example in
Referring also to
Hypervisor 112A further implements virtual switch 114A and logical distributed router (DR) instance 115A to handle egress packets from, and ingress packets to, virtual machines such as VM1 131. In practice, logical switches and logical distributed routers may be implemented in a distributed manner and can span multiple hosts 110A-H to connect virtual machines 131-138. Referring also to logical view 102 in
Virtual machines 131-138 send and receive packets via respective logical ports 141-148. As used herein, the term “logical port” may refer generally to a port on a logical switch to which a virtualized computing instance is connected. A “logical switch” (e.g., 140) may refer generally to an SDN construct that is collectively implemented by virtual switches of hosts 110A-H, whereas a “virtual switch” (e.g., 114A) may refer generally to a software switch or software implementation of a physical switch. In practice, there is usually a one-to-one mapping between a logical port on a logical switch and a virtual port on a virtual switch. However, the mapping may change in some scenarios, such as when the logical port is mapped to a different virtual port on a different virtual switch after migration of the corresponding virtualized computing instance (e.g., when the source and destination hosts do not have a distributed virtual switch spanning them).
Although examples of the present disclosure refer to virtual machines, it should be understood that a “virtual machine” running on a host is merely one example of a “virtualized computing instance” or “workload.” A virtualized computing instance may represent an addressable data compute node or isolated user space instance. In practice, any suitable technology may be used to provide isolated user space instances, not just hardware virtualization. Other virtualized computing instances may include containers (e.g., running within a VM or on top of a host operating system without the need for a hypervisor or separate operating system or implemented as an operating system level virtualization), virtual private servers, client computers, etc. Such container technology is available from, among others, Docker, Inc. Example containers will be discussed further using
As used herein, the term “hypervisor” may refer generally to a software layer or component that supports the execution of multiple virtualized computing instances, including system-level software in guest virtual machines that supports namespace containers such as Docker, etc. The term “packet” may refer generally to a group of bits that can be transported together from a source to a destination, such as message, segment, datagram, etc. The term “traffic” may refer generally to one or more packets. The term “layer-2” may refer generally to a Media Access Control (MAC) layer; “layer-3” to a network or Internet Protocol (IP) layer; and “layer-4” to a transport layer (e.g., using transmission control protocol (TCP) or user datagram protocol (UDP)) in the Open System Interconnection (OSI) model, although the concepts described herein may be used with other networking models.
SDN environment 100 further includes SDN controller 160 and SDN manager 170 are example network management entities that facilitate implementation of software-defined (e.g., logical overlay) networks. One example of an SDN controller is the NSX controller component of VMware NSX® (available from VMware, Inc.) that operates on a central control plane (also referred as “control plane”). SDN controller 160 may be a member of a controller cluster (not shown for simplicity) that is configurable using SDN manager 170 operating on a management plane. Network management entity 160/170 may be implemented using physical machine(s), virtual machine(s), or both. Logical switches, logical routers, and logical overlay networks may be configured using SDN controller 160, SDN manager 170, etc.
A logical overlay network (also known as “logical network”) may be formed using any suitable tunneling protocol, such as Virtual eXtensible Local Area Network (VXLAN), Stateless Transport Tunneling (STT), Generic Network Virtualization Encapsulation (GENEVE), etc. For example, VXLAN is a layer-2 overlay scheme on a layer-3 network that uses tunnel encapsulation to extend layer-2 segments across multiple hosts. In the example in
Hosts 110A-H may maintain data-plane connectivity with each other to facilitate communication among virtual machines 131-138. For example, hypervisor 112A-H may each implement a virtual tunnel endpoint (VTEP) to encapsulate and decapsulate packets with an outer header (also known as a tunnel header) identifying the relevant logical overlay network (e.g., VNI=5001). This way, hypervisors 112A-H may “participate” in the logical overlay network and handle traffic to and from virtual machines 131-138. For example in
In practice, traffic replication is performed in SDN environment 100 when, for example, handling broadcast, unknown unicast and multicast (BUM) packets. One type of broadcast traffic is address resolution traffic. In practice, address resolution refers to the process of resolving a protocol address (e.g., IP address) to a hardware address (e.g., MAC address). For example, address resolution may be required when a source wishes to communicate with a destination. To learn the hardware address of the destination, the source broadcasts a address resolution request that includes a known protocol address of the destination. In response, the destination will send a response that includes its hardware address. Other recipients are not required to respond to the broadcasted request message. For example in
Conventionally, host-A 110A performs replication by sending the address resolution request to other hosts 110B-H supporting respective virtual machines 132-138 connected to logical switch 140. For example, to reach VM2 132 on host-B 110B, host-A 110A generates an encapsulated packet by encapsulating the ARP request with an outer header addressed to host-B 110B. To reach VM3 133 on host-C 110C, host-A 110A generates another encapsulated packet by encapsulating the ARP request with an outer header addressed to host-C 110C. This is repeated for host-D 110D, host-E 110E, host-F 110F, host-G 110G and host-H 110H. Once VM3 133 responds, VM1 131 caches the MAC address=MAC-3 of VM3 133 in a table entry, which expires if VM1 131 does not communicate with VM3 133 within a predefined period of time. After the table entry expires, VM1 131 will have to repeat the above process to relearn the MAC address of VM3 133. The address resolution process may be performed by other virtual machines in a similar manner.
The above conventional approach is undesirable because, inter alia, it creates a burst of traffic that may overload the resources of host-A 110A and physical network 105. For example, hardware resources (e.g., physical NIC(s) 124A) may be overloaded when host-A 110A generates and sends replicated traffic to a large number of hosts. This also adversely affects the performance of other virtual machines (not shown for simplicity) supported by host-A 110A, as well as that of other users of physical network 105. These problems are exacerbated when a particular source host supports a large number of virtual machines and/or there are tens and hundreds of destination hosts to which traffic is replicated. Similar problems are observed for multicast and unknown unicast traffic.
Replication Domains
According to examples of the present disclosure, traffic replication may be improved by assigning hosts 110A-H to various replication domains 181-183. The term “replication domain” may refer generally to a group of one or more hosts (each supporting a VTEP) to which traffic is replicated, thereby limiting the scope of traffic replication in SDN environment 100. This improves scalability and efficiency of traffic replication, especially when there is a large number of hosts in SDN environment 100. As will be discussed further below, traffic replication may be performed without necessitating host-A 110A to send encapsulated packets to every other host in
In more detail,
At 310 in
Some examples will be explained with
In response to detecting a packet from VM1 131 that requires replication on a logical overlay network (e.g., VXLAN5001), host-A 110A generates and sends encapsulated packets to host-B 110B (see 191) and host-C 110C (see 192), respectively. Further, host-A 110A generates and sends an encapsulated packet to host-D 110D (see 193) to cause host-D 110D to perform replication within second replication domain 182. This way, it is not necessary for host-A 110A to send any encapsulated packet to host-E 110E in second replication domain 182.
In practice, any suitable number of replication domains may be configured in SDN environment 100. For example in
According to examples of the present disclosure, the flexibility of replication domain assignment may be improved using identifiers to identify various replication domains 181-183. In this case, hosts assigned to the same replication domain may be associated with the same VTEP IP subnet, or different VTEP IP subnets. In the example in
Additionally or alternatively, hosts associated with the same VTEP IP subnet may be assigned to different replication domains. In the example in
In the following, various examples will be discussed using
Configuration of Replication Domains
At 410 in
Depending on the desired implementation, the assignment policy may be a static or dynamic policy that assigns a host to a particular replication domain based on the host's name; the host's location; IP address information of a VTEP implemented by the host; amount of BUM traffic generated by the host, etc. For example, a location-dependent assignment policy may assign hosts associated with the same location (e.g., chassis, rack, pod, data center, etc.) to the same replication domain. If the number of hosts located at the same location exceeds a predetermined threshold, the hosts may distributed among multiple replication domains. In practice, a chassis may refer to an enclosure in which one or more hosts are mounted (e.g., depending on the vendor's specification). A rack (e.g., server rack) may include one or more chassis stacked to make efficient use of space and position within a pod. A pod may be a modular unit of datacenter with a set of resources or infrastructure to service one or more racks. A datacenter may be a collection of hosts housed in one or more pods, racks and chassis.
In another example, the assignment policy may dynamically assign or reassign a host to a particular replication domain based on the amount of BUM traffic generated by the host over a period of time. This way, the number of replication domains configured in SDN environment 100 and the number of hosts assigned to each replication domain may be dynamically updated over time to improve or optimize traffic replication efficiency. This also improves flexibility and scalability without necessitating all member VTEPs from the same IP subnet to be assigned to the same replication domain.
At 420 in
At 430 in
At 440 and 450, SDN controller 160 generates and sends control information to hosts 110A-H to configure hosts 110A-H to perform traffic replication based on the control information. Some examples will be explained using
As exemplified in
In relation to URD2, host-C 110C and host-D 110D are associated with the first VTEP IP subnet (i.e., same as host-A 110A). In relation to URD3, host-E 110E, host-F 110F and host-G 110G are associated with a third VTEP IP subnet=10.40.10.0/24. Control information 500 further indicates the RTEP selected to perform traffic replication in each replication domain. For example in
At 460 and 470 in
Depending on the desired implementation, the selection at block 430 in
Based on the control information defining the scope of each URDi, hosts 110A-H may then select the RTEPi for URDi, where i=1, . . . , N. For example, for URD2, host-A 110A then select either host-D 110D or host-E 110E to be the RTEP. Further, for URD3, the selected RTEP may be host-F 110F, host-G 110G or host-F 110F. After the selection process, host-A 110A may then update the control information in
In practice, any suitable fault tolerance mechanism may be implemented with the examples of the present disclosure. For example, when an RTEP is down or becomes non-responsive due to a fault (e.g., hardware/software fault, network fault, power fault, etc.), a new RTEP may be selected. Consider an example scenario where there is a fault associated with host-D 110D (i.e., current RTEP selected by SDN controller 180 or host-A 110A). In this case, host-A 110A may identify that host-E 110E is also assigned to URD2 based on the control information, and selects host-E 110E to be the new RTEP. Other hosts 110B-H may perform the RTEP selection and/or re-selection in a similar manner. Alternatively, the new RTEP may be selected by SDN controller 180.
Traffic Replication
In practice, example process 600 may be implemented using hosts 110A-H, such as using respective hypervisors 112A-H (or more particularly traffic replication module), etc. In the following, various examples will be explained using host-A 110A as a “first host,” host-B 110B and host-C 110C as “second hosts,” host-D 110D and host-F 110F as “third hosts,” host-E 110E, host-G 110G and host-H 110H as “fourth hosts,” and SDN controller 160 as a “network management entity.” Traffic replication within replication domains 181-183 will be discussed in turn below.
(a) First Replication Domain: Host-A 110A
At 605, 610 and 615 in
In a broadcast scenario, packet 710 may be an address resolution request with MAC-BUM=FF:FF:FF:FF:FF:FF (i.e., broadcast MAC address). In IP-based networks, address resolution may be performed using Address Resolution Protocol (ARP) for IP version 4 (IPv4) addresses or Neighbor Discovery Protocol (NDP) for IP version 6 (IPv6) addresses. Depending on the address resolution protocol, packet 710 may be an ARP request (using ARP for IPv4), neighbor solicitation message (using NDP for IPv6), etc. In an unknown unicast scenario, packet 710 may be addressed to MAC-BUM that is unknown to host-A 110A, which causes packet 710 to be flooded on VXLAN5001.
In a multicast scenario, packet 710 may be a multicast packet with IP-BUM=IP-M (i.e., multicast group IP address) and MAC-BUM=MAC-M (i.e., multicast group MAC address). Multicasting may be implemented in SDN environment 100 to support the distribution of information from one or more sources (e.g., VM1 131) to a group of destinations (e.g., VM2 132 to VM8 138) simultaneously. In the example below, virtual machines 131-138 are members of the multicast group. If a particular host (e.g., host-H 110H) or replication domain does not support any multicast group member, it is not necessary to replicate packet 710 to the host or replication domain.
At 620, 625, 630 and 635 in
In the example in
As shown in
At 640, 645 and 650 in
Since further replication is required within remote replication domains URDj (j≠i), host-A 110A may assign a higher priority to encapsulated packets 720, 730 compared to encapsulated packets 740, 750. In this case, encapsulated packets 720, 730 destined for respective host-D 110D in URD2 and host-F 110F in URD3 may be generated and sent before encapsulated packets 740, 750 destined for respective host-B 110B and host-C 110C in URD1. Depending on the capability of physical NICs 124A of host-A 110A, encapsulated packets 720-750 may be sent simultaneously.
As can be seen from the above examples, the scope of traffic replication at host-A 110A is limited to host-B 110B and host-C 110C in URD1, host-D 110D in URD2 and host-F 110F in URD3. Compared to conventional approaches that necessitate host-A 110A to replicate packet 710 to hosts 110B-H, the the number of encapsulated packets generated and sent by host-A 110A is significantly reduced. This in turn reduces the processing burden on host-A 110A, which may improve performance or at least reduce the adverse effect on other resource consumers at host-A 110A.
Further, compared to conventional approaches, examples of the present disclosure do not necessitate underlying physical network 105 (see
Instead, host-A 110A generates and sends encapsulated packet to host-F 110F in URD3 to cause host-F 110F to generate and send encapsulated packets 770, 780 to hosts 110G-H, respectively, within the same replication domain. As such, the implementation of replication domains provides more flexibility without any hardware requirement for multicast or limitation as to whether VTEPs in a particular URDi belong to the same layer-2 domain or subnet. In practice, it should be understood that hosts in the same subnet may be connected via layer-2 virtual private network (L2VPN), layer-3 VPN (L3VPN), etc.
(b) First Replication Domain: Host-B 110B and Host-C 110C
At 655, 660 and 665 in
(c) Second Replication Domain: Host-D 110D and Host-E 110E
At 670 and 675 in
At 680 in
Further, at 695 in
(d) Third Replication Domain: Host-F 110F, Host-G 110G and Host-H 110H
Similarly, host-F 110F performs blocks 670-690 to generate and send encapsulated packets 770, 780 to respective host-G 110G and host-H 110H within URD3. As shown in more detail in
Container Implementation
Although described using virtual machines 131-138, examples of the present disclosures may be implemented to perform traffic replication for other data compute nodes, such as containers supported by virtual machines 131-138. Some examples will be described using
Containers 901-908 are OS-less, meaning that they do not include any OS that could weigh 10s of Gigabytes (GB). This makes containers 901-908 more lightweight, portable, efficient and suitable for delivery into an isolated OS environment. Running containers inside a virtual machine (known as “containers-on-virtual-machine” approach) not only leverages the benefits of container technologies but also that of virtualization technologies. Containers 901-908 are located on the same logical overlay network (e.g., VXLAN5001) and are connected to logical switch 140 in
In the example in
At host-D 110D, replication is performed to generate and send encapsulated packet 960 to host-E 110E. Similarly, at host-F 110F, further replication is performed to generate and send encapsulated packets 970, 980 to respective host-G 110G and host-H 110H. This in turn causes decapsulated packets 925, 965, 935, 975, 985 to be generated and sent to respective C4 904, C5 905, C6 906, C7 907 and C8 908 located on VXLAN5001. See corresponding blocks 655-698 in
Computer System
The above examples can be implemented by hardware (including hardware logic circuitry), software or firmware or a combination thereof. The above examples may be implemented by any suitable computing device, computer system, etc. The computer system may include processor(s), memory unit(s) and physical NIC(s) that may communicate with each other via a communication bus, etc. The computer system may include a non-transitory computer-readable medium having stored thereon instructions or program code that, when executed by the processor, cause the processor to perform processes described herein with reference to
The techniques introduced above can be implemented in special-purpose hardwired circuitry, in software and/or firmware in conjunction with programmable circuitry, or in a combination thereof. Special-purpose hardwired circuitry may be in the form of, for example, one or more application-specific integrated circuits (ASICs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), and others. The term ‘processor’ is to be interpreted broadly to include a processing unit, ASIC, logic unit, or programmable gate array etc.
The foregoing detailed description has set forth various embodiments of the devices and/or processes via the use of block diagrams, flowcharts, and/or examples. Insofar as such block diagrams, flowcharts, and/or examples contain one or more functions and/or operations, it will be understood by those within the art that each function and/or operation within such block diagrams, flowcharts, or examples can be implemented, individually and/or collectively, by a wide range of hardware, software, firmware, or any combination thereof.
Those skilled in the art will recognize that some aspects of the embodiments disclosed herein, in whole or in part, can be equivalently implemented in integrated circuits, as one or more computer programs running on one or more computers (e.g., as one or more programs running on one or more computing systems), as one or more programs running on one or more processors (e.g., as one or more programs running on one or more microprocessors), as firmware, or as virtually any combination thereof, and that designing the circuitry and/or writing the code for the software and or firmware would be well within the skill of one of skill in the art in light of this disclosure.
Software and/or to implement the techniques introduced here may be stored on a non-transitory computer-readable storage medium and may be executed by one or more general-purpose or special-purpose programmable microprocessors. A “computer-readable storage medium”, as the term is used herein, includes any mechanism that provides (i.e., stores and/or transmits) information in a form accessible by a machine (e.g., a computer, network device, personal digital assistant (PDA), mobile device, manufacturing tool, any device with a set of one or more processors, etc.). A computer-readable storage medium may include recordable/non recordable media (e.g., read-only memory (ROM), random access memory (RAM), magnetic disk or optical storage media, flash memory devices, etc.).
The drawings are only illustrations of an example, wherein the units or procedure shown in the drawings are not necessarily essential for implementing the present disclosure. Those skilled in the art will understand that the units in the device in the examples can be arranged in the device in the examples as described, or can be alternatively located in one or more devices different from that in the examples. The units in the examples described can be combined into one module or further divided into a plurality of sub-units.
Patent | Priority | Assignee | Title |
11362849, | Nov 23 2020 | Cisco Technology, Inc. | SD-WAN multicast replicator selection centralized policy |
Patent | Priority | Assignee | Title |
20110252124, | |||
20130031051, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Jan 15 2018 | GUO, FEI | NICIRA, INC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 044722 | /0439 | |
Jan 15 2018 | JIANG, JINGCHUN | NICIRA, INC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 044722 | /0439 | |
Jan 25 2018 | Nicira, Inc. | (assignment on the face of the patent) | / |
Date | Maintenance Fee Events |
Jan 25 2018 | BIG: Entity status set to Undiscounted (note the period is included in the code). |
Jun 21 2023 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
Date | Maintenance Schedule |
Jan 07 2023 | 4 years fee payment window open |
Jul 07 2023 | 6 months grace period start (w surcharge) |
Jan 07 2024 | patent expiry (for year 4) |
Jan 07 2026 | 2 years to revive unintentionally abandoned end. (for year 4) |
Jan 07 2027 | 8 years fee payment window open |
Jul 07 2027 | 6 months grace period start (w surcharge) |
Jan 07 2028 | patent expiry (for year 8) |
Jan 07 2030 | 2 years to revive unintentionally abandoned end. (for year 8) |
Jan 07 2031 | 12 years fee payment window open |
Jul 07 2031 | 6 months grace period start (w surcharge) |
Jan 07 2032 | patent expiry (for year 12) |
Jan 07 2034 | 2 years to revive unintentionally abandoned end. (for year 12) |