A method and system allows a service provider to provide Intranet services remotely by assigning private virtual servers to customers. Each customer addresses transmissions to one or more private virtual servers using private addresses from the customer's private Intranet. The addresses of different private virtual servers do not have to be unique and may overlap. Customers exchange privately-addressed transmissions with the service provider using tunnels to traverse the local or regional network connecting the customer with the service provider. The service provider routes the transmissions to the relevant private virtual server belonging to the customer that sent the transmission. The service provider also routes privately-addressed transmissions back to individual customers using tunnels.

Patent
   RE43051
Priority
Mar 15 2000
Filed
Sep 19 2007
Issued
Dec 27 2011
Expiry
Mar 15 2020
Assg.orig
Entity
Large
21
151
all paid
1. In a system comprising a host computer containing a plurality of virtual servers which support a private network address space wherein the private network address spaces of two or more of the virtual servers overlap, a method for providing private network services using private addresses in a location remote from private network users, the method comprising:
storing a customer lookup table, the customer lookup table storing associations between physical interfaces and tunnel identifiers identifying tunnels for private networks and a plurality of customer forwarding tables;
storing a plurality of customer forwarding tables, the customer forwarding tables associating network addresses with physical interfaces and tunnel identifiers;
receiving, over a tunnel, a transmission on a physical interface, the transmission containing a tunnel identifier;
determining the correct customer forwarding table from the customer lookup table using the physical interface and the tunnel identifier;
determining via the customer forwarding table a physical interface and tunnel identifier associated with a network address of the transmission; and
sending the transmission to the network address on the determined physical interface using the determined tunnel identifier.
0. 3. In a system comprising a host computer containing multiple virtual servers that each support a private network address space wherein the private network address spaces of two or more of the virtual servers overlap, a method for providing private network services using private addresses in a location remote from private network users, the method comprising:
storing customer lookup information and customer forwarding information, the customer lookup information specifying associations between physical interfaces and tunnel identifiers identifying tunnels for private networks and multiple customer forwarding tables, the customer forwarding information associating network addresses with physical interfaces and tunnel identifiers;
receiving, over a tunnel, a transmission on a physical interface having an interface identifier, the transmission identifying a tunnel identifier;
determining the correct customer forwarding information from the customer lookup information using the physical interface identifier and the tunnel identifier;
using the customer forwarding information to identify a physical interface and tunnel identifier associated with a network address of the transmission; and
sending the transmission to the network address on the identified physical interface using the identified tunnel identifier.
2. A computer-readable medium containing a computer program product for providing private network services using private addresses in a location remote from private network users, wherein a host computer contain a plurality of virtual servers which support a private network address space and wherein the private network address spaces of two or more of the virtual servers overlap, the computer program product, when executed by a computing system, implements a process comprising:
program instructions for storing a customer lookup table, the customer lookup table storing associations between physical interfaces and tunnel identifiers identifying tunnels for private networks and a plurality of customer forwarding tables;
program instructions for storing a plurality of customer forwarding tables, the customer forwarding tables associating network addresses with physical interfaces and tunnel identifiers;
program instructions for receiving, over a tunnel, a transmission on a physical interface, the transmission containing a tunnel identifier;
program instructions for determining the correct customer forwarding table from the customer lookup table using the physical interface and the tunnel identifier;
program instructions for determining via the customer forwarding table a physical interface and tunnel identifier associated with a network address of the transmission; and
program instructions for sending the transmission to the network address on the determined physical interface using the determined tunnel identifier.
0. 4. The method of claim 3, further comprising receiving the transmission via the tunnel from a private network.
0. 5. The method of claim 3, further comprising routing the transmission over a layer 2 tunnel.
0. 6. The method of claim 3, wherein routing the transmission to a virtual server comprises:
terminating an incoming tunnel containing a transmission; and
multiplexing the transmission to a virtual server.
0. 7. The method of claim 6, further comprising:
identifying the tunnel identifier contained in the transmission; and
selecting a virtual server based upon the identified tunnel identifier.
0. 8. The method of claim 6, wherein routing the transmission to a virtual server comprises:
terminating an incoming tunnel containing the transmission;
switching the transmission to a tunnel connected to a physical host computer containing a private network's virtual server;
terminating the tunnel at the physical host computer; and
multiplexing the transmission to the virtual server.

This patent application is a reissue application for U.S. Pat. No. 6,948,003, issued from U.S. patent application Ser. No. 09/526,980, filed on Mar. 15, 2000.

This application is related to U.S. patent Ser. No. 09/452,286, entitled “Providing Quality of Service Guarantees to Virtual Hosts”, by Pawan Goyal et al., filed Nov. 30, 1999, and commonly assigned with the present application. The subject matter of related application U.S. patent Ser. No. 09/452,286 is incorporated by reference herein in its entirety.

1. Field of Invention

the present invention relates generally to providing private networking services, e.g., Intranet services, remotely, and more particularly, to allowing a service provider to locate and manage private network servers at the service provider's location, while connecting the servers to a customer's premises such that they appear to be local and private to the customer.

2. Background of the Invention

Networked computer resources are growing more popular as the benefits of sharing computing resources becomes evident. One of the fastest-growing segments of the Internet is the private network market. A private network is an interconnected group of computing resources accessible only by the network members. Security protocols are used to ensure that only authorized users have access to the network's resources, even where the network operates on the public network infrastructure and protocols. A private network, often belonging to a corporation, may be used to store web pages and other shared information. This information is maintained in a private space, generally screened off from external sources such as the Internet by a firewall which blocks unauthorized access. Such private networks are often referred to as intranets, local area networks (LAN) or wide area networks (WAN).

In a typical LAN implementation, a single location contains a group of individual user computers, as well as one or more dedicated host computers executing server programs to maintain the network's shared information. The private LAN is screened off from the Internet by a firewall, though users may access the Internet if needed. Network traffic intended for the network is allowed through the firewall only if authorized. The resources within the LAN all may communicate using private addresses. It is not necessary to use registered IP addresses for each resource because the system is screened off from the global Internet.

This model may be extended to multiple location sites. Computer networks that span relatively large geographical distances are typically referred to as WANs. In a private WAN, individual sites must be connected in a secure manner. A secure connection between WAN sites may be accomplished using a virtual private network. A virtual private network utilizes ordinary Internet protocols and may also use public communications mediums to connect; however, privacy is ensured through features such as tunneling (data encapsulation) or the use of leased lines. A leased line is a permanent connection between two points that is always active. Resources on a WAN may communicate using only private addresses because the network is screened off from the global Internet.

Private networks contain common elements. Each generally contains a dedicated local server to maintain the shared private network data, and a communications system for providing data communication services between machines on the private network. Communication takes place using a private address space. Because the address spaces for individual private networks need only be locally unique, the address spaces among several different private networks may overlap because the networks are isolated from each other. More specifically, in private intranets, two unrelated intranets at different companies may use the same local addresses for user computers. No conflict arises since the networks are not connected.

Data communications services and servers are not easy to configure, manage, and maintain. Thus, there is an incentive for the service providers that offer access to communications facilities to provide such private network services and servers as well, thereby relieving corporations from the burden of providing these services directly. Some examples of service providers are: Internet Service Providers (ISP), Application Service Providers, Network Service Providers, and Competitive Local Exchange Carriers (CLEC).

It is not economically feasible for a service provider to remotely manage servers located on a customer's premises, and support many different customers in this fashion. Rather a service provider would prefer to offer private network services to multiple customers while keeping all of the server host computers within a location of the service provider for ease of management. Accordingly, service providers typically dedicate a physical host computer as each individual customer's server, and maintain each host computer in the centralized facility. However, this means the service provider will have to own and maintain potentially large numbers of physical host computers, at least one for each customer's server or private network However, many customers will neither require nor be amenable to paying for the use of an entire host computer. Generally, only a fraction of the processing power, storage, and other resources of a host computer will be required to meet the needs of an individual customer.

Alternatively, a service provider may utilize one physical host computer to provide commercial host services to multiple customers. Using Transmission Control Protocol (TCP) and other transport protocols, a server application executing on a single physical host can be programmed to process requests made to multiple network addresses. Such functionality is known as virtual hosting.

In virtual hosting, each customer is assigned a network address (or domain name), and is provided with resources on a single, physical host computer, effectively sharing the host with other customers. A client computer requests data from a specific customer's host by targeting communication requests to the appropriate network address (or domain name). The virtual host server can service requests to multiple network addresses or domain names. Thus, the functionality of numerous hosts is provided by a single physical host computer, servicing requests made to a plurality of network addresses and domain names by multiple customers.

However, virtual hosting it is commonly performed today does not provide many of beneficial features of private networks. Service providers will have to be able to provide certain features of private networks before customers will be willing to outsource services related to the operation and maintenance of their private network. First, customers will want to ensure that their private data is inaccessible to other customers sharing the same host computers. For instance, if a service provider provides email outsourcing for both Company A and Company B on the same computer, Company A will want to ensure that the directories in which its email is stored are not accessible to Company B, and vice versa.

Additionally, customers will want to ensure that their services are not compromised due to problems originating with another customer. If a service provider uses a single host computer to provide server resources for both Company A and Company B, steps must be taken to ensure that overuse of the resources by Company A does not impact Company B's service. Additionally, faults, crashes, or similar problems caused by one customer must not compromise the service provided to another customer. Such performance degradation issues must be contained by the service provider to impact only the customer responsible for the problem, and not to impact any other customers.

Finally, companies A and B will want their servers to have IP addresses that belong to their own private address spaces. Using addresses from each company's own private address space offers more security because private IP addresses are not reachable over the public Internet. The use of private IP addresses guards against private servers becoming accessible from the public Internet by accidental misconfiguration of equipment. Also, public IP addresses are a limited resource; there is insufficient address space for private networks to consume addresses from the public address space. Furthermore, if a company connects a number of servers or corporate locations together they will wish to establish a virtual private network. To run the routing protocols required for communications within a virtual private network requires a coherent addressing scheme. Such a virtual private network is easier to manage from a private address space.

However, the use of private address schemes creates difficulties for the service provider. The service provider may now have several virtual servers assigned to the same IP address, because companies A and B may have overlapping address spaces, as is typical in private networks. This address overlap can cause the communication network to fail. Typically, one of the virtual servers would become unreachable due to this address overlap error.

Thus in order to satisfy customers' needs, a service provider desiring to provide private network services must be able to guarantee four different kinds of isolation. Functional isolation separates the data and functionality of each customer. Fault isolation protects one customer from the faults created by another customer. Performance isolation allows each customer to receive a performance commitment independent of the behavior of other customers. Address isolation allows each customer to choose the virtual server IP address that it wants to be associated with, independent of other customers.

Virtual hosting currently cannot provide these beneficial features of ordinary private servers. This is due to the inability of a virtual host to allocate appropriate amounts of computer resources of the physical host computer to servicing client requests made to specific virtual hosts, and hence to specific customers. A private virtual server, by contrast, is able to provide the functional, fault, and performance isolation that an ordinary virtual server cannot. A method for creating such a private virtual server is disclosed in the related application identified above, U.S. patent Ser. No. 09/452,286, entitled “Providing Quality of Service Guarantees to Virtual Hosts.”

However, a method and system is still needed to allow customers to use their own private address spaces to communicate with a remotely-located private virtual server maintained by a service provider, where the private virtual server addresses may overlap.

The present invention allows providers of virtual servers to properly differentiate and route transmissions using private addresses on a common host server. The term “private virtual server” as used herein is a virtual server that supports a private address space wherein the private address spaces of different private virtual servers may overlap.

Customers exchange privately-addressed transmissions with a service provider using tunnels to traverse the local or regional network connecting the customer with the service provider. The service provider receives the transmissions at a gateway into the service provider's data center. The service provider then routes the transmission to the private virtual server belonging to the customer that sent the transmission. The service provider also routes privately-addressed transmissions back to individual customers using tunnels. In this way, the service provider is able to implement a separate routing context on behalf of each individual customer.

The present invention allows for flexibility in designing a private virtual server that suits an individual customer's needs. For example, an individual customer may have multiple physical sites all utilizing the same private virtual server. Optionally, an individual customer may be assigned more than one private virtual server, for instance, if different divisions of an organization each wish to maintain their own private servers while making all the data available to the organization at large.

In one embodiment, the present invention comprises a multiplexing/demultiplexing mechanism capable of routing signals to and from one or more private virtual servers located on a physical host computer. Each private virtual server is associated with only one private network. The multiplexing/demultiplexing mechanism receives a privately addressed transmission and routes it to the private virtual server with which it is associated. The privately addressed transmission may then be processed within the private virtual server in the same manner as if the server was actually a physical server resident within a LAN. The multiplexing/demultiplexing mechanism also receives an outgoing transmission from a private virtual server and routes it back to the private network associated with it. Incoming and outgoing transmissions are addressed using a tunneling scheme. Tunneling allows privately-addressed transmissions to be transported over a network that uses global addresses and allows customers to address their private virtual server using a non-unique private address. As a result, all transmissions to and from a customer are sent only to the customer's respective private virtual server.

In another embodiment, the present invention includes more than one physical host computer. Each physical host computer contains one or more private virtual servers. Privately-addressed incoming transmissions are sent to the service provider's data center. The transmissions are placed on tunnels to traverse the local or regional network connecting the customer with the service provider. A tunnel switching mechanism is used to forward transmissions received at the service provider's data center to the proper physical host computer.

In another embodiment, the present invention is a method for locating and managing private network services in a data center location remote from private network users. The method comprises receiving a transmission addressed using a private address of a recipient, and routing the transmission to a private virtual server. The correct private virtual server is determined from the address of either the sender or the recipient of the transmission.

The foregoing merely summarizes aspects of the invention. The present invention is more completely described with respect to the following drawings and detailed description.

FIG. 1 is an illustration of a private virtual server system in accordance with the present invention.

FIG. 2 is an illustration of an embodiment of a private virtual server system with individual tunnels between each customer and associated private virtual server.

FIG. 3 is an illustration of an embodiment of a private virtual server system with a multiplexing/demultiplexing mechanism.

FIG. 4 is a block diagram illustrating the tunnel-to-private virtual server traffic flow of a multiplexing/demultiplexing mechanism.

FIG. 5 is a block diagram illustrating the private virtual server-to-tunnel traffic flow of a multiplexing/demultiplexing mechanism.

FIG. 6 is an illustration of an embodiment of a private virtual server system with multiplexing/demultiplexing mechanisms and a tunnel switch.

FIG. 7 is a block diagram illustrating the traffic flow of a tunnel switch.

FIG. 8 is a diagram of a customer lookup table for a tunnel switch in an embodiment of the present invention.

FIG. 9 is a diagram of a set of customer forwarding tables for a tunnel switch in an embodiment of the present invention.

FIG. 10A is an illustration of an embodiment of a system for the separation of Internet and private virtual server traffic.

FIG. 10B is an illustration of another embodiment of a system for the separation of Internet and private virtual server traffic.

FIG. 11 is an illustration of an embodiment of a private virtual server system using Asynchronous Transfer Mode (ATM) layer two tunneling.

FIG. 12 is a block diagram illustrating the traffic flow of an ATM cell from a tunnel to a private virtual server.

Reference will now be made in detail to several embodiments of the present invention, examples of which are illustrated in the accompanying drawings. Wherever practicable, the same reference numbers will be used throughout the drawings to refer to the same or like parts. The figures depict preferred embodiments of the present invention for purposes of illustration only. One skilled in the art will readily recognize from the following discussion that alternative embodiments of the structures and methods illustrated herein may be employed without departing from the principles of the invention described herein.

FIG. 1 is an illustration of an embodiment of a private virtual server system, which replaces multiple private Intranet servers. A private virtual server system 100 includes a service provider gateway 152 that connects to a service provider data center 150. System 100 is connected to multiple customer sites 110 via an access network 120. Customers, e.g. 112 and 114, are located in potentially any global location, although frequently customers are located within the regional access network of the service provider. As will be evident to one of skill in the art, any number of customers may be supported by the private virtual server system 100. Only the resources of the physical servers owned by the service provider limit the number of customers supported. Furthermore, a service provider may add additional physical servers as required to support additional customers.

As used herein, the terms “customer”, “user”, and “private network user” refer to individuals or groups of individuals accessing the same private virtual server. Typically, a private virtual server “user” is a group of individuals with a shared association. For example, “user” may collectively refer to the employees of a company, or to certain employees within a division of a company. One company (a “customer”) may have several different users, each corresponding to a different group within the company. Additionally, a “user” may also refer to a single individual.

In the present invention, customers send and receive data using a network. In one embodiment, the protocol used within each customer's network will be IP (Internet Protocol). The IP addressing format will also be assumed herein for purposes of illustration. However, it will be evident to one of skill in the art that a different network protocol could be used instead of IP within a customer's private network, for example, Open Systems Interconnection (OSI), Internetwork Packet Exchange (IPX), System Network Architecture (SNA), and Asynchronous Transfer Mode (ATM).

Data from customers 112 and 114 may optionally be aggregated 130 before being sent out over a local or regional network 140. Aggregation 130 is not required, but generally is done to concentrate data traffic for more efficient transmission over a network. For example, a customer site may aggregate the multiple data streams coming from various different users (clients) within the site before transmitting data onto a public network.

Aggregation 130 may also take place between customers and non-customers. This may occur when data transmission sites are located physically close together, to consolidate traffic flow onto the local or regional network 140. In another example, aggregation is also common in digital subscriber line (DSL) systems. A digital subscriber line access multiplexer (DSLAM) concentrates data traffic from multiple DSL loops onto the backbone network before connection to the rest of the local or regional network 140. Data directed to different destinations will be separated and individually routed within the local or regional network 140.

The local or regional network 140 connects a customer with a private virtual server system 100. The local or regional network 140 may be comprised of different types of interconnected networks. System 100 is capable of functioning with a wide variety of different local or regional networks 140, as will be evident to one of skill in the art.

Traffic from each individual customer 112 and 114 is aggregated 130 and transported across the local or regional network 140 until it reaches a service provider gateway 152. The service provider gateway 152 provides the connection into the service provider data center 150. The service provider gateway 152 direct traffic from each customer to the private virtual servers it owns and prevents traffic from reaching private virtual servers a customer does not own.

The service provider gateway 152 connects to a physical server machine 160. The physical server machine 160 may be any kind of computer adapted to support private virtual servers. It is to be understood that a service provider data center 150 will typically contain more than one physical server machine 160.

Located on the physical server machine 160 is a group of private virtual servers 162. In one embodiment, each private virtual server 162 is capable of implementing quality of service guarantees to individual customers. A service provider may implement different quality of service guarantees by allocating different percentages of the physical server machine 160 to servicing each of the private virtual servers 162. Thus the private virtual servers 162 may each consume a different percentage of the resources of physical server machine 160. This resource allocation may be dynamically changed by the service provider as required.

In one embodiment, the IP network address of each private virtual server 162 corresponds to a private address from the private address space of the respective customer assigned to the private virtual server. A private address is any locally-assigned address, which does not have to be unique within the global Internet. Conversely, a global address is a registered IP address that is unique within the public network system of communications. Generally, connecting a private network to a public network requires network address translation, which maps global addresses onto private addresses at the public/private network boundary. Private addresses are not routable in the public network, therefore transmissions cannot be sent to the private virtual servers 162 across the public network 120 using only their private addresses.

The network addresses for the private virtual servers are chosen to correspond to each customer's private address space. The private address spaces of customers 112 and 114 may overlap. Therefore, the network addresses for these customers' assigned virtual private servers may not be unique. It is possible for private virtual servers 162 to all be assigned the same network address.

Thus the use of private addresses for the private virtual servers creates two different problems: such private addresses cannot be used to transmit data directly across a public network, and there may be address overlap among the private virtual servers.

A solution to the problem of transporting privately-addressed transmissions is shown in FIG. 2. FIG. 2 is an illustration of an embodiment of a private virtual server system 200 that uses individual tunnels to connect between each customer and a service provider. The tunnels provide a means to transmit privately-addressed data across a public network.

FIG. 2 shows a private virtual server system 200. The private virtual server system 200 includes a service provider gateway 252 that connects to a service provider data center 250. A physical server machine 260 contains three private virtual servers 262. These private virtual servers may have overlapping private IP addresses. Private virtual server 262A is assigned to a customer 220, while private virtual server 262B is assigned to a customer 210. Customers 210 and 220 are connected to the private virtual server system 200 via a local or regional network 240.

Customers 210 and 220 use tunnels to allow privately-addressed data transmissions to traverse the local or regional network 240. Customer 210 has a single tunnel 212 from customer 210's site to the service provider gateway 252. Similarly, customer 220 has a single tunnel 222 from customer 220's site to the service provider gateway 252. A tunnel is created by encapsulating a data transmission within a second type of addressing protocol. Transmissions, which use addresses that are unique only within a narrow scope, may thus be transported across a second network within a wider address scope. In this way, private IP addresses that are only unique within a private IP network are encapsulated for transport across the global public Internet. The origination of the tunnel, on the customer's side, must occur before traffic from multiple customers is aggregated. The numbers of customers and private virtual servers shown in FIG. 2 is merely representative. It is to be understood that a service provider may have more or fewer customers. Furthermore, a physical host machine may contain more or fewer private virtual servers.

System 200 demonstrates how a customer can be communicatively coupled to a private virtual server system using privately-addressed transmissions. However, once privately-addressed transmissions are routed across a public network, the problem of potential address overlap among the destination private virtual servers still remains. FIG. 3 demonstrates a method for routing transmissions to private virtual servers, where the private virtual servers may have overlapping address spaces.

FIG. 3 is an illustration of an embodiment of a private virtual server system 300 including a multiplexing/demultiplexing mechanism 350. Private virtual server system 300 provides a separate routing context on behalf of each user to route privately-addressed transmissions between the users and the private virtual servers. System 300 is connected to three customer sites 310, 320 and 330. Each customer uses a tunnel to traverse the local or regional network 340 and arrive at a physical server machine 360 within the private virtual server system 300. Customer site 310 uses a tunnel 312, customer site 320 uses a tunnel 322, and customer site 330 uses a tunnel 332. Each tunnel is a different data encapsulation. Multiple tunnels may be carried on the same physical medium connecting to the multiplexing/demultiplexing mechanism 350.

In another embodiment, the tunnels 312, 322, and 332 could be replaced with dedicated leased lines. A leased line is a permanent connection between two points set up by a telecommunications common carrier. A leased line is not part of the global public network, and therefore may carry privately-addressed traffic.

The physical server machine 360 contains three private virtual servers 362, as well as a multiplexing/demultiplexing mechanism 350. Incoming tunnels 312, 322, and 332 communicatively couple to the multiplexing/demultiplexing mechanism 350. The private virtual servers 362 may have overlapping IP addresses. A set of internal pointers 314 is used to direct traffic from the multiplexing/demultiplexing mechanism 350 to the correct private virtual server 362, thereby communicatively coupling the multiplexing/demultiplexing mechanism 350 to the private virtual servers 362.

The multiplexing/demultiplexing mechanism 350 performs the functions of separating incoming communication streams back into their original constituent streams, and merging multiple separate communication streams onto a single physical communications medium. In one embodiment, the multiplexing/demultiplexing mechanism 350 is implemented in the network interface card of the physical server machine 360. The multiplexing/demultiplexing mechanism 350 may be implemented in an application specific integrated circuit (ASIC) on the network interface card, or on the software driver.

Incoming tunneled transmissions are sent on a physical medium as packet flows. When the multiplexing/demultiplexing mechanism 350 demultiplexes an incoming set of packet flows, incoming packets are stored in a buffer and one of the fields in the packet header is used to select the incoming packet queue to which the buffer should be linked. An incoming packet queue is a list of pointers wherein each pointer points to a packet buffer. Thus packets arriving with different tunnel identifiers are linked to different incoming packet queues. There is one incoming packet queue per tunnel.

Outgoing transmissions sent by the various private virtual servers are also packet flows. Each private virtual server has its own outgoing packet queue. These packet queues are again implemented as lists of pointers to packet buffers. The scheduler in the network interface card selects which of the non-empty outgoing packet queues it should serve next. The scheduler takes the pointer from the head of the selected queue and transmits the packet from the buffer that is pointed to by the pointer.

The tunnel switching operations of the mutiplexing/demultiplexing mechanism 350 are shown in more detail in FIGS. 4 and 5. FIG. 4 is a block diagram illustrating the tunnel-to-private virtual server traffic switching functions of a multiplexing/demultiplexing mechanism. FIG. 5 is a block diagram illustrating the private virtual server-to-tunnel traffic switching functions of a multiplexing/demultiplexing mechanism.

FIG. 4 shows an embodiment of a physical host computer 400 including three private virtual servers 420A, 420B, and 420C. Each private virtual server includes an associated IP stack 422. An IP stack is a set of software processes that together manage the transfer of information in packets according to Internet protocols. Internet protocols define the rules and conventions for exchanging information across the Internet. The number of private virtual servers shown is merely illustrative. It is to be understood that a physical host computer may include more or fewer private virtual servers.

The physical host computer 400 also includes a multiplexing/demultiplexing mechanism 410. Multiplexing/demultiplexing mechanism 410 has an internal pointer 430 directed at each IP stack 422. Multiplexing/demultiplexing mechanism 410 includes a lookup table 412 that includes a list of incoming tunnel identifiers and pointers to their associated IP stacks within the physical host computer 400. Lookup table 412 is created by software residing on the physical host computer 400, which associates each IP stack with a particular customer, and ensures that transmissions sent from a particular customer are only directed to that particular customer's private virtual server.

A data packet 452 enters the multiplexing/demultiplexing mechanism 410 using an incoming tunnel 450. The tunnel 450 is not an individual physical connection, but is a means of encapsulating the packet 452 to permit routing across a public network. Although only one incoming tunnel 450 is shown in FIG. 4, this is merely illustrative. It is to be understood that there may be multiple different tunnels entering the multiplexing/demultiplexing mechanism 410.

The tunnel identifying information of the incoming packet 452 identifies which customer sent the packet 452. Packet 452's incoming tunnel identifying information is stripped 446, and the tunnel identifying information is presented 444 to the lookup table 412. Lookup table 412 returns 442 an internal pointer 430 for the appropriate IP stack 422. Packet 452 is then routed 440 to the identified IP stack 422 using the internal pointer 430.

An alternative embodiment is to embed the internal pointer 430 in the control data structure that controls the operation of the tunnel. The control data structure is typically located on the network interface card. The network interface card is typically located on the physical server machine 400.

FIG. 5 is a block diagram illustrating an embodiment of the private virtual server-to-tunnel traffic switching operations for the physical host computer 400. Multiplexing/demultiplexing mechanism 410 contains a lookup table 512 that consists of a list of IP stacks in the physical host computer 400 and their associated outgoing tunnel identifiers. Multiplexing/demultiplexing mechanism 410 ensures that packets sent from a customer's private virtual server are routed back to that customer on the correct outgoing tunnel.

A packet 552 is originally sent from the IP stack 422 of one of the private virtual servers 420. The packet 552 is directed 530 to the multiplexing/demultiplexing mechanism 410. Upon arrival at the multiplexing/demultiplexing mechanism 410, the internal tunnel IP stack identifier is read 540, and this identifier is presented 542 to lookup table 512.

Lookup table 512 returns 544 the associated outgoing tunnel identifying information. The outgoing tunnel identifier is added 546 to packet 552. Packet 552 is then sent out using the appropriate outgoing tunnel 550. The outgoing tunnel 550 is associated with the customer assigned to the private virtual server 420, which originally sent the packet 552. Although only one outgoing tunnel is shown in FIG. 5, this is merely illustrative. It should be understood that there may be multiple different outgoing tunnels. Each tunnel is not a separate physical connection; it is a specific encapsulation of data allowing the data to be separated out from other data sent on a physical connection.

An alternative embodiment is for the IP stack 422 of each private virtual server 420 to encapsulate the packet 552 with the proper outgoing tunnel header and tunnel identifier, thereby creating the tunnel 550. In this embodiment, the lookup table 512 is not used. The multiplexer/demultiplexer mechanism 410 merges the encapsulated and identified packet streams together, and sends them out.

A service provider will typically own and manage multiple physical server machines. Additionally, customers may wish to purchase more than one private virtual server, for example, for separate divisions within the same company. A customer may also have multiple physical customer sites using the same private virtual server, wherein each customer site uses a different tunnel to communicate with the service provider. A tunnel switch supports these different configurations in a private virtual server system.

A tunnel switch comprises one or more physical interfaces, with each interface capable of carrying many multiplexed tunnels. A tunnel switch will typically be capable of supporting a number of different physical interface technologies and a number of different types of tunnels for each type of physical interface. A tunnel switch performs two separate services: switching tunnels, and switching packets within a tunnel.

In a switching tunnels service, all packets arriving on one incoming tunnel are forwarded to an outgoing tunnel. This may be implemented without looking into the headers of the packets themselves. The tunnel switch notes which tunnel and physical interface the packet arrived on. Given the identifier of the incoming tunnel and the incoming physical interface, the tunnel switch uses a lookup table to specify the outgoing tunnel and physical interface.

In a switching packets service, incoming tunnels are terminated at the tunnel switch. The packets within each tunnel are extracted and switched individually based upon the incoming physical interface, the incoming tunnel, and information from the header of the packet. A private virtual server system supporting multiple physical servers, multiple private virtual servers per customer, and multiple customer sites per private virtual server will support such a switching packets service in addition to supporting a switching tunnels service.

FIG. 6 is an illustration of an embodiment of a private virtual server system containing a tunnel switch. Private virtual server system 600 provides a separate routing context on behalf of each customer to route between the customer and each customer's associated private virtual server. A private virtual server system 600 is communicatively coupled to three customer sites 612, 614, and 616 across a local or regional network 620. The number of customers, physical servers, and private virtual servers shown in FIG. 6 is merely representative. It is to be understood that a service provider may have more or fewer customers and more or fewer physical servers. Furthermore, a physical server may contain more or fewer private virtual servers.

Each customer site is connected to the system 600 via an external tunnel that traverses the local or regional network 620 and communicatively couples to a tunnel switch 632. Customer site 612 uses external tunnel 622, customer site 614 uses external tunnel 624, and customer site 616 uses external tunnel 626. A tunnel switch 632 operates as the gateway to physical servers 640 and 650, and supports tunnels on multiple physical interfaces. Tunnel switch 632 is communicatively coupled to physical server 640 via a set of tunnels 634. Tunnel switch 632 is communicatively coupled to physical server 650 via a set of tunnels 636. Physical server 640 contains a multiplexing/demultiplexing mechanism 642, which is linked via a set of internal pointers 662 to a set of private virtual servers 660. Physical server 650 contains a multiplexing/demultiplexing mechanism 652, which is linked via a set of internal pointers 682 to a set of private virtual servers 680.

FIG. 7 is a block diagram of an embodiment of the functions of a tunnel switch. A tunnel switch 700 is connected to a set of physical interfaces 712 and 714. Each physical interface 712 and 714 is capable of carrying a set of external tunnels. Physical interface 712 carries tunnels 710A, 710B, 710C, 710D, 710E and 710F. Physical interface 714 carries tunnels 716A and 716B.

Tunnel switch 700 also includes a set of outgoing physical interfaces 732 carrying a set of outgoing tunnels 730 to a set of physical host computers 720. Physical interface 732A carries tunnels 730A and 730B to physical host computer 720A. Physical interface 732B carries tunnel 730C to physical host computer 720B. Physical interface 732C carries tunnels 730D and 730E to physical host computer 720C. The tunnel switch 700 includes a customer lookup table 800 and a set of customer forwarding tables 900. The features of the customer lookup table and customer forwarding tables will be discussed in more detail before fully explaining the functions of the tunnel switch 700.

FIG. 8 is an embodiment of a customer lookup table 800, and FIG. 9 is an embodiment of a set of customer forwarding tables 900. Together, table 800 and set of tables 900 are suitable for switching a set of transmissions from an incoming physical interface and tunnel to an outgoing physical interface and tunnel. An incoming transmission may be arriving at the tunnel switch either from a customer, or from a private virtual server. Similarly, an outgoing transmission may be directed towards a private virtual server or a customer. Tables 800 and 900 operate to switch transmissions in both directions. Customer lookup table 800 is used as an index into the correct customer forwarding table from the set of customer forwarding tables 900.

The customer lookup table 800 associates external tunnel and physical interface identifiers with a particular customer. Each customer listed in the customer lookup table 800 has an associated customer forwarding table. For example, customer 1's information is contained in customer forwarding table 910, and customer 2's information is contained in customer forwarding table 920. When a customer communicates with a private virtual server, each data transmission will arrive on a particular physical interface using a particular tunnel.

Customer lookup table 800 contains four fields: incoming physical interface, incoming tunnel identifier, service, and customer identifier. Each incoming physical interface and incoming tunnel identifier entry will reference a unique customer identifier. This customer identifier provides an index to the correct customer forwarding table associated with this physical interface/tunnel identifier pair. For example, a transmission arriving on physical interface 712 and incoming tunnel 710B would be indexed to customer 1's customer forwarding table (table 910 from FIG. 9). In another example in the opposite direction, a transmission arriving on physical interface 732A and incoming tunnel 730B would also be indexed to customer 1's customer forwarding table.

Each customer forwarding table 910, 920 and 930 contains three fields: destination IP address, outgoing tunnel identifier, and outgoing physical interface. Based upon the destination IP address of a particular transmission, the proper outgoing tunnel and outgoing physical interface is determined. Using customer lookup table 910 as an example, transmissions with a destination IP address of the “main server” for customer I would be placed on outgoing tunnel 730A on physical interface 732A. In the opposite direction, transmissions with a destination IP address of “site 1” for customer 1 would be placed on outgoing tunnel 710E on physical interface 712.

The information in the customer forwarding tables 900 is segregated by customer because the private address spaces of different customers may overlap, and therefore the destination IP addresses on each individual customer forwarding table are not unique within the set of all customer forwarding tables. For example, “main server” of customer 1 and “server” of customer 2 may have the same IP address.

The service field in the customer lookup table 800 identifies whether only a tunnel switching service (TS) is required, or a packet switching service (PS) is required. If only a tunnel switching service is required, the associated customer forwarding table will contain only a single entry specifying the proper outgoing tunnel and outgoing physical interface. For example, customer lookup table 800 indexes transmissions arriving on physical interface 712 and incoming tunnel 710C to customer 2, and identifies these transmissions as requiring only a tunnel switching service Customer lookup table 920 associated with customer 2 directs all traffic to outgoing tunnel 730D on physical interface 732C.

The customer lookup table 800 and customer forwarding tables 900 allow the tunnel switch 700 to support a variety of different private network configurations. For example, customer lookup table 800 shows that customer 1 uses two different incoming tunnels: 710A and 710B. Customer forwarding table 910 shows that customer I also has two different destination IP addresses corresponding to two different private virtual servers: “main server” and “backup server.” Additionally, customer 1 has two different destination IP addresses corresponding to two different customer sites: “site 1” and “site 2.” However, customer forwarding table 920 shows that customer 2 has only one private virtual server (“server”). The example private network configurations referred to herein are merely illustrative. It will be understood by one of skill in the art that many different configurations are possible.

Referring back to FIG. 7, FIG. 7 shows the steps associated with switching a packet between an external tunnel (in one embodiment, from a customer site) and a private virtual server. A physical interface 712 connects a set of external tunnels 710 to the tunnel switch 700. A packet 718 arrives on one of the external tunnels 710B. The incoming physical interface and tunnel identification information is read 740 from the packet 718, and presented 744 to a customer lookup table 800.

The customer lookup table 800 uses the physical interface and tunnel identifier to return 748 the correct customer forwarding table (910) for use with the packet 718. A group of customer forwarding tables 900 contains a customer forwarding table 910 that is associated with the customer that uses physical interface 712 and tunnel 710B. Packet 718's destination IP address, for example, “main server” is presented 750 to customer forwarding table 910.

From the information contained in customer forwarding table 910, the correct outgoing physical interface and tunnel identifier for packet 718 is identified 754. Referring to FIG. 9, destination IP address “main server” corresponds to outgoing tunnel 730A and physical interface 732A. Packet 718 is then placed on tunnel 730A that will transport it to the physical host computer 720A.

Customers utilizing a private virtual server system may also be accessing the global Internet. In this case, both the private virtual server communications traffic and the Internet communications traffic are sent out on a public network. A method for separating the two traffic streams is required.

In one embodiment, shown in FIG. 10A, Internet traffic is separated out at the customer's site. FIG. 10A shows a system 1000 for separating Internet and private virtual server traffic. In system 1000, a traffic separation mechanism 1012 is located at the customer site 1010. A tunnel 1022 is created for sending private virtual server traffic across the local or regional network 1020. Internet traffic 1024 is separated out before reaching the local or regional network 1020 and sent separately to the Internet 1030.

FIG. 10B shows another embodiment of a system for separating Internet and private virtual server traffic. System 1050 separates Internet traffic out after all customer traffic has reached a private virtual server system 1040. A customer site 1010 sends both Internet and private virtual server traffic out on a tunnel 1026 across the local or regional network 1020. All traffic arrives at the private virtual server system 1040 through a tunnel switch 1060.

Within the tunnel switch 1060, traffic addressed to the Internet is segregated out from traffic directed to the customer's private virtual server(s). The Internet traffic is sent out to the Internet 1030 via a public communications channel 1064. Internet responses back to the customer are returned in the same way that they were sent. The tunnel switch 1060 sends private virtual server traffic out on an internal tunnel 1062 to the physical server machine 1070 that holds the customer's private virtual server.

A variety of tunneling protocols may be used to create the tunnels used in the present invention. It is preferable to use a layer 2 tunneling protocol for security purposes. Layer 2 tunnels provide solid circuits that make it difficult to “spoof” a fake source address. Packets using a layer 3 tunneling protocol may be created with a fake IP address, allowing a packet to appear to come from a customer when in fact it was sent by an unauthorized third party. Tunnels using a layer 3 tunneling protocol require encryption so that an intruder cannot decode the information. Encryption is also required to protect against accidentally routing the traffic to an incorrect destination, because the encryption will prevent mis-directed traffic from being decoded. Preference for tunnel type depends upon the service provider's network architecture.

Typical examples of tunnel protocols include Asynchronous Transfer Mode virtual circuits (ATM VCs), frame relay virtual circuits (FR VCs), the Point-to-Point Protocol (PPP) across the Layer 2 Tunneling Protocol (L2TP), and IP security protocol (IPsec). ATM or frame relay virtual circuits may be delivered to a customer using Digital Subscriber Line (DSL) access. However, it will be evident to one of skill in the art that other tunneling protocols may be used to implement the tunnels of the present invention.

FIG. 11 is an illustration of an embodiment of a private virtual server system using ATM layer 2 tunneling with DSL access. A system 1100 spans a customer site 1110, a local or regional network 1140, and a service provider 1150.

The customer site 1110 contains a group of computers 1112A, 1112B, and 1112C. The computers 1112 are representative of the customer's on-site private network. Such a private network could be comprised of more or fewer individual computers, as well as other types of equipment such as storage devices.

Components within a customer's on-site private network communicate using a private IP addressing scheme. A packet 1114 is a privately-addressed transmission sent using the local IP protocol of the customer site 1110. Packet 1114 is sent from customer 1110 to customer 1110's private virtual server. Packet 1114 has a destination address corresponding to a private virtual server of service provider 1150.

The on-site private network of devices 1112 is connected to a customer premise equipment box (CPE) 1120. Packet 114 is routed to CPE 1120. The CPE connects the customer site 1110 to a tunnel 1132, established between the customer site 1110 and the service provider site 1150. The tunnel functions as a bi-directional data pipe, and is typically established when a customer subscribes to a service provider providing a tunneling service. A fixed ATM tunnel is referred to as a permanent virtual circuit. The CPE divides the data of packet 1114 into cells (or packets) of a fixed size designated by the ATM protocol, and encapsulates them with a Virtual Channel Identifier (VCI) used to direct the cells through the data pipe. An ATM cell 1118 is created from the division and encapsulation of packet 1114.

Tunnel 1132 terminates at a tunnel switch 1160 of the service provider 1150. Tunnel switch 1160 is connected via a set of bi-directional ATM tunnels 1172 to a set of physical servers 1170. In another embodiment, two sets of unidirectional tunnels are used to provide a two-way connection between customer site 1110 and service provider 1150.

FIG. 12 shows an embodiment of the traffic flow of an ATM cell from a tunnel to a private virtual server. The system of FIG. 12 presents in more detail the functions of the service provider data service center 1150 shown in FIG. 11. In FIG. 12, the service provider data service center 1150 contains the tunnel switch 1160 and a physical host computer 1170. It is to be understood that more than one physical host computer 1170 may be included in system 1150.

A set of incoming external tunnels 1132 terminates at the tunnel switch 1160. Tunnel 1132B carries the incoming ATM cell 1118. Referring back to FIG. 11, ATM cell 1118 is created by the ATM CPE 1120 on the customer site 1110. ATM cell 1118 is created from a privately-addressed IP packet 1114 originally sent by one of the computers 1112.

In FIG. 12, the VCI identifying the incoming tunnel of ATM cell 1118 is read 1212, and presented 1214 to a customer lookup table 1230. Customer lookup table 1230 returns 1216 the correct customer forwarding table (1232B). Table 1232B is accessed from a set of customer forwarding tables 1232.

Customer forwarding table 1232B returns 1218 the identity of the outgoing tunnel required to reach the correct private virtual server destination (1250A) for ATM cell 1118. ATM cell 1118 is then placed 1220 on an internal tunnel 1172 to reach the private virtual server 1250A. Internal tunnel 1172 terminates at a multiplexing/demultiplexing mechanism 1290 of the physical host computer 1170, which contains private virtual server 1250A.

The VCI of ATM cell 1118 is stripped 1252, and the VCI is presented 1254 to lookup table 1260. The rest of the ATM cell 1118, including the original source/destination addresses and payload, is held until the original IP packet 1114 sent by a customer 1112 can be reassembled. The ATM protocol uses relatively small cells compared to other transmission protocols. Therefore multiple ATM cells may be required to reassemble the original pre-ATM-encapsulation packet 1114.

Once the original IP packet 1114 has been reassembled 1262, the location of the IP stack of the destination private virtual server 1250A is retrieved 1256 from lookup table 1260. Packet 1114 is routed 1280 to the IP stack of private virtual server 1250A.

Although the invention has been described in considerable detail with reference to certain embodiments, other embodiments are possible. As will be understood by those of skill in the art, the invention may be embodied in other specific forms without departing from the essential characteristics thereof For example, different protocols may be used to create tunnels. Accordingly, the present invention is intended to embrace all such alternatives, modifications and variations as fall within the spirit and scope of the appended claims and equivalents.

Newman, Peter, Goyal, Pawan

Patent Priority Assignee Title
10291753, Sep 30 2009 Nicira, Inc. Private allocated networks over shared communications infrastructure
10637800, Jun 30 2017 NICIRA, INC Replacement of logical network addresses with physical network addresses
10681000, Jun 30 2017 Nicira, Inc.; NICIRA, INC Assignment of unique physical network addresses for logical network addresses
10757234, Sep 30 2009 Nicira, Inc. Private allocated networks over shared communications infrastructure
10949246, Jul 27 2009 VMware, Inc. Automated network configuration of virtual machines in a virtual lab environment
10951744, Jun 21 2010 Nicira, Inc. Private ethernet overlay networks over a shared ethernet in a virtual environment
11190463, May 23 2008 VMware, Inc. Distributed virtual switch for virtualized computer systems
11533389, Sep 30 2009 Nicira, Inc. Private allocated networks over shared communications infrastructure
11595345, Jun 30 2017 Nicira, Inc. Assignment of unique physical network addresses for logical network addresses
11757797, May 23 2008 VMware, Inc. Distributed virtual switch for virtualized computer systems
11838395, Jun 21 2010 Nicira, Inc. Private ethernet overlay networks over a shared ethernet in a virtual environment
11917044, Sep 30 2009 Nicira, Inc. Private allocated networks over shared communications infrastructure
8619771, Sep 30 2009 NICIRA, INC Private allocated networks over shared communications infrastructure
8924524, Jul 27 2009 NICIRA, INC Automated network configuration of virtual machines in a virtual lab data environment
9306910, Sep 30 2009 VMware, Inc. Private allocated networks over shared communications infrastructure
9391810, Jul 30 2012 VONAGE BUSINESS INC Systems and methods for communicating a stream of data packets via multiple communications channels
9560085, Jul 30 2012 VONAGE BUSINESS INC Systems and methods for communicating a stream of data packets via multiple communications channels
9697032, Jul 27 2009 NICIRA, INC Automated network configuration of virtual machines in a virtual lab environment
9888097, Sep 30 2009 Nicira, Inc. Private allocated networks over shared communications infrastructure
9900410, Jun 21 2010 NICIRA, INC Private ethernet overlay networks over a shared ethernet in a virtual environment
9952892, Jul 27 2009 NICIRA, INC Automated network configuration of virtual machines in a virtual lab environment
Patent Priority Assignee Title
3377624,
4177510, Nov 30 1973 Compagnie Internationale pour l'Informatique, CII Honeywell Bull Protection of data in an information multiprocessing system by implementing a concept of rings to represent the different levels of privileges among processes
5189667, Mar 01 1990 Kabushiki Kaisha Toshiba Method and apparatus for controlling call processing based upon load conditions
5212793, Sep 04 1991 International Business Machines Corporation Generic initiators
5226160, Jul 18 1989 Visage Method of and system for interactive video-audio-computer open architecture operation
5249290, Feb 22 1991 AT&T Bell Laboratories Method of and apparatus for operating a client/server computer network
5263147, Mar 01 1991 Hughes Training, Inc. System for providing high security for personal computers and workstations
5325530, Jan 29 1993 International Business Machines Corporation Controller for sequential programming tools executed in a parallel computing environment
5437032, Nov 04 1993 International Business Machines Corporation Task scheduler for a miltiprocessor system
5528753, Jun 30 1994 International Business Machines Corporation System and method for enabling stripped object software monitoring in a computer system
5572680, Dec 18 1992 Fujitsu Limited Method and apparatus for processing and transferring data to processor and/or respective virtual processor corresponding to destination logical processor number
5584023, Dec 27 1993 OMNISECURE, INC Computer system including a transparent and secure file transform mechanism
5603020, Oct 08 1993 Fujitsu Limited Method for detecting file names by informing the task of the identification of the directory antecedent to the file
5623492, Mar 24 1995 Qwest Communications International Inc Methods and systems for managing bandwidth resources in a fast packet switching network
5636371, Jun 07 1995 Bull HN Information Systems Inc.; BULL HN INFORMATION SYSTEMS INC Virtual network mechanism to access well known port application programs running on a single host system
5640595, Jun 29 1993 International Business Machines Corporation Multimedia resource reservation system with graphical interface for manual input of resource reservation value
5692047, Dec 08 1995 Oracle America, Inc System and method for executing verifiable programs with facility for using non-verifiable programs from trusted sources
5706097, Sep 13 1996 Eastman Kodak Company Index print with a digital recording medium containing still images, motion sequences, and sound sequences
5706453, Feb 06 1995 Intelligent real-time graphic-object to database linking-actuator for enabling intuitive on-screen changes and control of system configuration
5708774, Jul 23 1996 International Business Machines Corporation Automated testing of software application interfaces, object methods and commands
5719854, Nov 23 1994 Alcatel-Lucent USA Inc Efficiently providing multiple grades of service with protection against overloads in shared resources
5727203, Mar 31 1995 Sun Microsystems, Inc. Methods and apparatus for managing a database in a distributed object operating environment using persistent and transient cache
5748614, Jun 09 1995 Siemens Aktiengesellschaft Method for scheduling message cells leaving an ATM node
5752003, Jul 14 1995 HEWLETT-PACKARD DEVELOPMENT COMPANY, L P Architecture for managing traffic in a virtual LAN environment
5761477, Dec 04 1995 Microsoft Technology Licensing, LLC Methods for safe and efficient implementations of virtual machines
5764889, Sep 26 1996 International Business Machines Corporation Method and apparatus for creating a security environment for a user task in a client/server system
5781550, Feb 02 1996 Hewlett Packard Enterprise Development LP Transparent and secure network gateway
5799173, Jul 25 1994 International Business Machines Corporation Dynamic workload balancing
5809527, Dec 23 1993 Unisys Corporation Outboard file cache system
5828893, Dec 24 1992 Freescale Semiconductor, Inc System and method of communicating between trusted and untrusted computer systems
5838686, Apr 22 1994 Thomson Consumer Electronics, Inc. System for dynamically allocating a scarce resource
5838916, Mar 14 1996 RPX CLEARINGHOUSE LLC Systems and methods for executing application programs from a memory device linked to a server
5842002, Jun 01 1994 Quantum Leap Innovations, Inc. Computer virus trap
5845129, Mar 22 1996 Philips Electronics North America Corporation; Philips Electronics North America Corp Protection domains in a single address space
5850399, Mar 27 1998 RPX Corporation Hierarchical packet scheduling method and apparatus
5860004, Jul 03 1996 Oracle America, Inc Code generator for applications in distributed object systems
5864683, Oct 12 1994 McAfee, LLC System for providing secure internetwork by connecting type enforcing secure computers to external network for limiting access to data based on user and process access rights
5889956, Jul 18 1996 FUJITSU LIMITED, A JAPANESE CORPORATION Hierarchical resource management with maximum allowable allocation boundaries
5889996, Dec 16 1996 Oracle International Corporation Accelerator for interpretive environments
5892968, Oct 16 1995 GOOGLE LLC Multimedia data transferring method
5905730, Mar 27 1998 RPX Corporation High speed packet scheduling method and apparatus
5905859, Jan 09 1997 TREND MICRO INCORPORATED Managed network device security method and apparatus
5913024, Feb 09 1996 McAfee, LLC Secure server utilizing separate protocol stacks
5915085, Feb 28 1997 International Business Machines Corporation; IBM Corporation Multiple resource or security contexts in a multithreaded application
5915095, Aug 08 1995 RPX Corporation Method and apparatus for balancing processing requests among a plurality of servers based on measurable characteristics off network node and common application
5918018, Feb 09 1996 McAfee, LLC System and method for achieving network separation
5920699, Nov 07 1996 Hewlett Packard Enterprise Development LP Broadcast isolation and level 3 network switch
5933603, Oct 27 1995 EMC Corporation Video file server maintaining sliding windows of a video data set in random access memories of stream server computers for immediate video-on-demand service beginning at any specified location
5937159, Mar 28 1997 DATA GENERAL CORP Secure computer system
5956481, Feb 06 1997 Microsoft Technology Licensing, LLC Method and apparatus for protecting data files on a computer from virus infection
5978373, Jul 11 1997 AG COMMUNICATION SYSTEMS CORPORATION, A CORPORATION OF DELAWARE Wide area network system providing secure transmission
5982748, Oct 03 1996 AVAYA Inc Method and apparatus for controlling admission of connection requests
5987524, Apr 17 1997 Fujitsu Limited Local area network system and router unit
5991812, Jan 24 1997 FONEWEB, INC Methods and apparatus for fair queuing over a network
5999963, Nov 07 1997 Alcatel Lucent Move-to-rear list scheduling
6016318, Jul 12 1996 NEC Corporation Virtual private network system over public mobile data network and virtual LAN
6018527, Aug 13 1996 RPX CLEARINGHOUSE LLC Queue service interval based cell scheduler with hierarchical queuing configurations
6023721, May 14 1997 Citrix Systems, Inc. Method and system for allowing a single-user application executing in a multi-user environment to create objects having both user-global and system global visibility
6038608, Nov 25 1996 NEC Corporation Virtual LAN system
6038609, Apr 04 1997 Telefonaktiebolaget LM Ericsson Method, communication network and service access interface for communications in an open system interconnection environment
6047325, Oct 24 1997 Network device for supporting construction of virtual local area networks on arbitrary local and wide area computer networks
6055617, Aug 29 1997 International Business Machines Corporation Virtual address window for accessing physical memory in a computer system
6061349, Nov 03 1995 Cisco Technology, Inc System and method for implementing multiple IP addresses on multiple ports
6065118, Aug 09 1996 Citrix Systems, Inc Mobile code isolation cage
6075791, Oct 28 1997 WSOU Investments, LLC System for guaranteeing data transfer rates and delays in packet networks
6075938, Jun 10 1997 The Board of Trustees of the Leland Stanford Junior University Virtual machine monitors for scalable multiprocessors
6078929, Jun 07 1996 DROPBOX, INC Internet file system
6078957, Nov 20 1998 CHECK POINT SOFTWARE TECHNOLOGIES INC Method and apparatus for a TCP/IP load balancing and failover process in an internet protocol (IP) network clustering system
6086623, Jun 30 1997 Oracle America, Inc Method and implementation for intercepting and processing system calls in programmed digital computer to emulate retrograde operating system
6092178, Sep 03 1998 Oracle America, Inc System for responding to a resource request
6094674, May 06 1994 Hitachi, Ltd. Information processing system and information processing method and quality of service supplying method for use with the system
6101543, Oct 25 1996 Hewlett Packard Enterprise Development LP Pseudo network adapter for frame capture, encapsulation and encryption
6108701, Jul 20 1998 THE CHASE MANHATTAN BANK, AS COLLATERAL AGENT Soft switch extension for internet protocol applications
6108759, Feb 23 1995 Veritas Technologies LLC Manipulation of partitions holding advanced file systems
6122673, Jul 22 1998 Ericsson AB Port scheduler and method for scheduling service providing guarantees, hierarchical rate limiting with/without overbooking capability
6154776, Mar 20 1998 Oracle America, Inc Quality of service allocation on a network
6154778, May 19 1998 Hewlett Packard Enterprise Development LP Utility-based multi-category quality-of-service negotiation in distributed systems
6161139, Jul 10 1998 ENTRUST, INC Administrative roles that govern access to administrative functions
6167520, Nov 08 1996 FINJAN LLC System and method for protecting a client during runtime from hostile downloadables
6172981, Oct 30 1997 International Business Machines Corporation Method and system for distributing network routing functions to local area network stations
6189046, Mar 27 1997 Hewlett Packard Enterprise Development LP Mechanism and method for merging cached location information in a distributed object environment
6192389, Mar 28 1997 International Business Machines Corporation Method and apparatus for transferring file descriptors in a multiprocess, multithreaded client/server system
6192512, Sep 24 1998 TREND MICRO INCORPORATED Interpreter with virtualized interface
6230203, Oct 20 1995 Scientific-Atlanta, LLC System and method for providing statistics for flexible billing in a cable environment
6240463, Nov 24 1998 Lucent Technologies Inc Router placement methods and apparatus for designing IP networks with performance guarantees
6247057, Oct 22 1998 Microsoft Technology Licensing, LLC Network server supporting multiple instance of services to operate concurrently by having endpoint mapping subsystem for mapping virtual network names to virtual endpoint IDs
6259699, Dec 30 1997 WSOU Investments, LLC System architecture for and method of processing packets and/or cells in a common switch
6266678, Dec 31 1998 GOOGLE LLC System and method for dynamically viewing contents of a data file
6269404, Jul 14 1995 HEWLETT-PACKARD DEVELOPMENT COMPANY, L P Virtual network architecture for connectionless LAN backbone
6279039, Apr 03 1996 NCR Voyix Corporation Resource management method and apparatus for maximizing multimedia performance of open systems
6279040, Dec 06 1995 Industrial Technology Research Institute Scalable architecture for media-on demand servers
6282581, Mar 27 1997 Hewlett-Packard Company; HEWLETT-PACKARD DEVELOPMENT COMPANY, L P ; Agilent Technologies, Inc Mechanism for resource allocation and for dispatching incoming calls in a distributed object environment
6282703, Oct 29 1998 International Business Machines Corporation Statically linking an application process with a wrapper library
6286047, Sep 10 1998 Viavi Solutions Inc Method and system for automatic discovery of network services
6298479, May 29 1998 Oracle America, Inc Method and system for compiling and linking source files
6314558, Aug 27 1996 JPMORGAN CHASE BANK, N A , AS SUCCESSOR AGENT Byte code instrumentation
6327622, Sep 03 1998 Oracle America, Inc Load balancing in a network environment
6336138, Aug 25 1998 Hewlett Packard Enterprise Development LP Template-driven approach for generating models on network services
6351775, May 30 1997 SAP SE Loading balancing across servers in a computer network
6353616, May 21 1998 Lucent Technologies Inc Adaptive processor schedulor and method for reservation protocol message processing
6363053, Feb 08 1999 UNILOC 2017 LLC Method and apparatus for measurement-based conformance testing of service level agreements in networks
6370583, Aug 17 1998 HEWLETT-PACKARD DEVELOPMENT COMPANY, L P Method and apparatus for portraying a cluster of computer systems as having a single internet protocol image
6381228, Jan 15 1999 Northrop Grumman Systems Corporation Onboard control of demand assigned multiple access protocol for satellite ATM networks
6385638, Sep 04 1997 HANGER SOLUTIONS, LLC Processor resource distributor and method
6389448, Dec 06 1999 WARP Solutions, Inc.; WARP SOLUTIONS, INC System and method for load balancing
6393484, Apr 12 1999 International Business Machines Corp. System and method for controlled access to shared-medium public and semi-public internet protocol (IP) networks
6425003, Jan 22 1999 Cisco Technology, Inc Method and apparatus for DNS resolution
6430622, Sep 22 1999 International Business Machines Corporation Methods, systems and computer program products for automated movement of IP addresses within a cluster
6434631, Oct 15 1999 WSOU Investments, LLC Method and system for providing computer storage access with quality of service guarantees
6434742, May 10 1999 Alcatel Lucent Symbol for automatically renaming symbols in files during the compiling of the files
6438134, Aug 19 1998 Alcatel-Lucent Canada Inc Two-component bandwidth scheduler having application in multi-class digital communications systems
6442164, Jun 03 1999 Fujitsu Limited Method and system for allocating bandwidth and buffer resources to constant bit rate (CBR) traffic
6457008, Aug 28 1998 Oracle International Corporation Pluggable resource scheduling policies
6463459, Jan 22 1999 JPMORGAN CHASE BANK, N A , AS SUCCESSOR AGENT System and method for executing commands associated with specific virtual desktop
6470398, Aug 21 1996 HEWLETT-PACKARD DEVELOPMENT COMPANY, L P Method and apparatus for supporting a select () system call and interprocess communication in a fault-tolerant, scalable distributed computer environment
6487578, Sep 29 1997 Intel Corporation Dynamic feedback costing to enable adaptive control of resource utilization
6487663, Oct 19 1998 Intel Corporation System and method for regulating the transmission of media data
6490670, Apr 24 1998 International Business Machines Corporation Method and apparatus for efficiently allocating objects in object oriented systems
6499137, Oct 02 1998 Microsoft Technology Licensing, LLC Reversible load-time dynamic linking
6529950, Jun 17 1999 International Business Machines Corporation Policy-based multivariate application-level QoS negotiation for multimedia services
6529985, Feb 04 2000 CUFER ASSET LTD L L C Selective interception of system calls
6542167, Jan 28 2000 WIND RIVER SYSTEMS, INC System and method for flexible software linking
6553413, Jul 14 1998 Massachusetts Institute of Technology Content delivery network using edge-of-network servers for providing content delivery to a set of participating content providers
6560613, Feb 08 2000 DATACLOUD TECHNOLOGIES, LLC Disambiguating file descriptors
6578055, Jun 05 2000 International Business Machines Corporation Methods, system and computer program products for mirrored file access through assuming a privileged user level
6578068, Aug 31 1999 Accenture Global Services Limited Load balancer in environment services patterns
6580721, Aug 11 1998 Apple Inc Routing and rate control in a universal transfer mode network
6625650, Jun 27 1998 U S BANK NATIONAL ASSOCIATION, AS COLLATERAL AGENT System for multi-layer broadband provisioning in computer networks
6647422, Feb 26 1996 Network Engineering Technologies, Inc. Web server employing multi-homed, modular framework
6658571, Feb 09 1999 JPMORGAN CHASE BANK, N A ; MORGAN STANLEY SENIOR FUNDING, INC Security framework for dynamically wrapping software applications executing in a computing system
6680922, Jul 10 1998 Intellectual Ventures I LLC Method for the recognition and operation of virtual private networks (VPNs) over a wireless point to multi-point (PtMP) transmission system
6691312, Mar 19 1999 MASSACHUSETTS, UNIVERSITY OF Multicasting video
6711607, Feb 04 2000 SERVSTOR TECHNOLOGIES, LLC Dynamic scheduling of task streams in a multiple-resource system to ensure task stream quality of service
6725456, Nov 29 1999 Alcatel Lucent Methods and apparatus for ensuring quality of service in an operating system
6754716, Feb 11 2000 UNWIRED BROADBAND, INC Restricting communication between network devices on a common network
6760775, Mar 05 1999 AT&T Corp System, method and apparatus for network service load and reliability management
6779016, Aug 23 1999 Oracle America, Inc Extensible computing system
6820117, Oct 18 1999 COBALT NETWORKS, INC Bandwidth management
6976258, Nov 30 1999 HANGER SOLUTIONS, LLC Providing quality of service guarantees to virtual hosts
6976286, Oct 21 2002 Motorized self-draining utility bucket
6982984, Aug 28 2001 Ericsson AB Method and apparatus for virtual private networks
7061899, May 01 2001 HEWLETT-PACKARD DEVELOPMENT COMPANY L P Method and apparatus for providing network security
7111163, Jul 10 2000 ALTERWAN, INC , A CALIFORNIA CORPORATION Wide area network using internet with quality of service
7225259, Feb 21 2001 NOKIA INC Service tunnel over a connectionless network
7318152, Jul 10 2000 ALTERWAN, INC Wide area network using internet with high quality of service
7441043, Dec 31 2002 AT&T Corp System and method to support networking functions for mobile hosts that access multiple networks
7653074, Aug 28 2001 Ericsson AB Method and apparatus for virtual private networks
7672288, Mar 29 1999 III HOLDINGS 3, LLC Arrangement for secure communication and key distribution in a telecommunication system
20030061338,
JP64002145,
WO9939261,
//////
Executed onAssignorAssigneeConveyanceFrameReelDoc
Jun 06 2000NEWMAN, PETEREnsim CorporationASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS 0254960110 pdf
Jun 06 2000GOYAL, PAWANEnsim CorporationASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS 0254960110 pdf
Jun 07 2007Ensim CorporationDIGITAL ASSET ENTERPRISES, L L C ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS 0254950602 pdf
Sep 19 2007Digital Asset Enterprises, L.L.C.(assignment on the face of the patent)
Aug 12 2015DIGITAL ASSET ENTERPRISES, L L C CUFER ASSET LTD L L C MERGER SEE DOCUMENT FOR DETAILS 0371180001 pdf
Sep 18 2018CUFER ASSET LTD L L C Intellectual Ventures I LLCASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS 0469040748 pdf
Date Maintenance Fee Events
Feb 25 2013M1552: Payment of Maintenance Fee, 8th Year, Large Entity.
Feb 24 2017M1553: Payment of Maintenance Fee, 12th Year, Large Entity.


Date Maintenance Schedule
Dec 27 20144 years fee payment window open
Jun 27 20156 months grace period start (w surcharge)
Dec 27 2015patent expiry (for year 4)
Dec 27 20172 years to revive unintentionally abandoned end. (for year 4)
Dec 27 20188 years fee payment window open
Jun 27 20196 months grace period start (w surcharge)
Dec 27 2019patent expiry (for year 8)
Dec 27 20212 years to revive unintentionally abandoned end. (for year 8)
Dec 27 202212 years fee payment window open
Jun 27 20236 months grace period start (w surcharge)
Dec 27 2023patent expiry (for year 12)
Dec 27 20252 years to revive unintentionally abandoned end. (for year 12)