The present invention relates to systems and methods of enhancing prefetch operations. One potential method comprises fetching an object from a page on a web server. The method may further include storing, at a proxy server, caching instructions for the fetched object. The proxy server may be connected with the client and the object is cached at the client. Furthermore, the method may include identifying a prefetchable reference to the fetched object in a subsequent web page and using the caching instructions stored on the proxy server to determine if a fresh copy of the object will be requested by the client. Further, the method may include, based on the determination that the object will be requested, sending a prefetch request for the object using an If-Modified-Since directive, and transmitting a response to the If-Modified-Since directive prefetch request to a proxy client. The proxy client may then either serve the response to the client or a copy of the object stored at the proxy client, depending on the request for the object from the client.
|
10. A method of enhancing prefetch operations, the method comprising:
storing, at a client-side proxy, a first object;
receiving, at the client-side proxy, a prefetched object valid response to a prefetch validity check associated with the first object, wherein the prefetch validity check comprises a first validity check;
storing at the client-side proxy the prefetched object valid response and associating the stored prefetched object valid response with the first object;
receiving a request for the first object from a client, the request including a second validity check;
responsive to identifying, at the client-side proxy, the request for the first object and the second validity check, determining that the client needs to be served the first object;
generating a request fulfilled response based on the stored prefetched object valid response; and
serving the first object from the client-side proxy to the client with the request fulfilled response.
1. A method of enhancing prefetch operations, the method comprising:
storing, at a client-side proxy, a first object;
receiving, at the client-side proxy, a prefetched object valid response to a prefetch validity check comprising a first object validity check associated with the first object;
storing at the client-side proxy the prefetched object valid response and associating the stored prefetched object valid response with the first object;
identifying at the client-side proxy, a request for the first object from a client;
determining, at the client-side proxy, whether the request for the first object from the client includes a second object validity check;
responsive to determining that the request for the first object from the client does not include the second object validity check, generating a request fulfilled response based on the stored prefetched object valid response; and
serving the first object from the client-side proxy to the client with the request fulfilled response.
21. A system comprising:
a client-side proxy device comprising:
a first processor;
an object cache; and
a computer readable storage medium comprising instructions that when executed by the first processor cause the client-side proxy device to:
store, in the object cache, a first object;
receive a prefetched object valid response to a prefetch validity check comprising a first object validity check associated with the first object;
store the prefetched object valid response and associate the stored prefetched object valid response with the first object;
receive a request for the first object from a client, the request including a second validity check;
responsive to an identification of the request for the first object and the second validity check, determine that the client needs to be served the first object;
generate a request fulfilled response based on the stored prefetched object valid response; and
serve the first object from the client-side proxy to the client with the request fulfilled response.
18. A system comprising:
a client-side proxy device comprising:
a first processor;
an object cache; and
a computer readable storage medium comprising instructions that when executed by the first processor cause the client-side proxy device to:
store, in the object cache, a first object;
receive a prefetched object valid response to a prefetch validity check comprising a first object validity check associated with the first object;
store the prefetched object valid response and associate the stored prefetched object valid response with the first object;
identify a request for the first object from a client;
determine whether the request for the first object from the client includes a second object validity check;
in response to a determination that the request for the first object from the client does not include the second object validity check, generate a request fulfilled response based on the stored prefetched object valid response; and
serve the first object from the object cache to the client with the request fulfilled response.
2. The method of
fetching, by a proxy server on behalf of the client, the first object from a content server;
storing, at the proxy server, metadata comprising caching instructions which comprise validity data for the first object and communicating the first object to the client-side proxy in conjunction with storing the first object at the client-side proxy;
identifying, by the proxy server, a prefetchable reference to the first object in a subsequent web page transaction including the client;
based on identifying the prefetchable reference to the first object, sending a first prefetch request for the first object using a third object validity check, wherein the third object validity check is based on the metadata;
receiving, at the proxy server, the prefetched object valid response to the first prefetch request; and
communicating the prefetched object valid response to the client.
4. The method of
5. The method of
7. The method of
9. The method of
using the caching instructions stored on the proxy server to determine that a fresh copy of the first object will be requested by the client prior to sending the first prefetch request;
wherein the metadata comprises a first object expiration value.
11. The method of
fetching, by a proxy server on behalf of the client, the first object from a content server;
storing, at the proxy server, metadata comprising caching instructions which comprise validity data for the first object and communicating the first object to the client-side proxy in conjunction with storing the first object at the client-side proxy;
identifying, by the proxy server, a prefetchable reference to the first object in a subsequent web page transaction including the client;
based on identifying the prefetchable reference to the first object, sending a first prefetch request for the first object using a third object validity check, wherein the third object validity check is based on the metadata;
receiving, at the proxy server, the prefetched object valid response to the first prefetch request; and
communicating the prefetched object valid response to the client.
12. The method of
13. The method of
14. The method of
16. The method of
19. The system of
a second processor;
a second computer readable storage medium comprising instructions that when executed by the second processor cause the proxy server computer to:
fetch on behalf of the client, the first object from a content server;
communicate to a metadata database, caching instructions which comprise validity data for the first object;
communicate the first object to the client-side proxy device in conjunction with the client-side proxy device storing the first object at the object cache;
identify a prefetchable reference to the first object in a subsequent web page transaction including the client-side proxy device;
based on identifying the prefetchable reference to the first object, send a first prefetch request for the first object using a third object validity check, wherein the third object validity check is based on the caching instructions;
receive the prefetched object valid response to the first prefetch request; and
communicate the prefetched object valid response to the client-side proxy device.
20. The system of
a server-side database computer comprising the metadata database, coupled to the proxy server computer, wherein the metadata database comprises a last modified date, an expiration date, a caching permitted value, and an entity tag for a plurality of objects intercepted at the proxy server computer.
22. The system of
fetch the first object from a content server;
store metadata comprising caching instructions which comprise validity data for the first object and communicating the first object to the client-side proxy in conjunction with storing the first object at the client-side proxy;
identify a prefetchable reference to the first object in a subsequent web page transaction including the client;
based on an identification of the prefetchable reference to the first object, send a first prefetch request for the first object using a third object validity check, wherein the third object validity check is based on the metadata;
receive the prefetched object valid response to the first prefetch request; and
communicate the prefetched object valid response to the client.
|
|||||||||||||||||||||||||||||
This application is a continuation-in-part (CIP) of U.S. patent application Ser. No. 12/252,181 filed Oct. 15, 2008, entitled “METHODS AND SYSTEMS FOR IMPLEMENTING A CACHE MODEL IN A PREFETCHING SYSTEM”, which claims priority to U.S. Provisional Patent Application Ser. No. 60/980,101, filed Oct. 15, 2007, entitled “CACHE MODEL IN PREFETCHING SYSTEM”, both of which are hereby incorporated by reference herein in their entirety for any purpose.
The present invention relates, in general, to cache modeling and, more particularly, to cache modeling in a prefetching system.
In general, the prefetching of HTTP content is intended to reduce the latency in downloading web pages that include references to multiple objects by issuing requests from a proxy server and pushing the responses to a proxy client without waiting for the browser to request the items. The proxy server identifies objects to be prefetched by scanning the content of HTML, CSS, JavaScript™, or other objects to identify references to items that are likely to be requested by the browser when it receives the object containing the reference. The browser will not request items that are in its cache if the objects are fresh under the HTTP caching rules. Also, if the browser has an item which may be stale, it will issue a request with the “If-Modified-Since” directive, so that if the object has not changed, a short HTTP response can be returned instead of the full file.
Thus, without a model of the browser cache, the prefetching proxy server would send many objects that will not be requested by the browser and send full files where the browser would normally have received the “Not-Modified” responses. This creates extra load on both the proxy server to webhost upstream link and the proxy server to the client accelerated link. Thus, the current system downloads a number of unnecessary objects, which in turn causes slowdown of the link. Hence, improvements in the art are needed.
Embodiments of the present invention are directed to a method of enhancing prefetch operations. The method includes fetching an object from a page on a web server. The method further includes storing, at a proxy server, caching instructions for the fetched object. The proxy server is connected with the client and the object is cached at the client. Furthermore, the method includes identifying a prefetchable reference to the fetched object in a subsequent web page and using the caching instructions stored on the proxy server to determine if a fresh copy of the object will be requested by the client. Further, the method includes, based on the determination that the object will be requested, sending a prefetch request for the object using an If-Modified-Since directive, and transmitting a response to the If-Modified-Since directive prefetch request to a proxy client.
According to further embodiments, a system for enhancing prefetch operations includes a client including a proxy client. The proxy client is configured to transmit object requests. The system further includes a proxy server connected with the client via the proxy client. The proxy server is configured to fetch, on behalf of the client, at least one object from a webpage, store caching instructions for the at least one fetched object, and identify a prefetchable reference to the at least one fetched object in a subsequent web page. The proxy server is further configured to use the caching instructions to determine if a fresh copy of the at least one object will be requested by the client, and based on the determination that a fresh copy of the at least one object will be requested, send a prefetch request for the object using an If-Modified-Since directive. The system further includes a web server connected with the proxy server. The web server is configured to transmit a response to the If-Modified-Since directive prefetch request.
In an alternative embodiment, a machine-readable medium is described. The machine-readable medium includes instructions for enhancing prefetch operations. The machine-readable medium includes instructions for fetching an object from a page on a web server. The machine-readable medium further includes instructions for storing, at a proxy server, caching instructions for the fetched object. The proxy server is connected with the client and the object is cached at the client. Furthermore, the machine-readable medium includes instructions for identifying a prefetchable reference to the fetched object in a subsequent web page and using the caching instructions stored on the proxy server to determine if a fresh copy of the object will be requested by the client. Further, the machine-readable medium includes instructions based on the determination that the object will be requested, sending a prefetch request for the object using an If-Modified-Since directive, and transmitting a response to the If-Modified-Since directive prefetch request to a proxy client.
A further understanding of the nature and advantages of the present invention may be realized by reference to the remaining portions of the specification and the drawings wherein like reference numerals are used throughout the several drawings to refer to similar components. In some instances, a sub-label is associated with a reference numeral to denote one of multiple similar components. When reference is made to a reference numeral without specification to an existing sub-label, it is intended to refer to all such multiple similar components.
While various aspects of embodiments of the invention have been summarized above, the following detailed description illustrates exemplary embodiments in further detail to enable one of skill in the art to practice the invention. In the following description, for the purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the present invention. It will be apparent, however, to one skilled in the art that the present invention may be practiced without some of these specific details. In other instances, well-known structures and devices are shown in block diagram form. Several embodiments of the invention are described below and, while various features are ascribed to different embodiments, it should be appreciated that the features described with respect to one embodiment may be incorporated with another embodiment as well. By the same token, however, no single feature or features of any described embodiment should be considered essential to the invention, as other embodiments of the invention may omit such features.
Aspects of the disclosure relate to enhancing prefetch operations in network optimization environments. In one embodiment, such enhancements may include only prefetching an object if the object has been modified since it was last prefetched. For example, an object may have been prefetched 2 days ago and, if the object has not been modified in the last 2 days, there is no need to prefetch the object again. Thus, by only prefetching modified (or stale) objects, round trips and bandwidth usage can be minimized.
Turning now to
In one embodiment, these values may be maintained in, for example, a cache model which includes all of the caching instructions for all objects downloaded by the proxy server on behalf of the client (process block 115). The Cache Model thus may contain a list of universal resource locators (URLs) in the client's browser cache with the same set of caching instructions that may be used by the browser in deciding which items are stale. This browser cache data can be volatile and lost after a browser session has ended. However, in one embodiment, at process block 120, the list created from each session may optionally be archived to a persistent storage device (e.g., a hard disk, an optical disk, a network-attached storage (NAS), etc.). Accordingly, even after a session has ended, the prefetch information may be used in subsequent sessions.
At process block 125, an object prefetch request may be received. In one embodiment, the object may be, for example, a picture file, a cascading style sheet (CSS), text, a hyperlink, etc. The prefetch request may be generated by scanning HTML, CSS, JavaScript files, etc. for objects that may be needed to render the associated web page. This scanning may be in accordance to the techniques described in U.S. Provisional Application No. 60/949,493, entitled METHODS AND SYSTEMS FOR JAVA SCRIPT PARSING, FILED ON Jul. 12, 2007, which is incorporated by reference for any and all purposes. Upon receipt of the prefetch request from the scanner, the list of previously downloaded URLs may be checked to determine if an entry already exists for the URL of the current web site (process block 130). At decision block 135, a determination is made if an entry exists for the URL in the cache model.
In one embodiment, if an entry exists for the URL in the cache model, the caching instructions from the previous response for that URL may be retrieved (process block 140). At process block 145, the current date and time may then be applied to the caching instructions in conjunction with the methods of, for example, RFC 2616 to determine if the content is “fresh” (i.e., not modified since it was last prefetched). At decision block 150, the determination is made if the content is “fresh” or not. At process block 155, if the object is “fresh” according to the methods, the probability of the browser emitting a request for the objects is low, and thus it may not be efficient to prefetch the item. However, if the object is “stale” (i.e., has been modified since it was last prefetched), a prefetch request may be uploaded from the proxy server to the web server (process block 160). Thus, since a copy of the item exists in the browser cache, the HTTP “If Modified Since” directive can be attached to the request using the “Last Modified Date” stored in the cache model for the previous response from the URL. If an entry for the prefetch URL does not exist in the cache model, the prefetch request may be sent to the web server, and no “If-Modified-Since” directive is added (process block 175).
At process block 165, if the proxy server receives a response to the prefetch request, the response may be forwarded to the proxy client using the procedures, for example, that are specified in U.S. Provisional Application No. 60/949,492. In one embodiment, if the response contains the requested object, the proxy client may process it as described in U.S. Provisional Application No. 60/949,492. Since, the “If-Modified-Since” directive was added to the request, the response may be an HTTP “Not Modified” message. In such a situation, an additional check may be required to insure that the request from the browser contains the “If-Modified-Since” directive. This can be expected, since the cache model on the proxy server may indicate that a previous copy of the URL was present on the client. In the event that the directive is not present in the request, the prefetched response cannot be used, and the client request may be required to be forwarded to the web server as would be done for other non-prefetched requests.
At process block 170, the cache model entry for the object in the list of last modified dates may be updated to reflect the HTTP caching information attached to the prefetched response. This may be the same process performed in process block 110, as it may be performed on all objects downloaded by the proxy server.
Turning now to
In one embodiment, proxy server 220 may be the proxy server described above in
In one embodiment, proxy server 220 may send a request over low latency link 225 to a web server 230. In one embodiment, the request may include the HTTP “If-Modified-Since” directive and the time stamp stored in the caching instructions. Web server 230 may then analyze the request and the metadata for the file to determine if the object has been modified since it was last prefetched. Accordingly, if the object has been modified, then web server 230 would download the updated version of the object to the proxy server 225. Otherwise, the web server responds with a “Not-Modified” directive. The proxy server 225 then pushes the response to the client proxy 210, which uses it to provide a response to a request from the client web browser 205.
A number of variations and modifications of the disclosed embodiments can also be used. For example, proxy client 210 may be a software or hardware system installed on the same machine as client 205, or proxy client 210 may be implemented on a separate machine as a proxy at the gateway to a branch office or other network serving multiple client machines. In this case, proxy client 205 may be proxying traffic for more than one client web browser, and proxy server 220 may maintain separate browser cache models for each client web browser.
In an additional embodiment, the cache model may be improved by making additional inferences about the client browser based on the pattern of requests that are sent. If the browser uploads requests for items that are known to be in cache and fresh, the browser may be configured to check all items before using them and the proxy server 220 should emit “If-Modified-Since” requests for fresh objects as well as stale. If requests without the “If-Modified-Since” directive are received for items that should have been in the cache, proxy server 220 may infer that the cache has been cleared or that the size of the browser cache is insufficient to hold the older objects.
The computer system 300 is shown comprising hardware elements that can be electrically coupled via a bus 305 (or may otherwise be in communication, as appropriate). The hardware elements can include one or more processors 310, including without limitation one or more general-purpose processors and/or one or more special-purpose processors (such as digital signal processing chips, graphics acceleration chips, and/or the like); one or more input devices 315, which can include without limitation a mouse, a keyboard and/or the like; and one or more output devices 320, which can include without limitation a display device, a printer and/or the like.
The computer system 300 may further include (and/or be in communication with) one or more storage devices 325, which can comprise, without limitation, local and/or network accessible storage and/or can include, without limitation, a disk drive, a drive array, an optical storage device, solid-state storage device such as a random access memory (“RAM”) and/or a read-only memory (“ROM”), which can be programmable, flash-updateable and/or the like. The computer system 300 might also include a communications subsystem 330, which can include without limitation a modem, a network card (wireless or wired), an infra-red communication device, a wireless communication device and/or chipset (such as a Bluetooth™ device, an 802.11 device, a WiFi device, a WiMax device, cellular communication facilities, etc.), and/or the like. The communications subsystem 330 may permit data to be exchanged with a network (such as the network described below, to name one example), and/or any other devices described herein. In many embodiments, the computer system 300 will further comprise a working memory 335, which can include a RAM or ROM device, as described above.
The computer system 300 also can comprise software elements, shown as being currently located within the working memory 335, including an operating system 340 and/or other code, such as one or more application programs 345, which may comprise computer programs of the invention, and/or may be designed to implement methods of the invention and/or configure systems of the invention, as described herein. Merely by way of example, one or more procedures described with respect to the method(s) discussed above might be implemented as code and/or instructions executable by a computer (and/or a processor within a computer). A set of these instructions and/or code might be stored on a computer readable storage medium, such as the storage device(s) 325 described above. In some cases, the storage medium might be incorporated within a computer system, such as the system 300. In other embodiments, the storage medium might be separate from a computer system (i.e., a removable medium, such as a compact disc, etc.), and or provided in an installation package, such that the storage medium can be used to program a general purpose computer with the instructions/code stored thereon. These instructions might take the form of executable code, which is executable by the computer system 300 and/or might take the form of source and/or installable code, which, upon compilation and/or installation on the computer system 300 (e.g., using any of a variety of generally available compilers, installation programs, compression/decompression utilities, etc.) then takes the form of executable code.
It will be apparent to those skilled in the art that substantial variations may be made in accordance with specific requirements. For example, customized hardware might also be used, and/or particular elements might be implemented in hardware, software (including portable software, such as applets, etc.), or both. Further, connection to other computing devices such as network input/output devices may be employed.
In one aspect, the invention employs a computer system (such as the computer system 300) to perform methods of the invention. According to a set of embodiments, some or all of the procedures of such methods are performed by the computer system 300 in response to processor 310 executing one or more sequences of one or more instructions (which might be incorporated into the operating system 340 and/or other code, such as an application program 345) contained in the working memory 335. Such instructions may be read into the working memory 335 from another machine-readable medium, such as one or more of the storage device(s) 325. Merely by way of example, execution of the sequences of instructions contained in the working memory 335 might cause the processor(s) 310 to perform one or more procedures of the methods described herein.
The terms “machine-readable medium” and “computer readable medium”, as used herein, refer to any medium that participates in providing data that causes a machine to operate in a specific fashion. In an embodiment implemented using the computer system 300, various machine-readable media might be involved in providing instructions/code to processor(s) 310 for execution and/or might be used to store and/or carry such instructions/code (e.g., as signals). In many implementations, a computer readable medium is a physical and/or tangible storage medium. Such a medium may take many forms, including but not limited to, non-volatile media, volatile media, and transmission media. Non-volatile media includes, for example, optical or magnetic disks, such as the storage device(s) 325. Volatile media includes, without limitation dynamic memory, such as the working memory 335. Transmission media includes coaxial cables, copper wire and fiber optics, including the wires that comprise the bus 305, as well as the various components of the communication subsystem 330 (and/or the media by which the communications subsystem 330 provides communication with other devices). Hence, transmission media can also take the form of waves (including without limitation radio, acoustic and/or light waves, such as those generated during radio-wave and infra-red data communications).
Common forms of physical and/or tangible computer readable media include, for example, a floppy disk, a flexible disk, hard disk, magnetic tape, or any other magnetic medium, a CD-ROM, any other optical medium, punchcards, papertape, any other physical medium with patterns of holes, a RAM, a PROM, an EPROM, a FLASH-EPROM, any other memory chip or cartridge, a carrier wave as described hereinafter, or any other medium from which a computer can read instructions and/or code.
Various forms of machine-readable media may be involved in carrying one or more sequences of one or more instructions to the processor(s) 310 for execution. Merely by way of example, the instructions may initially be carried on a magnetic disk and/or optical disc of a remote computer. A remote computer might load the instructions into its dynamic memory and send the instructions as signals over a transmission medium to be received and/or executed by the computer system 300. These signals, which might be in the form of electromagnetic signals, acoustic signals, optical signals and/or the like, are all examples of carrier waves on which instructions can be encoded, in accordance with various embodiments of the invention.
The communications subsystem 330 (and/or components thereof) generally will receive the signals, and the bus 305 then might carry the signals (and/or the data, instructions, etc., carried by the signals) to the working memory 335, from which the processor(s) 305 retrieves and executes the instructions. The instructions received by the working memory 335 may optionally be stored on a storage device 325 either before or after execution by the processor(s) 310.
A set of embodiments comprises systems for implementing a cache model in a prefetching system. In one embodiment, proxy server 220, web server 230, and/or client 205, (as shown in
Certain embodiments of the invention operate in a networked environment, which can include a network 410. The network 410 can be any type of network familiar to those skilled in the art that can support data communications using any of a variety of commercially-available protocols, including without limitation TCP/IP, SNA, IPX, AppleTalk, and the like. Merely by way of example, the network 410 can be a local area network (“LAN”), including without limitation an Ethernet network, a Token-Ring network and/or the like; a wide-area network (WAN); a virtual network, including without limitation a virtual private network (“VPN”); the Internet; an intranet; an extranet; a public switched telephone network (“PSTN”); an infra-red network; a wireless network, including without limitation a network operating under any of the IEEE 802.11 suite of protocols, the Bluetooth™ protocol known in the art, and/or any other wireless protocol; and/or any combination of these and/or other networks.
Embodiments of the invention can include one or more server computers 415. Each of the server computers 415 may be configured with an operating system, including without limitation any of those discussed above, as well as any commercially (or freely) available server operating systems. Each of the servers 415 may also be running one or more applications, which can be configured to provide services to one or more clients 405 and/or other servers 415.
Merely by way of example, one of the servers 415 may be a web server, which can be used, merely by way of example, to process requests for web pages or other electronic documents from user computers 405. The web server can also run a variety of server applications, including HTTP servers, FTP servers, CGI servers, database servers, Java™ servers, and the like. In some embodiments of the invention, the web server may be configured to serve web pages that can be operated within a web browser on one or more of the user computers 405 to perform methods of the invention.
The server computers 415, in some embodiments, might include one or more application servers, which can include one or more applications accessible by a client running on one or more of the client computers 405 and/or other servers 415. Merely by way of example, the server(s) 415 can be one or more general purpose computers capable of executing programs or scripts in response to the user computers 405 and/or other servers 415, including without limitation web applications (which might, in some cases, be configured to perform methods of the invention). Merely by way of example, a web application can be implemented as one or more scripts or programs written in any suitable programming language, such as Java™, C, C#™ or C++, and/or any scripting language, such as Perl, Python, or TCL, as well as combinations of any programming/scripting languages. The application server(s) can also include database servers, including without limitation those commercially available from Oracle™, Microsoft™, Sybase™, IBM™ and the like, which can process requests from clients (including, depending on the configurator, database clients, API clients, web browsers, etc.) running on a user computer 405 and/or another server 415. In some embodiments, an application server can create web pages dynamically for displaying the information in accordance with embodiments of the invention. Data provided by an application server may be formatted as web pages (comprising HTML, JavaScript, etc., for example) and/or may be forwarded to a user computer 405 via a web server (as described above, for example). Similarly, a web server might receive web page requests and/or input data from a user computer 405 and/or forward the web page requests and/or input data to an application server. In some cases a web server may be integrated with an application server.
In accordance with further embodiments, one or more servers 415 can function as a file server and/or can include one or more of the files (e.g., application code, data files, etc.) necessary to implement methods of the invention incorporated by an application running on a user computer 405 and/or another server 415. Alternatively, as those skilled in the art will appreciate, a file server can include all necessary files, allowing such an application to be invoked remotely by a user computer 405 and/or server 415. It should be noted that the functions described with respect to various servers herein (e.g., application server, database server, web server, file server, etc.) can be performed by a single server and/or a plurality of specialized servers, depending on implementation-specific needs and parameters.
In certain embodiments, the system can include one or more databases 420. The location of the database(s) 420 is discretionary: merely by way of example, a database 420a might reside on a storage medium local to (and/or resident in) a server 415a (and/or a user computer 405). Alternatively, a database 420b can be remote from any or all of the computers 405, 415, so long as the database can be in communication (e.g., via the network 410) with one or more of these. In a particular set of embodiments, a database 420 can reside in a storage-area network (“SAN”) familiar to those skilled in the art. (Likewise, any necessary files for performing the functions attributed to the computers 405, 415 can be stored locally on the respective computer and/or remotely, as appropriate.) In one set of embodiments, the database 420 can be a relational database, such as an Oracle™ database, that is adapted to store, update, and retrieve data in response to SQL-formatted commands. The database might be controlled and/or maintained by a database server, as described above, for example.
Turning now to
In one embodiment, these values may be maintained in, for example, a cache model or metadata database which includes caching instructions for objects downloaded by the proxy server on behalf of clients. The cache model or metadata store thus may contain a list of universal resource locators (URLs) in the client's browser cache with the same set of caching instructions that may be used by the browser in deciding which items are stale. This browser cache data can be volatile and lost after a browser session has ended.
In process block 515 then, copies of the prefetched objects are stored at a proxy client or client side modem. Such a proxy client or client side modem may be a standalone device on the client side, or may be a module integrated with a user's computing device. However, in one embodiment, at process block 520, the list created from each session may optionally be archived to a persistent storage device (e.g., a hard disk, an optical disk, a network-attached storage (NAS), etc.). Accordingly, even after a session has ended, the prefetch information may be used in subsequent sessions.
At process block 525, an object or page request may be received at a proxy, and a prefetchable reference may be identified. In one embodiment, the object may be, for example, a picture file, a cascading style sheet (CSS), text, a hyperlink, etc. The prefetchable reference may be generated by scanning HTML, CSS, JavaScript files, etc. for objects that may be needed to render the associated web page. Upon receipt of a prefetch request for the prefetchable reference from the scanner, the list of previously downloaded URLs may be checked to determine if an entry already exists in a metadata database or cache model for the URL of the current web site (process block 530). At decision block 535, a determination is made if an entry exists for the URL. If no entry exists, an assumption is made that no copy of the object exists in the client cache or in the proxy client device, and a copy of the object is requested as a prefetched object from the appropriate content or web server. In alternative embodiments, any similar list, identifier, or database entry may be used to identify metadata for an object.
In one embodiment, if an entry exists for the URL in the metadata database, the caching instructions from the previous response for that URL may be retrieved (process block 540). At process block 545, the current date and time may then be applied to the caching instructions in conjunction with the methods to determine if the content is “fresh” (i.e., not modified since it was last prefetched). In certain embodiments, this may involve checking metadata associated with an expiration of an object. For example, an object downloaded to a client may have associated metadata indicating that the object may be reused for a predetermined amount of time. In certain embodiments, an additional decision following 545 may include a determination that a reuse time has expired, and a check needs to be made to see if the object has been updated at a content server. In further embodiments, checking that the content is “fresh” following 545 may involve verifying that the object has not been removed from a cache or memory of the client-side proxy.
In certain embodiments, a system may simply assume that the content is not fresh, or may proceed to block 560 if there is any uncertainty about whether the object may appropriately be used. In such embodiments, the method may simply assume any initial associations made as to whether the client-side proxy version of the object is fresh, and the system will always proceed to use metadata to send a prefetch validity check if appropriate given the metadata stored in the database.
In certain embodiments, as similarly described in
Based on metadata stored in the system, the prefetch request for the object in block 560 may be created with a validity check. A validity check may be a query as part of the prefetch request that uses metadata associated with the object, such as an ETag identifier or a last downloaded time, to determine if the object already at the client or client proxy is the appropriate object to be served in response to a request. For example, a validity check may be an HTTP “If Modified Since” directive included with a response, or may be an “If None Match” directive. Either validity check may enable the system to identify that an object already in storage at the client proxy is the correct object to serve to the client. Thus, since a copy of the item exists in the browser cache, the HTTP “If Modified Since” directive can be attached to the request using the “Last Modified Date” stored in the cache model for the previous response from the URL. If an entry for the prefetch URL does not exist in the cache model, the prefetch request may be sent to the web server, and no “If Modified Since” directive is added (process block 575).
In block 565, a prefetched “object valid” response is received in response to the validity check. In alternative embodiments, certain responses may receive an invalid object response at a proxy server from a content server, with a copy of the correct object. In block 565, however, the response is a prefetched object valid response which indicates that the object stored in the client proxy device is the correct object for responding to the identified prefetchable reference. An example of a prefetched object valid response is an HTTP 304 not modified response to an object validity check. When the object valid response is received by the proxy server computer, it is forwarded to the proxy client device.
At process block 570, any additional information required to complete a response to an object request for the identified prefetchable reference may be performed, either by the proxy server computer, the proxy client device, or both. The cache model entry or any appropriate metadata database information may then be updated for the object. For example, in the list of last modified dates, for the object, an update may reflect the HTTP caching information attached to the prefetched response.
In various embodiments, a single web page or object request may result in the method 500 operating multiple times. For example, if a request for a web page results in multiple prefetchable objects being identified, where all the prefetchable objects have metadata stored on the server-side and accessible by the proxy server, and number of prefetch requests with validity checks may be issued and object valid responses returned to a proxy client in response to a single object or web page request by a client or client web browser.
Similarly, in certain embodiments, multiple clients or client web browsers may be associated with a single proxy client device, such that a proxy server computer may communicate with a metadata database to associate metadata from multiple clients with a single proxy client or group of proxy clients. In such embodiments, a system may use an object cached at a proxy client in response to a request by a first web browser or first client, but may perform method 500 in response to a request for a second web browser or second client associated with the proxy client. Thus, regardless of whether a particular client makes a request for an object with a validity check, the prefetched validity response may be used to respond correctly to the actual request from the client by converting the response from the web server to match the request made by the client.
In 580, a client-side proxy stores an object. The object may be associated with metadata, such as web browser caching metadata, which may include ETag data or last time updated data as described above. The object may be cached as part of a request and response, where a client has requested the object, or may be cached by any other means, such as on request to a different client. In certain embodiments, subsequent to the caching in 580, a client may request an object or web page, and communicate a request for the web page to a content server via a proxy server computer and/or a client-side proxy device. As part of this request, a proxy may intercept the request and identify prefetchable references that are expected to be subsequently requested by the client as part of a web page transaction. One potential embodiment is described in
After the prefetched object valid response is received at the client-side proxy device, the client-side proxy device may intercept a request associated with the object in 584. Once client-side proxy device identifies that a request has been received for an object stored in the client-side proxy device which further has an associated prefetched object valid response, the client-side proxy may check to see a prefetch validity check that resulted in the prefetched object valid response matched a request validity check from the client as the client actually requests the object. The client-side proxy may further check in 587 that the any client object cached at a client matches the proxy client object. These may not match if, for example, a proxy client has been updated with a newer version of the object, or if a copy of the object. If both decision block 586 and decision block 587 result in a yes, then in 588 the proxy-client may response to the request for the object from the proxy client by sending the prefetched object valid response to the client.
If, however, the decision in either 586 or 587 results in a no, then the object stored in the proxy client may be served to the client to replace any invalid or non-matching copy of the object stored in a client or client browser cached. In various embodiments, the order of decisions 586 and 587 may be reversed, or may be identified simultaneously. In block 590, after either decision 586 or 587 results in a now, the prefetched validity response is converted to a request fulfilled response.
This conversion of 590 may thus occur under two circumstances. In a first circumstance described by 587, the client-side proxy identifies that the copy of the object stored in the client cache does not match the copy in the client side proxy, after the client-side proxy has verified using the prefetched validity check that the client-side proxy has the correct version of the object. Such circumstances may involve identifying at the client-side proxy, a request for the object from the client wherein the request includes the validity check and then determining in response to the request for the object that the client needs to be served the first object because the object at the client is incorrect or questionable. For example, if the validity check was based on an If Modified Since that included noon on a Monday as the last download time metadata, and the request from the client includes the same If Modified Since validity check, but the last download time metadata is for the previous Friday at noon, then there is uncertainty in the system as to whether the object was modified between Friday at noon and Monday at noon, which is the last modified time validated by the prefetched validity check. In such a circumstance, the client-side proxy may convert the prefetched validity response to a request fulfilled response, essentially mimicking the response that would be sent if an updated had occurred, and the copy of the object which has been verified may be served from the client-side proxy to the client with the converted request fulfilled response.
In the second circumstance, identified by 586, the request from the client does not include the validity check used by the prefetched validity check. This may result in multiple uncertainties. For example, if the object has been deleted from the client cache, the client will send a request for the object with no validity check at all, since the client does not have a copy of the object to validate. In such a circumstance, the client-side proxy has the correct object, and can respond to the request by converting the prefetched validity response to a request fulfilled response. Just as above, the client-side proxy essentially mimicks the response from a web server by providing the validated object from the client-side proxy.
After this conversion of 590 takes place, the proxy-client may respond to the request for the object by the client using the request fulfilled response and the copy of the object stored in the client-side proxy in 592. After the object is served to the client from the client-side proxy, the client-side proxy may, in certain embodiments, communicate updated metadata to the server-side proxy, identifying that the object was served to the client from the client-side proxy.
One particular example may now be described for an embodiment using an If Modified Since validity check. Elements of such an embodiment may correspond to elements of the methods in
At a later time, the client may initiate the same or a similar web page transaction, and the proxy client may identify the object as an expected part of this web page transaction, flagging the object as a prefetchable reference. The last download time metadata may be used at the proxy server to create a request for the object with an If Modified Since directive, such that an updated copy of the object will only be communicated if the object has been updated at a web server. This request functions as a prefetch validity check for the object. If the object has not been updated since the time identified in the metadata as the last download time, an HTTP 304 object not modified response may be returned to the proxy server as a prefetched object valid response to the prefetch validity check. The HTTP 304 object not modified response may then be forwarded to the client-side proxy, which may be equivalent to 565 of
When the client-side proxy receives the HTTP 304 object not modified response, this may be stored and associated with the object, waiting for the client-side proxy to actually receive the request for the object as part of the web page transaction. When the client-side proxy actually receives the request for the object, the client-side proxy may analyze the request to see if the same validity check is present as was used in the prefetch validity check. If the request for the object uses an If Modified Since directive with the same or a later associated last download time, then the proxy client may simply pass the prefetched HTTP 304 object not modified response to the client. If, however, the request for the object from the client does not include an If Modified Since directive (equivalent to a no response to decision block 586) or if the associated metadata leaves some question as to whether the object cached by the client is valid (for example if the last download time in the request for the client is prior to the last download time used in the prefetched validity check, indicating that an older version of the object may potentially be cached, equivalent to a no response to decision black 587) then a new copy of the object needs to be served to the client. Because the client-side proxy has information that the object stored in the client-side proxy is valid, the client-side proxy can serve the copy of the object stored in the client-side proxy to the client. In order to match the request for the object issued by the client to the response sent the client, the HTTP 304 object not modified response that was prefetched to the client-side proxy may be converted to an HTTP 200 response. The request from the client may then be directly responded to by the client-side proxy using the converted HTTP 200 response and the copy of the object stored at the client-side proxy.
Similarly, in an alternate embodiment if the validity check is an If None Match request with associated ETag identifying metadata, if the client-side proxy has the correct copy of the object, it may be served to the client in a similar fashion, by converting a prefetched HTTP 304 object not modified response into an HTTP 200 response, and serving the object from the client-side proxy to the client.
Such embodiments provide for reduced network use by replacing copies of objects that would otherwise be communicated across a network, with validity checks and responses indicating that cached objects at proxy systems are valid and may be used rather than downloading new copies of an object. Such systems may additionally provide a transparent system to clients while insuring the accuracy of the content provided to the client and also greatly reducing latency such as when a network connection from a client-side to a server-side is over a high latency link such as a satellite link.
While the invention has been described with respect to exemplary embodiments, one skilled in the art will recognize that numerous modifications are possible. For example, the methods and processes described herein may be implemented using hardware components, software components, and/or any combination thereof Further, while various methods and processes described herein may be described with respect to particular structural and/or functional components for ease of description, methods of the invention are not limited to any particular structural and/or functional architecture but instead can be implemented on any suitable hardware, firmware and/or software configurator. Similarly, while various functionalities are ascribed to certain system components, unless the context dictates otherwise, this functionality can be distributed among various other system components in accordance with different embodiments of the invention.
Moreover, while the procedures comprised in the methods and processes described herein are described in a particular order for ease of description, unless the context dictates otherwise, various procedures may be reordered, added, and/or omitted in accordance with various embodiments of the invention. Moreover, the procedures described with respect to one method or process may be incorporated within other described methods or processes; likewise, system components described according to a particular structural architecture and/or with respect to one system may be organized in alternative structural architectures and/or incorporated within other described systems. Hence, while various embodiments are described with—or without—certain features for ease of description and to illustrate exemplary features, the various components and/or features described herein with respect to a particular embodiment can be substituted, added and/or subtracted from among other described embodiments, unless the context dictates otherwise. Consequently, although the invention has been described with respect to exemplary embodiments, it will be appreciated that the invention is intended to cover all modifications and equivalents within the scope of the following claims.
Sebastian, William B., Lepeska, Peter
| Patent | Priority | Assignee | Title |
| 11095494, | Oct 15 2007 | Viasat, Inc | Methods and systems for implementing a cache model in a prefetching system |
| Patent | Priority | Assignee | Title |
| 5802292, | Apr 28 1995 | HEWLETT-PACKARD DEVELOPMENT COMPANY, L P | Method for predictive prefetching of information over a communications network |
| 6085193, | Sep 29 1997 | GOOGLE LLC | Method and system for dynamically prefetching information via a server hierarchy |
| 6195622, | Jan 15 1998 | Microsoft Technology Licensing, LLC | Methods and apparatus for building attribute transition probability models for use in pre-fetching resources |
| 6249804, | Jul 22 1998 | Computer network read-ahead caching method | |
| 6282542, | Aug 06 1997 | TACHYON, INC | Distributed system and method for prefetching objects |
| 6330561, | Jun 26 1998 | AT&T Corp | Method and apparatus for improving end to end performance of a data network |
| 6389422, | Jan 27 1998 | Sharp Kabushiki Kaisha | METHOD OF RELAYING FILE OBJECT, DISTRIBUTED FILE SYSTEM, COMPUTER READABLE MEDIUM RECORDING A PROGRAM OF FILE OBJECT RELAY METHOD AND GATEWAY COMPUTER, ALLOWING REFERENCE OF ONE SAME FILE OBJECT AMONG NETWORKS |
| 6453404, | May 27 1999 | ZHIGU HOLDINGS LIMITED | Distributed data cache with memory allocation model |
| 6496520, | Jan 21 2000 | OPTIMORPHIX, INC | Wireless network system and method |
| 6505253, | Jun 30 1998 | Oracle America, Inc | Multiple ACK windows providing congestion control in reliable multicast protocol |
| 6615267, | Mar 13 1997 | Google Technology Holdings LLC | System and method for delivery of information over narrow-band communications links |
| 6658463, | Jun 10 1999 | U S BANK NATIONAL ASSOCIATION | Satellite multicast performance enhancing multicast HTTP proxy system and method |
| 7130890, | Sep 04 2002 | HEWLETT-PACKARD DEVELOPMENT COMPANY, L P | Method and system for adaptively prefetching objects from a network |
| 7286476, | Aug 01 2003 | F5 Networks, Inc | Accelerating network performance by striping and parallelization of TCP connections |
| 7359890, | May 08 2002 | Oracle International Corporation | System load based adaptive prefetch |
| 7363291, | Mar 29 2002 | GOOGLE LLC | Methods and apparatus for increasing efficiency of electronic document delivery to users |
| 7389330, | Sep 11 2002 | U S BANK NATIONAL ASSOCIATION | System and method for pre-fetching content in a proxy architecture |
| 7437438, | Dec 27 2001 | HEWLETT-PACKARD DEVELOPMENT COMPANY, L P | System and method for energy efficient data prefetching |
| 7555488, | Mar 05 1999 | Microsoft Technology Licensing, LLC | Prefetching and caching persistent objects |
| 7587398, | Jun 30 2004 | GOOGLE LLC | System and method of accessing a document efficiently through multi-tier web caching |
| 7603616, | Jun 26 2000 | Microsoft Technology Licensing, LLC | Proxy server using a statistical model |
| 7640353, | Apr 27 2006 | Microsoft Technology Licensing, LLC | Guided random seek support for media streaming |
| 7653722, | Dec 05 2005 | NetApp, Inc | Server monitoring framework |
| 7711797, | Jul 31 2006 | Juniper Networks, Inc. | Optimizing batch size for prefetching data over wide area networks |
| 8074028, | Mar 12 2007 | Citrix Systems, Inc | Systems and methods of providing a multi-tier cache |
| 8812651, | Feb 15 2007 | GOOGLE LLC | Systems and methods for client cache awareness |
| 8966053, | Jul 12 2007 | Viasat, Inc | Methods and systems for performing a prefetch abort operation for network acceleration |
| 9460229, | Oct 15 2007 | ViaSat, Inc.; Viasat, Inc | Methods and systems for implementing a cache model in a prefetching system |
| 20020010761, | |||
| 20020062384, | |||
| 20030061451, | |||
| 20030115281, | |||
| 20030126232, | |||
| 20030182437, | |||
| 20040015591, | |||
| 20040205149, | |||
| 20040215717, | |||
| 20040255048, | |||
| 20060212524, | |||
| 20060294576, | |||
| 20070038853, | |||
| 20070156845, | |||
| 20080005736, | |||
| 20080208789, | |||
| 20080228899, | |||
| 20080229025, | |||
| 20090019153, | |||
| 20090094417, | |||
| 20090100228, | |||
| 20090193147, | |||
| 20090287842, | |||
| 20090292791, | |||
| 20090292824, | |||
| 20090300208, | |||
| 20100067378, | |||
| 20100088398, | |||
| 20150295804, |
| Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
| Jan 10 2013 | ViaSat, Inc. | (assignment on the face of the patent) | / | |||
| Jan 16 2013 | LEPESKA, PETER | VIASAT,INC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 041508 | /0003 | |
| Jan 16 2013 | SEBASTIAN, WILLIAM B | VIASAT,INC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 041508 | /0003 | |
| Jan 16 2013 | LEPESKA, PETER | Viasat, Inc | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 030474 | /0136 | |
| Nov 26 2013 | Viasat, Inc | UNION BANK, N A , AS AGENT FOR THE SECURED PARTIES | SECURITY AGREEMENT | 031868 | /0789 | |
| Mar 27 2019 | Viasat, Inc | Wilmington Trust, National Association, as Collateral Trustee | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 048715 | /0589 | |
| Mar 04 2022 | Viasat, Inc | BANK OF AMERICA, N A | SECURITY AGREEMENT | 059332 | /0558 | |
| May 30 2023 | Viasat, Inc | BANK OF AMERICA, N A , AS AGENT | SECURITY AGREEMENT | 063822 | /0446 |
| Date | Maintenance Fee Events |
| Mar 31 2017 | ASPN: Payor Number Assigned. |
| Nov 16 2020 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
| Date | Maintenance Schedule |
| May 16 2020 | 4 years fee payment window open |
| Nov 16 2020 | 6 months grace period start (w surcharge) |
| May 16 2021 | patent expiry (for year 4) |
| May 16 2023 | 2 years to revive unintentionally abandoned end. (for year 4) |
| May 16 2024 | 8 years fee payment window open |
| Nov 16 2024 | 6 months grace period start (w surcharge) |
| May 16 2025 | patent expiry (for year 8) |
| May 16 2027 | 2 years to revive unintentionally abandoned end. (for year 8) |
| May 16 2028 | 12 years fee payment window open |
| Nov 16 2028 | 6 months grace period start (w surcharge) |
| May 16 2029 | patent expiry (for year 12) |
| May 16 2031 | 2 years to revive unintentionally abandoned end. (for year 12) |