A method and apparatus for creating and posting media is provided. For example, the invention allows a user to quickly create, signal process, encode, and transfer media files to a server for storage, posting, distribution, and retrieval. Thus, media such as audio, video, display, photo, spreadsheet, Web Clips, and HTML pages can be combined into a media file for uploading to a server and accessed from listings posted at web sites. A user downloads and installs a plug-in on a computer and performs various tasks. For example, the user can create a combined audio and photo media file on the computer and perform digital signal processing and encoding of the media file and upload to a server for storage, posting, distribution, and retrieval. An information management system provides file and file list rankings based upon selection or click through of files and file listings.
|
1. A system for sharing media for retrieval comprising: a first computer system configured to connect to a server via a communication network;
wherein said first computer system is configured to create a mediagram specified by a creator user wherein said mediagram comprises an atomic unit having at least one reference to audio data and a set of media attributes, wherein said atomic unit is a logical entity that is not further divisible;
said server configured to receive and store said mediagram;
said mediagram referenced in an ordered list in said server;
wherein position of said mediagram within said ordered list is based upon a popularity ranking;
said server configured to present said ordered list comprising said mediagram to at least one client computer to enable a user of said at least one client computer to select a list item for retrieval from said server;
said ordered list and contents of said ordered list are altered dynamically as a result of input provided to said ordered list;
said at least one client computer configured to retrieve said mediagram from said server in response to said selection and wherein said at least one client computer is configured to reference said mediagram in said ordered list;
said at least one client computer configured to retrieve said audio data using said reference to said audio data contained in said mediagram; and
said at least one client computer configured to present said mediagram to enable said user of said at least one client computer to select said mediagram for playback of said audio data referenced by said mediagram.
2. A system for sharing media for retrieval comprising:
a mediagram specified by a creator user in a first computer configured to connect to a server via a communication network, wherein said mediagram comprises an atomic unit having at least one reference to audio data and a set of media attributes, wherein said atomic unit is a logical entity that is not further divisible;
wherein said server is configured to receive and store said mediagram;
wherein said mediagram is referenced in an ordered list in said server, wherein position of said mediagram within said ordered list is based upon a popularity ranking;
wherein said server is accessible by at least one client configured to execute in at least one client computer;
wherein said server configured to present said mediagram to enable said at least one client to select said mediagram for retrieval from said server;
said at least one client computer configured to retrieve said mediagram from said server in response to said selection and wherein said at least one client computer is configured to reference said mediagram in a client list;
said at least one client computer configured to present said client list comprising said mediagram to enable selection of a list item for playback of said audio data referenced by said mediagram;
said at least one client computer configured to retrieve said audio data using said reference to said audio data contained in said mediagram; and
said ordered list in said server and contents of said ordered list in said server are altered dynamically as a result of input provided to said ordered list.
4. A system for sharing media for retrieval comprising:
a first client computer configured to connect to a server via a communication network;
wherein said server comprises references to audio data stored in said server, wherein said audio data is from a plurality of sources and is stored in condition for retrieval;
wherein said first client computer is configured to obtain said references to said audio data from said server;
wherein said first client computer is configured to create a mediagram specified by a creator user wherein said mediagram comprises said references enabling retrieval of said audio data wherein said mediagram comprises an atomic unit having at least one reference to said audio data and a set of media attributes, wherein said atomic unit is a logical entity that is not further divisible;
wherein said first client computer is configured to publish said mediagram to said server via said communication network;
wherein said server is configured to receive and store said mediagram that comprises said references enabling retrieval of said audio data;
wherein said mediagram is referenced in an ordered list in said server;
wherein position of said mediagram within said ordered list is based upon a popularity ranking;
wherein said server is configured to cause said ordered list comprising said mediagram to be displayed on at least one other client computer in a way that enables a user of at least one other client computer to select a list item for retrieval to said at least one other client; and,
wherein said ordered list and contents of said ordered list are altered dynamically as a result of input provided to said ordered list.
3. The system for sharing media for retrieval of
said client list in said client computer and contents of said client list in on said client computer are altered automatically as a result of changes to said mediagram.
|
|||||||||||||||||||||||||||
This patent application is a continuation of U.S. patent application Ser. No. 09/710,654, now U.S. Pat. No. 7,069,310 to Bartholomew, entitled “METHOD AND APPARATUS FOR CREATING AND POSTING MEDIA” filed Nov. 10, 2000, the specification of which is hereby incorporated herein by reference.
1. Field of the Invention
The present invention relates to the generation, transfer, and posting of media data in a computer network environment. More particularly, the invention relates to a client computer based system for creating, processing, encoding, and transferring media files for server based storage, posting, distribution, and retrieval.
2. Background Art
The development of computer technology, computer networks and the Internet has brought about a need for better ways to create, manage and disseminate files. The advancement of the Internet market has only increased this need and allowed providers of such services to maintain a viable business.
However, using current technology, the creation, preparation, management and dissemination of files (e.g., audio, visual media and/or presentation files) over the Internet is a tedious and inefficient process for the typical user. For instance, in order to disseminate an audio or visual presentation over the Internet, a number of steps are required. In addition, many parts of the process require specialized knowledge that many computer users do not have.
Using current systems, a user must first create or record an audio or video file live using a microphone and/or as a compilation of material that may include recordings made live as well as prerecorded offerings, including offerings from various potential inputs. All of these sources must be mixed together into a single recording with the volume and recording level controlled appropriately for each of the components. While programs exist for accomplishing this task, they require a degree of expertise on the part of the user.
In addition, recorded audio files can be digitally signal processed to optimize the quality of the sound using digital signal processing. However, such processing can require many steps including multi-band voice-optimized compression where compression reduces selected signal input (e.g. audio analog compression, not to be confused with data compression or encoding). Current systems also provide a way to optimize other types of files (e.g., video, audio, etc . . . ) using digital or analog optimization techniques. For example, in order to create professional quality media files, these steps are generally not optional and thus failure to perform them put a web broadcaster at a competitive disadvantage as compared to one who does perform them.
Also, in order to use a file with certain software applications, the file is usually converted into a file format, such as Real Audio™, that can be replayed by that application. File conversion may also be required when the target application is a web browser. For instance, if the intended recipient is a web browser, the file is encoded into a format (e.g., WAV) that the web browser or a help application associated with the web browser is capable of playing. The programs that exist to accomplish this encoding require a degree of expertise on the part of the user.
Furthermore, media files uploaded to a server have little in the way of the capability to incorporate links to other web sites as part of the media file or presentation. Current systems, for example, lack a way for users to post parts of a presentation on different servers in order to utilize servers with various capabilities (e.g., RealServer™). If parts of the presentation are posted on different servers, the server must typically be provided with the capability to download all of the files associated with the presentation to the audience upon request. Once again, the steps require user intervention to accomplish tasks that require expertise. Furthermore, these tasks are time consuming and the process of editing or modifying a media file or presentation includes repeating the same steps as above.
Another limitation inherent in current systems is that once the user generates a media file, there is no simple mechanism for depositing the media files into a dynamic environment (e.g., a list that changes according to a set of criteria or behaviors established by the user). For example, users may send files they create to a server, but the prior art does not have a way for the posting user to sequence the files according to a series of dynamic attributes. Users cannot, for example, define the type of files that are to be placed on the server where the files that are on the server are associated with a list that changes according to criteria established by the user. Thus, there is a need for a system that accomplished these objectives by providing the user with a dynamic environment in which to upload files.
It is apparent that the current procedures to create, prepare, manage and disseminate media files and presentations over the Internet are lengthy and tedious, requiring a high level of knowledge of a number of computer programs for processing each step. The process is so tedious because each step typically requires the use of a different computer program and the user must take the output of one program and feed it into the next program.
Moreover, these tasks are currently performed as individual steps in separate programs on servers rather than on the user's computer. It would be more efficient for users to perform as many of these steps as possible on their own computers or clients, rather than attempt to perform the processing using software provided for them on a server.
For example, a user may have to upload a .WAV file to one server for signal processing and know how to operate the signal processing for that server. The user will then have to load the file to another server for encoding and know how to operate that program as well. After that, the user will have to load the completed file to a third server for distribution and must know how to use the system on that third server as well.
Therefore, there is a need for a simple, inexpensive way to create, process, encode, upload, post and distribute seamless media files and presentations while requiring minimal creator input, expertise, and time. Hence, a system is needed that runs on a user's local PC and is suitable for users who are not experts in various media recording, processing, encoding, transmitting, and server based software packages.
The present invention provides a method and apparatus for creating and posting media. Embodiments of the invention provide a convenient process for a user to quickly create, signal process, encode, and transfer media files to a server for storage, posting, distribution, and retrieval. For example, audio, video, display, photo, database, spreadsheet, voice messages, Web Clips, pictures, HTML pages, attachments, templates, and/or combinations of such data can be combined into a media file for uploading to a server and accessible from a listing posted at a web site.
In accordance with an embodiment of the present invention, a user accesses a system server to download a plug-in and register as a user. After downloading the plug-in, the plug-in is installed at step. The user may then log into the server where the user is given multiple options. For example, the user can “create” a media file using the create command. If the user selects the create command, server based control is initiated and the plug-in continues to record or receive media file at the plug-in, in accordance with the control parameters received from the system server.
For example, a user may record audio, video, photo, and/or display information options using the plug-in or other systems. For example, the plug-in may provide a user with a system for recording audio information using a PC base microphone and video input. Alternatively, a media file may be recorded using another method, or previously recorded and accessed by the plug-in.
Also, in accordance with another aspect of the invention, once the plug in has access to a media file, the plug-in performs digital signal processing upon that media file. In addition, the plug-in encodes the media file. After a file is encoded, it may be uploaded to a server for storage, posting, distribution, and retrieval from other client computers.
According to an embodiment of the invention, recording (e.g. setting levels, recording, playback, etc), signal processing of the generated file, RealAudio encoding, and upload to a server can be done with as few as 3 clicks (e.g. record/stop/upload).
Upon successful upload of a file, a file management system provides copies and listings of the file to other servers and web sites as approved by the creator of the file and the owner of the servers and/or site owners. For example, once a file is uploaded, the system then incorporates the file information into one or more web site lists and/or server based database. Once a file is incorporated into the databases, any user having access to a database or list, may select that file for retrieval or playback. Hence, the invention allows for media files to be stored to and accessed from one location (e.g. an Internet server) that is accessible from various locations (e.g. Internet clients via an Internet web site).
In accordance with another aspect of the invention, an information management system provides file and file list rankings based upon selection or click through of web page listing and/or desired files. Thus, for example, information relating to popular selections and lists can be tracked and recorded by the system in order to provide list and/or file ratings.
The present invention provides a method and apparatus for providing a system for creating and posting media. In the following description, numerous specific details are set forth in order to provide a more thorough understanding of the present invention. It will be apparent, however, to one skilled in the art, that the present invention may be practiced without these specific details. In other instances, well-known features have not been described in detail in order not to unnecessarily obscure the present invention. Hereinafter, the term “system” is used to refer to a device and/or a method for performing a function. Furthermore, hereinafter, use of the term “media”, “audio”, “video”, “data”, or “data files” shall comprise various types of media including analog and digital audio, video, database, and display information or data.
Embodiments of the invention provide a convenient system for the user to create, signal process, encode, and transfer a media file (e.g. an audio file) to a server for storage, distribution, and retrieval from a posting. For example, a system can be implemented using a plug-in installed on a general purpose computer for creating RealAudio recordings with client-side processing, and automatically hosting those recordings on a computer network server and posting a reference to the recording on web site lists.
Embodiment of General Purpose Computer Environment
Referring to
Computer 100 includes video memory 114, main memory 115, mass storage 112, and communication interface 120. All these devices are coupled to a bi-directional system bus 118 along with keyboard 110, mouse 111 and CPU 113. The mass storage 112 may include both fixed and removable media, such as magnetic, optical or magnetic optical storage systems or any other available mass storage technology. The system bus 118 provides a means for addressing video memory 114 or main memory 115. The system bus 118 also provides a mechanism for the CPU to transferring data between and among the components, such as main memory 115, video memory 114 and mass storage 112.
In one embodiment of the invention, the CPU 113 is a microprocessor manufactured by Motorola, such as the 680X0 processor, an Intel Pentium III processor, or an UltraSPARC processor from Sun Microsystems. However, any other suitable processor or computer may be utilized. Video memory 114 is a dual-ported video random access memory. One port of the video memory 114 is coupled to video accelerator 116. The video accelerator device 116 is used to drive a CRT (cathode ray tube), and LCD (Liquid Crystal Display), or TFT (Thin-Film Transistor) monitor 117. The video accelerator 116 is well known in the art and may be implemented by any suitable apparatus. This circuitry converts pixel data stored in video memory 114 to a signal suitable for use by monitor 117. The monitor 117 is a type of monitor suitable for displaying graphic images.
The computer 100 may also include a communication interface 120 coupled to the system bus 118. The communication interface 120 provides a two-way data communication coupling via a network link 121 to a network 122. For example, if the communication interface 120 is a modem, the communication interface 120 provides a data communication connection to a corresponding type of telephone line, which comprises part of a network link 121. If the communication interface 120 is a Network Interface Card (NIC), communication interface 120 provides a data communication connection via a network link 121 to a compatible network. Physical network links can include Ethernet, wireless, fiber optic, and cable television type links. In any such implementation, communication interface 120 sends and receives electrical, electromagnetic or optical signals which carry digital data streams representing various types of information and media (e.g. audio and video data).
The network link 121 typically provides data communication through one or more networks to other data devices. For example, network link 121 may provide a connection through local network 122 to a host computer 123 or to data equipment operated by an Internet Service Provider (ISP) 124. ISP 124 in turn provides data communication services through the world wide packet data communication network now commonly referred to as the “Internet” 125. Hereinafter, “the Internet” will be used to refer to the Internet itself as well as other types of Intranets, networks, distributed servers, or client/server architectures.
Local network 122 and Internet 125 both use electrical, electromagnetic or optical signals which carry digital data streams to files. The signals through the various networks and the signals on network link 121 and through communication interface 120, which carry the digital data to and from computer 100, are exemplary forms of carrier waves for transporting the digital information.
The computer 100 can send messages and receive data, including program code, through the network(s), network link 121, and communication interface 120. In the Internet example, server 126 might transmit a requested code for an application program through Internet 125, ISP 124, local network 122 and communication interface 120.
The Internet/Client/Server
Computers and computer networks are used to exchange information, perform transactions, and provide entertainment in many fields. During these events, the exchange of data between computers typically occurs between a “server application” that provides information or services, and a “client application” or device that receives the provided information and services. Multiple server applications are sometimes available on a “system server” such as a single computer server that provides services for multiple clients. Alternatively, distributed server systems allow a single client to obtain services from applications residing on multiple servers. For example, in current distributed server systems, client applications or plug-ins are able to communicate with server applications executing on the same computer system or on another computer system accessible via a network, for instance via the Internet.
The Internet is a worldwide network of interconnected computers. An Internet client computer accesses a computer on the network via an Internet provider. An Internet provider is an organization that provides a client (computer) with access to the Internet (via analog telephone line or Integrated Services Digital Network line, for example). A client can, for example, read information from, download a file from, or send an electronic mail message to another computer/client using the Internet.
To retrieve a file or service on the Internet, a client must typically search for the file or service, make a connection to the computer on which the file or service is stored, and download the file or access the service. Each of these steps may involve a separate application and access to multiple, dissimilar computer systems (e.g. computer systems having operating different systems). The World Wide Web (WWW) was developed to provide a simpler, more uniform means for accessing information on the Internet.
The components of the WWW include browser software, network links, servers, and WWW protocols. The browser software, or browser, is a tool for displaying a user-friendly interface (i.e., front-end) that simplifies user access to content (information and services) on the WWW. Browsers use standard WWW protocols to access content on remote computers running WWW server processes. A browser allows a user to communicate a request to a WWW server without having to use the more obscure addressing scheme of the underlying Internet. A browser typically provides a graphical user interface (GUI) for displaying information and receiving input. Examples of browsers currently available include Netscape Navigator and Communicator, and Microsoft Internet Explorer.
WWW browsers and servers communicate over network links using standardized messages formats called protocols. The most common modern protocol is the TCP/IP (Transmission Control Protocol/Internet Protocol) protocol suite. The protocols are based on the OSI (Open Systems Interconnect) seven-layered network communication model. WWW messages are primarily encoded using Hypertext Transport Protocol (HTTP). HTTP instantiates the (top) Application layer of the OSI model. Application layer protocols facilitate remote access and resource sharing and are supported by the reliable communications ensured by the lower layers of the communications model. Therefore HTTP simplifies remote access and resource sharing between clients and servers while providing reliable messaging on the WWW.
Information servers maintain the information on the WWW and are capable of processing client requests. HTTP has communication methods that allow clients to request data from a server and send information to the server.
To submit a request, the client browser contacts the HTTP server and transmits the request to the HTTP server. The request contains the communication method requested for the transaction (e.g., GET an object from the server or POST data to an object on the server). The HTTP server responds to the client by sending a status of the request and the requested information. The connection is then terminated between the client and the HTTP server.
A client request, therefore, consists of establishing a connection between the client and the HTTP server, performing the request, and terminating the connection. The HTTP server typically does not retain any information about the request after the connection has been terminated. That is, a client can make several requests of an HTTP server, but each individual request is treated independently of any other request.
WWW employs an addressing scheme that uniquely identifies Internet resources (e.g., HTTP server, file, or program) to clients and servers. This addressing scheme is called the Uniform Resource Locator (URL). A URL represents the Internet address of a resource on the WWW. The URL contains information about the protocol, Internet domain name and addressing port of the site on which the server is running. It also identifies the location of the resource in the file structure of the server.
HTTP provides a mechanism of associating a URL address with active text. A browser generally displays active text as underlined and color-coded. When activated (by a mouse click, for example) the active text causes the browser to send a client request for a resource to the server indicated in the text's associated URL address. This mechanism is called a hyperlink. Hyperlinks provide the ability to create links within a document to move directly to other information. A hyperlink can request information stored on the current server or information from a remote server.
If the client requests a file, the HTTP server locates the file and sends it to the client. An HTTP server also has the ability to delegate work to gateway programs. The Common Gateway Interface (CGI) specification defines a mechanism by which HTTP servers communicate with gateway programs. A gateway program is referenced using a URL. The HTTP server activates the program specified in the URL and uses CGI mechanisms to pass program data sent by the client to the gateway program. Data is passed from the server to the gateway program via command-line arguments, standard input, or environment variables. The gateway program processes the data and returns its response to the server using CGI (via standard output, for example). The server forwards the data to the client using the HTTP.
When a browser displays information to a user it is typically as pages or documents (referred to as “web pages”). The document encoding language used to define the format for display of a Web page is called Hypertext Markup Language (HTML). A sever sends a Web page to a client in HTML format. The browser program interprets the HTML and displays the Web page in a format based on the control tag information in the HTML.
For example,
Referring to the embodiment shown in
Thus, for instance, client PC's 310 and 390s could be connected to the Internet 320 and 370 in order to access server computers 360 and 330 which in turn provide access via a local network 340 to media file storage 350. In addition, the system servers, 360 and 330, provide a user with access to the database of media files 350 from a multitude of locations 390. Couplings, for example, via network connections 320, 340, and 370 may comprise or incorporate any web browser, such as Mosaic, Netscape Navigator, or Internet Explorer. Hence, the system servers may be accessed through an Internet web site and the computer network may be the Internet, however, various other appropriate bases for the system (e.g. servers) and computer networks may be used with the invention as appropriate.
According to an embodiment for example, the system comprises a client machine 310 (a general-purpose computer, PC, cell phone, space shuttle etc.), a connecting apparatus allowing the client machine to communicate through communication means 302 (internet, LAN, WAN, wireless space shuttle etc.) with a server, where server means an electronic device able to communicate through communication lines. The servers are not limited to a single machine. For instance a server may include a duster of machines connected to each other or not within one or more sub-networks 340. Server may also comprise necessary routers, repeaters, firewalls and all means that allow electronic devices to function and provide network functionality such as traffic load balancing, re-routing, failover and any other means that allow these devices to operate and implement any connection or system required functionality.
For example, servers may use software or hardware that enables them to transmit and receive encrypted data for enhanced communication security. In accordance with an embodiment of the present invention, some servers may be dedicated to communicating with the creator user, for clarity we refer to these servers as application servers. Other servers may be dedicated to other tasks, for example, involving information distribution to creator users 310 and/or other users 390.
According to embodiments, the apparatus comprises one or more data storage devices 350. Storage devices may comprise one or more computer hardware storage devices and/or various other means of data storage. Examples of storage devices include computer hard disks attached to servers and stand alone file systems enabled to communicate through any type of network connection (e.g. 340). For instance a storage device might be a general-purpose computer having a media file library or database and an association engine for associating the files with requests and Internet web site based listings of the files.
Thus, a creator and/or system user may keep a personal database of media files on a computer at home and/or in a database on a server. In such a case, an user of a PC having an audio and/or video mixing and recording system may record, signal process, encode, and upload the desired media to the server database for future use. Thus, a version of media from at any point in the recording, processing, encoding processes may be stored in the user's local computer, while the final processed version (e.g. edited, combined with other media, re-edited, condensed, and encoded file) is uploaded and stored on the server. The computer systems described above are for purposes of example only. An embodiment of the invention may be implemented in any type of computer system or programming or processing environment.
According to an embodiment, the user simply creates the media file, performs any desired signal processing, encodes the file at the user's local computer and then connects to the Service Website or local Website on his personal machine and uploads the file to the Website and selects which web sites to list the file with. Referring to
After downloading the plug-in, the plug-in is installed at step 406. During installation, the plug-in registers with the browser and generates a unique code that is stored in the plug-in computer's system registry for transmission to the server at a later time. Registration provides the user's browser with a code identifying the plug-in and linking the browser to the plug-in so that during network browsing, the browser will invoke the plug-in whenever the browser downloads a file having a specific MIME type from a server. Thus, registration of the plug-in with the browser enables the browser to find the plug-in and use it as a helper application.
According to an embodiment, once the plug in is installed and the user is registered, the user may log into the server 408. For example, the user logs in on the web site with the same user name and password provided during the registration process. After logon, the system may serve up a page that informs the user about the state of the system and gives configuration information or any other information the system is programmed to provide. After successful login, a user interface provides the user with multiple options, actions, and commands to choose from. For example, the user can create and upload a media file using the “create” command 410.
According to an embodiment, once the user selects the “create” command, the browser sends a request to the server for a link initiating the server based control process 420. Examples of server based control details and parameters are provided in reference to
According to an embodiment, after server based control is incorporated, the user may record or receive media file at the plug-in at step 430. Using the plug-in or another system, a user may record or access audio, video, photo, and/or media display control information and options. In addition the user may create any combination of such media as desired.
For example, the plug-in may provide a user with controls for recording audio information using a PC base system whereby a user may create and record an audio file at that time using a microphone, or from material that includes prior recordings. Examples of audio data input methods or systems comprise by microphone, computer network or Internet link, telephone link, cell or other wireless network links, infra-red link, file download, keyboard input, menu selection by keyboard or mouse, as well as various other appropriate systems. Prerecorded audio offerings include input from compact disks, phone lines, tape recorders, wireless transmission, MIDI music players, MP3, WAV and RA files. The plug in, allows all of these sources to be mixed together into a single recording with the volume and recording level controlled appropriately for each of the components. In addition the user may create any combination of such audio media as desired. For example, the user can mix these various input sources by selecting the “Custom” input type in the plug-in and then using a volume control panel to set the levels.
Similarly, for example, the plug-in may provide a user with controls for recording video, photo, presentation, or display information using a PC base system whereby a user may create and record a media file at that time using a camera, or from material that includes prior media recordings. Examples of video, photo, presentation, or display information data input methods or systems comprise by scanner, bar code reader, other 2 dimensional indicia, data over computer network or Internet link, telephone link, cell or other wireless network links, infra-red link, file download, scanner, keyboard input, menu selection by keyboard or mouse, as well as various other appropriate systems. In addition the user may create any combination of such visual media as desired.
For instance, the user may select one of the above mentioned data input methods and/or types from a menu. Thus, a creator may select to enter photo media data from scanning a photo via a computer scanner. In the next step, the user inputs the scanned information into the system. Then, the creator may desire to attach audio to the scanned in photo using a microphone. Thus, the user selects audio input for the photo via microphone. The system now asks the user to input the audio information. After the audio data is input, the system associates the digital photo and audio data into a single media file in accordance with the server control parameters. As a result, the creator now has an audio and visual media file that can be used in a presentation. Although a system a specific example of inputting or recording is media files described above, a variety of appropriate input systems, fields, inputs, data types and input queries may be used in the invention at step 430. Embodiments of the invention also comprise the ability to do complex preprocessing of the media before sending it to the server. So, for example, the client plug-in performs complex and computationally intensive process such as the cropping and resizing of a photo. By having such intensive processing of loaded to the client, the system runs more efficiently.
In addition, embodiments of the invention provide for the client to provide the user with information regarding creation of improper media file data or formats, for instance when the recorded or created information is of an improper format or not in accordance with server based control parameters. For example, the creation process may require media processing by the client that can not be performed due to formatting problems or that the client does not have permission to upload to the server. Moreover, the client may be asking for processing of improper files, restricted files, or files that don't exist.
Once a media file is created or accessed by the plug-in, digital signal processing can be performed upon that media file 440. For example, recorded audio files can be digitally signal processed to optimize the quality of the sound for Internet transmission. Digital signal processing can require many steps including multi-band voice-optimized compression, where compression reduces selected signal input. Digital signal processing also includes sibilance, or hissing, reduction and presence boost for intelligibility, where presence refers to creating an impression that sound is being produced by something nearby. Further examples of details and parameters related to digital signal processing performed on media file data are provided in reference to
According to an embodiment, after performing digital signal processing upon that media file, the plug-in encodes the media file. Encoding of the media file, at the plug-in, is performed at step 450. For example, the signal processing and encoding processes performed by the plug-in will reduce the size of the file data and encoded the reduced file data into a standard format. The plug-in also makes a connection with the system server in order to download the condensed standardized file to that server.
After a connection is made between the plug-in client and the server, the condensed encoded file may be uploaded to the server for storage, posting, distribution, and retrieval by other client computers. Referring to
Upon successful upload of a file, the file management system provides copies and listings of the file as appropriate 470. For example, once a file is uploaded, the system then incorporates the file information into one or more lists and/or database. Further examples of details and parameters related to the file management system are provided in reference to
Once a file is incorporated into the databases, any user having access to a database or list, may select that file for retrieval or playback 480. For example, a user could also opt to retrieve one of that a media file similar to the type of file the user wishes to create. In order to find such a file, the user could access web page listing of files advertised to be the same appropriate type. From such listing, the user then selects a file as desired. Further examples of details and parameters related to retrieval and playback are provided in reference to
Upon selection of the web page listing and/or desired file, information relating to those selections can be tracked and recorded by the system in order to provide list and/or file ratings 490. Examples of details and parameters related to ratings are provided in reference to
Thus, for example, the system improves upon prior systems because it accomplishes the automated collection of the data, combination of media, preprocessing of the media to make suitable for web presentation, encoding (for audio/video), and uploading in a unique and more efficient manner.
For example,
If the client request is permitted at 780, the server then sends the requested control instructions to the client 790 (e.g. see steps 730 and 740 of
After the media is loaded into memory and the configuration data is read, the DSP module sequentially applies a data processing or manipulation process to the file 510. If necessary, the DSP continues to apply processing or manipulation steps to the file as required by the user, server based control, or other client, server, or system based parameter 520. Such processing could be, for example, to be any type of processing to make the media or data suitable for hosting. This could be digital signal processing for audio and video, or some other sort of processing for photos, such as cropping and resizing to fit a size specified by the control parameters.
The processing steps are aimed at, for example, improving the sound quality and removing components of the signal that are not perceivable by the human ear. Examples of processing methods include multiband voice-optimized compression, where compression reduces selected signal input. Digital signal processing also comprises sibilance, or hissing, reduction and presence boost for intelligibility, where presence refers to creating an impression that sound is being produced by something nearby. Bass boost can be used to create a feeling of warmth with male voices. Normalization for the maximum output level adjusts the level of a selection so that the highest peak is at the maximum recording level of the medium. Other digital signal processing features include a peak limiter that controls overload distortion, a smart expansion gate that reduces background noise by expanding signal input and a DC offset adjustment for cleaner encoding. A high frequency cutoff for reduced anti-aliasing effects is desirable, where aliasing refers to distortion caused by a sampler mis-recognizing a signal sent to it that is at a frequency higher than the highest frequency that can be recorded and reproduced properly at a particular sampling rate. Upon playback, the system will provide a signal at an incorrect frequency (called an alias frequency). While the proper digital signal processing is essential for the preparation of a high quality audio presentation, and computer programs exist to assist with the process, the various procedures can be difficult for those without the requisite experience.
Following digital signal processing, the system encodes the file by applying and encoding process 540. For instance, encoding involves converting or translating the file data into a standard format that can be distributed to other users and played by other media playing means.
Next, the plug-in opens or establishes a network connection with the application server 605 (e.g. using the URL obtained from the server in step 740). The plug-in tests whether the connection is successful 610, and if the connection is not successful returns to 605. When a connection is successfully established the application sends an information header to the server 615. The header may include, for example, the size of the file to be transferred as read by the plug-in. The plug-in then reads data blocks containing blocks of the file data 620. For instance, a block of file data may comprise a block of specific size. The plug-in checks the connection again at step 625. If the connection still exists, the plug-in then sends the data block to the server 630. Next the client reports the status of the transfer to the server 635. Embodiments also comprise the plug-in sending status of the transfer reports to the user through the user interface. The plug-in then checks to see if the data block currently transmitted (e.g. at 630 above) is the last block to be transmitted for the current file 640. If the block is not the last block, the plug-in returns to step 620 and reads data from another block. If the block is the last block for that file, the plug in reads the server response 645, and closes the client server connection. Examples of server responses comprise sending the client a page confirming that the upload was successfully completed, a page indicating that the upload was successfully canceled, a page indicating that the upload was not successfully. Further examples of server responses are provide in reference to
In addition, according to embodiments, the server may carry out a plurality of operations on the information received from the client application. For example, the server may check the plug-in's unique identifier to validate a user's rights to use a copy of the plug-in. The server obtains a unique identifier and uses the identifier to identify and generate a data file name 665. The server then opens a file where it will write the data received from the client. The server checks the connection again at step 670. If the connection still exists, the server waits to receive a data block 675.
Upon receipt of a data block, the server appends the data block information received from the client into a data file and stores the identifier newly obtained into a database 680. After each block of data received the server checks whether the total size of data received is equal to or has exceeded the total size of the file being uploaded 682 (e.g. total size of file being uploaded as previously communicated to the server by the client at step 655). If the total data file size has been reached or exceeded, the server closes the data file and stores the data 684.
Next the server generates a file information web page 686. Such a page may contain, for example, a page confirming that the upload was successfully completed, a page indicating that the upload was successfully canceled, a page indicating that the upload was not successfully. The server then sends the file information web page to the client 690 (e.g. see server responses 645 above). Further examples of file information web pages are provide in reference to
According to an embodiment of the invention, once a file has been uploaded, a file management system provides processing so that the file may be stored, posted, and/or retrieved. For example, following the upload of a new data file, the system stores the new file on the storage device 350 under the file name newly generated in step 665. The server may also create a link to the new file at the file serving location. The link allows the media streaming server to access the content of the file and serve it to various users 390. The application server also stores file information in the database.
According to embodiments, after the allowable functions for a user are determined, the system generates a web page containing the graphical user interface controls and hyperlinks needed to access the server functionality associated with those allowable functions 820. Then, the user may choose to enter one or more types of information and/or issue one or more user commands 830. For example, the user may enter information describing the content of the file just uploaded. Other types or information may include attribute information. The server then updates any databases, file listings, web pages, file storage locations, and/or file or file listing libraries as necessary, as a result of, or as indicated in accordance with the user's command or information entered 840.
In one or more embodiments of the invention, the server is capable of generating one or more hyperlinks to media files 850. For example, the user is able to write a message and enter the email address of one or more correspondents. Upon the user issuing a command to the server, the system processes the message and adds media file hyperlink information into the message. The system may, for example, insert hyperlinks to the location of the media file into the message. The system then transmits messages with links to the creator user's specified media files, allowing the recipient of the message to easily access those media files. The links to the file locations are those created and made available on the media-streaming server.
The invention contemplates providing the user access to a variety of functionalities. In an embodiment of the present invention the user is able to input attributes associated with media files. The system uses such attributes to determine, for example, the user's preferred location for posting hyperlinks to the media files and/or the user's restricted locations. Other types of functionality include but not limited to posting a message onto a messaging system, or any other medium for communicating information.
According to embodiments, a user using a client computer 940 enabled with web browsing capability may access 950 a web server 930 and download a web page posted by a creator user 960. The web page may contain one or more hyperlinks to media files. The web page may also contain one or more instructions to download a list of hyperlinks to media files located on the media file server. Such instructions may contain one or more list identifiers, or one or more user identifiers. For example, the instructions can cause the browser to connect to the media file server 970 and request one or more media file lists. In response, the media file server may generate one or more lists of hyperlinks using information stored in the system database. Thus, a client browser may receive one or more lists or hyperlinks to media files 990. The hyperlinks are then displayed, enabling users to click through the links and download the media files.
Also, according to embodiments, a user may click through the hyperlinks displayed by the web-browsing device 940. Clicking on a hyperlink causes the browser to connect to the media file server and request a download of the media file. The media file server loads the requested media file into memory and start sending blocks of data to the client. Upon receiving data of a given media type, the client browser invokes a helper application (e.g. plug-in) that is designed to handle the specific media type. For example, if a user clicks to view a video clip, the browser may invoke a helper application able to play video clips. Likewise, if a user clicks through a hyperlink causing the browser to download an audio clip, the browser may invoke a helper application that plays the audio clip.
As described above (
The system also utilizes information entities that describe relationships between mediagrams. These relationships may also possess properties that can be set or modified by the creator user or by the system. For example, a relationship may describe the number of times viewers viewing mediagram “A”, which contains references to media files, clicked through to view a given file. In this example, the relationship is a number associating a mediagram “A” with mediagram “B”, which contains a reference to a single media file and its attributes. As exemplified here, one can see that such a system facilitates information management for storing and posting media files on a network. mediagrams can be represented as database entries or any other type of structure or container capable of holding data. The system propagates new additions to lists, or changes to attributes made by the creator user to all mediagrams automatically. The system, by way of using association entities, is able to provide some new properties such as rating, ranking, and/or popularity based on users interaction with the data.
Therefore, a list comprises a unit that can be managed by the creator-user (or any one else given authorization by the creator-user). Each list comprises a structure that takes on dynamic characteristics as a result of the input provided to the list. The creator-user can control the type of content data placed on the list and the users who have access to the list. Only certain type of users, for instance, may be allowed to utilize the list. Each list may comprise content (media data, mediagrams, links, other lists, etc . . . ). In one embodiment of the invention, a list may contain or refer to other lists thereby creating a hierarchy of interrelated lists where each list has items comprising content data. A parent list, for example, may contain or refer to other child-lists that are related to the parent and possibly associated with one another. The contents (e.g., content data) or sequence of the list may change according to a set of criteria or behaviors (e.g., actions performed by users). The criteria or behaviors can be defined by the creator user although in some instances the criteria may be defined by others users. If a user selects an item in the list, that action (considered a “vote” for the item) may cause the selected item to ascend in the list because it is considered more popular. When an item is considered popular it is displayed in one embodiment of the invention in a more prevalent location than item that are not considered popular. Thus, items that are not popular descend in the list where items that are popular ascend. The invention contemplates many different activities that can be utilized to gauge popularity. For example, other actions may also cause the contents of the list to change. If, for instance a user places a link on a web page to a content item on the list that activity may be viewed as a strong statement that the content item on the list is worthwhile. In one embodiment of the invention, the criteria or behavior that moves the location of a content item on the list is defined by the creator-user. The invention contemplates that such criteria or behaviors may comprise any action by a user that expresses an interest or disinterest in the content item that was selected. Thus, the list comprises a dynamic environment that changes based on actions performed by users of the list.
According to an embodiment, at step 1015, media files are associated with the list entries by a creator. As a result, media content is stored in database and file records. Media content may be stored in different databases or on different servers. Each piece of media content is treated as an atomic unit (e.g. a media file or mediagram) that can be directly linked to via a resource locator (e.g. URL) and served as a link through a page generated from a distribution list. Examples of media content comprise voice messages, Web Clips, pictures, HTML pages, attachments, templates, and imported lists. Templates may be used to collect and post media file or mediagram entries from a resource locator (e.g. URL) link. Imported lists comprise pointers to distribution lists and individual media files or mediagrams kept in another account. Moreover, the creator of the content can give permission to another media file or mediagram account holder to publish the content on other media file or mediagram accounts.
According to an embodiment, at step 1020, the system creates list entry connections and relationships and stores that data. For instance, connection data collected for the list entry is stored in the system databases. Also, associated rating, ranking, and/or popularity data for each media file, mediagram, web page, list, and/or list entry can be stored in the same and/or another database.
At step 1025, the list entries may be edited to add, delete or correct list entries. For instance, the creator of an entry and/or the owner of a list may have editing capability.
At step 1030, list display, browsing, exporting, and importing information functions may be selected. For example, a creator may select to export list in order to sharing that list with other media file or mediagram accounts. The creator supplies the system with information on the user accounts the creator desires to share the list with. The information may include control over the whole list and/or separate overriding control for each individual media file or media gram entry. Each media file or media gram can be placed on multiple lists if desired to spread content around to various other lists. Access can be granted through static passwords, one-time passwords and digital certificates.
According to embodiments, a database is generated that contains information on all links between media files or mediagrams entries and lists. Whenever a creator edits lists, entries, media files or mediagrams, the changes are automatically made in the database and wherever the lists, entries and media files or mediagrams are stored. Also, a creator can request permission from another media file or mediagram account holder to publish content on the other account holders media file or mediagram account. If changes are made to media files or mediagrams that have been published on accounts belonging to others, a creator's changes will also be made in those accounts providing there is permission for placement of the items in those accounts.
By way of example, assume at step 1030 that an art site exists with stages for poetry, books, music, etc. A poet can request permission for posting of his poems on the poetry stage of the art site. Once permission is granted, his poem will appear on the poetry stage and any changes he subsequently makes to his poem will be automatically made there as well.
The system processes or performs list display, browsing, export, import and other connection relationship actions and information (e.g. including future actions depending on existing relationships) at step 1035. As mentioned above, embodiments provide tracking of associated rating, ranking, and/or popularity data for each media file, mediagram, web page, list, and/or list entry displayed or browsed by users and creators via selection, click through, activation, or various other appropriate systems.
At step 1040, the system notifies selected users, creators, list owners and managers about the existence and availability of lists. When a change is made to a list, media file or mediagram, notification can be sent by email or other delivery method (e.g. pagers and/or automated telephone calls). Thus, system users and creators have the opportunity to subscribe to or remove themselves from a subscription list.
According to an embodiment, at step 1045, a user may request lists from the system. The system allows for there to be lists of lists, thus lists may be multilevel or nested so that selection of an entry on one list causes a more detailed list for that entry to be displayed. The user may export the list if he has permission. The system may detect exportation of a list and keep a record of the exportation.
For example a creator could ask for permission to post to a second list owned by another by sending an email to the owner of the second list requesting authorization for the post, or for all posts from that creator (note that a system user can be a creator and/or list owner). Then, the owner of the second list could give authorization by checking a box in the email, by clicking a button, or other methods. Also, creators and/or list owners could join clubs or groups having certain distribution or listing rights.
According to an embodiment, a user may request the data associated with a list entry, for example by clicking on that entry, at step 1050. After a user selects or requests a media file associated with a list entry, the system processes the user's request and provides the data associated with the list entry to the user and will make an entry in the associated ratings database increasing the rating for that media file 1055. Additionally, embodiments provide tracking of associated rating, ranking, and/or popularity data for each media file, mediagram, and/or list entry for which data is requested by users and creators via selection, click through, activation, or various other appropriate systems.
For example, the system will provide the media file selected to the computer or device the user has accessed the system server from and increases the rating for that media file. As noted earlier, media file data may comprise audio and visual data, attachments, documents and other items. If the media data file selected is owned by someone other than the list owner of the list the file is displayed on, then the file will only be retrieved if permission for listing by the list account holder and retrieval by the retrieving user has been obtained from the file owner account.
Embodiments provide tracking of associated rating, ranking, and/or popularity data for each media file, mediagram, and/or list entry that a creator or list owner desires. Thus, a user can be presented with a popularity ranking of a list or list entry in order to assist in selection (e.g. steps 1045-1055). Rating, ranking, and/or popularity data can be obtained by system comprising (1) counting the number of click-throughs from one list to another, (2) by counting the number of inclusions of a media file, mediagram, lists in another account holder's list, (3) by a count of the number of subscriptions to a list and (4) by various other appropriate systems or means that the creator, user, or system may desire. For example, ranking information may comprise a count of subscriptions to a list and/or a count for each of the entries of a subscribed to list. A creator or user may determine the type of information provided. For example, rankings can be displayed in chronological order, by popularity, title, creator, or as otherwise desired.
According to an embodiment, at step 1060, the system accumulates the tracking of associated rating, ranking, and/or popularity data described above. At step 1065, the system ranks the popularity or usage of the entry (e.g. rating, ranking, and/or popularity data) and stores this information in a database for access by the user at step 1055 or by others. For instance, according to an embodiment, at step 1070, the system provides detailed popularity or usage information to creators and others permitted by the creator to view such information such as system users, list owners, and managers. The creator determines the type of data provided and its availability.
In addition to the lists and processes explained above, embodiments of the invention comprise additional sections to the existing media file or mediagram content collection system. For example, additional sections may be added to the content distribution lists which are used for assembling and managing the display and distribution of media file or mediagram content. Thus, the additional sections allow each mediagram to be assigned to an arbitrary number of content distribution lists and the resulting lists of mediagrams or nested content distribution lists (e.g. “sub-lists”) are stored as database records. Such distribution lists fall into 3 categories.
The first category is navigation pages. For example, navigation pages may use a three frame display (or simulated frames, depending on implementation), a header frame, a navigation frame and a content frame. The title of the mediagram or sub-list is displayed in the navigation frame and the content of the currently selected list entry in a content frame. The second category is Display Pages. For example, there is a single display area (no frames) with the header at the top followed by the display content of each mediagram in the list. The third category is single entry pages. For example, this type is for when the user wants to distribute a single mediagram using the distribution list processing features (such as sharing lists with other accounts). In this case there is no header, only the display content for the single mediagram in the list is shown.
In additional embodiments, the distribution lists may have a list definition that gives list types including navigation pages, display pages, and single entry pages. Also, the distribution list may include a list display header (e.g. a header specified in same manager as mediagrams). In addition, the distribution list exporting may include control of access for all entries on the list. For example, for this reason, users will have to use single entry lists to have granular distribution control over individual mediagrams. List exporting may specify a distribution list for user to access as a click-through point from the exported list. Here, the purpose is to provide an entry point from an aggregated collection of content to content at this specific account. Thus, it fits in with the calculation of relative popularity. Moreover, the list exporting may grant access via manual evaluation, or various other techniques as appropriate.
In additional embodiments, the distribution lists may have a popularity ranking where the relative rank of popularity is based on the items in each list. For example, each mediagram and distribution list contains a numeric count of popularity. The rank is the relative popularity within each list. Popularity count values have no absolute meaning and may be concealed from user in final implementation. For example, if a list contains an entry that is extremely popular in some other list, but is unpopular on this list, the system may display the overall rating (including counts both lists), or the system may just rank relative to this particular list (e.g. according to click-throughs from this list only), or some combination. Additional embodiment contemplate popularity ranking by various other empirical and statistical methods.
Additional embodiments of the invention comprise content automation lists (e.g. content “Wizards” or “Templates”). These types of lists or wizards contain sequential steps that guide the user through the generation of mediagram content and the assembly of that content into the distribution lists. An example of an automation lists may include various features and information, such as a list definition having user accessed permissions (e.g. passwords) and automation step list. Automation step lists can include lists of each step to generate the mediagram content and place it in the appropriate distribution list where each entry contains a mediagram type to collect or a Distribution List where the content will be deposited. Automation step lists can also include default values for each field of the mediagram or list that are hardcoded into the step, or inserted based on form entries requested from the user. Such version may not have programming, but that could be added (such as VB code to handle more complex steps). Moreover, the account user can use the automation lists to simplify routine production processes. Finally, just like all other lists in the system, the account owner has the ability to link the automation list into another HTML page. Traversing this link will invoke the steps of the automation list. This is extremely important, as it provides for the automated collection and distribution from any page on the Internet that contains the link.
Additional embodiments of the invention comprise content packaging technology. For example, packed into a single file would be all of the files of a web page or set of pages. This single file could then be downloaded and viewed offline, and passed around intact, thus, allowing for an application where the distribution lists provide a mechanism for specifying what would be packed into one of the self-contained single files. The distribution list could also provide the underlying control structures for managing access and distribution to the single files. For example, if the content creator chose, a distribution list could be packed into a single file and downloaded to users, instead of being served in real time. If the user volunteers, their computer could act as a distribution point for the file, forming the basis for a peer-to-peer content distribution system. Additional embodiments of the invention comprise combining the elements and processes above to create a system for distributing original content by tapping into the spare bandwidth of the volunteer computers to distribute multimedia websites for a much lower cost than using a centralized system.
The invention also contemplates embodiments wherein the media comprises audio, video, display, photo, spread sheet, database, octal, programming, object oriented programming, message, email, attachment, word processing, textual, figure, drawing, network browser, network resource locator, network link, web site, web page, web content, program application, program plug-in, java page, java programming, object oriented programming, and/or any combination thereof.
Additionally, the invention contemplates embodiments wherein the media comprises various functionalities applicable to the desired media as set forth above. For example, an embodiment contemplates sound, video, icons, active icon, text scrolling, hotlink, embedded link, and other media functionality as appropriate. Additionally, once the presentation has been finalized, the creator would like to be able to transmit either the presentation or voice messages to selected members of an audience by e-mail. Finally, a creating user might wish to use these files to provide programming material for an Internet Radio Station.
Similarly, the invention contemplates application to various other appropriate telecommunications, data communications, and signal transmission systems and environments where a plug-in at one location or device can be used to record information to be uplinked to another location or device using other networks such as wireless networks, satellite networks, RF networks, coax cable, fiber optic cable, satellite links, cell links, radio waves, etc.
The computer systems, networks, programming, and processes described above are for purposes of example only. An embodiment of the invention may be implemented in any type of computer system or programming or processing environment. Furthermore, any and all of the above mentioned methods, products, and/or embodiments may be used separately or integrated with any and/or all of the others.
Thus, a method, apparatus, and system for creating and posting media has been described. Although the present invention has been described in detail with reference to particular embodiments, persons possessing ordinary skill in the art to which this invention pertains will appreciate that various modifications and enhancements may be made without departing from the spirit and scope of the claims that follow. Hence, particular embodiments described herein are illustrative only and should not limit the present invention thereby. The invention is defined by the claims and their full scope of equivalents.
| Patent | Priority | Assignee | Title |
| 10327034, | Mar 27 2014 | TVU Networks Corporation | Methods, apparatus and systems for exchange of video content |
| 10609097, | Mar 27 2014 | TVU Networks Corporation | Methods, apparatus, and systems for instantly sharing video content on social media |
| 8015263, | Nov 10 2000 | POST MEDIA SYSTEMS LLC | System and method for creating and posting media lists for purposes of subsequent playback |
| 8209285, | Nov 15 2005 | HEWLETT-PACKARD DEVELOPMENT COMPANY, L P | Method and a system for publishing data |
| 8584002, | Jan 09 2006 | Apple Inc | Automatic sub-template selection based on content |
| 8645560, | Feb 28 2007 | Sony Corporation | Content providing system and method, shared content providing apparatus and method, content output apparatus and method, and program |
| 8725832, | Nov 10 2000 | POST MEDIA SYSTEMS LLC | System and method for creating and posting media lists for purposes of subsequent playback |
| 8786875, | Mar 26 2010 | Philips North America LLC | Systems and methods for printing a document from a mobile communication device |
| 8959181, | Nov 10 2000 | POST MEDIA SYSTEMS LLC | System and method for creating and posting media lists for purposes of subsequent playback |
| 9613063, | Jul 11 2007 | Sony Corporation | Content transmission device, content transmission method, and content transmission program |
| 9640223, | Mar 27 2014 | TVU Networks Corporation | Methods, apparatus and systems for time-based and geographic navigation of video content |
| 9811523, | Oct 29 2014 | System and method for publishing online posts | |
| 9992246, | Mar 27 2014 | TVU Networks Corporation | Methods, apparatus, and systems for instantly sharing video content on social media |
| Patent | Priority | Assignee | Title |
| 6871107, | Jul 01 1999 | FTR Labs Pty Ltd | Digital audio transcription system |
| 20020013897, | |||
| 20070011206, | |||
| 20070177586, |
| Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
| May 10 2006 | Trio Systems, LLC | (assignment on the face of the patent) | / | |||
| Jan 23 2008 | BARTHOLOMEW, ALAN | Trio Systems, LLC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 023468 | /0752 | |
| Jan 14 2016 | Trio Systems, LLC | POST MEDIA SYSTEMS LLC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 042381 | /0920 |
| Date | Maintenance Fee Events |
| Jul 02 2012 | M2551: Payment of Maintenance Fee, 4th Yr, Small Entity. |
| Aug 12 2016 | REM: Maintenance Fee Reminder Mailed. |
| Dec 30 2016 | M2552: Payment of Maintenance Fee, 8th Yr, Small Entity. |
| Dec 30 2016 | M2555: 7.5 yr surcharge - late pmt w/in 6 mo, Small Entity. |
| Jun 18 2020 | M2553: Payment of Maintenance Fee, 12th Yr, Small Entity. |
| Date | Maintenance Schedule |
| Dec 30 2011 | 4 years fee payment window open |
| Jun 30 2012 | 6 months grace period start (w surcharge) |
| Dec 30 2012 | patent expiry (for year 4) |
| Dec 30 2014 | 2 years to revive unintentionally abandoned end. (for year 4) |
| Dec 30 2015 | 8 years fee payment window open |
| Jun 30 2016 | 6 months grace period start (w surcharge) |
| Dec 30 2016 | patent expiry (for year 8) |
| Dec 30 2018 | 2 years to revive unintentionally abandoned end. (for year 8) |
| Dec 30 2019 | 12 years fee payment window open |
| Jun 30 2020 | 6 months grace period start (w surcharge) |
| Dec 30 2020 | patent expiry (for year 12) |
| Dec 30 2022 | 2 years to revive unintentionally abandoned end. (for year 12) |