A method and system for digital marketing and the provision of digital content allows a user to express, using an application executed on a computing device while a piece of content is being broadcast using an analog or digital signal by an analog or digital radio or television station system, an interest in the broadcast piece of content that is communicated to a backend system. The backend system selects an end point destination that is a pointer to further digital information associated with the broadcast piece of content and communicates the end point destination for the broadcast piece of content to the user who can access the digital information.

Patent
   12086836
Priority
Mar 03 2020
Filed
Oct 03 2023
Issued
Sep 10 2024
Expiry
May 01 2040

TERM.DISCL.
Assg.orig
Entity
Small
0
176
currently ok
9. A computing device for interacting with a television broadcast system that live streams a plurality of pieces of content using a particular station, the device comprising:
a processor and memory that executes an app that has an identifier for the particular station that links the app to the particular station, wherein the processor is configured to:
express, by the user using the app while an end point destination for a particular live streamed piece of content is active when an interest occurs between a start time and an end time of the particular live streamed piece of content and the particular live streamed piece of content is being live streamed by the particular station, the interest in the particular live streamed piece of content of the particular station that includes the identifier for the particular live streamed piece of content, wherein the identifier sent by the app identifies the expressed interest of the user in the particular live streamed piece of content of the particular station;
communicate the interest in the particular live streamed piece of content to a backend system, wherein the particular live streamed piece of content is identified by the backend system by the identifier of the particular live streamed piece of content provided by the computing device and a timestamping of the interest occurring between a start time and an end time of the particular live streamed piece of content when the end point destination is active; and
receive a personalized offer associated with the particular live streamed piece of content of interest wherein the personalized offer is displayable to the user.
1. A method, comprising:
providing a plurality of television broadcast systems, each television broadcast system live streaming a television piece of content through at least one station, wherein each station schedules the live streamed television piece of content;
providing a backend system configured to store at least one end point destination for the live streamed television piece of content;
activating the at least one end point destination for the live streamed television piece of content at a start time for the live streamed television piece of content and deactivating the end point destination for the live streamed television piece of content at an end time for the live streamed television piece of content;
receiving, from an app executed on a computing device of a user that has an identifier of the at least one station that links the app to the live streamed television piece of content of the at least one station, an expression of interest from the user while the at least one end point destination for the live streamed television piece of content is active and the television piece of content is being live streamed by the particular station and the expression of interest includes the identifier for the live streamed television piece of content;
identifying at the backend system, the live streamed television piece of content using the identifier provided by the computing device and a timestamping of the expression of interest occurring between the start time and the end time of the live streamed television piece of content; and
selecting, in the backend system, a personalized offer associated with the live streamed television piece of content that is displayable to the user.
5. A system, comprising:
a plurality of television broadcast systems, wherein each television broadcast system live streams television through at least one station, wherein each station schedules sequences of live streamed pieces of content for live streaming broadcast by the at least one station;
a backend system connected to the plurality of television broadcast systems and configured to store at least one end point destination for each live streamed piece of content, to activate the at least one end point destination for each live streamed piece of content at a start time for each live streamed piece of content and to deactivate the end point destination for each live streamed piece of content at an end time for each live streamed piece of content;
a computing device having a processor and memory that executes an app that is associated with a particular station and has a station identifier for the particular station that links the app to the particular station, the app having a plurality of lines of code and the processor is configured to express, by the user using the app while the end point destination for the live streamed piece of content is active and a particular live streamed piece of content is being broadcast by the particular station, an interest in the particular live streamed piece of content that includes the identifier for the particular live streamed television piece of content; and
the backend system being further configured to identify the particular live streamed piece of content using the identifier of the particular live streamed piece of content provided by the computing device and a timestamping of the interest occurring between the start time and the end time of the particular live streamed piece of content and select a personalized offer based on the end point destination associated with the particular live streamed piece of content that is displayable to the user.
2. The method of claim 1, wherein expressing the interest using the app further comprises using one of an application and a mobile application.
3. The method of claim 1, wherein the end point destination is one of a uniform resource locator (URL) to a webpage having digital information about the live streamed television piece of content and content in a second app having digital information about the live streamed television piece of content.
4. The method of claim 1, wherein the live streamed television signal is live streamed by a device separate from the computing device.
6. The system of claim 5, wherein the app executed on the computing device is an application downloaded to the computing device.
7. The system of claim 5, wherein the end point destination is one of a uniform resource locator (URL) to a webpage having digital information about the live streamed piece of content and content in a second application having digital information about the live streamed piece of content.
8. The system of claim 5, wherein the backend system is further configured to receive a playlist for each station of each broadcast system using a unique station identifier, the playlist having the start time and the end time for each live streamed piece of content and a station identifier for the station scheduled to broadcast each live streamed piece of content in the playlist.
10. The device of claim 9, wherein the app executed on the computing device is an application downloaded to the computing device.
11. The device of claim 9, wherein the end point destination is one of a uniform resource locator (URL) to a webpage having digital information about the live streamed piece of content and content in a second application having digital information about the live streamed piece of content.

This application is a continuation of and claims priority under 35 USC 120 to U.S. patent application Ser. No. 17/850,579 filed Jun. 27, 2022 that is a continuation of and claims priority under 35 USC 120 to U.S. patent application Ser. No. 17/097,970 filed Nov. 13, 2020 and Ser. No. 16/865,109 filed May 1, 2020 that in turn claims priority and the benefit under 35 USC 119 to Singapore Patent Application No. 10202001898S filed Mar. 3, 2020, all of which are incorporated herein by reference.

The disclosure relates generally to a system and method for digital marketing and the provision of digital content. While the present disclosure will be described in relation to its application in relation to analog radio broadcasts. It is to be appreciated that the present disclosure is not z to this application, and is also applicable for other forms of media broadcasts including, but not restricted to, digital radio and analog and digital television broadcasts.

The following discussion of the background is intended to facilitate an understanding of the system. It should be appreciated that the discussion is not an acknowledgement or admission that any of the material referred to was published, known or part of the common general knowledge of the person skilled in the art in any jurisdiction.

Systems exist that provide personalized offers and advertisements to a user in various manners. However, those systems do not provide personalized offers and advertisements for all of the different types of communications mediums. For example, communication mediums can include radio or television (both over the air and digitally) in which commercials and advertisements are presently orally to each audience member who is listening to a particular radio station or viewing a particular television station. It is desirable to be able to permit each audience member to identify a commercial or advertisement in the broadcast and then provide a personalized offer to that audience member and it is to this end that the disclosure is directed.

FIG. 1A illustrates an example of a cloud based implementation of an analog radio broadcast content scanner system that facilitates digital marketing;

FIG. 1B illustrates more details of the preferred implementation of the personal ad system shown in FIG. 1;

FIGS. 2A-2C illustrate examples of the program/playlists of a broadcast system;

FIG. 3 illustrates a digital marketing method for an analog radio broadcast;

FIG. 4 illustrates more details of the computing device shown in FIG. 1A;

FIG. 5 illustrates more details of the radio system server shown in FIG. 1A;

FIG. 6 illustrates more details of the personal ad system server shown in FIG. 1A; and

FIG. 7 illustrates an example of a user interface for the application.

The disclosure can be applicable to an analog radio system that uses an application or website to digitally deliver content to a user based on the broadcast analog radio signal with a computing device and a personal offer system that can provide a personal offer using a progressive web application (PWA) to the user based on the pieces of content being broadcast by the analog radio station and it is in this context that the disclosure will be described. It will be appreciated, however, that the system and method has greater utility since: 1) the personalized offer system may be implemented on a computing device using other known or yet to be developed technology in lieu of the progressive web application; 2) the system and method may be used with other types of content other than radio content delivered over the air, and can include digitally delivered radio and television as well as television delivered over the air; and 3) the personalized offer system may be implemented on other devices that are capable to performing the processes described below including a virtual reality device or headset, a pair of glasses with embedded computer functionality and the like. The system and method may also be implemented using an application or mobile application rather than a PWA. Furthermore, the system and method described below may be used with various content broadcasts that may be delivered to a user as a live radio or television broadcast (either over the air or over a computer network), a streaming broadcast, a catch-up service broadcast, a podcast and the like. Furthermore, the system may be used with digital broadcasts or analog broadcasts of content to the user.

According to an aspect of the present disclosure, there is provided a method, comprising: expressing, by a user using an application executed on a computing device while a piece of content is being broadcast using an analog or digital signal by an analog or digital radio or television station system, an interest in the broadcast piece of content; communicating the interest in the broadcast piece of content to a backend system; selecting, in the backend system, an end point destination associated with the broadcast piece of content, the end point destination being a pointer to further digital information about the broadcast piece of content; communicating, by the backend system to the computing device, the end point destination for the broadcast piece of content; and accessing, using the computing device and the end point destination, the further digital information about the broadcast piece of content.

In some embodiments, the method further comprises providing, by a digital marketing system in the backend system connected to the computing device, a personalized offer associated with the broadcast piece of content and displaying, on a display of the computing device, the personalized offer to the user.

In some embodiments, the method further comprises providing a playlist for the broadcast by the analog or digital radio or television station system to the backend system, the playlist having one or more discrete pieces of content and storing, in the backend system, an association of each discrete piece of content in the broadcast with a particular end point destination. Providing the playlist may further comprise providing, for each discrete piece of content in the broadcast, a start time and an end time for each discrete piece of content.

In some embodiments, the method further comprises activating the end point destination for each discrete piece of content at the start time for each discrete piece of content in the playlist and deactivating the end point destination for each discrete piece of content at the end time for each discrete piece of content in the playlist and wherein expressing interest for the broadcast piece of content further comprises expressing interest in the discrete piece of content while the end point destination for the discrete piece of content is active.

In some embodiments, the broadcast is selected from a group consisting of an analog broadcast, a streamed broadcast and an archived broadcast. In some embodiments, the application executed on the computing device is one of a progressive web application (PWA) or an application downloaded to the computing device. In some embodiments, the end point destination is a uniform resource locator (URL) to a webpage having digital information about the broadcast piece of content or content in an application having digital information about the broadcast piece of content. In some embodiments, the application executed on the computing device broadcasts the radio or television signal of the analog or digital radio or television station. In some embodiments, the radio signal of the analog or digital radio or television station is broadcast by a device separate from the computing device. In some embodiments, the device that broadcasts the radio signal of the analog radio station is a transistor radio.

According to another aspect of the present disclosure, there is provided a system, comprising: an analog or digital radio or television broadcast system that broadcasts a plurality of pieces of discrete content, the analog radio broadcast system having a playlist that has each piece of discrete content being broadcast, a start time and end time for each piece of discrete content; a backend system that receives the playlist and stores an association of each piece of content in the playlist of the broadcast with a particular end point destination; a computing device having a processor and memory that executes an application that has a plurality of lines of code that are executed to: express, by the user while a particular piece of content is being broadcast by the analog or digital radio or television system, an interest in the broadcast piece of content; communicating the interest in the broadcast piece of content to the backend system; the backend system being configured to select an end point destination associated with the broadcast piece of content, the end point destination being a pointer to further information about the broadcast piece of content and communicate the end point destination for the broadcast piece of content to the computing device; and the computing device configured to access the further information about the broadcast piece of content using the end point destination.

In some embodiments, the backend system further comprises a digital marketing system that provides a personalized offer associated with the broadcast piece of content and wherein a display of the computing device displays the personalized offer to the user.

In some embodiments, the backend system activates the end point destination for each discrete piece of content at the start time for each discrete piece of content in the playlist and deactivates the end point destination for each discrete piece of content at the end time for each discrete piece of content in the playlist and wherein the computing device is further configured to express interest for the broadcast piece of content while the end point destination for the discrete piece of content is active. In some embodiments, the broadcast is selected from a group consisting of a live broadcast, a streamed broadcast and an archived broadcast. In some embodiments, the application executed on the computing device is one of a progressive web application (PWA) or an application downloaded to the computing device.

In some embodiments, the end point destination is a uniform resource locator (URL) to a webpage having digital information about the broadcast piece of content or content in an application having digital information about the broadcast piece of content. In some embodiments, the application executed on the computing device broadcasts the radio or television signal of the analog or digital radio or television station. In some embodiments, the radio or television signal of the analog or digital or television radio station is broadcast by a device separate from the computing device. In some embodiments, the device that broadcasts the radio signal of the analog radio station is a transistor radio.

According to a further aspect of the present disclosure, there is provided a computing device for interacting with an analog or digital radio or television broadcast system that broadcasts a plurality of pieces of discrete content, the broadcast system having a playlist that has each piece of discrete content being broadcast, a start time and end time for each piece of discrete content, the device comprising: a processor and memory that executes an application that is configured to: express, by the user while the piece of content is being broadcast by the analog or digital radio or television station, an interest in the broadcast piece of content; communicating the interest in the broadcast piece of content to a backend system; receive an end point destination associated with the broadcast piece of content of interest, the end point destination being a pointer to further information about the broadcast piece of content and communicate the end point destination for the broadcast piece of content to the computing device; and access the further information about the broadcast piece of content using the end point destination.

In some embodiments, the device is further configured to display a personalized offer to the user. In some embodiments, the device is further configured to express interest for the broadcast piece of content while the end point destination for the discrete piece of content is active. In some embodiments, the analog or digital radio or television broadcast is selected from a group consisting of a live broadcast, a streamed broadcast and an archived broadcast. In some embodiments, the application executed on the computing device is one of a progressive web application (PWA) or an application downloaded to the computing device.

In some embodiments, the end point destination is a uniform resource locator (URL) to a webpage having digital information about the broadcast piece of content or content in an application having digital information about the broadcast piece of content. In some embodiments, the application executed on the computing device broadcasts the radio signal of the analog digital radio station.

Other aspects and features will become apparent to those of ordinary skill in the art upon review of the following description of specific embodiments in conjunction with the accompanying figures.

The system may for example be used for live radio being played in any location (car, shop, supermarket, etc.), on an analog radio, through a TV channel or through the app/PWA on the computing device. Furthermore, background noise does not affect the efficacy of the system. The system allows a user to listen to an analog radio signal (generated by whatever device) and react/express interest about a piece of content in the broadcast using a PWA or application executing on the computing device (that may or may not being presenting the radio signal to the user) wherein the user is delivered an end point destination to the PWA or application based on the particular piece of content. The end point destination in turn directs the user to further information about the piece of content. Thus, in one embodiment, the system allows the user to listen to an analog radio signal and express interest/react to a piece of content in the analog radio signal and receive a digital marketing message. In a number of countries, a company that owns at least one radio station also owns other media such as television or magazines and the system described herein can be used to provide information about products on the other media using the end point destinations.

FIG. 1A illustrates an example of a cloud based implementation of an analog radio scanner system 100 that links analogue live radio broadcast (played on a 20 year old transistor radio, for example) to the digital world (and digital marketing) through a PWA or application on a computing device. The system 100 may have one or more computing devices 102 that may connect to and communicate over a communication path 104 with one or more backend systems 106 in order to provide radio digital marketing so that a user of the computing device 102 may hear a piece of content (commercial, advertorial, public service announcement, news-story, etc.) broadcast on a radio station (whether over the air or digital or streaming) and the user may indicate an interest in the piece of content currently being broadcast on the radio station. The system may communicate, back to the computing device, an end point destination that is associated with the piece of content, such as one or more personalized details/offers or other information. In this manner, each user of each computing device 102 may listen to a radio station, using the application, and receive the end point destination related to the piece of content of interest to each user. Alternatively, the analog radio signal may be broadcast by a device, such as a radio receiver.

Each computing device 102 may be a processor based device with memory, a display, an input device and connectivity circuits wherein the display may generate and display a user interface (see FIG. 7 for an example) so that the user can indicate interest in a particular piece of content broadcast by the radio stations and display the one or more personalized offers or other information based on the end point destination. The input device of the computing device 102 allows the user to interact with the user interface and the connectivity circuits may permit the computing device to connect and communicate wirelessly or over a wired line with the backend systems 106. For example, each computing device 102 may be a laptop computer, a tablet computer, a smartphone device, such as an Apple iPhone or an Android OS based device or a personal computer as shown in FIG. 1A. To interact with the radio station to indicate the interest in the piece of content, receive the end point destination and follow the end point destination, each computing device may have an application 102A that is a plurality of lines of instructions or computer code that are stored in the memory of the computing device and executed by the processor to generate the user interface as described below. Each application may be a mobile application or other application. In one embodiment, each application 102A may be a branded Radio Station App/progressive web app (PWA) that may be available, for example, on Android Auto/Apple Car Play. In one embodiment, the computing device 102 may be a processor based device that has limited capabilities, but does have access to the Internet and the system allows the user of this limited capability device to indicate an interest in content on the radio and receive digital marketing as a result of that expressed interest. For example, many computing devices 102 in India are feature phones that have limited capabilities, such as no ability to download apps, but has internet access and thus can use the PWA to indicate an interest in content on the radio and receive digital marketing as a result of that expressed interest.

The communication path 104 may be a wired link or a wireless link or a combination thereof that uses known communication and data transfer protocols that allow each computing device 120 to connect to and communicate with the backend systems 106.

The backend systems 106 may include one or more computing resources, such as a server computers, blade servers, cloud computing resources, etc. In more detail, the backend systems 106 may include, in an embodiment in which the radio is digital or streamed, one or more radio system servers 106A that deliver a broadcast (such as digital or analog radio or a stream) to each computing device 102 and more specifically to an app 102A. Each radio system server 106A may be owned by a third party and the system can provide its service to a plurality of radio systems 106A. Alternatively, the radio station system may be an analog radio station system that broadcasts via a transmitter the radio program over the air to listeners. The backend system 106 may further include a personal ad system server 106B that: 1) receives the interest indication from each user of each computing device; 2) selects the end point destination (such as customized offers) for each user based on the interest indication; 3) delivers the end point destination to the user; and 4) permits the user to access the end point destination as described below. The further information resulting from the end point destination, such as one or more customized offers, may be displayed to the user on the app 102A or via a dynamic web page such as using a PWA.

FIG. 1B illustrates more details of the preferred implementation of the backend system 106B shown in FIG. 1A. In a preferred implementation, the backend 106B may have a presentation layer 110A that interfaces with each user of the system, a network layer 110B that handles the well-known and understood network logistics such as load balancing and firewalls and a business layer 110C and a data layer 110D that implement the main processes of the radio advertising system. Each of the layers may be implemented using Amazon web systems (AWS) elements. It is understood that the system and method described below are in no way limited to the architecture shown in FIG. 1B. As shown in FIG. 1B, each user (using an application, mobile application or PWA on a computing device 102) may hear a piece of content in a radio broadcast and interact with the backend 106B through the presentation layer 110A. When the user expresses an interest in a particular piece of content being broadcast by the radio station, the PWA or application may generate data that is sent to the backend system 106B that identifies the radio station performing the broadcast and the content.

The data for each user as a result of the interaction with the backend 106B may be passed onto the network layer 110B that has the well-known load balancer and firewall (provided by AWS) that are not described further here. The business layer 110C may contain the various plurality of lines of code/instructions that perform the processes of the backend 106B. The data layer 110D may store the data used by the backend 106B including user data, data about each broadcast, such as playlist, data about the URL/links to content interacted with by a user and other content.

Each broadcast system 106A shown in FIG. 1A interacts with the backend system 106B using an application programming interface (API). Each broadcast system 106A may have a key, such as an API key, that allows the broadcast system 106A to interact with the backend system 106B. In one embodiment, there may be an allocated unique key per broadcaster/station that may be stored in multiple apps/PWAs, but each station has its own unique identifier so that, for example, there could be a BBC radio scanner but they have about 15 radio stations. In order to implement the content interacting system provided by the backend 106B, each broadcast system 106A using the key may upload the program/playlist for the particular broadcast system wherein the program/playlist may include the archived broadcasts of the broadcast system so that the interaction system provided by the backend 106B may be utilized for both the active broadcasts and the archive broadcasts. Using the API key, each piece of broadcast content may have a time marker to denote the beginning of the program (see examples in FIGS. 2A-2C) and a monitor within the app/PWA to determine when the live broadcast is paused. The time marker may be located in the audio file itself that the API key will identify. Through the app/PWA, from where the file is being played, the system knows the name of the recorded file/program and when each element of the broadcast starts and ends in granular detail (egg. adverts, interviews, commentary, music etc.).

FIGS. 2A-2C illustrate examples of the program/playlists of a broadcast system. Each playlist program has one or more piece of content being broadcast and then one or more advertisements/articles/discussions/promotions/sponsor messages that the user can interact with as described below in more detail. FIG. 2A shows a playlist 202 for a music type broadcast system in which one or more songs (S1, S2, . . . , SN) are broadcast along with one or more advertisements (A1, A2, . . . , A3) over a predetermined time of the playlist. In the playlist 202 a start time and an end time for each song and each advertisement is specified so that, for example, the first song starts at t0 and ends at t1 and the first ad starts at time t1 and ends a time t2, etc. Each time in the playlist may be measured in milliseconds. FIG. 2B illustrates a playlist 204 for a talk radio broadcast system that has one or more discussions (D1, . . . , D2) and one or more promotions (P1, . . . , P2) in which the start and end times of each piece of content is known down to the millisecond. FIG. 2C illustrates a playlist 206 for national public radio broadcast system that has one or more pieces of content (C1, . . . , CN) such as news stories or discussions and one or more ads (A1, . . . , A2) in which the start and end times of each piece of content is known down to the millisecond. Note that the backend system 106B allows a user to indicate an interest in the ads, the discussions, the stories, the songs, the promotions, etc. . . . . In each of the playlists, each piece of content, such as the songs and ads in FIG. 2A, is a discrete piece of content that has a start time and an end time.

Using the playlists/programs for each broadcast system 106B, each piece of content being broadcast is identified (including its start and end time) so that each piece of content can be associated/linked to an end point destination and thus each piece of content in the broadcast becomes clickable by the user by interacting with the backend 106B. Thus, all of the broadcast content (including archive content) becomes clickable by a user. In more detail, each piece of clickable content in the broadcast is synchronized with an end point destination (a URL or in-app content) associated with the particular piece of content. For example, an ad for a new Ford Mustang car may have an end point destination that directs the browser of the user to a website with details of the new Ford Mustang car. Alternatively, a new story about a volcano in Ethiopia may had an end point destination for a travel site to book travel to the Erta Ale region in Ethiopia. Each end point destination may be synchronized to be available to the user to select between the start time and end time of the piece of content in the playlist associated with the end point destination. Thus, the backend 106B is able to provide the end point destinations for the pieces of content based solely on the time when the user expressed their interest in the piece of content. For example, if a particular piece of content was broadcast from 10:00 AM to 10:05 AM and the user expresses an interest at 10:03 AM, the backend 106B knows that the user is expressing an interest in the particular piece of content. Once a particular broadcast system's playlist(s) are loaded into the backend system 106B, a user may interact with the broadcast system content as described in more detail with reference to FIG. 3. The system, due to the playlist, has millisecond precision about when to activate a particular end point destination (when the piece of content, ad, promotion, etc. starts being broadcast) and when to deactivate the particular end point destination (when the particular piece of content's broadcast has ended.) In this manner, the content sent to the computing device of the user (and the app or PWA) is in sync with the live broadcast based on the playlist timing sequences. The system can also handle the playlist being out of synchronization with the live broadcast such as when, for example, an interview last longer than scheduled. In this case, a time correction shift can be performed manually or automatically in real time using various techniques, such as for example audio recognition, to re-synchronize the playlist with the live broadcast.

FIG. 3 illustrates a digital marketing method 300 for an analog radio broadcast. The method 300 may be performed using the system 100 shown in FIGS. 1A and 1, but may also be performed in other manners. Furthermore, the method may be used with various analog radio systems that broadcast pieces of content including live radio stations (whether analog over the air or streaming) or archived content in which it is desirable to provide a way to provide digital marketing to the analog radio broadcast system. In the method, the user may listen to the analog radio broadcast (302) in any manner In one embodiment, the user may use a radio station app to listen to the radio station or may listen to the analog radio station using a separate device like a transistor radio. Note that each different user may be listening to a different radio station and each radio station may be coupled to the personal ad system 106B so that end point destinations may be delivered to each user listening to each radio station.

While listening to the broadcast, the user may hear a piece of content (ad, promotion, discussion, article, public announcement, sponsorship, news story, etc.) that is “interesting” to the user. For example, the user may hear an advertisement for a particular entertainment experience, such as a baseball game/team. The user may indicate their interest in the piece of content in the broadcast (304). In one embodiment, the user may use the radio station app/PWA app 102A to indicate the interest in the piece of content and may click on an icon in the app (an example of which is shown in FIG. 7).

The interest by the user may be communicated over the communications path 104 to the backend digital marketing system 106B. As described above, for this broadcast system, the backend digital marketing system 106B has the playlist for the broadcast with the different pieces of content and has one or more end point destinations for each piece of content. The end point destinations will be moved based on timing and all of the end point destinations will be pre-programmed based on the playlist (songs and adverts), live interviews and news/sport/traffic bulletins. In some embodiments, the application/PWA stores metadata about the user and the computing device (time, SKU, location, handset, language, version, OS, browser etc) so that the system may serve content personalized/relevant to each user if such content is available from the radio station/end point destination. For example, if the user indicates his interest in a particular product that is part of the radio broadcast at a particular location near a store for the product (known from the metadata), the application/PWA can direct that particular user to the store for the product thus increasing the foot traffic at the store. Thus, the backend may provide the end point destination to the user (306) back to the computing device. In some embodiments, the application/native application may store the database of content and end point destination associations (instead of being stored in the backend) and thus select the end point destination for a particular piece of content.

The user may then interact with the end point destination and receive information about the service or product or piece of content (308). In one embodiment, the user can purchase a product or service based on the end point destination using the radio station app/PWA. For example, the user may be listening to national radio and an advertisement is broadcast for a particular product. The user can express an interest in the advertisement and the product and the application/PWA may direct the user straight to that product on the brand/retailer's website/app. Furthermore, based on the metadata captured via the computing device, the application/PWA can inform the user of the nearest store for the particular product based on the GPS positioning of the current location of the computing device when the user expressed the interest in the product.

In some embodiments, the app 102A may be distributed by (or on behalf of) the broadcast system and may have a single icon for each user that each user can customize via the computing device app 102A. In one commercial embodiment, the app 102A may be a ‘RaydioActif’ app. In another embodiment, each car manufacturer may already have its own app in Car Play/Auto and the personalized offer functionality may be added into that existing app and the car manufacturer may do the deals with the local country radio stations for a revenue share. The above embodiment provides a completely new revenue stream for the auto industry and the radio stations.

FIG. 4 illustrates more details of the computing device 102 shown in FIG. 1A that has a display 402, a processor 404, connectivity circuits 406 and memory 408 that are connected together as is known in the art. Each computing device may also have the app 102A and an operating system 102B that reside in the memory 408 and have a plurality of lines of instructions/computer code that are executed by the processor 404 of the computing device 102. The functions and operations of the app 102A are described above. As described above, the app 102A may be a progressive web app (PWA) that is a web application that can be saved to the home screen of the computing device. A PWA is a known technology that is described in more detail at //developers.google.com/web/progressive-web-apps/ and llen.wikipedia.org/wiki/Progressive_Web_Apps, both of which are incorporated herein by reference. The app may also be an application downloaded to the computing device. While the computing device 102 and the PWA are known technology, the disclosed radio personalized offer system and method using the computing device and PWA are not known in the marketing or digital marketing industry. Each computing device 102 may also have an input device, such as a touchscreen, keyboard, mouse, etc. that allows the user to interact with the computing device 102 and the app 102A to, for example, indicate a piece of content of interest in the broadcast and select one of the one or more personalized offers provided to the user.

FIG. 5 illustrates more details of the broadcast system server 106a shown in FIG. 1A that streams or broadcasts content, such as radio station data, to the user and the radio station app in one embodiment. The broadcast system 106A may include one or more computing resources, such as a server computers, blade servers, cloud computing resources, etc. and may further include a store for the content 502 to be broadcast (if the broadcast content is not live) and a broadcast content streaming system 504 connected to the store 502 that streams or broadcasts the content to each user through the app 102A. The broadcast content streaming system or the broadcast content store 502 may also communicate the playlist/program to the backend 106B as described above.

FIG. 6 illustrates more details of the personal ad system server 106B shown in FIG. 1A. The personal ad system 106B may include one or more computing resources, such as a server computers, blade servers, cloud computing resources, etc. and may further include an interest parser 602 that receives an indication of interest for a particular piece of content from a user listening to the broadcast using the app/PWA when the end point destination for the particular piece of content is active and, using timestamping and a broadcast store 504 in one embodiment, determines, for each user, the end point destination identified by the user in each broadcast signal, such as a radio signal. The system 106B may have an end point destination manager 606 that receives the determined interest for each user and, using an end point destination store 608, selects the one or more end point destinations that may be returned to the user. In one embodiment, each broadcast station may have its own set of offers that may be selected.

FIG. 7 illustrates an example of a user interface for the application. The application or PWA may display the user interface shown in FIG. 7 during the live broadcast of the radio station. The user may indicate/express an interest in a discrete piece of content being broadcast by the radio station by tapping on a user interface element 702 such as the one shown. The result of tapping the user interface element is the delivery of the end point destination of the particular piece of content as described above. Further, as described above, when a different discrete piece of content is being broadcast by the radio station, tapping on the same user interface element results in the end point destination for the different discrete piece of content being communicated to the application.

Use Cases for Broadcast System and Method

The broadcast system and method may be used for various different types of content that may each have an end point destination associated with the piece of content. For example, the piece of content may be a product placement in a radio show in which the end point destination allows the user to tap/select for further information or to buy the product. The piece of content may also be advertising/clickable advertising in which the end point destination allows the user to tap/select for further information or to buy the product. In an example in which the broadcast is a broadcast or music by an artist, the end point destination allows the user to tap/click/select to learn more about the song or artist, go to artist's page/Spotify channel/YouTube/Vevo/T-Series/merchandise/tour tickets/social media channels etc. In an example in which the broadcast content is a movie review, the end point destination may allow the user to click/tap/select when listening to commentary to view trailer, book cinema tickets etc. In an example in which the broadcast content is commentary, such as sports talk, the end point destination allows the user to select/tap/click to receive further information about the team/player/tournament mentioned in the commentary.

In an example in which the broadcast is a news program, the end point destination allows the user to select/tap/click to read local/national news, watch local/national news channel. For a public service announcement about a disaster or disaster preparation being broadcast, the end point destination may take a person to an evacuation route for the particular user based on the location of the user. For a podcast broadcast, the end point destination allows the user to tap/click/select for further information, access educational/political/scientific information about the podcast subject and idea mentioned in the podcast. For a public information broadcast, the end point destination allows the user to tap/click/select for further information, access further information/download documents to the computing device about the public information being broadcast. For an interview broadcast, the end point destination allows the user to tap/click/select to watch behind the scenes footage, tap to learn more about individual/group/team, etc. For a sponsor message broadcast, the end point destination allows the user to tap/click to buy, tap to view further information, tap to contact about the sponsor. For a competition/giveaway content broadcast, the end point destination allows the user to tap/click to signup/enter/win the competition/giveaway.

For a translation broadcast, the end point destination allows the user to tap/click to hear an add in Hindi, tap to translate into any particular language (known via user's handset). For a live call in program, the end point destination allows the user to tap/click to record question/phone in and thus upload a comment/question for inclusion in the live program. The end point destination may also allow the user to tap to review—eg. upload comment/media file/content for curation or tap to comment on social media—go straight to relevant page on social media channel The end point destination may also allow the user, for gambling content, to tap to place a bet or see odds for a bet.

As described above, the system and method sync the play list of a commercial broadcast station such that each advert/article/discussion/promotion/sponsor message, etc are known to the back end 106B and can be interacted with by the user using the end point destinations. Furthermore, the app/PWA may be integrated through the ‘Apple Car Play’ or ‘Android Auto’ controls of the major Car Manufacturers. In this instance, the system can create a ‘buy now’ button of the (for example) Audi button in the Car Play/Auto screen of the car so that, when a listener likes an advert, the audi button can be pressed and the special offer/information is sent directly to the user's phone in a single click. A further embodiment of this is via a Bluetooth connection rather than Car Play/Auto. A key aspect for Advertisers/Broadcasters here is that the same back end interface will control scanning an image or video, screen shooting an image or video, applying a visual ‘buy now’ button to a video and timestamping from radio. So any brand visual or audio can now be shoppable in anonymity, should the user so desire, without being ‘pushed’ by the brand, Broadcaster or Publisher.

The foregoing description, for purpose of explanation, has been described with reference to specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the disclosure to the precise forms disclosed. Many modifications and variations are possible in view of the above teachings. The system and method of the present disclosure may for example be applied to digital radio broadcasts as well as analog and digital broadcasts of television shows, programs and the like. The embodiments were chosen and described in order to best explain the principles of the disclosure and its practical applications, to thereby enable others skilled in the art to best utilize the disclosure and various embodiments with various modifications as are suited to the particular use contemplated.

The system and method disclosed herein may be implemented via one or more components, systems, servers, appliances, other subcomponents, or distributed between such elements. When implemented as a system, such systems may include an/or involve, inter alia, components such as software modules, general-purpose CPU, RAM, etc. found in general-purpose computers. In implementations where the innovations reside on a server, such a server may include or involve components such as CPU, RAM, etc., such as those found in general-purpose computers.

Additionally, the system and method herein may be achieved via implementations with disparate or entirely different software, hardware and/or firmware components, beyond that set forth above. With regard to such other components (e.g., software, processing components, etc.) and/or computer-readable media associated with or embodying the present inventions, for example, aspects of the innovations herein may be implemented consistent with numerous general purpose or special purpose computing systems or configurations. Various exemplary computing systems, environments, and/or configurations that may be suitable for use with the innovations herein may include, but are not limited to: software or other components within or embodied on personal computers, servers or server computing devices such as routing/connectivity components, hand-held or laptop devices, multiprocessor systems, microprocessor-based systems, set top boxes, consumer electronic devices, network PCs, other existing computer platforms, distributed computing environments that include one or more of the above systems or devices, etc.

In some instances, aspects of the system and method may be achieved via or performed by logic and/or logic instructions including program modules, executed in association with such components or circuitry, for example. In general, program modules may include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular instructions herein. The inventions may also be practiced in the context of distributed software, computer, or circuit settings where circuitry is connected via communication buses, circuitry or links. In distributed settings, control/instructions may occur from both local and remote computer storage media including memory storage devices.

The software, circuitry and components herein may also include and/or utilize one or more type of computer readable media. Computer readable media can be any available media that is resident on, associable with, or can be accessed by such circuits and/or computing components. By way of example, and not limitation, computer readable media may comprise computer storage media and communication media. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and can accessed by computing component. Communication media may comprise computer readable instructions, data structures, program modules and/or other components. Further, communication media may include wired media such as a wired network or direct-wired connection, however no media of any such type herein includes transitory media. Combinations of the any of the above are also included within the scope of computer readable media.

In the present description, the terms component, module, device, etc. may refer to any type of logical or functional software elements, circuits, blocks and/or processes that may be implemented in a variety of ways. For example, the functions of various circuits and/or blocks can be combined with one another into any other number of modules. Each module may even be implemented as a software program stored on a tangible memory (e.g., random access memory, read only memory, CD-ROM memory, hard disk drive, etc.) to be read by a central processing unit to implement the functions of the innovations herein. Or, the modules can comprise programming instructions transmitted to a general purpose computer or to processing/graphics hardware via a transmission carrier wave. Also, the modules can be implemented as hardware logic circuitry implementing the functions encompassed by the innovations herein. Finally, the modules can be implemented using special purpose instructions (SIMD instructions), field programmable logic arrays or any mix thereof which provides the desired level performance and cost.

As disclosed herein, features consistent with the disclosure may be implemented via computer-hardware, software and/or firmware. For example, the systems and methods disclosed herein may be embodied in various forms including, for example, a data processor, such as a computer that also includes a database, digital electronic circuitry, firmware, software, or in combinations of them. Further, while some of the disclosed implementations describe specific hardware components, systems and methods consistent with the innovations herein may be implemented with any combination of hardware, software and/or firmware. Moreover, the above-noted features and other aspects and principles of the innovations herein may be implemented in various environments. Such environments and related applications may be specially constructed for performing the various routines, processes and/or operations according to the invention or they may include a general-purpose computer or computing platform selectively activated or reconfigured by code to provide the necessary functionality. The processes disclosed herein are not inherently related to any particular computer, network, architecture, environment, or other apparatus, and may be implemented by a suitable combination of hardware, software, and/or firmware. For example, various general-purpose machines may be used with programs written in accordance with teachings of the invention, or it may be more convenient to construct a specialized apparatus or system to perform the required methods and techniques.

Aspects of the method and system described herein, such as the logic, may also be implemented as functionality programmed into any of a variety of circuitry, including programmable logic devices (“PLDs”), such as field programmable gate arrays (“FPGAs”), programmable array logic (“PAL”) devices, electrically programmable logic and memory devices and standard cell-based devices, as well as application specific integrated circuits. Some other possibilities for implementing aspects include: memory devices, microcontrollers 21 Furthermore, aspects may be embodied in microprocessors having software-based circuit emulation, discrete logic (sequential and combinatorial), custom devices, fuzzy (neural) logic, quantum devices, and hybrids of any of the above device types. The underlying device technologies may be provided in a variety of component types, e.g., metal-oxide semiconductor field-effect transistor (“MOSFET”) technologies like complementary metal-oxide semiconductor (“CMOS”), bipolar technologies like emitter-coupled logic (“ECL”), polymer technologies (e.g., silicon-conjugated polymer and metal-conjugated polymer-metal structures), mixed analog and digital, and so on.

It should also be noted that the various logic and/or functions disclosed herein may be enabled using any number of combinations of hardware, firmware, and/or as data and/or instructions embodied in various machine-readable or computer-readable media, in terms of their behavioral, register transfer, logic component, and/or other characteristics. Computer-readable media in which such formatted data and/or instructions may be embodied include, but are not limited to, non-volatile storage media in various forms (e.g., optical, magnetic or semiconductor storage media) though again does not include transitory media. Unless the context clearly requires otherwise, throughout the description, the words “comprise,” “comprising,” and the like are to be construed in an inclusive sense as opposed to an exclusive or exhaustive sense; that is to say, in a sense of “including, but not limited to.” Words using the singular or plural number also include the plural or singular number respectively. Additionally, the words “herein,” “hereunder,” “above,” “below,” and words of similar import refer to this application as a whole and not to any particular portions of this application. When the word “or” is used in reference to a list of two or more items, that word covers all of the following interpretations of the word: any of the items in the list, all of the items in the list and any combination of the items in the list.

Although certain presently preferred implementations of the invention have been specifically described herein, it will be apparent to those skilled in the art to which the invention pertains that variations and modifications of the various implementations shown and described herein may be made without departing from the spirit and scope of the invention. Accordingly, it is intended that the invention be limited only to the extent required by the applicable rules of law.

While the foregoing has been with reference to a particular embodiment of the disclosure, it will be appreciated by those skilled in the art that changes in this embodiment may be made without departing from the principles and spirit of the disclosure, the scope of which is defined by the appended claims.

Lancaster, Peter

Patent Priority Assignee Title
Patent Priority Assignee Title
10089550, Aug 17 2011 Sports video display
10120944, Jul 08 2015 Baidu USA LLC System and method for routing data and connecting users based on user interactions with a machine-readable code of content data
10142687, Dec 30 2011 SYMPHONY ADVANCED MEDIA, INC Audience content exposure monitoring apparatuses, methods and systems
10158722, Jul 31 2015 PAGE VAULT INC Method and systems for the scheduled capture of web content from web servers as sets of images
10231033, Sep 30 2014 Apple Inc. Synchronizing out-of-band content with a media stream
10291947, Jul 06 2011 Symphony Advanced Media Media content synchronized advertising platform apparatuses and systems
10445618, Feb 11 2005 Mobile Acuity Limited Storing information for access using a captured image
10504556, Mar 12 2012 BRANDACTIF LIMITED Intelligent print recognition system and method
11069379, Mar 12 2012 BRANDACTIF LTD Intelligent print recognition system and method
11301906, Mar 03 2020 BRANDACTIF LTD.; BRANDACTIF LTD Method and system for digital marketing and the provision of digital content
11373214, Mar 03 2020 BRANDACTIF LTD Method and system for digital marketing and the provision of digital content
11922464, Mar 03 2020 BRANDACTIF LTD. Sponsor driven digital marketing for live television broadcast
5188624, Jan 16 1990 PARAGON TRADE BRANDS, INC, Absorbent article with superabsorbent particle containing insert pad and liquid dispersion pad
5661517, May 02 1994 MESSAGEPHONE, INC Interactive intelligent video information system
5854894, Jul 26 1995 International Computers Limited Multi-media services system
5918012, Mar 29 1996 British Telecommunications plc Hyperlinking time-based data files
6175663, Feb 24 1998 Resource Consortium Limited Method and apparatus for preserving background continuity in images
6587599, Feb 24 1998 Resource Consortium Limited Method and apparatus for producing a composed output resembling an image
6826727, Nov 24 1999 MARLBOROUGH SOFTWARE DEVELOPMENT HOLDINGS INC Apparatus, methods, programming for automatically laying out documents
6914593, May 25 1999 Silverbrook Research Pty LTD Computer system control with user data via interface surface and processing sensor
7030642, Feb 06 2004 Honeywell International Inc. Quick attachment fixture and power card for diode-based light devices
7406603, Aug 31 1999 PLS IV, LLC Data protection systems and methods
7466444, Dec 01 1999 Silverbrook Research Pty LTD Mobile telecommunications device with stylus
7495795, Feb 21 2002 Ricoh Company, LTD Interface for printing multimedia information
7739583, Mar 31 2003 Ricoh Company, LTD Multimedia document sharing method and apparatus
7746498, May 25 1999 Silverbrook Research Pty LTD Facsimile delivery system using associated identifiers
7812986, Aug 23 2005 Ricoh Co. Ltd. System and methods for use of voice mail and email in a mixed media environment
7930642, Mar 20 2008 INTUIT INC.; INTUIT, INC System and method for interacting with hard copy documents
7962691, Mar 13 2007 Brother Kogyo Kabushiki Kaisha Information processing apparatus and computer usable medium therefor
7982898, May 25 1999 Silverbrook Research Pty LTD Method of creating printed interactive document
7991778, Aug 23 2005 Ricoh Co., Ltd. Triggering actions with captured input in a mixed media environment
8090628, Aug 04 2006 HOYA LENS MANUFACTURING PHILIPPINES INC Lens order system, lens order method, lens order program and recording medium storing the lens order program
8156427, Aug 23 2005 Ricoh Co. Ltd. User interface for mixed media reality
8271413, Nov 25 2008 GOOGLE LLC Providing digital content based on expected user behavior
8310985, Nov 13 2006 Interactive radio advertising and social networking
8332401, Oct 01 2004 Ricoh Co., Ltd Method and system for position-based image matching in a mixed media environment
8335789, Oct 01 2004 Ricoh Co., Ltd. Method and system for document fingerprint matching in a mixed media environment
8385660, Jun 24 2009 RICOH CO LTD Mixed media reality indexing and retrieval for repeated content
8390648, Dec 29 2009 Monument Peak Ventures, LLC Display system for personalized consumer goods
8438485, Mar 17 2009 uNews, LLC System, method, and apparatus for generating, customizing, distributing, and presenting an interactive audio publication
8601526, Jun 13 2008 Rovi Guides, Inc; TV GUIDE, INC ; UV CORP Systems and methods for displaying media content and media guidance information
8610730, Sep 19 2012 GOOGLE LLC Systems and methods for transferring images and information from a mobile computing device to a computer monitor for display
8635531, Feb 21 2002 Ricoh Company, LTD Techniques for displaying information stored in multiple multimedia documents
8681243, Jan 11 2002 Nikon Corporation Digital camera
8682722, Jan 28 2005 Yahoo Ad Tech LLC Controlling user experience
8782135, May 18 2007 RADIOFLAG, INC Focused listening and advertising guide system and method
8797604, Aug 24 2012 Xerox Corporation Methods and systems for creating structural documents
8843963, Oct 29 1999 UV CORP ; TV GUIDE, INC ; Rovi Guides, Inc Interactive television system with programming-related links
8867106, Mar 12 2012 BRANDACTIF LIMITED Intelligent print recognition system and method
8918333, Feb 23 2009 Method, system and apparatus for interactive radio advertising
9036043, Jun 02 2010 BMUSE GROUP, LLC; TOUCHCAST LLC System and method for generating and transmitting interactive coordinated presentations
9092291, Jul 11 2013 T-MOBILE INNOVATIONS LLC Dynamic updating and renaming virtual pre-installation stub applications
9219840, Feb 11 2005 Mobile Acuity Limited Storing information for access using a captured image
9223782, Oct 11 2007 Mobile Acuity Limited System for performing instructions that are dependent upon received media-based messages and associated methods and components
9253513, Sep 08 2014 Microsoft Technology Licensing, LLC Independent multi-panel display with cross-panel interactivity
9332302, Jan 30 2008 AIBUY HOLDCO, INC Interactive product placement system and method therefor
9338493, Jun 30 2014 Apple Inc Intelligent automated assistant for TV user interactions
9363448, Jun 02 2011 TOUCHCAST, LLC System and method for providing and interacting with coordinated presentations
9418294, Feb 11 2005 Mobile Acuity Limited Storing information for access using a captured image
9448625, Jan 15 2013 Seiko Epson Corporation Head-mounted display device, control method for head-mounted display device, and image display system
9652783, Jun 30 2009 Verizon Patent and Licensing Inc. Methods and systems for controlling presentation of media content based on user interaction
9656492, Jun 26 2013 OCE-TECHNOLOGIES B V Method for generating prints on a flatbed printer, apparatus therefor and a computer program therefor
9659313, Sep 27 2010 Unisys Corporation Systems and methods for managing interactive features associated with multimedia content
9715629, Feb 11 2005 Mobile Acuity Limited Storing information for access using a captured image
9716918, Nov 10 2008 Winview IP Holdings, LLC Interactive advertising system
9754623, Mar 12 2012 BRANDACTIF LIMITED Intelligent print recognition system and method
9832532, Feb 20 2008 CSC Holdings, LLC Interactive save and purchase of content and products
9979758, Jul 02 2008 ICHARTS LLC Creation, sharing and embedding of interactive charts
20020184091,
20030070167,
20040019497,
20040032424,
20040047294,
20040095376,
20040098671,
20040193571,
20050278736,
20060080171,
20060136549,
20070288976,
20080052194,
20080167992,
20080250023,
20080260352,
20080262911,
20080318529,
20090047000,
20090061763,
20090150941,
20090210790,
20090265734,
20090313658,
20100063931,
20100146135,
20100195623,
20100280641,
20100280921,
20100286490,
20110035394,
20110157221,
20110157226,
20110179356,
20110247035,
20110320278,
20120066386,
20120072943,
20120085819,
20120159327,
20120173388,
20120274105,
20120317492,
20130034147,
20130036007,
20130173402,
20130191749,
20130198772,
20130212619,
20130254159,
20130332963,
20130346599,
20140036088,
20140068662,
20140164091,
20140198033,
20140215333,
20140245346,
20150033255,
20150036996,
20150067748,
20150149585,
20150162997,
20150181269,
20150199084,
20150213439,
20150270318,
20150271234,
20150294366,
20150312302,
20150358790,
20160094302,
20160182923,
20160192001,
20160316233,
20160351062,
20170013314,
20170178097,
20170200193,
20170272816,
20170365293,
20180035152,
20180054639,
20180122378,
20180190264,
20180261223,
20180343495,
20190066190,
20190273954,
20190313135,
20200104844,
20200111508,
20200151702,
20200242585,
20200245017,
20200285854,
20210044863,
20210342891,
20220321940,
20240029115,
CN101600118,
CN103905846,
CN106127469,
EP1847112,
GB2370456,
WO2002082351,
WO2005039080,
WO2014150073,
//
Executed onAssignorAssigneeConveyanceFrameReelDoc
Nov 13 2020LANCASTER, PETER GERARDBRANDACTIF LTD ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS 0651060604 pdf
Oct 03 2023BRANDACTIF LTD.(assignment on the face of the patent)
Date Maintenance Fee Events
Oct 03 2023BIG: Entity status set to Undiscounted (note the period is included in the code).
Oct 17 2023SMAL: Entity status set to Small.


Date Maintenance Schedule
Sep 10 20274 years fee payment window open
Mar 10 20286 months grace period start (w surcharge)
Sep 10 2028patent expiry (for year 4)
Sep 10 20302 years to revive unintentionally abandoned end. (for year 4)
Sep 10 20318 years fee payment window open
Mar 10 20326 months grace period start (w surcharge)
Sep 10 2032patent expiry (for year 8)
Sep 10 20342 years to revive unintentionally abandoned end. (for year 8)
Sep 10 203512 years fee payment window open
Mar 10 20366 months grace period start (w surcharge)
Sep 10 2036patent expiry (for year 12)
Sep 10 20382 years to revive unintentionally abandoned end. (for year 12)