characters represented within a frame of a television presentation are identified. A pattern formed by a subset of the characters is identified if the pattern is indicative of an addressing datum. A provision is made for a selection of characters that form the pattern indicative of the addressing datum. In one embodiment, a web page is displayed upon a selection of characters that form a pattern indicative of an uniform resource locator for the web page.

Patent
   7456902
Priority
Dec 04 2000
Filed
Dec 04 2001
Issued
Nov 25 2008
Expiry
Dec 24 2021
Extension
20 days
Assg.orig
Entity
Large
8
51
all paid
13. A system comprising:
a first unit to identify characters represented within a currently displayed frame of a broadcasted television presentation, to identify a pattern formed by a subset of the characters, the pattern indicative of an addressing datum by a presentation system, and to modify an appearance of the pattern indicative of the addressing datum to visually distinguish the pattern from other characters represented within the currently displayed frame of the television presentation; and
a second unit coupled with the first unit to provide for a selection of characters that form the pattern indicative of the addressing datum by the presentation system, wherein said TV presentation is simultaneously presented without interruption by the presentation system during said identifying characters, identifying a pattern, and providing for a selection of characters.
1. A method comprising:
identifying characters represented within a currently displayed frame of a broadcasted television presentation by a presentation system;
identifying a pattern formed by a subset of the characters, the pattern indicative of an addressing datum by the presentation system;
modifying an appearance of the characters that form the pattern indicative of the addressing datum to visually distinguish the characters from other characters represented within the currently displayed frame of the television presentation; and
providing for a selection of characters that form the pattern indicative of the addressing datum by the presentation system, wherein said TV presentation is simultaneously presented without interruption by the presentation system during said identifying characters, identifying a pattern, visually distinguishing, and providing for a selection of characters.
8. A computer-readable medium containing instructions that, when executed by a processor, cause the processor to perform operations comprising:
identifying characters represented within a currently displayed frame of a broadcasted television presentation by a presentation system;
identifying a pattern formed by a subset of the characters, the pattern indicative of an addressing datum by the presentation system;
modifying an appearance of the characters that form the pattern indicative of the addressing datum to visually distinguish the characters from other characters represented within the currently displayed frame of the television presentation; and
providing for a selection of characters that form the pattern indicative of the addressing datum by the presentation system, wherein said TV presentation is simultaneously presented without interruption by the presentation system during said identifying characters, identifying a pattern, visually distinguishing, and providing for a selection of characters.
2. The method of claim 1, wherein the step of visually distinguishing characters includes visually distinguishing characters in an area of the currently displayed frame of the television presentation in which a pointer is positioned.
3. The method of claim 1, further comprising:
upon a selection of characters that form a pattern indicative of a telephone number, dialing the telephone number.
4. The method of claim 1, further comprising:
upon a selection of characters that form a pattern indicative of an email address, sending email to the email address.
5. The method of claim 1, further comprising:
upon a selection of characters that form a pattern indicative of a uniform resource locator for a web page, displaying the web page.
6. The method of claim 1 further comprising automatically determining the addressing datum to be one of a plurality of different types of addressing datum and thereafter initiating a data transmission via a communication method that is associated with the addressing datum.
7. The method of claim 1, further comprising: automatically identifying a plurality of distinct addressing datum within the frame and visually distinguishing each of the different addressing datum.
9. The computer-readable medium of claim 8, wherein operations further comprise:
the step of visually distinguishing characters that form the pattern indicative of the addressing datum is performed in an area of the currently displayed frame of the television presentation in which a pointer is positioned.
10. The computer-readable medium of claim 8, wherein operations further comprise: upon a selection of characters that form a pattern indicative of a telephone number, dialing the telephone number.
11. The computer-readable medium of claim 8, wherein operations further comprise: upon a selection of characters that form a pattern indicative of an email address, sending email to the email address.
12. The computer-readable medium of claim 8, wherein operations further comprise:
upon a selection of characters that form a pattern indicative of a uniform resource locator for a web page, displaying the web page.
14. The system of claim 13, wherein the second unit is also to visually distinguishing characters that form the pattern indicative of the addressing datum in an area of the currently displayed frame of the television presentation in which a pointer is positioned from other characters represented within the currently displayed frame of the television presentation that form a pattern indicative of an addressing datum.
15. The system of claim 13, wherein the second unit is also to dial a telephone number upon a selection of characters that form a pattern indicative of the telephone number.
16. The system of claim 13, wherein the second unit is also to send email to an email address upon a selection of characters that form a pattern indicative of the email address.
17. The system of claim 13, wherein the second unit is also to display a web page upon a selection of characters that form a pattern indicative of a uniform resource locator for the web page.

The present application claims priority to the provisional filed application entitled Dynamic URL OCR and automatic hyperlinking, filed on Dec. 4, 2000, Ser. No. 60/251,248, which is also incorporated herein by reference.

The invention relates to the field of television. More specifically, the invention relates to identifying addressing data within a television presentation.

With the increasing popularity of the Internet as a means of conveying and receiving information, television presentations such as broadcasted programs have increasingly incorporated displaying addressing data such as uniform resource locators (“URLs”). For example, it is not uncommon for a presentation to state at its conclusion, “Please visit us at www.ourwebpage.com.” In this example, “www.ourwebpage.com” is an addressing datum; an URL, to be precise. Using this URL, a viewer may direct a device capable of Internet browsing to a web page specific to the television presentation viewed. The web page may contain additional information of similar interest to what was seen in the television presentation. One who is directed to the web page may also be presented with the opportunity to send information through the Internet to those associated with the television presentation. Of course, the addressing datum need not be a web page; television presentations also sometimes display other addressing data such as email addresses, and the display of telephone numbers in television presentations is also common. Other varied forms of addressing data that allow one to contact another are also conceivable.

Television presentations are inherently limited to a span of viewing time. A television commercial, as one example of a television presentation, may only be made up of relatively few frames in which an addressing datum may be displayed. The addressing datum may in some cases be difficult to immediately commit to memory in the relatively short presentation time. Means for recording the addressing datum in a more permanent form, such as a pencil and paper or a video recorder, may not be available, or may require so much time to prepare and use that the frames of the television presentation containing the addressing datum have already vanished from view. In some circumstances, preparing such recording means may require more time and effort than a viewer desires to invest in recording or using the addressing datum. Because one television presentation typically immediately follows another, a viewer may be disinclined to interrupt his viewing experience to use a device, such as a telephone or a computer, to input the addressing datum. Thus, a viewer may be frustrated in his attempt to contact a presenter via the addressing datum, and the presenter may never even become aware that a viewer desired to contact him via the addressing datum, making the whole display of the addressing datum in the television presentation a somewhat pointless undertaking.

Characters represented within a frame of a television presentation are identified. A pattern formed by a subset of the characters is identified if the pattern is indicative of an addressing datum. A provision is made for a selection of characters that form the pattern indicative of the addressing datum. In one embodiment, a web page is displayed upon a selection of characters that form a pattern indicative of an uniform resource locator for the web page.

The present invention will be understood more fully from the detailed description given below and from the accompanying drawings of various embodiments of the invention, which, however, should not be taken to limit the invention to the specific embodiments, but are for explanation and understanding only.

FIG. 1 illustrates a flow diagram for identifying addressing data within a television presentation, according to one embodiment;

FIG. 2 illustrates a flow diagram for taking action upon a selection of an addressing datum, according to one embodiment; and

FIG. 3 illustrates a system for identifying addressing data within a television presentation, according to one embodiment.

FIG. 1 illustrates a flow diagram for identifying addressing data within a television presentation, according to one embodiment. In process block 110, characters represented within a frame of a television presentation are identified. The characters may be alphanumeric characters. The characters may be identified using optical character recognition software. The characters may be represented within one or more frames of many frames of a television presentation. Each frame contains a time slice image of the television presentation. Of course, characters could also be identified in presentations other than television presentations. Characters may be identified which are represented within frames of any multi frame visual presentation. Character identification may take place prior to or after an actual broadcasting of a television presentation. Optical character recognition software could be used to process a recorded visual presentation at any time. Character identification through optical character recognition software could be used by a producer, a broadcaster, or a viewer. In one embodiment, the process, beginning with character identification, is started when a viewer presses a button, such as a button on a remote control.

In process block 120, a pattern formed by a subset of the characters, the pattern indicative of an addressing datum, is identified. The pattern may be one of a number of predetermined recognized patterns. Each pattern may be indicative of a different kind of addressing datum. For example, the characters “www.” or “http://” form patterns indicative of an uniform resource locator, one kind of addressing datum. A string of characters including an “@” symbol are indicative of an email address. Three digits enclosed in parenthesis, followed by three more digits, followed by a hyphen, followed by four digits is a pattern indicative of a telephone number, one kind of addressing datum. Of course, various other kinds of addressing data are possible, each having a different corresponding pattern.

In process block 130, a selection is provided for of the characters that form the pattern indicative of the addressing datum. The selection of the characters that form the pattern indicative of the addressing datum may be accomplished by using the controls on a television remote control. Up, down, left, and right buttons on the remote control may be used to move a visible pointer on a television screen. A button on the television remote control may be used to indicate a selection of characters in the region of the visible pointer. In one embodiment, the television presentation is paused at the current frame when a viewer initiates the character identification process, as by pushing a button. In one embodiment, rather than pausing the television presentation upon initiation of the character identification process, the viewing screen is divided into regions and the television presentation continues in one region. In one embodiment, the television presentation continues behind recognized characters.

In one embodiment, characters that form the pattern indicative of the addressing datum are visually distinguished from other characters represented within the frame of the television presentation, shown in process block 140. For example, characters may be distinguished by the overlaying of a graphic over the frame of the television presentation. The overlaying graphic may be a translucent rectangular area covering the characters to be distinguished, causing the overlayed characters to appear in a different color. Other schemes to distinguish the addressing datum are possible. The graphical overlay may cause the characters to appear to be underlined, similar to an Internet hyperlink. This identification and underlining process may be viewed as automatic hyperlinking.

Several different addressing data may be represented within a single frame of a television presentation. In such a case, each of the recognized addressing data may be visually distinguished, as described above, from other characters represented within the frame that do not indicate an addressing datum. In process block 150, according to one embodiment, characters that form the pattern indicative of the addressing datum in an area of the frame of the television presentation in which a pointer is positioned are visually distinguished from other characters represented within the frame of the television presentation that also form a pattern indicative of an addressing datum. Thus, in a frame containing more than one addressing datum, an addressing datum over which a pointer is positioned may be visually distinguished from other addressing data in the frame. In one embodiment, the selection process is ended after a predetermined time period has expired. In one embodiment, the selection process is ended upon some indication being made that no action is to be taken. Such an indication may be made through the selection of an “exit” or “no action” option represented in the frame with the addressing data. In one embodiment, the addressing datum may be edited. This editing permits a viewer to correct errors that may result during the optical character recognition process. The addressing datum may also be edited prior to actual broadcasting.

FIG. 2 illustrates a flow diagram for taking action upon a selection of an addressing datum, according to one embodiment. In decision block 201, it is determined whether there has been a selection of characters that form a pattern indicative of an addressing datum. If there has been a selection of characters that form a pattern indicative of an addressing datum, then in decision block 202, it is determined whether the pattern is indicative of an email address. If it is determined that the pattern is indicative of an email address, then in process block 203, email is sent to the email address. If it is determined in decision block 202 that the pattern is not indicative of an email address, then in decision block 204, it is determined whether the pattern is indicative of an uniform resource locator for a web page. If it is determined that the pattern is indicative of an uniform resource locator for a web page, then in process block 205, the web page is displayed. If the television is not capable of displaying a web page, then in one embodiment, an Internet-ready computer may be directed to display the web page instead. If it is determined that the pattern is not indicative of an uniform resource locator for a web page, then in decision block 206, it is determined whether the pattern is indicative of a telephone number. If the pattern is indicative of a telephone number, then in process block 207, the telephone number is dialed. Of course, the pattern listed above are not exclusive. Analysis of the patterns need not be performed in any particular order.

FIG. 3 illustrates a system for identifying addressing data within a television presentation, according to one embodiment. The system includes a television 301. The television 301 is to display a television presentation. The system includes a first unit to identify characters represented within a frame of a television presentation, and to identify a pattern formed by a subset of the characters, the pattern indicative of an addressing datum. The system also includes a second unit coupled with the first unit to provide for a selection of characters that form the pattern indicative of the addressing datum. In one embodiment, the first unit and the second unit are incorporated in set-top box 302, coupled with television 301. In one embodiment, the second unit is incorporated in settop box 302, and the first unit is incorporated in television media provider 305, which communicates with set-top box 302 through television communication medium 306. In one embodiment, television media provider 305 is a computer. Television media provider 305 may have stored on it a number of files that represent television presentations. These television presentations may be broadcast to set-top box 302 through television communication medium 306. Set-top box 302, in turn, may transmit the television presentation to television 301. Television communication medium 306 may be a form of guided media, such as a cable, or it may be a form of unguided media, such as electromagnetic waves. A viewer may use remote control 303 to send commands to set-top box 302. These commands may tell set-top box 302 to select a channel or an addressing datum displayed on television 301. In one embodiment, set-top box 302 graphically overlays the addressing data presented on television 301, as described above.

In one embodiment, set-top box 302 is coupled with Internet 307. In this way, set-top box 302 may send email through the Internet and receive email from the Internet. In one embodiment, set-top box 302 is coupled with a computer that is in turn coupled with the Internet 307. In one embodiment, set-top box 302 is also coupled with a telephone network 308. In this way, set-top box 302 may dial telephone numbers represented by addressing data. In one embodiment, set-top box 302 is not present, and television 301 contains all of the functionality of set-top box 302.

In one embodiment, the first unit is also to visually distinguish the characters that form the pattern indicative of the addressing datum from other characters represented within the frame of the television presentation. In one embodiment, the second unit is also to visually to distinguish characters that form the pattern indicative of the addressing datum in an area of the frame of the television presentation in which a pointer is positioned from other characters represented within the frame of the television presentation that form a pattern indicative of an addressing datum. In one embodiment, the second unit is also to dial a telephone number upon a selection of characters that form a pattern indicative of the telephone number represented within the frame of the television presentation that form a pattern indicative of an addressing datum. In one embodiment, the second unit is also to dial a telephone number upon a selection of characters that form a pattern indicative of the telephone number. In one embodiment, the second unit is also to send an email to an email address upon a selection of characters that form a pattern indicative of the email address. In one embodiment, the second unit is also to display a web page upon a selection of characters that form a pattern indicative of an uniform resource locator for the web page.

The embodiments described above can be implemented using software in a TV viewing system. Such a TV viewing system can be implemented in many ways. A typical approach to implementation uses a set-top box that contains, among other things, a CPU, storage (e.g., RAM, ROM, etc.), a receiving network adapter, and circuitry to drive a viewing system such as a TV, monitor, projector, etc. All of these elements are not necessarily shown, but are well know in the art. For purposes of the embodiments described below, any other grouping, such as a TV with a built-in CPU, or a personal computer with TV capabilities are considered to be equivalent. Such television viewing system are typically supplied with TV content by system operators, including but not limited to cable provider/operators, satellite provider/operators, broadcasters, overbuilders, etc.

The method and apparatus disclosed herein may be integrated into advanced Internet- or network-based knowledge systems as related to information retrieval, information extraction, and question and answer systems. The system has a processor coupled to a bus. Also coupled to the bus are a memory which may contain instructions. Additional components coupled to the bus are a storage device (such as a hard drive, floppy drive, CD-ROM, DVD-ROM, etc.), an input device (such as a keyboard, mouse, light pen, bar code reader, scanner, microphone, joystick, etc.), and an output device (such as a printer, monitor, speakers, etc.). Of course, an exemplary computer system could have more components than these or a subset of the components listed.

The method described above can be stored in the memory of a computer system (e.g., set top box, video recorders, etc.) as a set of instructions to be executed. In addition, the instructions to perform the method described above could alternatively be stored on other forms of machine-readable media, including magnetic and optical disks. For example, the method of the present invention could be stored on machine-readable media, such as magnetic disks or optical disks, which are accessible via a disk drive (or computer-readable medium drive). Further, the instructions can be downloaded into a computing device over a data network in a form of compiled and linked version.

Alternatively, the logic to perform the methods as discussed above, could be implemented in additional computer and/or machine readable media, such as discrete hardware components as large-scale integrated circuits (LSI′s), application-specific integrated circuits (ASIC′s), firmware such as electrically erasable programmable read-only memory (EEPROM′s).

Although the present invention has been described with reference to specific exemplary embodiments, it will be evident that various modifications and changes may be made to these embodiments without departing from the broader spirit and scope of the invention. One skilled in the art will appreciate that the embodiments described above apply also to satellite and internet and telephone systems as well as cable systems. Accordingly, the specification and drawings are to be regarded in an illustrative rather than a restrictive sense.

Kikinis, Dan

Patent Priority Assignee Title
7814524, Feb 14 2007 Sony Corporation; Sony Electronics Inc. Capture of configuration and service provider data via OCR
8079055, Oct 23 2006 Sony Corporation; Sony Electronics Inc. User managed internet links from TV
8438589, Mar 28 2007 Sony Corporation; Sony Electronics Inc.; Sony Electronics, INC Obtaining metadata program information during channel changes
8621498, Mar 28 2007 Sony Corporation; Sony Electronics Inc. Obtaining metadata program information during channel changes
8704948, Jan 18 2012 Echostar Technologies International Corporation; ECHOSTAR TECHNOLOGIES L L C Apparatus, systems and methods for presenting text identified in a video image
9124945, Jan 11 2005 TVNGO LTD BVI Integrating, at user's premises, TV channel format material with IP format material through overlays
9392339, Jan 11 2005 TVNGO LTD BVI TV-Internet integration circuit
9407969, Jan 11 2005 TVNGO LTD BVI Forming overlays at user's premises and utilizing them for selective combinations of TV broadcast channel format material and IP-format material
Patent Priority Assignee Title
5262860, Apr 23 1992 International Business Machines Corporation Method and system communication establishment utilizing captured and processed visually perceptible data within a broadcast video signal
5414773, Aug 19 1993 Cisco Systems, Inc CATV systems
5479268, Sep 10 1990 Rovi Guides, Inc User interface for television schedule system
5512954, Sep 27 1993 Sony Corporation Television receiver with decoder for decoding coded data from a video signal
5532754, Oct 30 1989 Rovi Guides, Inc Background television schedule system
5543850, Jan 17 1995 Nvidia Corporation System and method for displaying closed caption data on a PC monitor
5570295, Mar 18 1994 THE CHASE MANHATTAN BANK, AS COLLATERAL AGENT System and method of capturing encoded data transmitted over a communications network in a video system
5633918, Aug 03 1994 Information distribution system
5671019, Dec 24 1993 Kabushiki Kaisha Toshiba Character information display apparatus for a partial and a full-screen display
5684715, Jun 07 1995 Canon Kabushiki Kaisha Interactive video system with dynamic video object descriptors
5694163, Sep 28 1995 Intel Corporation Method and apparatus for viewing of on-line information service chat data incorporated in a broadcast television program
5708845, Sep 29 1995 INTELLECTUAL VENTURES ASSETS 6, LLC System for mapping hot spots in media content for interactive digital media program
5724103, Nov 13 1995 Intel Corporation CD ROM information references delivered to a personal computer using the vertical blanking intervals associated data technology from a nabts compliant television broadcast program
5737028, Nov 01 1995 MEDIATEK INC Previous channel listing with cursor controlled user interface for television video displays
5751282, Jun 13 1995 Microsoft Technology Licensing, LLC System and method for calling video on demand using an electronic programming guide
5774666, Oct 18 1996 Open Invention Network, LLC System and method for displaying uniform network resource locators embedded in time-based medium
5818441, Jun 15 1995 Intel Corporation System and method for simulating two-way connectivity for one way data streams
5818935, Mar 10 1997 Internet enhanced video system
5841563, Oct 29 1996 The George Washington University Method and system for efficient optical transmission of NTSC video
5870084, Nov 12 1996 OPENTV, INC System and method for efficiently storing and quickly retrieving glyphs for large character set languages in a set top box
5900915, Mar 18 1997 Thomson Consumer Electronics, Inc HD to SD guide converter for electronic television schedule system
5926168, Sep 30 1994 CDN INNOVATIONS, LLC Remote pointers for interactive televisions
5929849, May 02 1996 KINGLITE HOLDINGS INC Integration of dynamic universal resource locators with television presentations
5956456, Jul 10 1995 LG Electronics Inc Apparatus and method for displaying guide program data from a cassette tape
5987150, Aug 30 1996 Mineral Lassen LLC Video capturing using on-screen graphics
5999167, Nov 08 1996 MARSH, STEPHEN A Cursor control device
6029195, Nov 29 1994 Pinpoint Incorporated System for customized electronic identification of desirable objects
6064438, Oct 24 1994 Intel Corporation Video indexing protocol
6075575, Oct 02 1995 Rovi Guides, Inc Remote control device and method for using television schedule information
6076734, Oct 07 1997 Vulcan Patents LLC Methods and systems for providing human/computer interfaces
6101274, Dec 28 1994 Siemens Aktiengesellschaft Method and apparatus for detecting and interpreting textual captions in digital video signals
6167188, Sep 10 1990 Starsight Telecast, Inc. User interface for television schedule system
6169541, May 28 1998 TIVO SOLUTIONS INC Method, apparatus and system for integrating television signals with internet access
6205485, Mar 27 1997 JLB Ventures LLC Simulcast WEB page delivery using a 3D user interface system
6233389, Jul 30 1998 TIVO SOLUTIONS INC Multimedia time warping system
6253238, Dec 02 1998 ACTIVEVIDEO NETWORKS, INC Interactive cable television system with frame grabber
6271831, Apr 03 1997 HANGER SOLUTIONS, LLC Wireless control and pointer system
6285407, Feb 27 1997 Kabushiki Kaisha Toshiba Multi-function TV receiver
6308327, Mar 21 2000 PayPal, Inc Method and apparatus for integrated real-time interactive content insertion and monitoring in E-commerce enabled interactive digital TV
6411725, Jul 27 1995 DIGIMARC CORPORATION AN OREGON CORPORATION Watermark enabled video objects
6445398, Feb 04 1998 Contemporary Display LLC Method and system for providing user interface for electronic program guide
6473804, Jan 15 1999 THOMSON LICENSING S A System for indexical triggers in enhanced video productions by redirecting request to newly generated URI based on extracted parameter of first URI
6543052, Jul 09 1999 GOOGLE LLC Internet shopping system utilizing set top box and voice recognition
6591292, Jan 08 1999 THOMSON LICENSING S A Method and interface for incorporating program information into an electronic message
6631523, Mar 29 1996 Rovi Technologies Corporation Electronic program guide with hyperlinks to target resources
6658662, Jun 30 1997 Oracle America, Inc Retrieving information from a broadcast signal
6725260, Sep 11 1998 RPX Corporation Method and apparatus for configuring configurable equipment with configuration information received from a remote location
6745234, Sep 11 1998 RPX Corporation Method and apparatus for accessing a remote location by scanning an optical code
6978053, Feb 29 2000 MK SYSTEMS US SUB-HOLDCO INC ; MK SYSTEMS USA INC ; MK SYSTEMS US HOLDCO INC Single-pass multilevel method for applying morphological operators in multiple dimensions
20030093384,
WO1149,
/////
Executed onAssignorAssigneeConveyanceFrameReelDoc
Dec 04 2001JLB Ventures, LLC(assignment on the face of the patent)
Jan 29 2002KIKINIS, DANISURFTV CORPORATIONASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS 0126660438 pdf
Jul 03 2003isurfTVETALON SYSTEMS, INC CHANGE OF NAME SEE DOCUMENT FOR DETAILS 0142680480 pdf
Jul 14 2003ETALON SYSTEMS, INC Eagle New Media Investments, LLCASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS 0142770607 pdf
Feb 22 2007Eagle New Media Investments, LLCJLB Ventures LLCASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS 0195110863 pdf
Date Maintenance Fee Events
Jun 26 2012M1551: Payment of Maintenance Fee, 4th Year, Large Entity.
Jun 26 2012M1554: Surcharge for Late Payment, Large Entity.
May 25 2016M1552: Payment of Maintenance Fee, 8th Year, Large Entity.
May 26 2020M1553: Payment of Maintenance Fee, 12th Year, Large Entity.


Date Maintenance Schedule
Nov 25 20114 years fee payment window open
May 25 20126 months grace period start (w surcharge)
Nov 25 2012patent expiry (for year 4)
Nov 25 20142 years to revive unintentionally abandoned end. (for year 4)
Nov 25 20158 years fee payment window open
May 25 20166 months grace period start (w surcharge)
Nov 25 2016patent expiry (for year 8)
Nov 25 20182 years to revive unintentionally abandoned end. (for year 8)
Nov 25 201912 years fee payment window open
May 25 20206 months grace period start (w surcharge)
Nov 25 2020patent expiry (for year 12)
Nov 25 20222 years to revive unintentionally abandoned end. (for year 12)