A novel approach enables an event-based framework for evaluating a media instance based on key events of the media instance. first, physiological responses are derived and aggregated from the physiological data of viewers of the media instance. The key events in the media instance can then be identified, wherein such key events drive and determine the viewers' responses to the media instance. Causal relationship between the viewers' responses to the key events and their surveyed feelings about the media instance can further be established to identify why and what might have caused the viewers to feel the way they do.

Patent
   8347326
Priority
Dec 18 2007
Filed
Dec 18 2007
Issued
Jan 01 2013
Expiry
Jul 12 2029
Extension
572 days
Assg.orig
Entity
Large
21
288
all paid
9. A system, comprising:
an interface to obtain first physiological response data from a first subject exposed to media and second physiological response data from a second subject exposed to the media; and
a processor to:
aggregate the first physiological response data and the second physiological response data to form aggregated physiological response data;
correlate the aggregated physiological response data to the media;
process the aggregated physiological response data to identify a first transition representative of a change between a positive response and a negative response;
calculate a derivative of the aggregated physiological response data to identify a second transition representative of a change in rate of an increasing positive response, a decreasing positive response, an increasing negative response or a decreasing negative response;
parse the media into a plurality of events based on one or more of the first transition or the second transition;
identify a first one of the events as associated with an undesired physiological response; and
identify the first event as a candidate for modification based on the undesired response.
1. A method comprising:
obtaining first physiological response data from a first subject exposed to media and second physiological response data from a second subject exposed to the media;
aggregating the first physiological response data and the second physiological response data to form aggregated physiological response data;
correlating the aggregated physiological response data to the media;
processing, using a processor, the aggregated physiological response data to identify a first transition representative of a change between a positive response and a negative response;
calculating, using the processor, a derivative of the aggregated physiological response data to identify a second transition representative of a change in rate of an increasing positive response, a decreasing positive response, an increasing negative response or a decreasing negative response;
parsing the media into a plurality of events based on one or more of the first transition or the second transition;
identifying a first one of the events as associated with an undesired physiological response; and
identifying the first event as a candidate for modification based on the undesired response.
17. A tangible machine readable storage device or storage disc comprising instructions, which when executed, cause a machine to at least:
obtain first physiological response data from a first subject exposed to media and second physiological response data from a second subject exposed to the media;
aggregate the first physiological response data and the second physiological response data to form aggregated physiological response data;
correlate the aggregated physiological response data to the media;
process the aggregated physiological response data to identify a first transition representative of a change between a positive response and a negative response;
calculate a derivative of the aggregated physiological response data to identify a second transition representative of a change in rate of an increasing positive response, a decreasing positive response, an increasing negative response or a decreasing negative response;
parse the media into a plurality of events based on one or more of the first transition or the second transition;
identify a first one of the events as associated with an undesired physiological response; and
identify the first event as a candidate for modification based on the undesired response.
2. The method of claim 1, wherein the physiological response comprises one or more of a heart rate, a brain wave, an electroencephalographic signal, a blink rate, a breathing pattern, a motion, a muscle movement, a galvanic skin response or a change in emotion.
3. The method of claim 1 further comprising processing the aggregated physiological response data to identify a third transition representative of a change in aggregated physiological response data from above average to below average or from below average to above average.
4. The method of claim 1, wherein the first event is undesirable if the event polarizes the subjects.
5. The method of claim 1, wherein the first event is undesirable if the physiological response to the first event varies across a demographic factor.
6. The method of claim 1 further comprising:
obtaining survey data from the first and second subjects; and
running a multivariant regression analysis based on the first and second physiological response data and the survey data to determine which of the events drive the survey data.
7. The method of claim 1 further comprising parsing the media into the events based on hypothesized events.
8. The method of claim 1, wherein the media comprises one or more of a video, an audio, an advertisement, a move, a computer application, a printed media, a video game, a website, or a live performance.
10. The system of claim 9, wherein the physiological response comprises one or more of a heart rate, a brain wave, an electroencephalographic signal, a blink rate, a breathing pattern, a motion, a muscle movement, a galvanic skin response or a change in emotion.
11. The system of claim 9, wherein the processor is to process the aggregated physiological response data to identify a third transition representative of a change in aggregated physiological response data from above average to below average or from below average to above average.
12. The system of claim 9, wherein the first event is undesirable if the event polarizes the subjects.
13. The system of claim 9, wherein the first event is undesirable if the physiological response to the first event varies across a demographic factor.
14. The system of claim 9, wherein the interface is to obtain survey data from the first and second subjects, and the processor is to run a multivariant regression analysis based on the first and second physiological response data and the survey data to determine which of the events drive the survey data.
15. The system of claim 9, wherein the processor is to parse the media into the events based on hypothesized events.
16. The system of claim 9, wherein the media comprises one or more of a video, an audio, an advertisement, a move, a computer application, a printed media, a video game, a website, or a live performance.
18. The storage device or storage disc of claim 17, wherein the physiological response comprises one or more of a heart rate, a brain wave, an electroencephalographic signal, a blink rate, a breathing pattern, a motion, a muscle movement, a galvanic skin response or a change in emotion.
19. The storage device or storage disc of claim 17, wherein the instructions cause the machine to process the aggregated physiological response data to identify a third transition representative of a change in aggregated physiological response data from above average to below average or from below average to above average.
20. The storage device or storage disc of claim 17, wherein the first event is undesirable if the event polarizes the subjects.
21. The storage device or storage disc of claim 17, wherein the first event is undesirable if the physiological response to the first event varies across a demographic factor.
22. The storage device or storage disc of claim 17, wherein the instructions cause the machine to obtain survey data from the first and second subjects, and run a multivariant regression analysis based on the first and second physiological response data and the survey data to determine which of the events drive the survey data.
23. The storage device or storage disc of claim 17, wherein the instructions cause the machine to parse the media into the events based on hypothesized events.
24. The storage device or storage disc of claim 17, wherein the media comprises one or more of a video, an audio, an advertisement, a move, a computer application, a printed media, a video game, a website, or a live performance.

Advertisers, media producers, educators and other relevant parties have long desired to understand the responses their targets—customers, clients and pupils—have to their particular stimulus in order to tailor their information or media instances to better suit the needs of these targets and/or to increase the effectiveness of the media instance created. A key to making a high performing media instance is to make sure that every event in the media instance elicits the desired responses from the viewers, not responses very different from what the creator of the media instance expected. The media instance herein can be but is not limited to, a video, an advertisement clip, a movie, a computer application, a printed media (e.g., a magazine), a video game, a website, an online advertisement, a recorded video, a live performance, a debate, and other types of media instance from which a viewer can learn information or be emotionally impacted.

It is well established that physiological response is a valid measurement for viewers' changes in emotions and an effective media instance that connects with its audience/viewers is able to elicit the desired physiological responses from the viewers. Every media instance may have its key events/moments—moments which, if they do not evoke the intended physiological responses from the viewers, the effectiveness of the media instance may suffer significantly. For a non-limiting example, if an ad is intended to engage the viewers by making them laugh, but the viewers do not find a 2-second-long punch-line funny, such negative responses to this small piece of the ad may drive the overall reaction to the ad. Although survey questions such as “do you like this ad or not” have long been used to gather viewers' subjective reactions to a media instance, they are unable to provide more insight into why and what have caused the viewers reacted in the way they did.

An approach enables an event-based framework for evaluating a media instance based on key events of the media instance. First, physiological responses are derived and aggregated from the physiological data of viewers of the media instance. The key events in the media instance can then be identified, wherein such key events drive and determine the viewers' responses to the media instance. Causal relationship between the viewers' responses to the key events and their surveyed feelings about the media instance can further be established to identify why and what might have caused the viewers to feel the way they do.

Such an approach provides information that can be leveraged by a creator of the media instance to improve the media instance. For a non-limiting example, if a joke in an advertisement is found to drive purchase intent of the product advertised, but the advertisement's target demographic does not respond to the joke, the joke can be changed so that the advertisement achieves its goal: increasing product purchase intent in the target demographic.

This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter. These and other advantages of the present invention will become apparent to those skilled in the art upon a reading of the following descriptions and a study of the several figures of the drawings.

FIG. 1 depicts an example of a system to support identification of key events in a media instance that drive physiological responses from viewers.

FIG. 2 depicts a flowchart of an exemplary process to support identification of key events in a media instance that drive physiological responses from viewers.

FIGS. 3(a)-(c) depict exemplary traces of physiological responses measured and exemplary dividing lines of events in a media instance.

FIGS. 4(a)-(c) depict exemplary event identification results based on different event defining approaches.

FIG. 5 depicts results from exemplary multivariate regression runs on events in an advertisement to determine which events drive the viewers' responses the most.

FIGS. 6(a)-(b) depict exemplary correlations between physiological responses from viewers to key jokes in an ad and the surveyed intent of the viewers to tell others about the ad.

The invention is illustrated by way of example and not by way of limitation in the figures of the accompanying drawings in which like references indicate similar elements. It should be noted that references to “an” or “one” or “some” embodiment(s) in this disclosure are not necessarily to the same embodiment, and such references mean at least one. Although the subject matter is described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.

Although the diagrams depict components as functionally separate, such depiction is merely for illustrative purposes. It will be apparent to those skilled in the art that the components portrayed in this figure can be arbitrarily combined or divided into separate software, firmware and/or hardware components. Furthermore, it will also be apparent to those skilled in the art that such components, regardless of how they are combined or divided, can execute on the same computing device or multiple computing devices, and wherein the multiple computing devices can be connected by one or more networks.

Physiological data, which includes but is not limited to heart rate, brain waves, electroencephalogram (EEG) signals, blink rate, breathing, motion, muscle movement, galvanic skin response and any other response correlated with changes in emotion of a viewer of a media instance, can give a trace (e.g., a line drawn by a recording instrument) of the viewer's responses while he/she is watching the media instance. The physiological data can be measure by one or more physiological sensors, each of which can be but is not limited to, an electroencephalogram, an accelerometer, a blood oxygen sensor, a galvanometer, an electromygraph, skin temperature sensor, breathing sensor, and any other physiological sensor.

The physiological data in the human body of a viewer has been shown to correlate with the viewer's change in emotions. Thus, from the measured “low level” physiological data, “high level” (i.e., easier to understand, intuitive to look at) physiological responses from the viewers of the media instance can be created. An effective media instance that connects with its audience/viewers is able to elicit the desired emotional response. Here, the high level physiological responses include, but are not limited to, liking (valence)—positive/negative responses to events in the media instance, intent to purchase or recall, emotional engagement in the media instance, thinking—amount of thoughts and/or immersion in the experience of the media instance, adrenaline—anger, distraction, frustration, and other emotional experiences to events in the media instance. In addition, the physiological responses may also include responses to other types of sensory stimulations, such as taste and/or smell, if the subject matter is food or a scented product instead of a media instance.

FIG. 1 depicts an example of a system 100 to support identification of key events in a media instance that drives physiological responses from viewers. In the example of FIG. 1, the system 100 includes a response module 102, an event defining module 104, a key event module 106, and a reaction database 108.

The response module 102 is a software component which while in operation, first accepts and/or records physiological data from each of a plurality of viewers watching a media instance, then derives and aggregates physiological responses from the collected physiological data. Such derivation can be accomplished via a plurality of statistical measures, which include but are not limited to, average value, deviation from mean, 1st order derivative of the average value, 2nd order derivative of the average value, coherence, positive response, negative response, etc., using the physiological data of the viewers as inputs. Facial expression recognition, “knob” and other measures of emotion can also be used as inputs with comparable validity. Here, the physiological data may be either be retrieved from a storage device or measured via one or more physiological sensors, each of which can be but is not limited to, an electroencephalogram, an accelerometer, a blood oxygen sensor, a galvanometer, an electromygraph, and any other physiological sensor either in separate or integrated form. The derived physiological responses can then be aggregated over the plurality of viewers watching one or more media instances.

The event defining module 104 is a software component which while in operation, defines and marks occurrences and durations of a plurality of events happening in the media instance. The duration of each of event in the media instance can be constant, non-linear, or semi-linear in time. Such event definition may happen either before or after the physiological data of the plurality of viewers has been measured, where in the later case, the media instance can be defined into the plurality of events based on the physiological data measured from the plurality of viewers.

The key event module 106 is a software component which while in operation, identifies one or more key events in the media instance and reports the key events to an interested party of the media instance, wherein the key events drive and determine the viewers' physiological responses to the media instance. Key events in the media instance can be used to pinpoint whether and/or which part of the media instance need to be improved or changed, and which part of the media instance should be kept intact. For non-limiting examples, the key event module may identify which key event(s) in the media instance trigger the most positive or negative responses from the viewers, or alternatively, which key event(s) are polarizing events, e.g., they cause large discrepancies in the physiological responses from different demographic groups of viewers, such as between groups of men and women, when the groups are defined by demographic characteristics. In addition, the key event module is operable to establish a causal relationship between the viewers' responses to the events in the media instance and their surveyed feelings about the media instance so that creator of the media instance may gain insight into the reason why and what key events might have caused the viewers to feel the way they do.

The reaction database 108 stores pertinent data of the media instance the viewers are watching, wherein the pertinent data includes but is not limited to survey questions and results asked for each of the plurality of viewers before, during, and/or after their viewing of the media instance. In addition, the pertinent data may also include but is not limited to the following:

While the system 100 depicted in FIG. 1 is in operation, the response module 102 derives aggregated physiological responses from the physiological data of a plurality of viewers watching a media instance. The key event module 106 identifies, among the plurality of events in the media instance as defined by the event defining module 104, one or more key events that drive and determine the viewers' physiological responses to the media instance based on the aggregated physiological responses from the viewers. In addition, the key event module 106 may retrieve outcomes to questions surveyed from the viewers of the media instance from the reaction database 108, and correlates the viewers' responses to the key events and their surveyed feelings about the media instance to determine what might have caused the viewers to feel the way they do. The entire approach can also be automated as each step of the approach can be processed by a computing device, allowing for objective measure of a media without much human input or intervention.

FIG. 2 depicts a flowchart of an exemplary process to support identification of key events in a media instance that drive physiological responses from viewers. Although this figure depicts functional steps in a particular order for purposes of illustration, the process is not limited to any particular order or arrangement of steps. One skilled in the art will appreciate that the various steps portrayed in this figure could be omitted, rearranged, combined and/or adapted in various ways.

Referring to FIG. 2, physiological responses can be derived and aggregated from the physiological data of a plurality of viewers watching a media instance at block 202. At block 204, the media instance can be defined into a plurality of events, and correlation between the physiological responses from the viewers to the key events in the media instance and a surveyed outcome of their feelings about the media instance can optionally be established at block 206. At block 208, key events in the media instance can be identified based on the aggregated physiological responses from the viewers and/or the correlation between the physiological responses and a surveyed outcome. Finally, the key events and/or their correlation with the surveyed outcome are reported to an interested party of the media instance at block 210, wherein the interested party may then improve the media instance based on the key events and/or the correlations.

In some embodiments, the event defining module 104 is operable to define occurrence and duration of events in the media instance based on salient positions identified in the media instance. Once salient positions in the media instance are identified, the events corresponding to the salient positions can be extracted. For a non-limiting example, an event in a video game may be defined as a “battle tank” appearing in the player's screen and lasting as long as it remains on the screen. For another non-limiting example, an event in a movie may be defined as occurring every time a joke is made. While defining humor is difficult, punch line events that are unexpected, absurd, and comically exaggerated often qualify as joke events.

FIG. 3(a) shows an exemplary trace of the physiological response—“Engagement” for a player playing Call of Duty 3 on the Xbox 360. The trace is a time series, with the beginning of the session on the left and the end on the right. Two event instances 301 and 302 are circled, where 301 on the left shows low “Engagement” during a game play that happens during a boring tutorial section. 302 shows a high “Engagement” section that has been recorded when the player experiences the first battle of the game. FIG. 3(b) shows exemplary vertical lines that divide a piece of media instance into many events defining every important thing that a player of the video game or other media may encounter and/or interact with.

In some embodiments, the event defining module 104 is operable to define occurrence and duration of events in the media instance via at least the one or more of the following approaches. The events so identified by the event defining module 104 are then provided to the key event module 106 to test for “significance” as key events in the media instance as described below.

In some embodiments, the key event module 106 is operable to accept the events defined by the event defining module 104 and automatically spot statistically significant/important points in the aggregated physiological responses from the viewers relevant to identify the key moments/events in the media instance. More specifically, the key event module is operable to determine one or more of:

In some embodiments, the key events found can be used to improve the media instance. Here “improving the media instance” can be defined as, but is not limited to, changing the media instance so that it is more likely to achieve the goals of the interested party or creator of the media instance.

In some embodiments, the key event module 106 is further operable to establish a casual relationship between surveyed feelings about the media instance and the key events identified based on the physiological responses from the viewers. In other words, it establishes a correlation between the physiological responses from the viewers to key events in the media instance and a surveyed outcome, i.e., the viewers' reported feelings on a survey, and reports to the interested parties (e.g. creator of the event) which key events in the media instance actually caused the outcome. Here, the outcome can include but is not limited to, liking, effectiveness, purchase intent, post viewing product selection, etc. For a non-limiting example, if the viewers indicate on a survey that they did not like the media instance, something about the media instance might have caused them to feel this way. While the cause may be a reaction to the media instance in general, it can often be pinned down to a reaction to one or more key events in the media instance as discussed above. The established casual relationship explains why the viewers report on the survey their general feelings about the media instance the way they do without human input.

In some embodiments, the key event module 106 is operable to adopt multivariate regression analysis via a multivariate model that incorporates the physiological responses from the viewers as well as the surveyed feelings from the viewers to determine which events, on average, are key events in driving reported feelings (surveyed outcome) about the media instance. Here, the multivariate regression analysis examines the relationship among many factors (the independent variables) and a single, dependent variable, which variation is thought to be at least partially explained by the independent variables. For a non-limiting example, the amount of rain that falls on a given day varies, so there is variation in daily rainfall. Both the humidity in the air and the number of clouds in the sky on a given day can be hypothesized to explain this variation in daily rainfall. This hypothesis can be tested via multivariate regression, with daily rainfall as the dependent variable, and humidity and number of clouds as independent variables.

In some embodiments, the multivariate model may have each individual viewer's reactions to certain key events in the media instance as independent variables and their reported feeling about the media instance as the dependent variable. The coefficients from regressing the independent variables on the dependent variable would determine which key events are causing the reported feelings. Such a multivariate model could be adopted here to determine what set of key events most strongly affect reported feelings from the viewers about the media instance, such as a joke in an advertisement. One characterization of such event(s) is that the more positive (negative) the viewers respond to the event(s), the more likely the viewers were to express positive feelings about the media instance. For a non-limiting example, a multivariate regression can be run on multiples events (1, 2 . . . n) within an entire montage sequence of an advertisement to determine which events drive liking the most, using relationship between reported feelings about the ad and the emotional responses from the viewers to the events in the ad as input. The results of the multivariate regression runs shown in FIG. 5 indicate that 2 out of the 6 events tested in the ad drive the viewers' responses the most, while the other 4 events do not meet the threshold for explanatory power.

In an automated process, this multivariate regression may be run stepwise, which essentially tries various combinations of independent variables, determining which combination has the strongest explanatory power. This is a step toward creating the causal relationship between the viewers' responses to the events and their surveyed feelings about the media instance. For a non-limiting example, if response to joke #2 is correlated with indicated intent to purchase when holding genders and responses to jokes #1 and #3 constant, a causal conclusion can be made that joke #2 triggers the viewers' intent to purchase.

In some embodiments, the key event module 106 identifies the key polarizing event(s) that cause statistically significant difference in the surveyed outcome from different demographic groups of viewers and provides insight into, for non-limiting examples, why women do not like the show or which issue actually divides people in a political debate. The key event module 106 may collect demographic data from overall population of the viewers and categorize them into groups to differentiate the responses for the subset, wherein the viewers can be grouped one or more of: race, gender, age, education, demographics, income, buying habits, intent to purchase, and intent to tell. Such grouping information can be included in the regressions to determine how different groups report different reactions to the media instance in the survey. Furthermore, grouping/event response interaction variables can be included to determine how different groups respond differently to the key events in the media instance. For key events that are polarizing, demographic information and/or interaction variables of the viewers can also be included to the multivariate model capture the combined effect of the demographic factor and the reaction to the polarizing key events.

For a non-limiting example, the viewers of an ad can be first asked a survey question, “How likely are you to tell someone about this particular commercial—meaning tell a friend about this ad you've just seen” as shown in FIG. 6(a). The viewers of the ad are broken into two groups based on indicated likelihood to tell someone about the commercial—the affirmative group and the negative group, and it is assumed that the viewers in both groups are normally distributed with the same variance. The emotional responses from the viewers in the groups to two key jokes 601 and 602 in the ad are then compared to their surveyed reactions to test the following hypothesis—“the group that indicated they were likely to tell someone will have a stronger positive physiological response to the two key jokes than the group that indicated they were unlikely to tell someone.” The affirmative group that indicated they were likely to tell a friend had, on average, a more positive reaction to both jokes than the negative group that indicated they were unlikely to tell a friend. In both cases, experiments using the change in individual liking as the metric to measure the physiological response rejects the null hypothesis—that there was no difference in emotional response to the jokes between the two groups—at above the 95% confidence level. Referring to graphs in FIG. 6(a), the X axis displays the testers' likelihood to tell a friend as indicated on the post-exposure survey and the Y axis displays the testers' emotional response to the joke. The triangles represent the “Go” people—those who indicated they were likely (to varying degrees) to tell their friend about the spot. The circles represent those who indicated that they were unlikely to do so. Note the upward trends—the more positive the emotional reaction to the joke, the greater indicated likelihood to tell a friend about the spot. FIG. 6(b) further summarizes the physiological responses to both jokes, where the reaction to the Crying Wife is on the X axis and the reaction to the Dead Husband is on the Y axis. An imaginary line around is drawn around the viewers who reacted relatively positively to both jokes. Note that this line corrals most of the black diamonds, which represent viewers who indicated they would tell a friend about the ad.

One embodiment may be implemented using a conventional general purpose or a specialized digital computer or microprocessor(s) programmed according to the teachings of the present disclosure, as will be apparent to those skilled in the computer art. Appropriate software coding can readily be prepared by skilled programmers based on the teachings of the present disclosure, as will be apparent to those skilled in the software art. The invention may also be implemented by the preparation of integrated circuits or by interconnecting an appropriate network of conventional component circuits, as will be readily apparent to those skilled in the art.

One embodiment includes a computer program product which is a machine readable medium (media) having instructions stored thereon/in which can be used to program one or more computing devices to perform any of the features presented herein. The machine readable medium can include, but is not limited to, one or more types of disks including floppy disks, optical discs, DVD, CD-ROMs, micro drive, and magneto-optical disks, ROMs, RAMs, EPROMs, EEPROMs, DRAMs, VRAMs, flash memory devices, magnetic or optical cards, nanosystems (including molecular memory ICs), or any type of media or device suitable for storing instructions and/or data. Stored on any one of the computer readable medium (media), the present invention includes software for controlling both the hardware of the general purpose/specialized computer or microprocessor, and for enabling the computer or microprocessor to interact with a human viewer or other mechanism utilizing the results of the present invention. Such software may include, but is not limited to, device drivers, operating systems, execution environments/containers, and applications.

The foregoing description of the preferred embodiments of the present invention has been provided for the purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise forms disclosed. Many modifications and variations will be apparent to the practitioner skilled in the art. Particularly, while the concept “module” is used in the embodiments of the systems and methods described above, it will be evident that such concept can be interchangeably used with equivalent concepts such as, class, method, type, interface, bean, component, object model, and other suitable concepts. Embodiments were chosen and described in order to best describe the principles of the invention and its practical application, thereby enabling others skilled in the art to understand the invention, the various embodiments and with various modifications that are suited to the particular use contemplated. It is intended that the scope of the invention be defined by the following claims and their equivalents.

Lee, Hans C., Fettiplace, Michael R., Weitzenfeld, Daniel

Patent Priority Assignee Title
10003836, Apr 23 2015 Rovi Guides, Inc. Systems and methods for improving accuracy in media asset recommendation models based on users' levels of enjoyment with respect to media assets
10127130, Mar 18 2005 SALESFORCE COM, INC Identifying contributors that explain differences between a data set and a subset of the data set
10194214, Nov 20 2013 AT&T Intellectual Property I, L.P. Device, method and machine-readable storage medium for presenting advertising related to emotional context of received content
10545132, Jun 25 2013 Cilag GmbH International; Lifescan IP Holdings, LLC Physiological monitoring system communicating with at least a social network
10575057, Apr 23 2015 Rovi Guides, Inc. Systems and methods for improving accuracy in media asset recommendation models
10733196, Sep 18 2017 Method, apparatus, and computer readable medium for modeling relationships between query responses in a data set
10796232, Dec 04 2011 SALESFORCE COM, INC Explaining differences between predicted outcomes and actual outcomes of a process
10802687, Dec 04 2011 SALESFORCE COM, INC Displaying differences between different data sets of a process
10878017, Jul 29 2014 GROUPON, INC System and method for programmatic generation of attribute descriptors
10887666, Nov 20 2013 AT&T Intellectual Property I, L.P. Device, method and machine-readable storage medium for presenting advertising related to emotional context of received content
10909585, Jun 27 2014 GROUPON, INC. Method and system for programmatic analysis of consumer reviews
10977667, Oct 22 2014 GROUPON, INC Method and system for programmatic analysis of consumer sentiment with regard to attribute descriptors
11205103, Dec 09 2016 The Research Foundation for The State University of New York Semisupervised autoencoder for sentiment analysis
11250450, Jun 27 2014 GROUPON, INC Method and system for programmatic generation of survey queries
11294922, Sep 18 2017 Method, apparatus, and computer readable medium for modeling relationships between query responses in a data set
11392631, Jul 29 2014 GROUPON, INC System and method for programmatic generation of attribute descriptors
11547366, Mar 31 2017 Intel Corporation Methods and apparatus for determining biological effects of environmental sounds
11553871, Jun 04 2019 LAB NINE, INC System and apparatus for non-invasive measurement of transcranial electrical signals, and method of calibrating and/or using same for various applications
8676628, Sep 11 2009 Roil Results Pty Limited Method and system for determining effectiveness of marketing
9426538, Nov 20 2013 AT&T Intellectual Property I, LP Method and apparatus for presenting advertising in content having an emotional context
9766959, Mar 18 2014 GOOGLE LLC Determining user response to notifications based on a physiological parameter
Patent Priority Assignee Title
3950618, Mar 25 1971 System for public opinion research
4695879, Feb 07 1986 Television viewer meter
4755045, Apr 04 1986 Applied Science Group, Inc. Method and system for generating a synchronous display of a visual presentation and the looking response of many viewers
4846190, Aug 23 1983 UNIVERSITY, NEW YORK Electroencephalographic system data display
4931934, Jun 27 1988 Method and system for measuring clarified intensity of emotion
4974602, Aug 16 1988 Siemens Aktiengesellschaft Arrangement for analyzing local bioelectric currents in biological tissue complexes
5041972, Apr 15 1988 MARITZ INC Method of measuring and evaluating consumer response for the development of consumer products
5077785, Jul 13 1990 System for recording comments by patrons of establishments
5124911, Apr 15 1988 IMAGE ENGINEERING, INC Method of evaluating consumer choice through concept testing for the marketing and development of consumer products
5243517, Aug 03 1988 Northrop Grumman Corporation Method and apparatus for physiological evaluation of short films and entertainment materials
5301109, Jun 11 1990 CONTENT ANALYST COMPANY LLC Computerized cross-language document retrieval using latent semantic indexing
5317507, Nov 07 1990 Fair Isaac Corporation Method for document retrieval and for word sense disambiguation using neural networks
5321833, Aug 29 1990 GOOGLE LLC Adaptive ranking system for information retrieval
5371673, Apr 06 1987 INFOTREND, INC Information processing analysis system for sorting and scoring text
5406957, Feb 05 1992 EMTEE ASSOCIATES, L P Electroencephalic neurofeedback apparatus for training and tracking of cognitive states
5447166, Sep 26 1991 Neurocognitive adaptive computer interface method and system based on on-line measurement of the user's mental effort
5450855, May 13 1992 Method and system for modification of condition with neural biofeedback using left-right brain wave asymmetry
5495412, Jul 15 1994 ICAN Systems, Inc. Computer-based method and apparatus for interactive computer-assisted negotiations
5519608, Jun 24 1993 Xerox Corporation Method for extracting from a text corpus answers to questions stated in natural language by using linguistic analysis and hypothesis generation
5537618, Dec 23 1993 TIMDOLIR LTD , LIMITED LIABILITY COMPANY Method and apparatus for implementing user feedback
5579774, Mar 07 1994 NOVUS MONITORING LIMITED Method and apparatus for monitoring local cerebral physiology
5601090, Jul 12 1994 BRAIN FUNCTIONS LABORATORY, INC Method and apparatus for automatically determining somatic state
5659732, May 17 1995 Google, Inc Document retrieval over networks wherein ranking and relevance scores are computed at the client for multiple database documents
5659742, Sep 15 1995 BHW INFO EDCO COM, LLC Method for storing multi-media information in an information retrieval system
5668953, Feb 22 1995 Method and apparatus for handling a complaint
5671333, Apr 07 1994 THE CHASE MANHATTAN BANK, AS COLLATERAL AGENT Training apparatus and method
5675710, Jun 07 1995 Alcatel-Lucent USA Inc Method and apparatus for training a text classifier
5676138, Mar 15 1996 Emotional response analyzer system with multimedia display
5692906, Apr 01 1992 Method of diagnosing and remediating a deficiency in communications skills
5696962, Jun 24 1993 Xerox Corporation Method for computerized information retrieval using shallow linguistic analysis
5721721, Aug 25 1987 Canon Kabushiki Kaisha Two scanning probes information recording/reproducing system with one probe to detect atomic reference location on a recording medium
5724987, Sep 26 1991 Sam Technology, Inc. Neurocognitive adaptive computer-aided training method and system
5740812, Jan 25 1996 NEUROTEK, LLC Apparatus for and method of providing brainwave biofeedback
5761383, Apr 27 1995 Northrop Grumman Systems Corporation Adaptive filtering neural network classifier
5774591, Dec 15 1995 University of Maryland Apparatus and method for recognizing facial expressions and facial gestures in a sequence of images
5794412, Mar 15 1996 CO.ME.SCA. Costruzioni Meccaniche Scarperia S.r.l. Method of folding a portion of dielectric sheet material
5819285, Sep 20 1995 TWINTECH E U II, LIMITED LIABILITY COMPANY Apparatus for capturing, storing and processing co-marketing information associated with a user of an on-line computer service using the world-wide-web.
5822744, Jul 15 1996 Consumer comment reporting apparatus and method
5836771, Dec 02 1996 HANGER SOLUTIONS, LLC Learning method and system based on questioning
5845278, Sep 12 1997 GOOGLE LLC Method for automatically selecting collections to search in full text searches
5857179, Sep 09 1996 HEWLETT-PACKARD DEVELOPMENT COMPANY, L P Computer method and apparatus for clustering documents and automatic generation of cluster keywords
5884302, Dec 02 1996 HANGER SOLUTIONS, LLC System and method to answer a question
5895450, Feb 22 1995 Method and apparatus for handling complaints
5911043, Oct 01 1996 F POSZAT HU, L L C System and method for computer-based rating of information retrieved from a computer network
5920854, Aug 14 1996 GOOGLE LLC Real-time document collection search engine with phrase indexing
5924094, Nov 01 1996 Progress Software Corporation Independent distributed database system
5950172, Jun 07 1996 Secured electronic rating system
5950189, Jan 02 1997 AT&T Corp Retrieval system and method
5953718, Nov 12 1997 Oracle International Corporation Research mode for a knowledge base search and retrieval system
5974412, Sep 24 1997 ROYAL BANK OF CANADA, AS SUCCESSOR COLLATERAL AGENT Intelligent query system for automatically indexing information in a database and automatically categorizing users
5983129, Feb 19 1998 COWAN, JONATHAN DANIEL Method for determining an individual's intensity of focused attention and integrating same into computer program
5983214, Apr 04 1996 HUDSON BAY MASTER FUND LTD System and method employing individual user content-based data and user collaborative feedback data to evaluate the content of an information entity in a large information communication network
5983216, Sep 12 1997 GOOGLE LLC Performing automated document collection and selection by providing a meta-index with meta-index values indentifying corresponding document collections
5999908, Aug 06 1992 LODSYS GROUP, LLC Customer-based product design module
6006221, Aug 16 1995 Syracuse University Multilingual document retrieval system and method using semantic vector matching
6012053, Jun 23 1997 RPX Corporation Computer system with user-controlled relevance ranking of search results
6021409, Aug 09 1996 EUREKA DATABASE SOLUTIONS, LLC Method for parsing, indexing and searching world-wide-web pages
6026387, Jul 15 1996 Consumer comment reporting apparatus and method
6026388, Aug 16 1995 Textwise, LLC User interface and other enhancements for natural language information retrieval system and method
6029161, Apr 04 1996 HUDSON BAY MASTER FUND LTD Multi-level mindpool system especially adapted to provide collaborative filter data for a large scale information filtering system
6029195, Nov 29 1994 Pinpoint Incorporated System for customized electronic identification of desirable objects
6032145, Apr 10 1998 International Business Machines Corporation Method and system for database manipulation
6035294, Jul 03 1998 BSG TECH LLC Wide access databases and database systems
6038610, Jul 17 1996 Microsoft Technology Licensing, LLC Storage of sitemaps at server sites for holding information regarding content
6064980, Mar 17 1998 Amazon Technologies, Inc System and methods for collaborative recommendations
6067539, Mar 02 1998 VIGILTECH LTD Intelligent information retrieval system
6078892, Apr 09 1998 International Business Machines Corporation; IBM Corporation Method for customer lead selection and optimization
6094657, Oct 01 1997 International Business Machines Corporation Apparatus and method for dynamic meta-tagging of compound documents
6098066, Jun 13 1997 Oracle America, Inc Method and apparatus for searching for documents stored within a document directory hierarchy
6099319, Feb 24 1998 THE NIELSEN COMPANY US , LLC , A DELAWARE LIMITED LIABILITY COMPANY Neuroimaging as a marketing tool
6112203, Apr 09 1998 R2 SOLUTIONS LLC Method for ranking documents in a hyperlinked environment using connectivity and selective content analysis
6119933, Jul 17 1997 NCR Corporation Method and apparatus for customer loyalty and marketing analysis
6138113, Aug 10 1998 R2 SOLUTIONS LLC Method for identifying near duplicate pages in a hyperlinked database
6138128, Apr 02 1997 Microsoft Technology Licensing, LLC Sharing and organizing world wide web references using distinctive characters
6169986, Jun 15 1998 Amazon Technologies, Inc System and method for refining search queries
6185558, Mar 03 1998 A9 COM, INC Identifying the items most relevant to a current query based on items selected in connection with similar queries
6192360, Jun 23 1998 Microsoft Technology Licensing, LLC Methods and apparatus for classifying text and for building a text classifier
6202068, Jul 02 1998 Database display and search method
6233575, Jun 24 1997 International Business Machines Corporation Multilevel taxonomy based on features derived from training documents classification using fisher values as discrimination values
6236977, Jan 04 1999 Acacia Research Group LLC Computer implemented marketing system
6236987, Apr 03 1998 PERSPECTA, INC Dynamic content organization in information retrieval systems
6236991, Nov 26 1997 IBM Corporation Method and system for providing access for categorized information from online internet and intranet sources
6254536, Aug 02 1995 IBVA Technologies, Inc. Method and apparatus for measuring and analyzing physiological signals for active or passive control of physical and virtual spaces and the contents therein
6260041, Sep 30 1999 NetCurrents, Inc.; INFOLOCITY, INC Apparatus and method of implementing fast internet real-time search technology (first)
6266664, Oct 01 1998 Microsoft Technology Licensing, LLC Method for scanning, analyzing and rating digital information content
6269362, Dec 19 1997 R2 SOLUTIONS LLC System and method for monitoring web pages by comparing generated abstracts
6278990, Jul 25 1997 JUSTSYSTEMS EVANS RESEARCH INC Sort system for text retrieval
6289342, Jan 05 1998 NEC Corporation Autonomous citation indexing and literature browsing using citation context
6292688, Feb 28 1996 Advanced Neurotechnologies, Inc.; ADVANCED NEUROTECHNOLOGIES, INC Method and apparatus for analyzing neurological response to emotion-inducing stimuli
6304864, Apr 20 1999 Textwise LLC System for retrieving multimedia information from the internet using multiple evolving intelligent agents
6308176, Apr 24 1998 APR SMARTLOGIK LIMITED Associating files of data
6309342, Feb 26 1998 CARESTREAM HEALTH, INC Management of physiological and psychological state of an individual using images biometric analyzer
6314420, Apr 04 1996 HUDSON BAY MASTER FUND LTD Collaborative/adaptive search engine
6322368, Jul 21 1998 HELLO HELLO, INC Training and testing human judgment of advertising materials
6334131, Aug 29 1998 International Business Machines Corporation Method for cataloging, filtering, and relevance ranking frame-based hierarchical information structures
6360215, Nov 03 1998 R2 SOLUTIONS LLC Method and apparatus for retrieving documents based on information other than document content
6362837, May 06 1997 GINN, MICHAEL Method and apparatus for simultaneously indicating rating value for the first document and display of second document in response to the selection
6366908, Jun 28 1999 UNILOC 2017 LLC Keyfact-based text retrieval system, keyfact-based text index method, and retrieval method
6377946, Feb 25 1998 Hitachi Ltd Document search method and apparatus and portable medium used therefor
6385586, Jan 28 1999 Nuance Communications, Inc Speech recognition text-based language conversion and text-to-speech in a client-server configuration to enable language translation devices
6393460, Aug 28 1998 International Business Machines Corporation Method and system for informing users of subjects of discussion in on-line chats
6401118, Jun 30 1998 ZeroFOX, Inc Method and computer program product for an online monitoring search engine
6411936, Feb 05 1999 NVal Solutions, Inc.; NVAL SOLUTIONS, INC Enterprise value enhancement system and method
6418433, Jan 28 1999 International Business Machines Corporation System and method for focussed web crawling
6421675, Mar 16 1998 S L I SYSTEMS, INC Search engine
6434549, Dec 13 1999 SABA SOFTWARE, INC Network-based, human-mediated exchange of information
6493703, May 11 1999 CXT SYSTEMS, INC System and method for implementing intelligent online community message board
6507866, Jul 19 1999 RPX Corporation E-mail usage pattern detection
6513032, Oct 29 1998 Verizon Patent and Licensing Inc Search and navigation system and method using category intersection pre-computation
6519631, Aug 13 1999 Answers Corporation Web-based information retrieval
6526440, Jan 30 2001 GOOGLE LLC Ranking search results by reranking the results based on local inter-connectivity
6539375, Aug 04 1998 Microsoft Technology Licensing, LLC Method and system for generating and using a computer user's personal interest profile
6546390, Jun 11 1999 ABUZZ TECHNOLOGIES, INC Method and apparatus for evaluating relevancy of messages to users
6553358, Apr 20 1999 Microsoft Technology Licensing, LLC Decision-theoretic approach to harnessing text classification for guiding automated action
6571234, May 11 1999 CXT SYSTEMS, INC System and method for managing online message board
6571238, Jun 11 1999 ABUZZ TECHNOLOGIES, INC System for regulating flow of information to user by using time dependent function to adjust relevancy threshold
6574614, Jul 15 1996 Consumer feedback apparatus
6584470, Mar 01 2001 Buzzmetrics Ltd Multi-layered semiotic mechanism for answering natural language questions using document retrieval combined with information extraction
6585521, Dec 21 2001 HEWLETT-PACKARD DEVELOPMENT COMPANY, L P Video indexing based on viewers' behavior and emotion feedback
6606644, Feb 24 2000 International Business Machines Corporation System and technique for dynamic information gathering and targeted advertising in a web based model using a live information selection and analysis tool
6622140, Nov 15 2000 Justsystem Corporation Method and apparatus for analyzing affect and emotion in text
6623428, Oct 11 2001 Eastman Kodak Company Digital image sequence display system and method
6626676, Apr 30 1997 Unique Logic and Technology, Inc. Electroencephalograph based biofeedback system for improving learning skills
6640218, Jun 02 2000 HUDSON BAY MASTER FUND LTD Estimating the usefulness of an item in a collection of information
6651056, Mar 10 1999 REFINITIV US ORGANIZATION LLC Readership information delivery system for electronically distributed investment research
6651086, Feb 22 2000 OATH INC Systems and methods for matching participants to a conversation
6652283, Dec 30 1999 CEREGO LLC System apparatus and method for maximizing effectiveness and efficiency of learning retaining and retrieving knowledge and skills
6654813, Aug 17 1998 R2 SOLUTIONS LLC Dynamically categorizing entity information
6656116, Sep 02 2000 Samsung Electronics Co. Ltd. Apparatus and method for perceiving physical and emotional state
6658389, Mar 24 2000 Xylon LLC System, method, and business model for speech-interactive information system having business self-promotion, audio coupon and rating features
6662170, Aug 22 2000 International Business Machines Corporation System and method for boosting support vector machines
6671061, Jan 08 1999 Cisco Technology, Inc.; Cisco Technology, Inc Fax broadcast from a single copy of data
6678866, Jun 30 1998 Hakuhodo Inc.; Tyo Productions Inc. Notification information display apparatus notification information display system and recording medium
6708215, Jan 16 1998 Wilmington Trust, National Association, as Administrative Agent Method and system for initiating an outbound communication from a service provider responsive to a user activity with respect to a network resource
6721734, Apr 18 2000 JUSTSYSTEMS EVANS RESEARCH INC Method and apparatus for information management using fuzzy typing
6751606, Dec 23 1998 Microsoft Technology Licensing, LLC System for enhancing a query interface
6751683, Sep 29 2000 International Business Machines Corporation Method, system and program products for projecting the impact of configuration changes on controllers
6757646, Mar 22 2000 FIVER LLC Extended functionality for an inverse inference engine based web search
6772141, Dec 14 1999 Oracle International Corporation Method and apparatus for organizing and using indexes utilizing a search decision table
6775664, Apr 04 1996 HUDSON BAY MASTER FUND LTD Information filter system and method for integrated content-based and collaborative/adaptive feedback queries
6778975, Mar 05 2001 R2 SOLUTIONS LLC Search engine for selecting targeted messages
6782393, May 31 2000 RICOH CO , LTD Method and system for electronic message composition with relevant documents
6792304, May 15 1998 SSPT PROPRIETARY LIMITED Mass communication assessment system
6795826, May 25 2000 MANYWORLDS, INC Fuzzy content network management and access
6807566, Aug 16 2000 International Business Machines Corporation Method, article of manufacture and apparatus for processing an electronic message on an electronic message board
6839682, May 06 1999 CALLAHAN CELLULAR L L C Predictive modeling of consumer financial behavior using supervised segmentation and nearest-neighbor matching
6928526, Dec 20 2002 EMC Corporation Efficient data storage system
6978115, Mar 29 2001 GEOLUX COMMUNICATIONS, INC Method and system for training in an adaptive manner
6978292, Nov 22 1999 Fujitsu Limited Communication support method and system
6983320, May 23 2000 ZeroFOX, Inc System, method and computer program product for analyzing e-commerce competition of an entity by utilizing predetermined entity-specific metrics and analyzed statistics from web pages
6999914, Sep 28 2000 Manning And Napier Information Services LLC Device and method of determining emotive index corresponding to a message
7035685, Jan 22 2002 Electronics and Telecommunications Research Institute Apparatus and method for measuring electroencephalogram
7043760, Oct 11 2000 HOLTZMAN, DAVID M System and method for establishing and managing relationships between pseudonymous identifications and memberships in organizations
7050753, Apr 24 2000 Open Invention Network, LLC System and method for providing learning material
7113916, Sep 07 2001 SENSORY LOGIC, INC Method of facial coding monitoring for the purpose of gauging the impact and appeal of commercially-related stimuli
7146416, Sep 01 2000 ENERGETIC POWER INVESTMENT LIMITED Web site activity monitoring system with tracking by categories and terms
7185065, Oct 11 2000 Buzzmetrics Ltd System and method for scoring electronic messages
7188078, Oct 11 2000 BUZZMETRICS, LTD System and method for collection and analysis of electronic discussion messages
7188079, Oct 11 2000 BUZZMETRICS, LTD System and method for collection and analysis of electronic discussion messages
7197470, Oct 11 2000 BUZZMETRICS, LTD System and method for collection analysis of electronic discussion methods
7277919, Mar 19 1999 International Business Machines Corporation Relevance clause for computed relevance messaging
7363243, Oct 11 2000 Buzzmetrics Ltd System and method for predicting external events from electronic posting activity
7523085, Sep 30 2004 BUZZMETRICS, LTD Topical sentiments in electronically stored communications
7596552, Aug 05 2005 BuzzMetrics Ltd. Method and system for extracting web data
7600017, Oct 11 2000 BuzzMetrics, Ltd. System and method for scoring electronic messages
7660783, Sep 27 2006 CITIBANK, N A System and method of ad-hoc analysis of data
7725414, Mar 16 2004 Buzzmetrics Ltd Method for developing a classifier for classifying communications
7844483, Oct 11 2000 BuzzMetrics, Ltd. System and method for predicting external events from electronic author activity
7844484, Oct 11 2000 BuzzMetrics, Ltd. System and method for benchmarking electronic message activity
7877345, Sep 30 2004 BuzzMetrics, Ltd. Topical sentiments in electronically stored communications
8041669, Sep 30 2004 BuzzMetrics, Ltd. Topical sentiments in electronically stored communications
20010016874,
20010042087,
20010056225,
20020010691,
20020032772,
20020059258,
20020062368,
20020087515,
20020123988,
20020133481,
20020154833,
20020159642,
20020182574,
20030003433,
20030063780,
20030070338,
20030076369,
20030081834,
20030088532,
20030093784,
20030126593,
20030153841,
20040018476,
20040024752,
20040039268,
20040054737,
20040059708,
20040059729,
20040072133,
20040078432,
20040111412,
20040122811,
20040199498,
20040205482,
20040208496,
20040210561,
20040267141,
20050010087,
20050039206,
20050043774,
20050045189,
20050049908,
20050066307,
20050071865,
20050097594,
20050113656,
20050114161,
20050125216,
20050154686,
20050172311,
20050209907,
20060004691,
20060041605,
20060069589,
20060173819,
20060173837,
20060173985,
20060206505,
20060253316,
20060258926,
20060277102,
20060287989,
20060293921,
20070027840,
20070033189,
20070053513,
20070055169,
20070060830,
20070060831,
20070066914,
20070100779,
20070116037,
20070168461,
20070173733,
20070179396,
20070184420,
20070225585,
20070235716,
20070238945,
20070265507,
20080091512,
20080144882,
20080159365,
20080177197,
20080211768,
20080218472,
20090024049,
20090024447,
20090024448,
20090024449,
20090024475,
20090025023,
20090030287,
20090030303,
20090030717,
20090030930,
20090036755,
20090036756,
20090062629,
20090062681,
20090063255,
20090063256,
20090082643,
20090083129,
20090105576,
20090112077,
20090156925,
20090214060,
20090222330,
20110161270,
D565735, Dec 06 2006 Emotiv Systems Pty Ltd Electrode headset
EP1052582,
KR1020000072489,
KR1020010104579,
WO17824,
WO17827,
WO197070,
/////////////////////////////////////////////////////////////////////////////////////
Executed onAssignorAssigneeConveyanceFrameReelDoc
Dec 18 2007The Nielsen Company (US)(assignment on the face of the patent)
Jan 22 2008WEITZENFELD, DANIELEmsense CorporationASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS 0206620539 pdf
Jan 22 2008LEE, HANS C Emsense CorporationASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS 0206620539 pdf
Feb 25 2008FETTIPLACE, MICHAEL R Emsense CorporationASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS 0206620539 pdf
Nov 23 2011Emsense CorporationEMSENSE, LLCASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS 0279880744 pdf
Jan 24 2012EMSENSE, LLCTHE NIELSEN COMPANY US , LLC , A DELAWARE LIMITED LIABILITY COMPANYASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS 0279880777 pdf
Oct 23 2015THE NIELSEN COMPANY US , LLCCITIBANK, N A , AS COLLATERAL AGENT FOR THE FIRST LIEN SECURED PARTIESSUPPLEMENTAL IP SECURITY AGREEMENT0371720415 pdf
Jun 04 2020NIELSEN AUDIO, INC CITIBANK, N A CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001 ASSIGNOR S HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT 0540660064 pdf
Jun 04 2020NETRATINGS, LLCCITIBANK, N A CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001 ASSIGNOR S HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT 0540660064 pdf
Jun 04 2020GRACENOTE MEDIA SERVICES, LLCCITIBANK, N A CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001 ASSIGNOR S HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT 0540660064 pdf
Jun 04 2020GRACENOTE DIGITAL VENTURES, LLCCITIBANK, N A CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001 ASSIGNOR S HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT 0540660064 pdf
Jun 04 2020GRACENOTE, INCCITIBANK, N A CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001 ASSIGNOR S HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT 0540660064 pdf
Jun 04 2020EXELATE, INC CITIBANK, N A CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001 ASSIGNOR S HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT 0540660064 pdf
Jun 04 2020CZT ACN TRADEMARKS, L L C CITIBANK, N A CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001 ASSIGNOR S HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT 0540660064 pdf
Jun 04 2020ATHENIAN LEASING CORPORATIONCITIBANK, N A CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001 ASSIGNOR S HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT 0540660064 pdf
Jun 04 2020ART HOLDING, L L C CITIBANK, N A CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001 ASSIGNOR S HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT 0540660064 pdf
Jun 04 2020AFFINNOVA, INC CITIBANK, N A CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001 ASSIGNOR S HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT 0540660064 pdf
Jun 04 2020ACNIELSEN ERATINGS COMCITIBANK, N A CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001 ASSIGNOR S HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT 0540660064 pdf
Jun 04 2020ACNIELSEN CORPORATIONCITIBANK, N A CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001 ASSIGNOR S HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT 0540660064 pdf
Jun 04 2020NIELSEN CONSUMER INSIGHTS, INC CITIBANK, N A CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001 ASSIGNOR S HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT 0540660064 pdf
Jun 04 2020NIELSEN CONSUMER NEUROSCIENCE, INC CITIBANK, N A CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001 ASSIGNOR S HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT 0540660064 pdf
Jun 04 2020NIELSEN FINANCE CO CITIBANK, N A CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001 ASSIGNOR S HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT 0540660064 pdf
Jun 04 2020VNU INTERNATIONAL B V CITIBANK, N A CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001 ASSIGNOR S HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT 0540660064 pdf
Jun 04 2020THE NIELSEN COMPANY B V CITIBANK, N A CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001 ASSIGNOR S HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT 0540660064 pdf
Jun 04 2020NIELSEN HOLDING AND FINANCE B V CITIBANK, N A CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001 ASSIGNOR S HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT 0540660064 pdf
Jun 04 2020NMR LICENSING ASSOCIATES, L P CITIBANK, N A CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001 ASSIGNOR S HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT 0540660064 pdf
Jun 04 2020VNU MARKETING INFORMATION, INC CITIBANK, N A CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001 ASSIGNOR S HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT 0540660064 pdf
Jun 04 2020VIZU CORPORATIONCITIBANK, N A CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001 ASSIGNOR S HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT 0540660064 pdf
Jun 04 2020THE NIELSEN COMPANY US , LLCCITIBANK, N A CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001 ASSIGNOR S HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT 0540660064 pdf
Jun 04 2020TNC US HOLDINGS, INC CITIBANK, N A CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001 ASSIGNOR S HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT 0540660064 pdf
Jun 04 2020TCG DIVESTITURE INC CITIBANK, N A CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001 ASSIGNOR S HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT 0540660064 pdf
Jun 04 2020NMR INVESTING I, INC CITIBANK, N A CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001 ASSIGNOR S HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT 0540660064 pdf
Jun 04 2020NIELSEN MOBILE, LLCCITIBANK, N A CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001 ASSIGNOR S HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT 0540660064 pdf
Jun 04 2020NIELSEN INTERNATIONAL HOLDINGS, INC CITIBANK, N A CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001 ASSIGNOR S HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT 0540660064 pdf
Jun 04 2020ACN HOLDINGS INC CITIBANK, N A CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001 ASSIGNOR S HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT 0540660064 pdf
Jun 04 2020A C NIELSEN COMPANY, LLCCITIBANK, N A SUPPLEMENTAL SECURITY AGREEMENT0534730001 pdf
Jun 04 2020NIELSEN CONSUMER INSIGHTS, INC CITIBANK, N A SUPPLEMENTAL SECURITY AGREEMENT0534730001 pdf
Jun 04 2020NIELSEN AUDIO, INC CITIBANK, N A SUPPLEMENTAL SECURITY AGREEMENT0534730001 pdf
Jun 04 2020NETRATINGS, LLCCITIBANK, N A SUPPLEMENTAL SECURITY AGREEMENT0534730001 pdf
Jun 04 2020GRACENOTE MEDIA SERVICES, LLCCITIBANK, N A SUPPLEMENTAL SECURITY AGREEMENT0534730001 pdf
Jun 04 2020GRACENOTE DIGITAL VENTURES, LLCCITIBANK, N A SUPPLEMENTAL SECURITY AGREEMENT0534730001 pdf
Jun 04 2020GRACENOTE, INCCITIBANK, N A SUPPLEMENTAL SECURITY AGREEMENT0534730001 pdf
Jun 04 2020EXELATE, INC CITIBANK, N A SUPPLEMENTAL SECURITY AGREEMENT0534730001 pdf
Jun 04 2020CZT ACN TRADEMARKS, L L C CITIBANK, N A SUPPLEMENTAL SECURITY AGREEMENT0534730001 pdf
Jun 04 2020ATHENIAN LEASING CORPORATIONCITIBANK, N A SUPPLEMENTAL SECURITY AGREEMENT0534730001 pdf
Jun 04 2020ART HOLDING, L L C CITIBANK, N A SUPPLEMENTAL SECURITY AGREEMENT0534730001 pdf
Jun 04 2020AFFINNOVA, INC CITIBANK, N A SUPPLEMENTAL SECURITY AGREEMENT0534730001 pdf
Jun 04 2020ACNIELSEN ERATINGS COMCITIBANK, N A SUPPLEMENTAL SECURITY AGREEMENT0534730001 pdf
Jun 04 2020ACNIELSEN CORPORATIONCITIBANK, N A SUPPLEMENTAL SECURITY AGREEMENT0534730001 pdf
Jun 04 2020ACN HOLDINGS INC CITIBANK, N A SUPPLEMENTAL SECURITY AGREEMENT0534730001 pdf
Jun 04 2020NIELSEN CONSUMER NEUROSCIENCE, INC CITIBANK, N A SUPPLEMENTAL SECURITY AGREEMENT0534730001 pdf
Jun 04 2020NIELSEN FINANCE CO CITIBANK, N A SUPPLEMENTAL SECURITY AGREEMENT0534730001 pdf
Jun 04 2020A C NIELSEN ARGENTINA S A CITIBANK, N A CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001 ASSIGNOR S HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT 0540660064 pdf
Jun 04 2020A C NIELSEN COMPANY, LLCCITIBANK, N A CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001 ASSIGNOR S HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT 0540660064 pdf
Jun 04 2020VNU INTERNATIONAL B V CITIBANK, N A SUPPLEMENTAL SECURITY AGREEMENT0534730001 pdf
Jun 04 2020THE NIELSEN COMPANY B V CITIBANK, N A SUPPLEMENTAL SECURITY AGREEMENT0534730001 pdf
Jun 04 2020NIELSEN HOLDING AND FINANCE B V CITIBANK, N A SUPPLEMENTAL SECURITY AGREEMENT0534730001 pdf
Jun 04 2020NMR LICENSING ASSOCIATES, L P CITIBANK, N A SUPPLEMENTAL SECURITY AGREEMENT0534730001 pdf
Jun 04 2020VNU MARKETING INFORMATION, INC CITIBANK, N A SUPPLEMENTAL SECURITY AGREEMENT0534730001 pdf
Jun 04 2020VIZU CORPORATIONCITIBANK, N A SUPPLEMENTAL SECURITY AGREEMENT0534730001 pdf
Jun 04 2020THE NIELSEN COMPANY US , LLCCITIBANK, N A SUPPLEMENTAL SECURITY AGREEMENT0534730001 pdf
Jun 04 2020TNC US HOLDINGS, INC CITIBANK, N A SUPPLEMENTAL SECURITY AGREEMENT0534730001 pdf
Jun 04 2020TCG DIVESTITURE INC CITIBANK, N A SUPPLEMENTAL SECURITY AGREEMENT0534730001 pdf
Jun 04 2020NMR INVESTING I, INC CITIBANK, N A SUPPLEMENTAL SECURITY AGREEMENT0534730001 pdf
Jun 04 2020NIELSEN UK FINANCE I, LLCCITIBANK, N A SUPPLEMENTAL SECURITY AGREEMENT0534730001 pdf
Jun 04 2020NIELSEN INTERNATIONAL HOLDINGS, INC CITIBANK, N A SUPPLEMENTAL SECURITY AGREEMENT0534730001 pdf
Jun 04 2020NIELSEN MOBILE, LLCCITIBANK, N A SUPPLEMENTAL SECURITY AGREEMENT0534730001 pdf
Feb 09 2021THE NIELSEN COMPANY US , LLCNielsen Consumer LLCASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS 0552360963 pdf
Mar 05 2021CITIBANK, N A NIELSEN CONSUMER NEUROSCIENCE, INC PARTIAL RELEASE OF SECURITY INTEREST0555570949 pdf
Mar 05 2021BYZZER INC BANK OF AMERICA, N A , AS ADMINISTRATIVE AGENT AND COLLATERAL AGENTSECURITY INTEREST SEE DOCUMENT FOR DETAILS 0557420719 pdf
Mar 05 2021Nielsen Consumer LLCBANK OF AMERICA, N A , AS ADMINISTRATIVE AGENT AND COLLATERAL AGENTSECURITY INTEREST SEE DOCUMENT FOR DETAILS 0557420719 pdf
Mar 05 2021CITIBANK, N A Nielsen Consumer LLCPARTIAL RELEASE OF SECURITY INTEREST0555570949 pdf
Oct 11 2022CITIBANK, N A NETRATINGS, LLCRELEASE REEL 054066 FRAME 0064 0636050001 pdf
Oct 11 2022CITIBANK, N A THE NIELSEN COMPANY US , LLCRELEASE REEL 054066 FRAME 0064 0636050001 pdf
Oct 11 2022CITIBANK, N A GRACENOTE MEDIA SERVICES, LLCRELEASE REEL 054066 FRAME 0064 0636050001 pdf
Oct 11 2022CITIBANK, N A GRACENOTE, INCRELEASE REEL 054066 FRAME 0064 0636050001 pdf
Oct 11 2022CITIBANK, N A EXELATE, INC RELEASE REEL 054066 FRAME 0064 0636050001 pdf
Oct 11 2022CITIBANK, N A NETRATINGS, LLCRELEASE REEL 053473 FRAME 0001 0636030001 pdf
Oct 11 2022CITIBANK, N A THE NIELSEN COMPANY US , LLCRELEASE REEL 053473 FRAME 0001 0636030001 pdf
Oct 11 2022CITIBANK, N A GRACENOTE MEDIA SERVICES, LLCRELEASE REEL 053473 FRAME 0001 0636030001 pdf
Oct 11 2022CITIBANK, N A GRACENOTE, INCRELEASE REEL 053473 FRAME 0001 0636030001 pdf
Oct 11 2022CITIBANK, N A EXELATE, INC RELEASE REEL 053473 FRAME 0001 0636030001 pdf
Oct 11 2022CITIBANK, N A A C NIELSEN COMPANY, LLCRELEASE REEL 053473 FRAME 0001 0636030001 pdf
Oct 11 2022CITIBANK, N A THE NIELSEN COMPANY US , LLCRELEASE REEL 037172 FRAME 0415 0617500221 pdf
Oct 11 2022CITIBANK, N A A C NIELSEN COMPANY, LLCRELEASE REEL 054066 FRAME 0064 0636050001 pdf
Date Maintenance Fee Events
Jul 01 2016M1551: Payment of Maintenance Fee, 4th Year, Large Entity.
Jul 01 2020M1552: Payment of Maintenance Fee, 8th Year, Large Entity.
Jul 01 2024M1553: Payment of Maintenance Fee, 12th Year, Large Entity.


Date Maintenance Schedule
Jan 01 20164 years fee payment window open
Jul 01 20166 months grace period start (w surcharge)
Jan 01 2017patent expiry (for year 4)
Jan 01 20192 years to revive unintentionally abandoned end. (for year 4)
Jan 01 20208 years fee payment window open
Jul 01 20206 months grace period start (w surcharge)
Jan 01 2021patent expiry (for year 8)
Jan 01 20232 years to revive unintentionally abandoned end. (for year 8)
Jan 01 202412 years fee payment window open
Jul 01 20246 months grace period start (w surcharge)
Jan 01 2025patent expiry (for year 12)
Jan 01 20272 years to revive unintentionally abandoned end. (for year 12)