Systems and methods are provided for decoding a message symbol in an audio signal. This message symbol is represented by first and second code symbols displaced in time. values representing the code signals are accumulated and the accumulated values are examined to detect the message symbol.
|
0. 96. An apparatus for encoding a predetermined message in an audio signal, comprising:
a memory;
an encoder, operatively coupled to the memory, that encodes the audio signal with a first encoded sequence of code symbols representing the predetermined message and a second encoded sequence of code symbols representing the predetermined message, such that the second encoded sequence of code symbols differs from the first encoded sequence of code symbols and the second encoded sequence of code symbols is displaced in time in the audio signal with respect to the first encoded sequence of code symbols; and
wherein the first encoded sequence of code symbols has a frequency content which differs at least in part from a frequency content of the second encoded sequence of code symbols.
0. 55. A method of encoding a predetermined message in an audio signal using a processing device, comprising:
encoding the audio signal using the processing device with a first encoded sequence of code symbols representing the predetermined message; and
encoding the audio signal with a second encoded sequence of code symbols representing the predetermined message, such that the second encoded sequence of code symbols differs from the first encoded sequence of code symbols and the second encoded sequence of code symbols is displaced in time in the audio signal with respect to the first encoded sequence of code symbols;
wherein the first encoded sequence of code symbols has a frequency content which differs at least in part from a frequency content of the second encoded sequence of code symbols.
0. 102. An apparatus for encoding a predetermined message in an audio signal, comprising:
a memory;
an encoder, operatively coupled to the memory, that encodes the audio signal with a first encoded sequence of code symbols representing the predetermined message and a second encoded sequence of code symbols representing the predetermined message, such that the second encoded sequence of code symbols differs from the first encoded sequence of code symbols and the second encoded sequence of code symbols is displaced in time in the audio signal with respect to the first encoded sequence of code symbols; and
wherein each code symbol in the second encoded sequence of code symbols corresponds to a respective code symbol in the first encoded sequence of code symbols, and wherein each code symbol in the second encoded sequence of code symbols has a frequency content which differs at least in part from a frequency content of the corresponding code symbol in the first encoded sequence of code symbols.
0. 110. An apparatus for encoding a predetermined message in an audio signal, comprising:
a memory; and
an encoder that encodes the audio signal with a first encoded sequence of code symbols representing the predetermined message and a second encoded sequence of code symbols representing the predetermined message, such that the second encoded sequence of code symbols differs from the first encoded sequence of code symbols and the second encoded sequence of code symbols is displaced in time in the audio signal with respect to the first encoded sequence of code symbols,
wherein each of the code symbols in the first encoded sequence of code symbols comprises a first set of single frequency components and each of the code symbols in the second encoded sequence of code symbols comprises a second set of single frequency components, and wherein the first encoded sequence of code symbols has a frequency content which differs at least in part from a frequency content of the second encoded sequence of code symbols.
0. 95. An apparatus for encoding information in an audio signal, comprising:
a translator that translates an information signal into a first set of code symbols representing the information signal and a second set of code symbols representing the information signal, each of the code symbols in the first and second sets of code symbols having a corresponding plurality of single-frequency code components, such that at least some of the single-frequency code components of the code symbols in the first set of code symbols differ from the single-frequency code components of code symbols in the second set of code symbols; and
an encoder that combines the single-frequency code components of the first and second sets of code symbols with the audio signal to produce an encoded audio signal, such that the single-frequency code components of the code symbols in the first set of code symbols are time-displaced from the single-frequency code components of the code symbols in the second set of code symbols in the audio signal.
0. 83. A method of encoding a predetermined message in an audio signal in a processing device, comprising:
encoding the audio signal using the processing device with a first encoded sequence of code symbols representing the predetermined message, each of the first encoded code symbols comprising a first plurality of single frequency components; and
encoding the audio signal using the processing device with a second encoded sequence of code symbols representing the predetermined message, each of the second encoded code symbols comprising a second plurality of single frequency components, such that the second encoded sequence of code symbols differs from the first encoded sequence of code symbols and the second encoded sequence of code symbols is displaced in time in the audio signal with respect to the first encoded sequence of code symbols,
and wherein the first encoded sequence of code symbols has a frequency content which differs at least in part from a frequency content of the second encoded sequence of code symbols.
0. 67. A method of encoding a predetermined message in an audio signal using a processing device, comprising:
encoding the audio signal using the processing device with a first encoded sequence of code symbols representing the predetermined message; and
encoding the audio signal using the processing device with a second encoded sequence of code symbols representing the predetermined message, such that the second encoded sequence of code symbols differs from the first encoded sequence of code symbols and the second encoded sequence of code symbols is displaced in time in the audio signal with respect to the first encoded sequence of code symbols;
wherein each code symbol in the second encoded sequence of code symbols corresponds to a respective code symbol in the first encoded sequence of code symbols, and wherein each code symbol in the second encoded sequence of code symbols has a frequency content which differs at least in part from a frequency content of the corresponding code symbol in the first encoded sequence of code symbols.
8. A method for decoding a predetermined message symbol of a plurality of message symbols incorporated in an audio signal, comprising:
receiving an audio signal in which a plurality of message symbols have been incorporated so that the message symbols are inaudible when the audio signal is reproduced audibly, the plurality of message symbols being contained within a predetermined message as a plurality of code symbols, the predetermined message symbol being represented by first and second code symbols incorporated in and displaced in time in the audio signal with at least one code symbol representing a different one of the message symbols being incorporated in the audio signal and positioned in time between the first and second code symbols;
accumulating a first signal value of the first code symbol representing the predetermined message symbol and a second signal value of the second code symbol representing the predetermined message symbol; and
examining the accumulated first and second signal values to detect the predetermined message symbol.
0. 89. An apparatus for encoding a predetermined message in an audio signal, comprising:
a memory
an encoder, operatively coupled to the memory, that encodes the audio signal with a first encoded sequence of code symbols representing the predetermined message and a second encoded sequence of code symbols representing the predetermined message, such that the second encoded sequence of code symbols differs from the first encoded sequence of code symbols and the second encoded sequence of code symbols is displaced in time in the audio signal with respect to the first encoded sequence of code symbols;
wherein each of the code symbols in the first encoded sequence of code symbols comprises a first plurality of single frequency components and each of the code symbols in the second encoded sequence of code symbols comprises a second plurality of single frequency components,
and wherein the first encoded sequence of code symbols has a frequency content which differs at least in part from a frequency content of the second encoded sequence of code symbols.
0. 53. A method for encoding information in an audio signal using a processing device, comprising the steps of:
translating an information signal using the processing device into a first set of code symbols representing the information signal and a second set of code symbols representing the information signal, such that each of the code symbols in the first and second sets of code symbols comprises a corresponding plurality of single-frequency code components, at least some of the single-frequency code components of the code symbols in the first set of code symbols differing from the single-frequency code components of the code symbols in the second set of code symbols;
and, using the processing device, combining the single-frequency code components of the first and second sets of code symbols with the audio signal to produce an encoded audio signal, such that the single-frequency code components of the code symbols in the first set of code symbols are time-displaced from the single-frequency code components of the code symbols in the second set of code symbols in the audio signal.
21. A method for decoding a predetermined message symbol of a plurality of message symbols incorporated in an audio signal, comprising:
receiving an audio signal in which a plurality of message symbols have been incorporated so that the message symbols are inaudible when the audio signal is reproduced audibly, the plurality of message symbols being contained within a predetermined message as a plurality of code symbols, the predetermined message symbol being represented by first and second code symbols incorporated in and displaced in time in the audio signal with at least one code symbol representing a different one of the message symbols being incorporated in the audio signal and positioned in time between the first and second code symbols;
accumulating a first signal value of the first code symbol representing the predetermined message symbol and a second signal value of the second code symbol representing the predetermined message symbol based on multiple other signal values; and
examining the accumulated first and second signal values to detect the predetermined message symbol.
0. 41. A method of encoding a predetermined message in an audio signal using a processing device, comprising:
encoding the audio signal using the processing device with a first encoded sequence of code symbols representing the predetermined message; and
encoding the audio signal using the processing device with a second encoded sequence of code symbols representing the predetermined message, such that the second encoded sequence of code symbols differs from the first encoded sequence of code symbols and the second encoded sequence of code symbols is displaced in time in the audio signal with respect to the first encoded sequence of code symbols;
wherein each of the code symbols in the first encoded sequence of code symbols comprises a first plurality of single frequency components and each of the code symbols in the second encoded sequence of code symbols comprises a second plurality of single frequency components, and wherein the first encoded sequence of code symbols has a frequency content which differs at least in part from a frequency content of the second encoded sequence of code symbols.
1. A system for decoding a predetermined message symbol of a plurality of message symbols embedded in an audio signal, comprising:
means for receiving an audio signal in which a plurality of message symbols have been incorporated so that the message symbols are inaudible when the audio signal is reproduced audibly, the plurality of message symbols being contained within a predetermined message as a plurality of code symbols, the predetermined message symbol being represented by first and second code symbols incorporated in and displaced in time in the audio signal with at least one code symbol representing a different one of the message symbols being incorporated in the audio signal and positioned in time between the first and second code symbols;
means for accumulating a first signal value of the first code symbol representing the predetermined message symbol and a second signal value of the second code symbol representing the predetermined message symbol; and
means for examining the accumulated first and second signal values to detect the predetermined message symbol represented by the first and second code symbols.
0. 109. An apparatus for encoding a predetermined message in an audio signal, comprising:
a memory;
an encoder that encodes the audio signal with a first encoded sequence of code symbols representing the predetermined message and a second encoded sequence of code symbols representing the predetermined message, such that the second encoded sequence of code symbols differs from the first encoded sequence of code symbols and the second encoded sequence of code symbols is displaced in time in the audio signal with respect to the first encoded sequence of code symbols; and
wherein the code symbols of the first and second encoded sequences of code symbols are selected from a predetermined set of code symbols and each code symbol of the predetermined set of code symbols comprises a combination of single-frequency code components unique among all combinations of single-frequency code components of the code symbols within the predetermined set of code symbols,
and wherein the first encoded sequence of code symbols has a frequency content which differs at least in part from a frequency content of the second encoded sequence of code symbols.
11. A system for decoding a predetermined message symbol of a plurality of message symbols incorporated in an audio signal, comprising:
an input device for an audio signal in which a plurality of message symbols have been incorporated so that the message symbols are inaudible when the audio signal is reproduced audibly, the plurality of message symbols being contained within a predetermined message as a plurality of code symbols, the predetermined message symbol being represented by first and second code symbols incorporated in and displaced in time in the audio signal with at least one code symbol representing a different one of the message symbols being incorporated in the audio signal and positioned in time between the first and second code symbols; and
a digital processor in communication with the input device to receive the audio signal therefrom, the digital processor being programmed to accumulate a first signal value representing the first code symbol and a second signal value representing the second code symbol, the digital processor being further programmed to examine the accumulated first and second signal values to detect the predetermined message symbol.
33. A method for decoding a predetermined message symbol of a plurality of message symbols embedded in an audio signal, comprising:
receiving an audio signal in which a plurality of message symbols have been incorporated so that the message symbols are inaudible when the audio signal is reproduced audibly, the plurality of message symbols being contained within a predetermined message as a plurality of code symbols, the predetermined message symbol being represented by first and second code symbols incorporated in and displaced in time in the audio signal with at least one code symbol representing a different one of the message symbols being incorporated in the audio signal and positioned in time between the first and second code symbols;
accumulating a first signal value of the first code symbol representing the predetermined message symbol and a second signal value of the second code symbol representing the predetermined message symbol based on multiple other signal values;
storing the first and second signal values; and
examining both of the accumulated first and second signal values to detect the predetermined message symbol represented by the first and second code symbols.
22. A system for decoding a predetermined message symbol of a plurality of message symbols incorporated in an audio signal, comprising:
an input device for an audio signal in which a plurality of message symbols have been incorporated so that the message symbols are inaudible when the audio signal is reproduced audibly, the plurality of message symbols being contained within a predetermined message as a plurality of code symbols, the predetermined message symbol being represented by first and second code symbols incorporated in and displaced in time in the audio signal with at least one code symbol representing a different one of the message symbols being incorporated in the audio sign al and positioned in time between the first and second code symbols; and
a digital processor in communication with the input device to receive the audio signal therefrom, the digital processor being programmed to accumulate a first signal value representing the first code symbol and a second signal value representing the second code symbol based on multiple other signal values, the digital processor being further programmed to examine the accumulated first and second signal values to detect the predetermined message symbol.
0. 81. A method of encoding a predetermined message in an audio signal using a processing device, comprising:
encoding the audio signal using the processing device with a first encoded sequence of code symbols representing the predetermined message;
encoding the audio signal using the processing device with a second encoded sequence of code symbols representing the predetermined message, such that the second encoded sequence of code symbols differs from the first encoded sequence of code symbols and the second encoded sequence of code symbols is displaced in time in the audio signal with respect to the first encoded sequence of code symbols; and
wherein the code symbols of the first and second encoded sequences of code symbols are selected from a predetermined set of code symbols and each code symbol of the predetermined set of code symbols comprises a combination of single-frequency code components unique among all combinations of single-frequency code components of the code symbols within the predetermined set of code symbols,
and wherein the first encoded sequence of code symbols has a frequency content which differs at least in part from a frequency content of the second encoded sequence of code symbols.
20. A system for decoding a predetermined message symbol of a plurality of message symbols embedded in an audio signal, comprising:
means for receiving an audio signal in which a plurality of message symbols have been incorporated so that the message symbols are inaudible when the audio signal is reproduced audibly, the plurality of message symbols being contained within a predetermined message as a plurality of code symbols, the predetermined message symbol being represented by first and second code symbols incorporated in and displaced in time in the audio signal with at least one code symbol representing a different one of the message symbols being incorporated in the audio signal and positioned in time between the first and second code symbols;
means for accumulating a first signal value of the first code symbol representing the predetermined message symbol and a second signal value of the second code symbol representing the predetermined message symbol, wherein the accumulating means is operative to produce the first and second signal values based on multiple other signal values; and
means for examining the accumulated first and second signal values to detect the predetermined message symbol represented by the first and second code symbols.
24. A method for decoding a predetermined message symbol of a plurality of message symbols incorporated in an audio signal, comprising:
receiving an audio signal in which a plurality of message symbols have been incorporated so that the message symbols are inaudible when the audio signal is reproduced audibly, the plurality of message symbols being contained within a predetermined message as a plurality of code symbols, the predetermined message symbol being represented by first and second code symbols incorporated in and displaced in time in the audio signal with at least one code symbol representing a different one of the message symbols being incorporated in the audio signal and positioned in time between the first and second code symbols;
accumulating a first signal value of the first code symbol representing the predetermined message symbol and a second signal value of the second code symbol representing the predetermined message symbol, wherein the first and second signal values are produced from respective sets of time displaced signal values, each of the time displaced signal values representing a value of a respective one of the first and second code symbols during a corresponding time period thereof; and
examining the accumulated first and second signal values to detect the predetermined message symbol.
38. A system for decoding a predetermined message symbol of a plurality of message symbols embedded in an audio signal, comprising:
an input device for an audio signal in which a plurality of message symbols have been incorporated so that the message symbols are inaudible when the audio signal is reproduced audibly, the plurality of message symbols being contained within a predetermined message as a plurality of code symbols, the predetermined message symbol being represented by first and second code symbols incorporated in and displaced in time in the audio signal with at least one code symbol representing a different one of the message symbols being incorporated in the audio signal and positioned in time between the first and second code symbols; and
a digital processor in communication with the input device to receive the audio signal therefrom, the digital processor being programmed to accumulate a first signal value of the first code symbol representing the predetermined message symbol and a second signal value of the second code symbol representing the predetermined message symbol based on multiple other signal values, to store the first and second signal values, and to examine both of the accumulated first and second signal values to detect the predetermined message symbol represented by the first and second code symbols.
28. A system for decoding a predetermined message symbol of a plurality of message symbols embedded in an audio signal, comprising:
means for receiving an audio signal in which a plurality of message symbols have been incorporated so that the message symbols are inaudible when the audio signal is reproduced audibly, the plurality of message symbols being contained within a predetermined message as a plurality of code symbols, the predetermined message symbol being represented by first and second code symbols incorporated in and displaced in time in the audio signal with at least one code symbol representing a different one of the message symbols being incorporated in the audio signal and positioned in time between the first and second code symbols;
means for accumulating a first signal value of the first code symbol representing the predetermined message symbol and a second signal value of the second code symbol representing the predetermined message symbol, wherein the accumulating means is operative to produce the first and second signal values based on multiple other signal values and wherein the accumulating means is operative to store the first and second signal values; and
means for examining both of the accumulated first and second signal values to detect the predetermined message symbol represented by the first and second code symbols.
0. 106. An apparatus for encoding a predetermined message in an audio signal, comprising:
a memory; and
an encoder, operatively coupled to the memory, that encodes the audio signal with a first encoded sequence of code symbols representing the predetermined message and a second encoded sequence of code symbols representing the predetermined message, such that the second encoded sequence of code symbols differs from the first encoded sequence of code symbols and the second encoded sequence of code symbols is displaced in time in the audio signal with respect to the first encoded sequence of code symbols, wherein the first and second encoded sequences of code symbols are inaudible when the audio signal is reproduced audibly;
and wherein the code symbols of the first and second encoded sequences of code symbols are selected from a predetermined set of code symbols in which the code symbols are arranged in a predetermined order, and wherein each code symbol of the second encoded sequence of code symbols corresponds to a respective code symbol of the first encoded sequence of code symbols and is selected based on the order of the respective code symbol of the first encoded sequence of code symbols,
and wherein the first encoded sequence of code symbols has a frequency content which differs at least in part from a frequency content of the second encoded sequence of code symbols.
23. A system for decoding a predetermined message symbol of a plurality of message symbols embedded in an audio signal, comprising:
means for receiving an audio signal in which a plurality of message symbols have been incorporated so that the message symbols are inaudible when the audio signal is reproduced audibly, the plurality of message symbols being contained within a predetermined message as a plurality of code symbols, the predetermined message symbol being represented by first and second code symbols incorporated in and displaced in time in the audio signal with at least one code symbol representing a different one of the message symbols being incorporated in the audio signal and positioned in time between the first and second code symbols;
means for accumulating a first signal value of the first code symbol representing the predetermined message symbol and a second signal value of the second code symbol representing the predetermined message symbol, wherein the first and second signal values are produced from respective sets of time displaced signal values, each of the time displaced signal values representing a value of a respective one of the first and second code symbols during a corresponding time period thereof; and
means for examining the accumulated first and second signal values to detect the predetermined message symbol represented by the first and second code symbols.
0. 75. A method of encoding a predetermined message in an audio signal using a processing device, comprising:
encoding the audio signal using the processing device with a first encoded sequence of code symbols representing the predetermined message; and
encoding the audio signal using the processing device with a second encoded sequence of code symbols representing the predetermined message, such that the second encoded sequence of code symbols differs from the first encoded sequence of code symbols and the second encoded sequence of code symbols is displaced in time in the audio signal with respect to the first encoded sequence of code symbols, wherein the first and second encoded sequences of code symbols are inaudible when the audio signal is reproduced audibly;
wherein the code symbols of the first and second encoded sequences of code symbols are selected from a predetermined set of code symbols in which the code symbols are arranged in a predetermined order, and wherein each code symbol of the second encoded sequence of code symbols corresponds to a respective code symbol of the first encoded sequence of code symbols and is selected based on the order of the respective code symbol of the first encoded sequence of code symbols,
and wherein the first encoded sequence of code symbols has a frequency content which differs at least in part from a frequency content of the second encoded sequence of code symbols.
25. A system for decoding a predetermined message symbol of a plurality of message symbols incorporated in an audio signal, comprising:
an input device for an audio signal in which a plurality of message symbols have been incorporated so that the message symbols are inaudible when the audio signal is reproduced audibly, the plurality of message symbols being contained within a predetermined message as a plurality of code symbols, the predetermined message symbol being represented by first and second code symbols incorporated in and displaced in time in the audio signal with at least one code symbol representing a different one of the message symbols being incorporated in the audio signal and positioned in time between the first and second code symbols; and
a digital processor in communication with the input device to receive the audio signal therefrom, the digital processor being programmed to accumulate a first signal value representing the first code symbol and a second signal value representing the second code symbol, wherein the first and second signal values are produced from respective sets of time displaced signal values, each of the time displaced signal values representing a value of a respective one of the first and second code symbols during a corresponding time period thereof, the digital processor being further programmed to examine the accumulated first and second signal values to detect the predetermined message symbol.
15. A method for decoding a predetermined message symbol of a plurality of message symbols incorporated in an audio signal, comprising:
receiving an audio signal in which a plurality of message symbols have been incorporated so that the message symbols are inaudible when the audio signal is reproduced audibly, the plurality of message symbols being contained within a predetermined message as a plurality of code symbols, the predetermined message symbol being represented by first and second code symbols incorporated in and displaced in time in the audio signal with at least one code symbol representing a different one of the message symbols being incorporated in the audio signal and positioned in time between the first and second code symbols, the first and second code symbols each comprising a predetermined number of frequency components;
producing first and second sets of component values, each set corresponding to a respective one of the first and second code symbols and each component value of each set representing a characteristic of a respective frequency component of the corresponding symbol;
accumulating a first signal value of the first code symbol representing the predetermined message symbol based on the first set of component values and a second signal value of the second code symbol representing the predetermined message symbol based on the second set of component values; and examining the accumulated first and second signal values to detect the predetermined message symbol.
14. A system for decoding a predetermined message symbol of a plurality of message symbols embedded in an audio signal, comprising:
means for receiving an audio signal in which a plurality of message symbols have been incorporated so that the message symbols are inaudible when the audio signal is reproduced audibly, the plurality of message symbols being contained within a predetermined message as a plurality of code symbols, the predetermined message symbol being represented by first and second code symbols incorporated in and displaced in time in the audio signal with at least one code symbol representing a different one of the message symbols being incorporated in the audio signal and positioned in time between the first and second code symbols, the first and second code symbols each comprising a predetermined number of frequency components;
means for producing first and second sets of component values, each set corresponding to a respective one of the first and second code symbols and each component value of each set representing a characteristic of a respective frequency component of the corresponding symbol;
means for accumulating a first signal value of the first code symbol representing the predetermined message symbol based on the first set of component values and a second signal value of the second code symbol representing the predetermined message symbol based on the second set of component values; and
means for examining the accumulated first and second signal values to detect the predetermined message symbol represented by the first and second code symbols.
31. A method for decoding a predetermined message symbol of a plurality of message symbols embedded in an audio signal, comprising:
receiving an audio signal in which a plurality of message symbols have been incorporated so that the message symbols are inaudible when the audio signal is reproduced audibly, the plurality of message symbols being contained within a predetermined message as a plurality of code symbols, the predetermined message symbol being represented by first and second code symbols incorporated in and displaced in time in the audio signal with at least one code symbol representing a different one of the message symbols being incorporated in the audio signal and positioned in time between the first and second code symbols, the first and second code symbols each comprising a predetermined number of frequency components;
producing first and second sets of component values, each set corresponding to a respective one of the first and second code symbols and each component value of each set representing a characteristic of a respective frequency component of the corresponding symbol;
accumulating a first signal value of the first code symbol representing the predetermined message symbol based on the first set of component values and a second signal value of the second code symbol representing the predetermined message symbol based on the second set of component values, and for producing a third signal value derived from the first and second signal values; and
detecting the predetermined message symbol represented by the first and second code symbols based on the third signal value.
18. A method for decoding predetermined message symbols of a plurality of message symbols incorporated in an audio signal, comprising:
receiving an audio signal in which a plurality of message symbols have been incorporated so that the message symbols are inaudible when the audio signal is reproduced audibly, the plurality of message symbols being represented by plural sets of first and second code symbols, each set representing a respective one of the plurality of message symbols, the plural sets of first and second code symbols being arranged as a message having a predetermined sequence including at least one marker symbol and at least one data symbol, at least one of the marker symbol and the data symbol being represented by first and second code symbols incorporated in and displaced in time in the audio signal with at least one code symbol representing a different one of the message symbols being incorporated in the audio signal and positioned in time between the first and second code symbols;
accumulating sets of first and second signal values, each signal value set corresponding to a respective one of the sets of first and second code symbols and including a first signal value representing the first code symbol of the respective code symbol set and a second signal value representing the second code symbol thereof; and
examining the accumulated sets of first and second signal values to detect the presence of the marker symbol based on its signal value set and to detect at least one data symbol based on the detected presence of the marker symbol and the corresponding signal value set of the at least one data symbol.
26. A system for decoding a predetermined message symbol of a plurality of message symbols embedded in an audio signal, comprising:
means for receiving an audio signal in which a plurality of message symbols have been incorporated so that the message symbols are inaudible when the audio signal is reproduced audibly, the plurality of message symbols being contained within a predetermined message as a plurality of code symbols, the predetermined message symbol being represented by first and second code symbols incorporated in and displaced in time in the audio signal with at least one code symbol representing a different one of the message symbols being incorporated in the audio signal and positioned in time between the first and second code symbols, the first and second code symbols each comprising a predetermined number of frequency components;
means for producing first and second sets of component values, each set corresponding to a respective one of the first and second code symbols and each component value of each set representing a characteristic of a respective frequency component of the corresponding symbol;
means for accumulating a first signal value of the first code symbol representing the predetermined message symbol based on the first set of component values and a second signal value of the second code symbol representing the predetermined message symbol based on the second set of component values, and for producing a third signal value derived from the first and second signal values; and
means for detecting the predetermined message symbol represented by the first and second code symbols based on the third signal value.
17. A system for decoding predetermined message symbols of a plurality of message symbols embedded in an audio signal, comprising:
means for receiving an audio signal in which a plurality of message symbols have been incorporated so that the message symbols are inaudible when the audio signal is reproduced audibly, the plurality of message symbols being represented by plural sets of first and second code symbols, each set representing a respective one of the plurality of message symbols, the plural sets of first and second code symbols being arranged as a message having a predetermined sequence including at least one marker symbol and at least one data symbol, at least one of the marker symbol and the data symbol being represented by first and second code symbols incorporated in and displaced in time in the audio signal with at least one code symbol representing a different one of the message symbols being incorporated in the audio signal and positioned in time between the first and second code symbols;
means for accumulating sets of first and second signal values, each signal value set corresponding to a respective one of the sets of first and second code symbols and including a first signal value representing the first code symbol of the respective code symbol set and a second signal value representing the second code symbol thereof; and
means for examining the accumulated sets of first and second signal values to detect the presence of the at least one marker symbol based on its signal value set and to detect the at least one data symbol based on the detected presence of the at least one marker symbol and the corresponding signal value set of the at least one data symbol.
16. A system for decoding a predetermined message symbol of a plurality of message symbols incorporated in an audio signal, comprising:
an input device for an audio signal in which a plurality of message symbols have been incorporated so that the message symbols are inaudible when the audio signal is reproduced audibly, the plurality of message symbols being contained within a predetermined message as a plurality of code symbols, the predetermined message symbol being represented by first and second code symbols incorporated in and displaced in time in the audio signal with at least one code symbol representing a different one of the message symbols being incorporated in the audio signal and positioned in time between the first and second code symbols, the first and second code symbols each comprising a predetermined number of frequency components; and
a digital processor in communication with the input device to receive the audio signal therefrom, the digital processor being programmed to produce first and second sets of component values, each set corresponding to a respective one of the first and second code symbols and each component value of each set representing a characteristic of a respective frequency component of the corresponding symbol the digital processor being further programmed to produce a first signal value based on the first set of component values and a second signal value based on the second set of component values and to accumulate a first signal value representing the first code symbol and a second signal value representing the second code symbol, the digital processor being further programmed to examine the accumulated first and second signal values to detect the predetermined message symbol.
36. A system for decoding a predetermined message symbol of a plurality of message symbols embedded in an audio signal, comprising:
an input device for an audio signal in which a plurality of message symbols have been incorporated so that the message symbols are inaudible when the audio signal is reproduced audibly, the plurality of message symbols being contained within a predetermined message as a plurality of code symbols, the predetermined message symbol being represented by first and second code symbols incorporated in and displaced in time in the audio signal with at least one code symbol representing a different one of the message symbols being incorporated in the audio signal and positioned in time between the first and second code symbols, the first and second code symbols each comprising a predetermined number of frequency components;
a digital processor in communication with the input device to receive the audio signal therefrom, the digital processor being programmed to produce first and second sets of component values, each set corresponding to a respective one of the first and second code symbols and each component value of each set representing a characteristic of a respective frequency component of the corresponding symbol, the digital processor being further programmed to accumulate a first signal value of the first code symbol representing the predetermined message symbol based on the first set of component values and a second signal value of the second code symbol representing the predetermined message symbol based on the second set of component values, to produce a third signal value derived from the first and second signal values, and to detect the predetermined message symbol represented by the first and second code symbols based on the third signal value.
32. A method for decoding a message represented by a plurality of message symbols embedded in an audio signal, comprising:
receiving an audio signal in which a plurality of message symbols have been incorporated so that the message symbols are inaudible when the audio signal is reproduced audibly, the plurality of message symbols being represented by plural sets of first and second code symbols, each set representing a respective one of the plurality of message symbols, the plural sets of first and second code symbols being arranged as a message having a predetermined sequence including at least one marker symbol and at least one data symbol, at least one of the marker symbol and the data symbol being represented by first and second code symbols incorporated in and displaced in time in the audio signal with at least one code symbol representing a different one of the message symbols being incorporated in the audio signal and positioned in time between the first and second code symbols;
accumulating sets of first and second signal values, each signal value set corresponding to a respective one of the sets of first and second code symbols and including a first signal value representing the first code symbol of the respective code symbol set and a second signal value representing the second code symbol thereof;
producing a third signal value derived from the first and second signal values;
detecting a respective one of the plurality of message symbols represented by the first and second code symbols based on the third signal value; and
detecting the message by detecting the presence of the marker symbol based on its signal value set and detecting at least one data symbol based on the detected presence of the marker symbol and the corresponding signal value set of the at least one data symbol.
19. A system for decoding predetermined message symbols of a plurality of message symbols incorporated in an audio signal, comprising:
an input device for an audio signal in which a plurality of message symbols have been incorporated so that the message symbols are inaudible when the audio signal is reproduced audibly, the plurality of message symbols being represented by plural sets of first and second code symbols, each set representing a respective one of the plurality of message symbols, the plural sets of first and second code symbols being arranged as a message having a predetermined sequence including at least one marker symbol and at least one data symbol, at least one of the marker symbol and the data symbol being represented by first and second code symbols incorporated in and displaced in time in the audio signal with at least one code symbol representing a different one of the message symbols being incorporated in the audio signal and positioned in time between the first and second code symbols; and
a digital processor in communication with the input device to receive the audio signal therefrom, the digital processor being programmed to accumulate sets of first and second signal values, each signal value set corresponding to a respective one of the sets of first and second code symbols and including a first signal value representing the first code symbol of the respective code symbol set and a second signal value representing the second code symbol thereof, the digital processor being further programmed to examine the accumulated sets of first and second signal values to detect the presence of the marker symbol based on its signal value set and to detect at least one data symbol based on the detected presence of the marker symbol and the corresponding signal value set of the at least one data symbol.
27. A system for decoding a message represented by a plurality of message symbols embedded in an audio signal, comprising:
means for receiving an audio signal in which a plurality of message symbols have been incorporated so that the message symbols are inaudible when the audio signal is reproduced audibly, the plurality of message symbols being represented by plural sets of first and second code symbols, each set representing a respective one of the plurality of message symbols, the plural sets of first and second code symbols being arranged as a message having a predetermined sequence including at least one marker symbol and at least one data symbol, at least one of the marker symbol and the data symbol being represented by first and second code symbols incorporated in and displaced in time in the audio signal with at least one code symbol representing a different one of the message symbols being incorporated in the audio signal and positioned in time between the first and second code symbols;
means for accumulating sets of first and second signal values, each signal value set corresponding to a respective one of the sets of first and second code symbols and including a first signal value representing the first code symbol of the respective code symbol set and a second signal value representing the second code symbol thereof and for producing a third signal value derived from the first and second signal values; and
means for detecting a respective one of the plurality of message symbols represented by the first and second code symbols based on the third signal value and for detecting the message by detecting the presence of the marker symbol based on its signal value set and detecting at least one data symbol based on the detected presence of the marker symbol and the corresponding signal value set of the at least one data symbol.
37. A system for decoding a message represented by a plurality of message symbols embedded in an audio signal, comprising:
an input device for an audio signal in which a plurality of message symbols have been incorporated so that the message symbols are inaudible when the audio signal is reproduced audibly, the plurality of message symbols being represented by plural sets of first and second code symbols, each set representing a respective one of the plurality of message symbols, the plural sets of first and second code symbols being arranged as a message having a predetermined sequence including at least one marker symbol and at least one data symbol, at least one of the marker symbol and the data symbol being represented by first and second code symbols incorporated in and displaced in time in the audio signal with at least one code symbol representing a different one of the message symbols being incorporated in the audio signal and positioned in time between the first and second code symbols; and
a digital processor in communication with the input device to receive the audio signal therefrom, the digital processor being programmed to accumulate sets of first and second signal values, each signal value set corresponding to a respective one of the sets of first and second code symbols and including a first signal value representing the first code symbol of the respective code symbol set and a second signal value representing the second code symbol thereof, the digital processor being further programmed to produce a third signal value derived from the first and second signal values, to detect a respective one of the plurality of message symbols represented by the first and second code symbols based on the third signal value, and to detect the message by detecting the presence of the marker symbol based on its signal value set and detecting at least one data symbol based on the detected presence of the marker symbol and the corresponding signal value set of the at least one data symbol.
2. The system of
3. The system of
4. The system of
5. The system of
6. The system of
7. The system of
9. The method of
10. The method of
12. The system of
13. The system of
29. The system of
30. The system of
34. The method of
35. The method of
39. The system of
40. The system of
0. 42. A method according to claim 41, wherein each code symbol in the first encoded sequence of code symbols corresponds to a respective code symbol in the second encoded sequence of code symbols, and wherein each code symbol in the first encoded sequence of code symbols has a frequency content which differs at least in part from a frequency content of the respective code symbol in the second encoded sequence of code symbols.
0. 43. A method according to claim 41, wherein the code symbols in the first and second encoded sequences of code symbols are selected from a predetermined set of code symbols in which the code symbols are arranged in a predetermined order, and wherein each code symbol of the second encoded sequence of code symbols corresponds to a respective code symbol of the first encoded sequence of code symbols and is selected based on the order of the respective code symbol of the first encoded sequence of code symbols.
0. 44. A method according to claim 43, wherein each code symbol of the second encoded sequence of code symbols is selected from the predetermined set of code symbols based on a predetermined offset in the predetermined order from the respective code symbol of the first encoded sequence of code symbols.
0. 45. A method according to claim 44, wherein the predetermined offset is the same for all code symbols of the second encoded sequence of code symbols.
0. 46. A method according to claim 41, wherein the code symbols of the first and second encoded sequences of code symbols are selected from a predetermined set of code symbols and wherein each code symbol in the predetermined set of code symbols comprises a combination of single-frequency code components unique among all combinations of single frequency code components of the code symbols within the predetermined set of code symbols.
0. 47. A method according to claim 41, wherein the processing device is a record device storing a recorded audio signal encoded with a predetermined message.
0. 48. A method according to claim 47, wherein each code symbol in the first encoded sequence of code symbols corresponds to a respective code symbol in the second encoded sequence of code symbols.
0. 49. A method according to claim 47, wherein the code symbols in the first and second encoded sequences of code symbols are selected from a predetermined set of code symbols in which the code symbols are arranged in a predetermined order, and wherein each code symbol of the second encoded sequence of code symbols corresponds to a respective code symbol of the first encoded sequence of code symbols and is selected based on the order of the respective code symbol of the first encoded sequence of code symbols.
0. 50. A method according to claim 49, wherein each code symbol of the second encoded sequence of code symbols is selected from the predetermined set of code symbols based on a predetermined offset in the predetermined order from the respective code symbol of the first encoded sequence of code symbols.
0. 51. A method according to claim 50, wherein the predetermined offset is the same for all code symbols of the second encoded sequence of code symbols.
0. 52. A method according to claim 47, wherein the code symbols of the first and second encoded sequences of code symbols are selected from a predetermined set of code symbols and wherein each code symbol in the predetermined set of code symbols comprises a combination of single-frequency code components unique among all combinations of single frequency code components of the code symbols within the predetermined set of code symbols.
0. 54. A method according to claim 53, wherein the processing device is a record device storing a recorded audio signal encoded with a predetermined message.
0. 56. A method according to claim 55, wherein each code symbol in the first encoded sequence of code symbols corresponds to a respective code symbol in the second encoded sequence of code symbols, and wherein each code symbol in the first encoded sequence of code symbols has a frequency content which differs at least in part from a frequency content of its respective code symbol in the second encoded sequence of code symbols.
0. 57. A method according to claim 55, wherein the code symbols in the first and second encoded sequences of code symbols are selected from a predetermined set of code symbols in which the code symbols are arranged in a predetermined order, and wherein each code symbol of the second encoded sequence of code symbols corresponds to a respective code symbol of the first encoded sequence of code symbols and is selected based on the order of the respective code symbol of the first encoded sequence of code symbols.
0. 58. A method according to claim 57, wherein each code symbol of the second encoded sequence of code symbols is selected from the predetermined set of code symbols based on a predetermined offset in the predetermined order from the respective code symbol of the first encoded sequence of code symbols.
0. 59. A method according to claim 58, wherein the predetermined offset is the same for all code symbols of the second encoded sequence of code symbols.
0. 60. A method according to claim 55, wherein the code symbols of the first and second encoded sequences of code symbols are selected from a predetermined set of code symbols and wherein each code symbol in the predetermined set of code symbols comprises a combination of single-frequency code components unique among all combinations of single frequency code components of the code symbols within the predetermined set of code signals.
0. 61. A method according to claim 55, wherein the processing device is a record device storing a recorded audio signal encoded with a predetermined message.
0. 62. A method according to claim 61, wherein each code symbol in the first encoded sequence of code symbols corresponds to a respective code symbol in the second encoded sequence of code symbols, and wherein each code symbol in the first encoded sequence of code symbols has a frequency content which differs at least in part from a frequency content of the respective code symbol in the second encoded sequence of code symbols.
0. 63. A method according to claim 61, wherein the code symbols of the first and second encoded sequences of code symbols are selected from a predetermined set of code symbols and wherein each code symbol in the predetermined set of code symbols comprises a combination of single-frequency code components unique among all combinations of single frequency code components of the code symbols within the predetermined set of code symbols.
0. 64. A method according to claim 61, wherein the code symbols in the first and second encoded sequences of code symbols are selected from a predetermined set of code symbols in which the code symbols are arranged in a predetermined order, and wherein each code symbol of the second encoded sequence of code symbols corresponds to a respective code symbol of the first encoded sequence of code symbols and is selected based on the order of the respective code symbol of the first encoded sequence of code symbols.
0. 65. A method according to claim 64, wherein each code symbol of the second encoded sequence of code symbols is selected from the predetermined set of code symbols based on a predetermined offset in the predetermined order from the respective code symbol of the first encoded sequence of code symbols.
0. 66. A method according to claim 65, wherein the predetermined offset is the same for all code symbols of the second encoded sequence of code symbols.
0. 68. A method according to claim 67, wherein the code symbols in the first and second encoded sequences of code symbols are selected from a predetermined set of code symbols in which the code symbols are arranged in a predetermined order, and wherein each code symbol of the second encoded sequence of code symbols is selected based on the predetermined order of the corresponding code symbol of the first encoded sequence of code symbols.
0. 69. A method according to claim 68, wherein each code symbol of the second encoded sequence of code symbols is selected from the predetermined set of code symbols based on a predetermined offset in the predetermined order from the corresponding code symbol of the first encoded sequence of code symbols.
0. 70. A method according to claim 69, wherein the predetermined offset is the same for all code symbols of the second encoded sequence of code symbols.
0. 71. A method according to claim 67, wherein the processing device is a record device storing a recorded audio signal encoded with a predetermined message.
0. 72. A method according to claim 71, wherein the code symbols in the first and second encoded sequences of code symbols are selected from a predetermined set of code symbols in which the code symbols are arranged in a predetermined order, and wherein each code symbol of the second encoded sequence of code symbols is selected based on the predetermined order of the corresponding code symbol of the first encoded sequence of code symbols.
0. 73. A method according to claim 72, wherein each code symbol of the second encoded sequence of code symbols is selected from the predetermined set of code symbols based on a predetermined offset in the predetermined order from the corresponding code symbol of the first encoded sequence of code symbols.
0. 74. A method according to claim 73, wherein the predetermined offset is the same for all code symbols of the second encoded sequence of code symbols.
0. 76. A method according to claim 75, wherein each code symbol of the second encoded sequence of code symbols is selected from the predetermined set of code symbols based on a predetermined offset in the predetermined order from its respective code symbol of the first encoded sequence of code symbols.
0. 77. A method according to claim 76, wherein the predetermined offset is the same for all code symbols of the second encoded sequence of code symbols.
0. 78. A method according to claim 75, wherein the processing device comprises a record device storing a recorded audio signal encoded with a predetermined message.
0. 79. A method according to claim 78, wherein each code symbol of the second encoded sequence of code symbols is selected from the predetermined set of code symbols based on a predetermined offset in the predetermined order from the respective code symbol of the first encoded sequence of code symbols.
0. 80. A method according to claim 79, wherein the predetermined offset is the same for all code symbols of the second encoded sequence of code symbols.
0. 82. A method according to claim 81, wherein the processing device comprises a record device storing a recorded audio signal encoded with a predetermined message.
0. 84. A method according to claim 83, further comprising:
encoding the audio signal with a marker symbol positioned in time adjacent at least one of the first encoded sequence of code symbols and the second encoded sequence of code symbols.
0. 85. A method according to claim 83, further comprising:
encoding the audio signal with a first marker symbol adjacent the first encoded sequence of code symbols and a second marker symbol adjacent the second encoded sequence of code symbols.
0. 86. A method according to claim 83, wherein the processing device comprises a record device storing a recorded audio signal encoded with a predetermined message.
0. 87. A method according to claim 86, further comprising:
encoding the audio signal with a marker symbol positioned in time adjacent at least one of the first encoded sequence of code symbols and the second encoded sequence of code symbols.
0. 88. A method according to claim 86, further comprising:
encoding the audio signal with a marker symbol adjacent the first encoded sequence of code symbols and adjacent the second encoded sequence of code symbols.
0. 90. An apparatus according to claim 89, wherein each code symbol in the first encoded sequence of code symbols corresponds to a respective code symbol in the second encoded sequence of code symbols.
0. 91. An apparatus according to claim 89, wherein the code symbols in the first and second encoded sequences of code symbols are selected from a predetermined set of code symbols in which the code symbols are arranged in a predetermined order, and wherein each code symbol of the second encoded sequence of code symbols corresponds to a respective code symbol of the first encoded sequence of code symbols and is selected based on the order of the respective code symbol of the first encoded sequence of code symbols.
0. 92. An apparatus according to claim 91, wherein each code symbol of the second encoded sequence of code symbols is selected from the predetermined set of code symbols based on a predetermined offset in the predetermined order from the respective code symbol of the first encoded sequence of code symbols.
0. 93. An apparatus according to claim 92, wherein the predetermined offset is the same for all code symbols of the second encoded sequence of code symbols.
0. 94. An apparatus according to claim 89, wherein the code symbols of the first and second encoded sequences of code symbols are selected from a predetermined set of code symbols and wherein each code symbol in the predetermined set of code symbols comprises a combination of single-frequency code components unique among all combinations of single frequency code components of the code symbols within the predetermined set of code symbols.
0. 97. An apparatus according to claim 96, wherein each code symbol in the first encoded sequence of code symbols corresponds to a respective code symbol in the second encoded sequence of code symbols, and wherein each code symbol in the first encoded sequence of code symbols has a frequency content which differs at least in part from a frequency content of the respective code symbol in the second encoded sequence of code symbols.
0. 98. An apparatus according to claim 96, wherein the code symbols in the first and second encoded sequences of code symbols are selected from a predetermined set of code symbols in which the code symbols are arranged in a predetermined order, and wherein each code symbol of the second encoded sequence of code symbols corresponds to a respective code symbol of the first encoded sequence of code symbols and is selected based on the order of the respective code symbol of the first encoded sequence of code symbols.
0. 99. An apparatus according to claim 98, wherein each code symbol of the second encoded sequence of code symbols is selected from the predetermined set of code symbols based on a predetermined offset in the predetermined order from the respective code symbol of the first encoded sequence of code symbols.
0. 100. An apparatus according to claim 99, wherein the predetermined offset is the same for all code symbols of the second encoded sequence of code symbols.
0. 101. An apparatus according to claim 96, wherein the code symbols of the first and second encoded sequences of code symbols are selected from a predetermined set of code symbols and wherein each code symbol in the predetermined set of code symbols comprises a combination of single-frequency code components unique among all combinations of single frequency code components of the code symbols within the predetermined set of code symbols.
0. 103. An apparatus according to claim 102, wherein the code symbols in the first and second encoded sequences of code symbols are selected from a predetermined set of code symbols in which the code symbols are arranged in a predetermined order, and wherein each code symbol of the second encoded sequence of code symbols is selected based on the predetermined order of the corresponding code symbol of the first encoded sequence of code symbols.
0. 104. An apparatus according to claim 103, wherein each code symbol of the second encoded sequence of code symbols is selected from the predetermined set of code symbols based on a predetermined offset in the predetermined order from the corresponding code symbol of the first encoded sequence of code symbols.
0. 105. An apparatus according to claim 104, wherein the predetermined offset is the same for all code symbols of the second encoded sequence of code symbols.
0. 107. An apparatus according to claim 106, wherein each code symbol of the second encoded sequence of code symbols is selected from the predetermined set of code symbols based on a predetermined offset in the predetermined order from the respective code symbol of the first encoded sequence of code symbols.
0. 108. An apparatus according to claim 107, wherein the predetermined offset is the same for all code symbols of the second encoded sequence of code symbols.
0. 111. An apparatus according to claim 110, wherein the audio signal is further encoded with a marker symbol positioned in time adjacent at least one of the first encoded sequence of code symbols and the second encoded sequence of code symbols.
0. 112. An apparatus according to claim 110, wherein the audio signal is further encoded with a first marker symbol adjacent the first encoded sequence of code symbols and a second marker symbol adjacent the second encoded sequence of code symbols.
|
This is an application to reissue U.S. Pat. No. 6,871,180 issued Mar. 22, 2005 from application Ser. No. 09/318,045 filed May 25, 1999.
The present invention relates to methods and apparatus for extracting an information signal from an encoded audio signal.
There are various motivations to permanently or indelibly incorporate information signals into audio signals, referred to as “watermarking.” Such an audio watermark may provide, for example, an indication of authorship, content, lineage, existence of copyright, or the like for the audio signals so marked. Alternatively, other information may be incorporated into audio signals either concerning the signal itself or unrelated to it. The information may be incorporated in an audio signal for various purposes, such as identification or as an address or command, whether or not related to the signal itself.
There is considerable interest in encoding audio signals with information to produce encoded audio signals having substantially the same perceptible characteristics as the original unencoded audio signals. Recent successful techniques exploit the psychoacoustic masking effect of the human auditory system whereby certain sounds are humanly imperceptible when received along with other sounds.
One particularly successful utilization of the psychoacoustic masking effect is described in U.S. Pat. No. 5,450,490 and U.S. Pat. No. 5,764,763 (Jensen et al.) in which information is represented by a multiple-frequency code signal which is incorporated into an audio signal based upon the masking ability of the audio signal. The encoded audio signal is suitable for broadcast transmission and reception as well as for recording and reproduction. When received the audio signal is then processed to detect the presence of the multiple-frequency code signal. Sometimes, only a portion of the multiple-frequency code signal, e.g., a number of single frequency code components, inserted into the original audio signal are detected in the received audio signal. If a sufficient quantity of code components is detected, the information signal itself may be recovered.
Generally, an acoustic signal having low amplitude levels will have only minimal capacity, if any at all, to acoustically mask an information signal. For example, such low amplitude levels can occur during a pause in a conversation, during an interlude between segments of music, or even within certain types of music. During a lengthy period of low amplitude levels, it may be difficult to incorporate a code signal in an audio signal without causing the encoded audio signal to differ from the original in an acoustically perceptible manner.
A further problem is the occurrence of burst errors during the transmission or reproduction of encoded audio signals. Burst errors may appear as temporally contiguous segments of signal error. Such errors generally are unpredictable and substantially affect the content of an encoded audio signal. Burst errors typically arise from failure in a transmission channel or reproduction device due to severe external interferences, such as an overlapping of signals from different transmission channels, an occurrence of system power spikes, an interruption in normal operations, an introduction of noise contamination (intentionally or otherwise), and the like. In a transmission system, such circumstances may cause a portion of the transmitted encoded audio signals to be entirely unreceivable or significantly altered. Absent retransmission of the encoded audio signal, the affected portion of the encoded audio may be wholly unrecoverable, while in other instances alterations to the encoded audio signal may render the embedded information signal undetectable. In many applications, such as radio and television broadcasting, real-time retransmission of encoded audio signals is simply unfeasible.
In systems for acoustically reproducing audio signals recorded on media, a variety of factors may cause burst errors in the reproduced acoustic signal. Commonly, an irregularity in the recording media, caused by damage, obstruction, or wear, results in certain portions of recorded audio signals being unreproducable or significantly altered upon reproduction. Also, misalignment of or interference with the recording or reproducing mechanism relative to the recording medium can cause burst-type errors during an acoustic reproduction of recorded audio signals. Further, the acoustic limitations of a speaker as well as the acoustic characteristics of the listening environment may result in spatial irregularities in the distribution of acoustic energy. Such irregularities may cause burst errors to occur in received acoustic signals, interfering with code recovery.
Therefore, an object of the present invention is to provide systems and methods for detecting code symbols in audio signals which alleviate the problems caused by periods of low signal levels and burst errors.
It is another object of the invention to provide such systems and methods which afford reliable operation under adverse conditions.
It is a further object of the invention to provide such systems and methods which are robust.
In accordance with an aspect of the present invention, systems and methods are provided for decoding at least one message symbol represented by a plurality of code symbols in an audio signal. The systems and methods comprise the means for and the steps of, respectively, receiving first and second code symbols representing a common message symbol, the first and second code symbols being displaced in time in the audio signal, accumulating a first signal value representing the first code symbol and a second signal value representing the second code symbol, and examining the accumulated first and second signal values to detect the common message symbol.
In accordance with another aspect of the present invention, a system is provided for decoding at least one message symbol represented by a plurality of code symbols in an audio signal. The system comprises, an input device for receiving first and second code symbols representing a common message symbol, the first and second code symbols being displaced in time in the audio signal; and a digital processor in communication with the input device to receive data therefrom representing the first and second code symbols, the digital processor being programmed to accumulate a first signal value representing the first code symbol and a second signal value representing the second code symbol, the digital processor being further programmed to examine the accumulated first and second signal values to detect the common message symbol.
In certain embodiments, the first and second signal values are accumulated by storing the values separately and the common message symbol is detected by examining both of the separately stored values. The first and second signal values may represent signal values derived from multiple other signal values, such as values of individual code frequency components, or a single signal value, such as a measure of the magnitude of a single code frequency component. Moreover, a derived value may be obtained as a linear combination of multiple signal values, such as a summation of weighted or unweighted values, or as a non-linear function thereof.
In further embodiments, the first and second signal values are accumulated by producing a third signal value derived from the first and second values. The third signal value in some embodiments is derived through a linear combination of the first and second signal values, such as a weighted or unweighted summation thereof, or as a nonlinear function thereof.
Other objects, features, and advantages according to the present invention will become apparent from the following detailed description of certain advantageous embodiments when read in conjunction with the accompanying drawings in which the same components are identified by the same reference numerals.
The present invention relates to the use of especially robust encoding which converts information into redundant sequences of code symbols. In certain embodiments, each code symbol is represented by a set of different, predetermined single-frequency code signals; however, in other embodiments different code symbols may optionally share certain single-frequency code signals or may be provided by a methodology which does not assign predetermined frequency components to a given symbol. The redundant sequence of symbols is incorporated into the audio signals to produce encoded audio signals that are unnoticed by the listener but nevertheless recoverable.
The redundant code symbol sequence is especially suited for incorporation into audio signals having low masking capacity, such as audio signals having many low amplitude portions or the like. Additionally, when incorporated into audio signals, the redundant sequence of code symbols resists degradation by burst errors which affect temporally contiguous audio signals. As described hereinabove, such errors may be the result of imperfect audio signal recording, reproduction, and/or storage processes, transmission of the audio signals through a lossy and/or noisy channel, irregularities in an acoustic environment, or the like.
To recover the encoded information in certain advantageous embodiments, the encoded audio signals are examined in an attempt to detect the presence of predetermined single-frequency code components. During the encoding process, some single-frequency code components may not have been incorporated into the audio signals in certain signal intervals due to insufficient masking capacity in the audio signals in these intervals. Burst errors which have corrupted portions of the encoded audio signals can result in the deletion of certain code signals from the encoded audio signals or in the insertion of erroneous signals, such as noise, into the encoded audio signals. Thus, examination of the encoded audio signals is likely to reveal a much distorted version of the original sequence of sets of single-frequency code signals that represented the information.
The single-frequency code components that are recovered, along with the erroneous additional signals that are mistakenly detected as code signals, are processed to discern the original sequence of code symbols, if possible. The code signal detection and processing operations are specifically adapted to exploit the strengths of the encoding methodology. As a result, the detection and processing methodology of the present invention provides improved error tolerance.
The symbol generation function 12, when employed, translates an information signal into a set of code symbols. This function may be carried out with the use of a memory device, such as a semiconductor EPROM of the computer system, which is prestored with a table of code symbols suitable for indexing with respect to an information signal. An example of a table for translating an information signal into a code symbol for certain applications is shown in
The symbol sequence generating function 14 formats the symbols produced by the symbol generating function (or input directly to the encoder 10) into a redundant sequence of code or information symbols. As part of the formatting process, in certain embodiments marker and/or synchronization symbols are added to the sequence of code symbols. The redundant sequence of code symbols is designed to be especially resistant to burst errors and audio signal encoding processes. Further explanation of redundant sequences of code symbols in accordance with certain embodiments will be provided in connection with the discussion of
As noted above, the symbol sequence generating function 14 is optional. For example, the encoding process may be carried out such that the information signal is translated directly into a predetermined symbol sequence, without implementing separate symbol generating and symbol sequence generating functions.
Each symbol of the sequence of symbols thus produced is converted by the symbol encoding function 16 into a plurality of single-frequency code signals. In certain advantageous embodiments the symbol encoding function is performed by means of a memory device of the computer system, such as a semiconductor EPROM, which is prestored with sets of single-frequency code signals that correspond to each symbol. An example of a table of symbols and corresponding sets of single-frequency code signals is shown in
Alternatively, the sets of code signals may be stored on a hard drive or other suitable storage device of the computer system. The encoding function may also be implemented by one or more discrete components, such as an EPROM and associated control devices, by a logic array, by an application specific integrated circuit or any other suitable device or combination of devices. The encoding function may also be carried out by one or more devices which also implement one or more of the remaining functions illustrated in
In the alternative, the encoded sequence may be generated directly from the information signal, without implementing the separate functions 12, 14, and 16.
The acoustic masking effect evaluation/adjustment function 18 determines the capacity of an input audio signal to mask single-frequency code signals produced by the symbol encoding function 16. Based upon a determination of the masking ability of the audio signal, the function 18 generates adjustment parameters to adjust the relative magnitudes of the single-frequency code signals so that such code signals will be rendered inaudible by a human listener when incorporated into the audio signal. Where the audio signal is determined to have low masking capacity, due to low signal amplitude or other signal characteristics, the adjustment parameters may reduce the magnitudes of certain code signals to extremely-low levels or may nullify such signals entirely. Conversely, where the audio signal is determined to have a greater masking capacity, such capacity may be utilized through the generation of adjustment parameters that increase the magnitudes of particular code signals. Code signals having increased magnitudes are generally more likely to be distinguishable from noise and thus detectable by a decoding device. Further details of certain advantageous embodiments of such evaluation/adjustment function are set forth in U.S. Pat. No. 5,764,763 and U.S. Pat. No. 5,450,490 to Jensen, et al., each entitled Apparatus and Methods for Including Codes in Audio Signals and Decoding, which are incorporated herein by reference in their entirety.
In certain embodiments, the function 18 applies the adjustment parameters to the single-frequency code signals to produce adjusted single-frequency code signals. The adjusted code signals are included in the audio signal by the function 20. Alternatively, the function 18 supplies the adjustment parameters along with the single-frequency code signals for adjustment and inclusion in the audio signal by the function 20. In still other embodiments, the function 18 is combined with one or more of the functions 12, 14, and 16 to produce magnitude-adjusted single-frequency code signals directly.
In certain embodiments, the acoustic masking effect evaluation/adjustment function 18 is implemented in a processing device, such as a microprocessor system which may also implement one or more of the additional functions illustrated in
The code inclusion function 20 combines the single-frequency code components with the audio signal to produce an encoded audio signal. In a straightforward implementation, the function 20 simply adds the single-frequency code signals directly to the audio signal. However, the function 20 may overlay the code signals upon the audio signal. Alternatively, modulator 20 may modify the amplitudes of frequencies within the audio signal according to an input from acoustic masking effect evaluation function 18 to produce an encoded audio signal that includes the adjusted code signals. Moreover, the code inclusion function may be carried out either in the time domain or in the frequency domain. The code inclusion function 20 may be implemented by means of an adding circuit, or by means of a processor. This function may also be implemented by one or more devices described above which also implement one or more of the remaining functions illustrated in
One or more of the functions 12 through 20 may be implemented by a single device. In certain advantageous embodiments, the functions 12, 14, 16 and 18 are implemented by a single processor, and in still others a single processor carries out all of the functions illustrated in
Generalizing from this example, an input set of N symbols, S1, S2, S3, . . . , SN−1, SN, is represented by the redundant symbol sequence comprising SA, S1, S2, S3, . . . SN−1, SN, followed by (P−1) repeating segments comprising SB, S1, S2, S3, . . . SN−1, SN. As in the example, this core unit may itself be repeated to increase survivability. In addition, the sequence of symbols in the message segments may be varied from segment to segment so long as the decoder is arranged to recognize corresponding symbols in the various segments. Moreover, different sequence or marker symbols and combinations thereof may be employed, and the positions of the markers with respect to the data symbols may be arranged differently. For example, the sequence can take the form, S1 . . . , S2, . . . , SA, . . . , SN or the form, S1, S2. . . , SN, SA.
Generalizing from this example, an input set of N symbols, S1, S2, S3, . . . SN−1, SN, is represented by the redundant symbol sequence comprising SA, S1, S2, S3, . . . SN−1, SN, SB, S(1+β) mod M, S(2+β) mod M, S(3+β) mod M, . . . S(N−1+β) mod M, S(N+β)mod M. That is, the same information is represented by two or more different symbols in the same core unit and recognized according to their order therein. In addition, these core units may themselves be repeated to increase survivability. Since the same information is represented by multiple different symbols, the coding is made substantially more robust. For example, the structure of an audio signal can mimic the frequency component of one of the data symbols SN, but the likelihood that the audio signal will also mimic its corresponding offset S(N+β) mod M at its predetermined occurrence is very much lower. Also, since the offset is the same for all symbols within a given segment, this information provides a further check on the validity of the detected symbols within that segment. Consequently, the encoding format of
A particular strength of the redundant sequence exemplified in
The table of
Recording facility 54 includes apparatus for receiving and encoding audio signals and recording encoded audio signals upon a storage medium. Specifically, facility 54 includes audio signal encoder 58 and audio signal recorder 62. Audio signal encoder 58 receives an audio signal feed 52 and a recording information signal 56 and encodes audio signal 52 with information signal 56 to produce an encoded audio signal 60. Audio signal feed 52 may be produced by any conventional source of audio signals such as a microphone, an apparatus for reproducing recorded audio signals, or the like. Recording information signal 56 preferably comprises information regarding audio signal feed 52, such as its authorship, content, or lineage, or the existence of copyright, or the like. Alternatively, recording information signal 56 may comprise any type of data.
Recorder 62 is a conventional device for recording encoded audio signals 60 upon a storage medium which is suitable for distribution to one or more broadcasters 66. Alternatively, audio signal recorder 62 may be omitted entirely. Encoded audio signals 60 may be distributed via distribution of the recorded storage media or via a communication link 64. Communication link 64 extends between recording facility 54 and broadcaster 66 and may comprise a broadcast channel, a microwave link, a wire or fiber optic connection, or the like.
Broadcaster 66 is a broadcasting station that receives encoded audio signals 60, further encodes such signals 60 with a broadcaster information signal 68 to produce a twice-encoded audio signal 72, and broadcasts the twice-encoded audio signal 72 along a transmission path 74. Broadcaster 66 includes an audio signal encoder 70 which receives encoded audio signal 60 from recording facility 54 and a broadcaster information signal 68. Broadcaster information signal 68 may comprise information regarding broadcaster 66, such as an identification code, or regarding the broadcasting process, such as the time, date or characteristics of the broadcast, the intended recipient(s) of the broadcast signal, or the like. Encoder 70 encodes encoded audio signal 60 with information signal 68 to produce twice-encoded audio signal 72. Transmission path 74 extends between broadcaster 66 and relay station 76 may comprise a broadcast channel, a microwave link, a wire or fiber optic connection, or the like.
Relay station 76 receives a twice-encoded audio signal 72 from broadcaster 66, further encodes that signal with a relay station information signal 78, and transmits the thrice-encoded audio signal 82 to a listener facility 86 via a transmission path 84. Relay station 76 includes an audio signal encoder 80 which receives twice-encoded audio signal 72 from broadcaster 66 and a relay station information signal 78. Relay station information signal 78 preferably comprises information regarding relay station 76, such as an identification code, or regarding the process of relaying the broadcast signal, such as the time, date or characteristics of the relay, the intended recipient(s) of the relayed signal, or the like. Encoder 80 encodes twice-encoded audio signal 72 with relay station information signal 78 to produce thrice-encoded audio signal 82. Transmission path 84 extends between relay station 76 and listener facility 86 and may comprise a broadcast channel, a microwave link, a wire or fiber optic connection, or the like. Optionally, transmission path 84 may be an acoustic transmission path.
Listener facility 86 receives thrice-encoded audio signal 82 from relay station 76. In audience estimate applications, listener facility 86 is located where a human listener may perceive an acoustic reproduction of audio signal 82. If audio signal 82 is transmitted as an electromagnetic signal, listener facility 86 preferably includes a device for acoustically reproducing that signal for the human listener. However, if audio signal 82 is stored upon a storage medium, listener facility 86 preferably includes a device for reproducing signal 82 from the storage medium.
In other applications, such as music identification and commercial monitoring, a monitoring facility is employed rather than listener 86. In such a monitoring facility, the audio signal 82 preferably is processed to receive the encoded message without acoustic reproduction.
Audio signal decoder 88 may receive thrice encoded audio signal 82 as an audio signal or, optionally, as an acoustic signal. Decoder 88 decodes audio signal 82 to recover one or more of the information signals encoded therein. Preferably, the recovered information signal(s) are processed at listener facility 86 or recorded on a storage medium for later processing.
Alternatively, the recovered information signal(s) may be converted into images for visual display to the listener.
In an alternate embodiment, recording facility 54 is omitted from system 50. Audio signal feed 52, representing, for example, a live audio performance, is provided directly to broadcaster 66 for encoding and broadcast. Accordingly, broadcaster information signal 68 may further comprise information regarding audio signal feed 52, such as its authorship, content, or lineage, or the existence of copyright, or the like.
In another alternate embodiment, relay station 76 is omitted from system 50. Broadcaster 66 provides twice-encoded audio signal 72 directly to listener 86 via transmission path 74 which is modified to extend therebetween. As a further alternative, both recording facility 54 and relay station 76 may be omitted from system 50.
In another alternate embodiment, broadcaster 66 and relay station 76 are omitted from system 50. Optionally, communication link 64 is modified to extend between recording facility 54 and listener facility 86 and to carry encoded audio signal 60 therebetween. Preferably, audio signal recorder 62 records encoded audio signal 60 upon a storage medium which is thereafter conveyed to listener facility 86. An optional reproduction device at listener facility 86 reproduces the encoded audio signal from the storage medium for decoding and/or acoustic reproduction.
A microphone 93 is within the housing 92 and serves as an acoustic transducer to transduce received acoustic energy, including encoded audio signals, to analog electrical signals. The analog signals are converted to digital by an analog to digital converter and the digital signals are then supplied to a digital signal processor (DSP) 95. The DSP 95 implements a decoder in accordance with the present invention in order to detect the presence of predetermined codes in the audio energy received by the microphone 93 indicating that the person carrying the personal portable meter 90 has been exposed to a broadcast of a certain station or channel. If so, the DSP 95 stores a signal representing such detection in its internal memory along with an associated time signal.
The meter 90 also includes a data transmitter/receiver, such as an infrared transmitter/receiver 97 coupled with the DSP 95. The transmitter/receiver 97 enables the DSP 95 to provide its data to a facility for processing such data from multiple meters 90 to produce audience estimates, as well as to receive instructions and data, for example, to set up the meter 90 for carrying out a new audience survey.
Decoders in accordance with certain advantageous embodiments of the present invention are illustrated by the functional block diagram of
For received audio signals in the time domain, the decoder 100 transforms such signals to the frequency domain by means of a function 106. The function 106 preferably is performed by a digital processor implementing a fast Fourier transform (FFT) although a direct cosine transform, a chirp transform or a Winograd transform algorithm (WFTA) may be employed in the alternative. Any other time-to-frequency-domain transformation function providing the necessary resolution may be employed in place of these. It will be appreciated that in certain implementations, the function 106 may also be carried out by analog or digital filters, by an application specific integrated circuit, or any other suitable device or combination of devices. The function 106 may also be implemented by one or more devices which also implement one or more of the remaining functions illustrated in
The frequency domain-converted audio signals are processed in a symbol values derivation function 110, to produce a stream of symbol values for each code symbol included in the received audio signal. The produced symbol values may represent, for example, signal energy, power, sound pressure level, amplitude, etc., measured instantaneously or over a period of time, on an absolute or relative scale, and may be expressed as a single value or as multiple values. Where the symbols are encoded as groups of single frequency components each having a predetermined frequency, the symbol values preferably represent either single frequency component values or one or more values based on single frequency component values.
The function 110 may be carried out by a digital processor, such as a digital signal processor (DSP) which advantageously carries out some or all of the other functions of decoder 100. However, the function 110 may also be carried out by an application specific integrated circuit, or by any other suitable device or combination of devices, and may be implemented by apparatus apart from the means which implement the remaining functions of the decoder 100.
The stream of symbol values produced by the function 110 are accumulated over time in an appropriate storage device on a symbol-by-symbol basis, as indicated by the function 116. In particular, the function 116 is advantageous for use in decoding encoded symbols which repeat periodically, by periodically accumulating symbol values for the various possible symbols. For example, if a given symbol is expected to recur every X seconds, the function 116 may serve to store a stream of symbol values for a period of nX seconds (n>1), and add to the stored values of one or more symbol value streams of nX seconds duration, so that peak symbol values accumulate over time, improving the signal-to-noise ratio of the stored values.
The function 116 may be carried out by a digital processor, such as a DSP, which advantageously carries out some or all of the other functions of decoder 100. However, the function 110 may also be carried out using a memory device separate from such a processor, or by an application specific integrated circuit, or by any other suitable device or combination of devices, and may be implemented by apparatus apart from the means which implements the remaining functions of the decoder 100.
The accumulated symbol values stored by the function 116 are then examined by the function 120 to detect the presence of an encoded message and output the detected message at an output 126. The function 120 can be carried out by matching the stored accumulated values or a processed version of such values, against stored patterns, whether by correlation or by another pattern matching technique. However, the function 120 advantageously is carried out by examining peak accumulated symbol values and their relative timing, to reconstruct their encoded message. This function may be carried out after the first stream of symbol values has been stored by the function 116 and/or after each subsequent stream has been added thereto, so that the message is detected once the signal-to-noise ratios of the stored, accumulated streams of symbol values reveal a valid message pattern.
The decoder of
In order to separate the various components, the DSP repeatedly carries out FFTs on audio signal samples falling within successive, predetermined intervals. The intervals may overlap, although this is not required. In an exemplary embodiment, ten overlapping FFT's are carried out during each second of decoder operation. Accordingly, the energy of each symbol period falls within five FFT periods. The FFT's may be windowed, although this may be omitted in order to simplify the decoder. The samples are stored and, when a sufficient number are thus available, a new FFT is performed, as indicated by steps 134 and 138.
In this embodiment, the frequency component values are produced on a relative basis. That is, each component value is represented as a signal-to-noise ratio (SNR), produced as follows. The energy within each frequency bin of the FFT in which a frequency component of any symbol can fall provides the numerator of each corresponding SNR Its denominator is determined as an average of adjacent bin values. For example, the average of seven of the eight surrounding bin energy values may be used, the largest value of the eight being ignored in order to avoid the influence of a possible large bin energy value which could result, for example, from an audio signal component in the neighborhood of the code frequency component. Also, given that a large energy value could also appear in the code component bin, for example, due to noise or an audio signal component, the SNR is appropriately limited. In this embodiment, if SNR=>6.0, then SNR is limited to 6.0, although a different maximum value may be selected.
The ten SNR's of each FFT and corresponding to each symbol which may be present, are combined to form symbol SNR's which are stored in a circular symbol SNR buffer, as indicated in step 142 and illustrated schematically in
As indicated by
When the symbol SNR buffer is filled, this is detected in a step 146. In certain advantageous embodiments, the stored SNR's are adjusted to reduce the influence of noise in a step 152, although this step is optional in many applications. In this optional step, a noise value is obtained for each symbol (row) in the buffer by obtaining the average of all stored symbol SNR's in the respective row each time the buffer is filled. Then, to compensate for the effects of noise, this average or “noise” value is subtracted from each of the stored symbol SNR values in the corresponding row. In this manner, a “symbol” appearing only briefly, and thus not a valid detection, is averaged out over time. Referring also to
After the symbol SNR's have been adjusted by subtracting the noise level, the decoder attempts to recover the message by examining the pattern of maximum SNR values in the buffer in a step 156. In certain embodiments, the maximum SNR values for each symbol are located in a process of successively combining groups of five adjacent SNR's, by weighting the values in the sequence in proportion to the sequential weighting (6 10 10 10 6) and then adding the weighted SNR's to produce a comparison SNR centered in the time period of the third SNR in the sequence. This process is carried out progressively throughout the fifty FFT periods of each symbol. For example, a first group of five SNR's for the “A” symbol in FFT periods 1 through 5 are weighted and added to produce a comparison SNR for FFT period 3. Then a further comparison SNR is produced using the SNR's from FFT periods 2-6, and so on until comparison values have been obtained centered on FFT periods 3 through 48. However, other means may be employed for recovering the message. For example, either more or less than five SNR's may be combined, they may be combined without weighing, or they may be combined in a non-linear fashion.
After the comparison SNR values have been obtained, the decoder examines the comparison SNR values for a message pattern. First, the marker code symbols SA and SB are located. Once this information is obtained, the decoder attempts to detect the peaks of the data symbols. The use of a predetermined offset between each data symbol in the first segment and the corresponding data symbol in the second segment provides a check on the validity of the detected message. That is, if both markers are detected and the same offset is observed between each data symbol in the first segment and its corresponding data symbol in the second segment, it is highly likely that a valid message has been received.
With reference both to
However, if the message is not thus found, a further fifty overlapping FFT's are carried out on the following portions of the audio signal and the symbol SNR's so produced are added to those already in the circular buffer. The noise adjustment process is carried out as before and the decoder attempts to detect the message pattern again. This process is repeated continuously until a message is detected. In the alternative, the process may be carried out a limited number of times.
It will be apparent from the foregoing to modify the operation of the decoder depending on the structure of the message, its timing, its signal path, the mode of its detection, etc., without departing from the scope of the present invention. For example, in place of storing SNR's, FFT results may be stored directly for detecting a message.
Steps employed in the decoding process illustrated in
As indicated in step 174, once the circular buffer is fill, its contents are examined in a step 178 to detect the presence of the message pattern. Once full, the buffer remains full continuously, so that the pattern search of step 178 may be carried out after every FFT.
Since each five symbol message repeats every 2½ seconds, each symbol repeats at intervals of 2½ seconds or every 25 FFT's. In order to compensate for the effects of burst errors and the like, the SNR's R1 through R150 are combined by adding corresponding values of the repeating messages to obtain 25 combined SNR values SNRn, n=1, 2 . . . 25, as follows:
Accordingly, if a burst error should result in the loss of a signal interval i, only one of the six message intervals will have been lost, and the essential characteristics of the combined SNR values are likely to be unaffected by this event.
Once the combined SNR values have been determined, the decoder detects the position of the marker symbol's peak as indicated by the combined SNR values and derives the data symbol sequence based on the marker's position and the peak values of the data symbols.
Once the message has thus been formed, as indicated in steps 182 and 183, the message is logged. However, unlike the embodiment of
As in the decoder of
In a further variation which is especially useful in audience measurement applications, a relatively large number of message intervals are separately stored to permit a retrospective analysis of their contents to detect a channel change. In another embodiment, multiple buffers are employed, each accumulating data for a different number of intervals for use in the decoding method of
Although illustrative embodiments of the present invention and modifications thereof have been described in detail herein, it is to be understood that this invention is not limited to these precise embodiments and modifications, and that other modifications and variations may be effected therein by one skilled in the art without departing from the scope and spirit of the invention as defined by the appended claims.
Lynch, Wendell D., Jensen, James M., Neuhauser, Alan R.
Patent | Priority | Assignee | Title |
10003846, | May 01 2009 | CITIBANK, N A | Methods, apparatus and articles of manufacture to provide secondary content in association with primary broadcast media content |
10008212, | Apr 17 2009 | CITIBANK, N A | System and method for utilizing audio encoding for measuring media exposure with environmental masking |
10115404, | Jul 24 2015 | TLS CORP | Redundancy in watermarking audio signals that have speech-like properties |
10134408, | Oct 24 2008 | CITIBANK, N A | Methods and apparatus to perform audio watermarking and watermark detection and extraction |
10148317, | Dec 31 2007 | CITIBANK, N A | Methods and apparatus to monitor a media presentation |
10152980, | Jul 24 2015 | TLS CORP. | Inserting watermarks into audio signals that have speech-like properties |
10347263, | Jul 24 2015 | TLS CORP. | Inserting watermarks into audio signals that have speech-like properties |
10348427, | Apr 14 2015 | TLS CORP. | Optimizing parameters in deployed systems operating in delayed feedback real world environments |
10356471, | Oct 21 2005 | CITIBANK, N A | Methods and apparatus for metering portable media players |
10467286, | Oct 24 2008 | CITIBANK, N A | Methods and apparatus to perform audio watermarking and watermark detection and extraction |
10555048, | May 01 2009 | CITIBANK, N A | Methods, apparatus and articles of manufacture to provide secondary content in association with primary broadcast media content |
10580421, | Nov 12 2007 | CITIBANK, N A | Methods and apparatus to perform audio watermarking and watermark detection and extraction |
10715214, | Dec 31 2007 | CITIBANK, N A | Methods and apparatus to monitor a media presentation |
10741190, | Jan 29 2008 | CITIBANK, N A | Methods and apparatus for performing variable block length watermarking of media |
10785519, | Mar 27 2006 | CITIBANK, N A | Methods and systems to meter media content presented on a wireless communication device |
10964333, | Nov 12 2007 | CITIBANK, N A | Methods and apparatus to perform audio watermarking and watermark detection and extraction |
11004456, | May 01 2009 | CITIBANK, N A | Methods, apparatus and articles of manufacture to provide secondary content in association with primary broadcast media content |
11057674, | Oct 21 2005 | CITIBANK, N A | Methods and apparatus for metering portable media players |
11256740, | Oct 24 2008 | CITIBANK, N A | Methods and apparatus to perform audio watermarking and watermark detection and extraction |
11386908, | Oct 24 2008 | CITIBANK, N A | Methods and apparatus to perform audio watermarking and watermark detection and extraction |
11418233, | Dec 31 2007 | The Nielsen Company (US), LLC | Methods and apparatus to monitor a media presentation |
11557304, | Jan 29 2008 | The Nielsen Company (US), LLC | Methods and apparatus for performing variable block length watermarking of media |
11562752, | Nov 12 2007 | The Nielsen Company (US), LLC | Methods and apparatus to perform audio watermarking and watermark detection and extraction |
11683070, | Dec 31 2007 | The Nielsen Company (US), LLC | Methods and apparatus to monitor a media presentation |
11809489, | Oct 24 2008 | The Nielsen Company (US), LLC | Methods and apparatus to perform audio watermarking and watermark detection and extraction |
11882333, | Oct 21 2005 | The Nielsen Company (US), LLC | Methods and apparatus for metering portable media players |
11948588, | May 01 2009 | CITIBANK, N A | Methods, apparatus and articles of manufacture to provide secondary content in association with primary broadcast media content |
11961527, | Nov 12 2007 | The Nielsen Company (US), LLC | Methods and apparatus to perform audio watermarking and watermark detection and extraction |
8508357, | Nov 26 2008 | CITIBANK, N A | Methods and apparatus to encode and decode audio for shopper location and advertisement presentation tracking |
8768005, | Dec 05 2013 | TLS CORP | Extracting a watermark signal from an output signal of a watermarking encoder |
8768710, | Dec 05 2013 | TLS CORP | Enhancing a watermark signal extracted from an output signal of a watermarking encoder |
8768713, | Mar 15 2010 | CITIBANK, N A | Set-top-box with integrated encoder/decoder for audience measurement |
8768714, | Dec 05 2013 | TLS CORP | Monitoring detectability of a watermark message |
8918326, | Dec 05 2013 | TLS CORP | Feedback and simulation regarding detectability of a watermark message |
8930003, | Dec 31 2007 | CITIBANK, N A | Data capture bridge |
8935171, | Dec 05 2013 | TLS CORP | Feedback and simulation regarding detectability of a watermark message |
9054820, | Jun 20 2003 | CITIBANK, N A | Signature-based program identification apparatus and methods for use with digital broadcast systems |
9100132, | Jul 26 2002 | CITIBANK, N A | Systems and methods for gathering audience measurement data |
9130685, | Apr 14 2015 | TLS CORP. | Optimizing parameters in deployed systems operating in delayed feedback real world environments |
9245309, | Dec 05 2013 | TLS CORP | Feedback and simulation regarding detectability of a watermark message |
9336784, | Jul 31 2013 | CITIBANK, N A | Apparatus, system and method for merging code layers for audio encoding and decoding and error correction thereof |
9454343, | Jul 20 2015 | TLS CORP.; TLS CORP | Creating spectral wells for inserting watermarks in audio signals |
9460730, | Nov 12 2007 | CITIBANK, N A | Methods and apparatus to perform audio watermarking and watermark detection and extraction |
9514135, | Oct 21 2005 | CITIBANK, N A | Methods and apparatus for metering portable media players |
9614881, | Dec 31 2007 | CITIBANK, N A | Methods and apparatus to monitor a media presentation |
9626977, | Jul 24 2015 | TLS CORP.; TLS CORP | Inserting watermarks into audio signals that have speech-like properties |
9667365, | Oct 24 2008 | CITIBANK, N A | Methods and apparatus to perform audio watermarking and watermark detection and extraction |
9711152, | Jul 31 2013 | CITIBANK, N A | Systems apparatus and methods for encoding/decoding persistent universal media codes to encoded audio |
9742511, | Apr 14 2015 | TLS. Corp | Optimizing parameters in deployed systems operating in delayed feedback real world environments |
9769294, | Mar 15 2013 | CITIBANK, N A | Methods, apparatus and articles of manufacture to monitor mobile devices |
9824694, | Dec 05 2013 | TLS CORP. | Data carriage in encoded and pre-encoded audio bitstreams |
9865272, | Jul 24 2015 | TLS. Corp. | Inserting watermarks into audio signals that have speech-like properties |
9947327, | Jan 29 2008 | CITIBANK, N A | Methods and apparatus for performing variable block length watermarking of media |
9972332, | Nov 12 2007 | CITIBANK, N A | Methods and apparatus to perform audio watermarking and watermark detection and extraction |
ER7688, |
Patent | Priority | Assignee | Title |
2470240, | |||
2573279, | |||
2630525, | |||
2660511, | |||
2660662, | |||
2662168, | |||
2766374, | |||
3004104, | |||
3397402, | |||
3492577, | |||
3760275, | |||
3803349, | |||
3845391, | |||
3919479, | |||
4025851, | Nov 28 1975 | A.C. Nielsen Company | Automatic monitor for programs broadcast |
4225967, | Jan 09 1978 | Fujitsu Limited | Broadcast acknowledgement method and system |
4230990, | Mar 16 1979 | JOHN G LERT, JR | Broadcast program identification method and system |
4238849, | Dec 22 1977 | NOKIA DEUTSCHLAND GMBH | Method of and system for transmitting two different messages on a carrier wave over a single transmission channel of predetermined bandwidth |
4306308, | Sep 14 1979 | L-3 Communications Corporation | Symbols communication system |
4425642, | Jan 08 1982 | APPLIED SPECTRUM TECHNOLOGIES, INC | Simultaneous transmission of two information signals within a band-limited communications channel |
4450531, | Sep 10 1982 | ENSCO, INC.; ENSCO INC | Broadcast signal recognition system and method |
4547804, | Mar 21 1983 | NIELSEN MEDIA RESEARCH, INC , A DELAWARE CORP | Method and apparatus for the automatic identification and verification of commercial broadcast programs |
4554669, | Jun 18 1982 | Thomson CSF | Frequency jump radiocommunications system with interburst redundancy |
4599732, | Apr 17 1984 | Harris Corporation | Technique for acquiring timing and frequency synchronization for modem utilizing known (non-data) symbols as part of their normal transmitted data format |
4613904, | Mar 15 1984 | ARBITRON INC | Television monitoring device |
4618995, | Nov 09 1983 | Automatic system and method for monitoring and storing radio user listening habits | |
4626904, | Nov 12 1985 | ARBITRON INC | Meter for passively logging the presence and identity of TV viewers |
4639779, | Mar 21 1983 | NIELSEN MEDIA RESEARCH, INC , A DELAWARE CORP | Method and apparatus for the automatic identification and verification of television broadcast programs |
4677466, | Jul 29 1985 | NIELSEN MEDIA RESEARCH, INC , A DELAWARE CORP | Broadcast program identification method and apparatus |
4697209, | Apr 26 1984 | NIELSEN MEDIA RESEARCH, INC , A DELAWARE CORP | Methods and apparatus for automatically identifying programs viewed or recorded |
4703476, | Sep 16 1983 | ASONIC DATA SERVICES, INC | Encoding of transmitted program material |
4718106, | May 12 1986 | PRETESTING COMPANY, INC , THE | Survey of radio audience |
4739398, | May 02 1986 | ARBITRON INC ; ARBITRON, INC A DELAWARE CORPORATION | Method, apparatus and system for recognizing broadcast segments |
4771455, | May 17 1982 | Sony Corporation | Scrambling apparatus |
4805020, | Mar 21 1983 | NIELSEN MEDIA RESEARCH, INC , A DELAWARE CORP | Television program transmission verification method and apparatus |
4843562, | Jun 24 1987 | BROADCAST DATA SYSTEMS LIMITED PARTNERSHIP, 1515 BROADWAY, NEW YORK, NEW YORK 10036, A DE LIMITED PARTNERSHIP | Broadcast information classification system and method |
4876617, | May 06 1986 | MEDIAGUIDE HOLDINGS, LLC | Signal identification |
4918730, | Jun 24 1987 | TELEVOTUM GESELLSCHAFT ZUR VERMITTLUNG UND VERWERTUNG VON TELEKOMMUNICATIONSDIENSTEN MBH; MEDICOR GMBH EDV-SERVICE UN DATENERFASSUNG | Process and circuit arrangement for the automatic recognition of signal sequences |
4930011, | Aug 02 1988 | NIELSEN MEDIA RESEARCH, INC , A DELAWARE CORP | Method and apparatus for identifying individual members of a marketing and viewing audience |
4942607, | Feb 03 1987 | Deutsche Thomson-Brandt GmbH | Method of transmitting an audio signal |
4943973, | Mar 31 1989 | AT&T Company; AT&T INFORMATION SYSTEMS INC , 100 SOUTHGATE PARKWAY, MORRISTOWN, NJ 07960, A CORP OF DE; AMERICAN TELEPHONE AND TELEGRAPH COMPANY, 550 MADISON AVE , NEW YORK, NY 10022-3201, A CORP OF NY | Spread-spectrum identification signal for communications system |
4945412, | Jun 14 1988 | ADVERTISING VERIFICATION INC | Method of and system for identification and verification of broadcasting television and radio program segments |
4955070, | Jun 29 1988 | VIEWFACTS, INC , A CORPORATION OF DE | Apparatus and method for automatically monitoring broadcast band listening habits |
4967273, | Apr 15 1985 | NIELSEN MEDIA RESEARCH, INC , A DELAWARE CORP | Television program transmission verification method and apparatus |
4972471, | May 15 1989 | Encoding system | |
5023929, | Sep 15 1988 | NPD Research, Inc. | Audio frequency based market survey method |
5113437, | Oct 25 1988 | MEDIAGUIDE HOLDINGS, LLC | Signal identification system |
5191593, | May 31 1991 | MOTOROLA, INC , A CORPORATION OF DELAWARE | Conference call feature for spread spectrum cordless telephone |
5213337, | Jul 06 1988 | RPX Corporation | System for communication using a broadcast audio signal |
5214788, | May 10 1989 | Thomson - CSF | Process and device for information transmission between radioelectric transceivers of the same network operating in frequency hopping |
5214793, | Mar 15 1991 | Pulse-Com Corporation | Electronic billboard and vehicle traffic control communication system |
5311541, | May 08 1992 | M&FC Holding, LLC | Frequency agile radio |
5319735, | Dec 17 1991 | Raytheon BBN Technologies Corp | Embedded signalling |
5379345, | Jan 29 1993 | NIELSEN COMPANY US , LLC, THE | Method and apparatus for the processing of encoded data in conjunction with an audio broadcast |
5394274, | Jan 22 1988 | Anti-copy system utilizing audible and inaudible protection signals | |
5404377, | Apr 08 1994 | Intel Corporation | Simultaneous transmission of data and audio signals by means of perceptual coding |
5408496, | Nov 03 1992 | RAFAEL ARMANENT DEVELOPMENT AUTHORITY | Spread-spectrum, frequency-hopping radiotelephone system |
5425100, | Nov 25 1992 | NIELSEN COMPANY US , LLC, THE | Universal broadcast code and multi-level encoded signal monitoring system |
5450490, | Mar 31 1994 | THE NIELSEN COMPANY US , LLC | Apparatus and methods for including codes in audio signals and decoding |
5461390, | May 27 1994 | AT&T IPM Corp | Locator device useful for house arrest and stalker detection |
5481294, | Oct 27 1993 | NIELSEN COMPANY US , LLC | Audience measurement system utilizing ancillary codes and passive signatures |
5483276, | Aug 02 1993 | THE NIELSEN COMPANY US , LLC | Compliance incentives for audience monitoring/recording devices |
5510828, | |||
5512933, | Oct 15 1992 | Taylor Nelson AGB plc | Identifying a received programme stream |
5526427, | Jul 22 1994 | NIELSEN COMPANY US , LLC, THE, A DELAWARE LIMITED LIABILITY COMPANY | Universal broadcast code and multi-level encoded signal monitoring system |
5541585, | Oct 11 1994 | PREMDOR INTERNATIONAL INC ; Masonite International Corporation | Security system for controlling building access |
5574962, | Sep 30 1991 | THE NIELSEN COMPANY US , LLC | Method and apparatus for automatically identifying a program including a sound signal |
5579124, | Nov 16 1992 | THE NIELSEN COMPANY US , LLC | Method and apparatus for encoding/decoding broadcast or recorded segments and monitoring audience exposure thereto |
5581800, | Sep 30 1991 | THE NIELSEN COMPANY US , LLC | Method and apparatus for automatically identifying a program including a sound signal |
5594934, | Sep 21 1994 | NIELSEN COMPANY US , LLC, THE, A DELAWARE LIMITED LIABILITY COMPANY | Real time correlation meter |
5612729, | Apr 30 1992 | THE NIELSEN COMPANY US , LLC | Method and system for producing a signature characterizing an audio broadcast signal |
5612741, | Nov 05 1993 | CURTIS MATHES MARKETING CORPORATION 10911 PETAL STREET; Curtis Mathes Marketing Corporation | Video billboard |
5687191, | Feb 26 1996 | Verance Corporation | Post-compression hidden data transport |
5737025, | Feb 28 1995 | NIELSEN MEDIA RESEARCH, INC , A DELAWARE CORP | Co-channel transmission of program signals and ancillary signals |
5758315, | May 25 1994 | Sony Corporation | Encoding/decoding method and apparatus using bit allocation as a function of scale factor |
5761240, | Feb 06 1996 | Unwired Planet, LLC | Method and apparatus for determining an optical communications channel without loss of channel messages on a current communications channel |
5764763, | Mar 31 1994 | THE NIELSEN COMPANY US , LLC | Apparatus and methods for including codes in audio signals and decoding |
5768680, | May 05 1995 | Yuzalla Investments LLC | Media monitor |
5787334, | Sep 30 1991 | THE NIELSEN COMPANY US , LLC | Method and apparatus for automatically identifying a program including a sound signal |
5796785, | Oct 04 1995 | U S PHILIPS CORPORATION | Digital audio broadcast receiver having circuitry for retrieving embedded data and for supplying the retrieved data to peripheral devices |
5809013, | Feb 09 1996 | GE SECURITY, INC | Message packet management in a wireless security system |
5828325, | Apr 03 1996 | VERANCE CORPORATION, DELAWARE CORPORATION | Apparatus and method for encoding and decoding information in analog signals |
5848129, | Nov 05 1996 | Electronic billboard with telephone call-in control | |
5848391, | Jul 11 1996 | FRAUNHOFER-GESELLSCHAFT ZUR FORDERUNG DER ANGEWANDTEN FORSCHUNG E V ; Dolby Laboratories Licensing Corporation | Method subband of coding and decoding audio signals using variable length windows |
5923252, | Apr 06 1995 | BLUE TOWEL PTY LIMITED | Audio/visual marketing device and marketing system |
5945932, | Oct 30 1997 | Audiotrack Corporation | Technique for embedding a code in an audio signal and for detecting the embedded code |
5960048, | Mar 26 1996 | Telefonaktiebolaget LM Ericsson | Method and an arrangement for receiving a symbol sequence |
5966696, | Apr 14 1998 | PROMOVU, INC | System for tracking consumer exposure and for exposing consumers to different advertisements |
6005598, | Nov 27 1996 | LG Electronics Inc | Apparatus and method of transmitting broadcast program selection control signal and controlling selective viewing of broadcast program for video appliance |
6148020, | Mar 22 1996 | Sanyo Electric Co., Ltd. | Method and device for frequency hopping communication by changing a carrier frequency |
6154484, | Sep 06 1995 | Verance Corporation | Method and apparatus for embedding auxiliary data in a primary data signal using frequency and time domain processing |
6175627, | May 19 1997 | VERANCE CORPORATION, DELAWARE CORPORATION | Apparatus and method for embedding and extracting information in analog signals using distributed signal features |
6252522, | May 28 1998 | Verance Corporation | Billboard consumption measurement system |
6266442, | Oct 23 1998 | GOOGLE LLC | Method and apparatus for identifying objects depicted in a videostream |
6286005, | Mar 11 1998 | NIELSEN COMPANY US , LLC , THE | Method and apparatus for analyzing data and advertising optimization |
6330293, | Jul 28 1997 | Thomson; Thomson Licensing; THOMSON LICENSING DTV | Method for receiving multicarrier digital signals |
6360167, | Jan 29 1999 | BEACON NAVIGATION GMBH | Vehicle navigation system with location-based multi-media annotation |
6396413, | Mar 11 1999 | Telephonics Corporation | Personal alarm monitor system |
6421445, | Mar 31 1994 | THE NIELSEN COMPANY US , LLC | Apparatus and methods for including codes in audio signals |
6424939, | Jul 14 1997 | Fraunhofer-Gesellschaft zur Forderung der Angewandten Forschung E.V. | Method for coding an audio signal |
6484148, | Feb 19 2000 | Apple Inc | Electronic advertising device and method of using the same |
6507802, | Feb 16 2000 | HRL Laboratories, LLC | Mobile user collaborator discovery method and apparatus |
6519769, | Nov 09 1998 | NBCUniversal Media, LLC | Audience measurement system employing local time coincidence coding |
6546257, | Jan 31 2000 | Providing promotional material based on repeated travel patterns | |
6571279, | Dec 05 1997 | Fred Herz Patents, LLC | Location enhanced information delivery system |
6580916, | Sep 15 2000 | ARRIS ENTERPRISES LLC | Service framework for evaluating remote services based upon transport characteristics |
6597405, | Nov 01 1996 | TeleVentions, LLC | Method and apparatus for automatically identifying and selectively altering segments of a television broadcast signal in real-time |
6647269, | Aug 07 2000 | GOOGLE LLC | Method and system for analyzing advertisements delivered to a mobile unit |
6647548, | Sep 06 1996 | NIELSEN COMPANY US , LLC, THE, A DELAWARE LIMITED LIABILITY COMPANY | Coded/non-coded program audience measurement system |
6675383, | Jan 22 1997 | NIELSEN COMPANY US , LLC, THE | Source detection apparatus and method for audience measurement |
6720876, | Feb 14 2002 | Vulcan Patents LLC | Untethered position tracking system |
6735775, | May 27 1998 | THE NIELSEN COMPANY US , LLC, A DELAWARE LIMITED LIABILITY COMPANY | Audience rating system for digital television and radio |
6845360, | Nov 22 2002 | CITIBANK, N A | Encoding multiple messages in audio data and detecting same |
6862355, | Sep 07 2001 | CITIBANK, N A | Message reconstruction from partial detection |
6871180, | May 25 1999 | THE NIELSEN COMPANY US , LLC | Decoding of information in audio signals |
6934508, | Mar 19 2001 | NAVIGAUGE INC | System and method for obtaining comprehensive vehicle radio listener statistics |
6958710, | Dec 24 2002 | CITIBANK, N A | Universal display media exposure measurement |
6996237, | Mar 31 1994 | THE NIELSEN COMPANY US , LLC | Apparatus and methods for including codes in audio signals |
7006982, | May 15 2001 | KANTAR RETAIL, LLC | Purchase selection behavior analysis system and method utilizing a visibility measure |
7015817, | May 14 2002 | BI Incorporated | Personal tracking device |
7222071, | Sep 27 2002 | CITIBANK, N A | Audio data receipt/exposure measurement with code monitoring and signature extraction |
20010053190, | |||
20020097193, | |||
20020107027, | |||
20030005430, | |||
20030055707, | |||
20030097302, | |||
20030110485, | |||
20030122708, | |||
20030170001, | |||
20030171833, | |||
20030171975, | |||
20040019675, | |||
20040102961, | |||
20040122727, | |||
20040127192, | |||
20040170381, | |||
20050035857, | |||
20050159863, | |||
20050201826, | |||
20060222179, | |||
CA1208761, | |||
CA2036205, | |||
DE3806411, | |||
EP372601, | |||
FR2559002, | |||
WO4662, | |||
WO72309, | |||
WO200614362, | |||
WO9111062, | |||
WO9307689, | |||
WO9512278, | |||
WO9627264, | |||
WO9810539, | |||
WO9826529, | |||
WO9832251, | |||
WO9959275, | |||
WO9111062, | |||
WO9307689, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Mar 22 2007 | Arbitron, Inc. | (assignment on the face of the patent) | / | |||
Dec 17 2012 | ARBITRON INC | NIELSEN HOLDINGS N V | MERGER SEE DOCUMENT FOR DETAILS | 032554 | /0765 | |
Oct 11 2013 | ARBITRON INC | NIELSEN AUDIO, INC | CHANGE OF NAME SEE DOCUMENT FOR DETAILS | 032554 | /0759 | |
Mar 25 2014 | NIELSEN AUDIO, INC | THE NIELSEN COMPANY US , LLC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 032554 | /0801 | |
Oct 23 2015 | THE NIELSEN COMPANY US , LLC | CITIBANK, N A , AS COLLATERAL AGENT FOR THE FIRST LIEN SECURED PARTIES | SUPPLEMENTAL IP SECURITY AGREEMENT | 037172 | /0415 | |
Oct 11 2022 | CITIBANK, N A | THE NIELSEN COMPANY US , LLC | RELEASE REEL 037172 FRAME 0415 | 061750 | /0221 | |
Jan 23 2023 | GRACENOTE, INC | BANK OF AMERICA, N A | SECURITY AGREEMENT | 063560 | /0547 | |
Jan 23 2023 | THE NIELSEN COMPANY US , LLC | BANK OF AMERICA, N A | SECURITY AGREEMENT | 063560 | /0547 | |
Jan 23 2023 | TNC US HOLDINGS, INC | BANK OF AMERICA, N A | SECURITY AGREEMENT | 063560 | /0547 | |
Jan 23 2023 | GRACENOTE MEDIA SERVICES, LLC | BANK OF AMERICA, N A | SECURITY AGREEMENT | 063560 | /0547 | |
Jan 23 2023 | GRACENOTE DIGITAL VENTURES, LLC | BANK OF AMERICA, N A | SECURITY AGREEMENT | 063560 | /0547 | |
Apr 27 2023 | GRACENOTE DIGITAL VENTURES, LLC | CITIBANK, N A | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 063561 | /0381 | |
Apr 27 2023 | TNC US HOLDINGS, INC | CITIBANK, N A | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 063561 | /0381 | |
Apr 27 2023 | GRACENOTE, INC | CITIBANK, N A | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 063561 | /0381 | |
Apr 27 2023 | GRACENOTE MEDIA SERVICES, LLC | CITIBANK, N A | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 063561 | /0381 | |
Apr 27 2023 | THE NIELSEN COMPANY US , LLC | CITIBANK, N A | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 063561 | /0381 | |
May 08 2023 | THE NIELSEN COMPANY US , LLC | ARES CAPITAL CORPORATION | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 063574 | /0632 | |
May 08 2023 | TNC US HOLDINGS, INC | ARES CAPITAL CORPORATION | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 063574 | /0632 | |
May 08 2023 | GRACENOTE, INC | ARES CAPITAL CORPORATION | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 063574 | /0632 | |
May 08 2023 | GRACENOTE MEDIA SERVICES, LLC | ARES CAPITAL CORPORATION | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 063574 | /0632 | |
May 08 2023 | GRACENOTE DIGITAL VENTURES, LLC | ARES CAPITAL CORPORATION | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 063574 | /0632 |
Date | Maintenance Fee Events |
Sep 24 2012 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
Mar 10 2015 | ASPN: Payor Number Assigned. |
Mar 10 2015 | RMPN: Payer Number De-assigned. |
Sep 22 2016 | M1553: Payment of Maintenance Fee, 12th Year, Large Entity. |
Date | Maintenance Schedule |
Aug 16 2014 | 4 years fee payment window open |
Feb 16 2015 | 6 months grace period start (w surcharge) |
Aug 16 2015 | patent expiry (for year 4) |
Aug 16 2017 | 2 years to revive unintentionally abandoned end. (for year 4) |
Aug 16 2018 | 8 years fee payment window open |
Feb 16 2019 | 6 months grace period start (w surcharge) |
Aug 16 2019 | patent expiry (for year 8) |
Aug 16 2021 | 2 years to revive unintentionally abandoned end. (for year 8) |
Aug 16 2022 | 12 years fee payment window open |
Feb 16 2023 | 6 months grace period start (w surcharge) |
Aug 16 2023 | patent expiry (for year 12) |
Aug 16 2025 | 2 years to revive unintentionally abandoned end. (for year 12) |