Examples described herein involve determining an audio processing algorithm for a playback device to apply when playing audio content in a playback zone. Determining the audio processing algorithm may involve causing the playback device to play a first audio signal in the playback zone, receiving data indicating a second audio signal detected by a microphone of the playback device. Based on the second audio signal and a characteristic of the playback device, an audio processing algorithm may be determined. The audio processing algorithm may be calculated, or identified in a database based on an acoustic characteristic of the playback zone. The acoustic characteristic of the playback zone may be determined based on the second audio signal and the characteristic of the playback device. The audio processing algorithm may then be applied by the playback device.
|
8. A method to be performed by a playback device, the method comprising:
determining that a first type of calibration is unavailable, the first type of calibration configured to offset acoustic characteristics of a particular zone in which the playback device is located;
based on determining that the first type of calibration is unavailable, calibrating the playback device with a second type of calibration, wherein calibrating the playback device with the second type of calibration comprises:
determining that the playback device is in a particular type of zone;
querying, via a network interface, a database of pre-determined calibrations of the second type for a particular pre-determined calibration of the second type, the particular pre-determined calibration offsetting acoustic characteristics of a model zone that simulates the particular type of zone, wherein the model zone is based on additional zones corresponding to the particular type of zone, wherein the model zone includes one or more known materials having a given reflectivity characteristic, and wherein the database is hosted by one or more servers remote from the playback device;
applying the particular pre-determined calibration to an audio stage of the playback device; and
playing back audio content via the calibrated audio stage and one or more speakers.
15. A non-transitory computer-readable medium having stored thereon instructions executable by a processor of a playback device to cause the playback device to perform a method comprising:
determining that a first type of calibration is unavailable, the first type of calibration configured to offset acoustic characteristics of a particular zone in which the playback device is located;
based on determining that the first type of calibration is unavailable, calibrating the playback device with a second type of calibration, wherein calibrating the playback device with the second type of calibration comprises:
determining that the playback device is in a particular type of zone;
querying, via a network interface, a database of pre-determined calibrations of the second type for a particular pre-determined calibration of the second type, the particular pre-determined calibration offsetting acoustic characteristics of a model zone that simulates the particular type of zone, wherein the model zone is based on additional zones corresponding to the particular type of zone, wherein the model zone includes one or more known materials having a given reflectivity characteristic, and wherein the database is hosted by one or more servers remote from the playback device;
applying the particular pre-determined calibration to an audio stage of the playback device; and
playing back audio content via the calibrated audio stage and one or more speakers.
1. A playback device comprising:
a network interface;
an audio stage comprising an amplifier;
one or more processors;
a housing, the housing carrying at least the network interface, the audio stage, the one or more processors, and data storage having stored therein instructions executable by the one or more processors to cause the playback device to perform operations comprising:
determining that a first type of calibration is unavailable, the first type of calibration configured to offset acoustic characteristics of a particular zone in which the playback device is located;
based on determining that the first type of calibration is unavailable, calibrating the playback device with a second type of calibration, wherein calibrating the playback device with the second type of calibration comprises:
determining that the playback device is in a particular type of zone;
querying, via the network interface, a database of pre-determined calibrations of the second type for a particular pre-determined calibration of the second type, the particular pre-determined calibration offsetting acoustic characteristics of a model zone that simulates the particular type of zone, wherein the model zone is based on additional zones corresponding to the particular type of zone, wherein the model zone includes one or more known materials having a given reflectivity characteristic, and wherein the database is hosted by one or more servers remote from the playback device;
applying the particular pre-determined calibration to the audio stage of the playback device; and
playing back audio content via the calibrated audio stage and one or more speakers.
2. The playback device of
after calibrating the playback device with the second type of calibration, receiving an instruction to calibrate the playback device with the first type of calibration;
based on the instruction to calibrate the playback device with the first type of calibration, calibrating the playback device with the first type of calibration, wherein calibrating the playback device with the first type of calibration comprises:
outputting calibration audio via the audio stage and the one or more speakers while a microphone device records the calibration audio output;
receiving, via the network interface from the microphone device, a particular calibration of the first type, the particular calibration of the first type based on the recorded calibration audio output such that the particular calibration of the first type offsets acoustic characteristics of the particular zone in which the playback device is located when applied to the audio stage of the playback device; and
applying the particular calibration of the first type to the audio stage of the playback device in place of the particular pre-determined calibration of the second type.
3. The playback device of
4. The playback device of
5. The playback device of
6. The playback device of
7. The playback device of
9. The method of
after calibrating the playback device with the second type of calibration, receiving an instruction to calibrate the playback device with the first type of calibration;
based on the instruction to calibrate the playback device with the first type of calibration, calibrating the playback device with the first type of calibration, wherein calibrating the playback device with the first type of calibration comprises:
outputting calibration audio via the audio stage and the one or more speakers while a microphone device records the calibration audio output;
receiving, via the network interface from the microphone device, a particular calibration of the first type, the particular calibration of the first type based on the recorded calibration audio output such that the particular calibration of the first type offsets acoustic characteristics of the particular zone in which the playback device is located when applied to the audio stage of the playback device; and
applying the particular calibration of the first type to the audio stage of the playback device in place of the particular pre-determined calibration of the second type.
10. The method of
11. The method of
12. The method of
13. The method of
14. The method of
16. The non-transitory computer-readable medium of
after calibrating the playback device with the second type of calibration, receiving an instruction to calibrate the playback device with the first type of calibration;
based on the instruction to calibrate the playback device with the first type of calibration, calibrating the playback device with the first type of calibration, wherein calibrating the playback device with the first type of calibration comprises:
outputting calibration audio via the audio stage and the one or more speakers while a microphone device records the calibration audio output;
receiving, via the network interface from the microphone device, a particular calibration of the first type, the particular calibration of the first type based on the recorded calibration audio output such that the particular calibration of the first type offsets acoustic characteristics of the particular zone in which the playback device is located when applied to the audio stage of the playback device; and
applying the particular calibration of the first type to the audio stage of the playback device in place of the particular pre-determined calibration of the second type.
17. The non-transitory computer-readable medium of
18. The non-transitory computer-readable medium of
19. The non-transitory computer-readable medium of
20. The non-transitory computer-readable medium of
21. The playback device of
22. The method of
23. The non-transitory computer-readable medium of
|
This application is a continuation of U.S. non-provisional patent application Ser. No. 14/481,505, filed on Sep. 9, 2014, entitled “Audio Processing Algorithms,” which is incorporated herein by reference in its entirety.
The disclosure is related to consumer goods and, more particularly, to methods, systems, products, features, services, and other elements directed to media playback or some aspect thereof.
Options for accessing and listening to digital audio in an out-loud setting were limited until in 2003, when SONOS, Inc. filed for one of its first patent applications, entitled “Method for Synchronizing Audio Playback between Multiple Networked Devices,” and began offering a media playback system for sale in 2005. The Sonos Wireless HiFi System enables people to experience music from a plethora of sources via one or more networked playback devices. Through a software control application installed on a smartphone, tablet, or computer, one can play what he or she wants in any room that has a networked playback device. Additionally, using the controller, for example, different songs can be streamed to each room with a playback device, rooms can be grouped together for synchronous playback, or the same song can be heard in all rooms synchronously.
Given the ever growing interest in digital media, there continues to be a need to develop consumer-accessible technologies to further enhance the listening experience.
Features, aspects, and advantages of the presently disclosed technology may be better understood with regard to the following description, appended claims, and accompanying drawings where:
The drawings are for the purpose of illustrating example embodiments, but it is understood that the inventions are not limited to the arrangements and instrumentality shown in the drawings.
When a playback device plays audio content in a playback zone, a quality of the playback may depend on an acoustic characteristic of the playback zone. In discussions herein, the playback zone may include one or more playback devices or groups of playback devices. The acoustic characteristic of the playback zone may depend on a dimension of the playback zone, types of furniture in the playback zone, and an arrangement of the furniture in the playback zone, among other factors. As such, different playback zones may have different acoustic characteristics. Because a given model of the playback device may be used in a variety of different playback zones with different acoustic characteristics, a single audio processing algorithm may not provide a consistent quality of audio playback by the playback device in each of the different playback zones.
Examples discussed herein relate to determining an audio processing algorithm for the playback device to apply based on acoustic characteristics of a playback zone the playback device is in. Application of the determined audio processing algorithm by the playback device when playing audio content in the playback zone may cause audio content rendered by the playback device in the playback zone to assume a predetermined audio characteristic, at least to some extent. In one case, application of the audio processing algorithm may alter audio amplifications at one or more audio frequencies of the audio content. Other examples are also possible.
In one example, the database of audio processing algorithms may be maintained, and an audio processing algorithm in the database may be identified based on one or more characteristics of the playback zone. The one or more characteristics of the playback zone may include the acoustic characteristic of the playback zone, and/or one or more of a dimension of the playback zone, a flooring and/or wall material of the playback zone, and a number and/or types of furniture in the playback zone, among other possibilities.
Maintaining the database of audio processing algorithms may involve determining at least one audio processing algorithm that corresponds to the one or more characteristics of the playback zone, and adding the determined audio processing algorithm to the database. In one example, the database may be stored on one or more devices maintaining the database, or one or more other devices. In discussions herein, unless otherwise noted, the functions for maintaining the database may be performed by one or more computing devices (i.e. servers), one or more playback devices, or one or more controller devices, among other possibilities. However, for simplicity, the one or more devices performing the functions may be generally referred to as a computing device.
In one example, determining such an audio processing algorithm may involve the computing device determining an acoustic characteristic of a playback zone. In one case, the playback zone may be a model room used to simulate a playback zone within which the playback device may play audio content. In such a case, one or more physical characteristics of the model room (i.e. dimensions, and floor and wall materials, etc.) may be pre-determined. In another case, the playback zone may be a room in a home of a user of the playback device. In such a case, the physical characteristics of the playback zone may be provided by the user, or may be otherwise unknown.
In one example, the computing device may cause the playback device in the playback zone to play an audio signal. In one case, the played audio signal may include audio content with frequencies covering substantially an entire frequency range renderable by the playback device. The playback device may subsequently detect an audio signal using a microphone of the playback device. The microphone of the playback devices may be a built-in microphone of the playback device. In one case, the detected audio signal may include a portion corresponding to the played audio signal. For instance, the detected audio signal may include a component of the played audio signal reflected within the playback zone. The computing device may receive the detected audio signal from the playback device, and determine an acoustic response of the playback zone based on the detected audio signal.
The computing device may then determine the acoustic characteristic of the playback zone by removing an acoustic characteristic of the playback device from the acoustic response of the playback zone. The acoustic characteristic of the playback device may be an acoustic characteristic corresponding to a model of the playback device. In one case, the acoustic characteristic corresponding to the model of the playback device may be determined based on audio signals played and detected by a representative playback device of the model in an anechoic chamber.
The computing device may then determine a corresponding audio processing algorithm based on the determined acoustic characteristics of the playback zone and a predetermined audio characteristic. The predetermined audio characteristics may involve a particular frequency equalization that is considered good-sounding. The corresponding audio processing algorithm may be determined such that an application of the corresponding audio processing algorithm by the playback device when playing audio content in the playback zone causes audio content rendered by the playback device in the playback zone to assume the predetermined audio characteristic, at least to some extent. For instance, if the acoustic characteristic of the playback zone is one in which a particular audio frequency is more attenuated than other frequencies, the corresponding audio processing algorithm may involve an increased amplification of the particular audio frequency. Other examples are also possible.
An association between the determined audio processing algorithm and the acoustic characteristic of the playback zone may then be stored as an entry in a database. In some cases, an association between the audio processing algorithm and one or more other characteristics of the playback zone may additionally or alternatively be stored in the database. For instance, if the playback zone is of a particular dimension, an association between the audio processing algorithm and the particular room dimension may be stored in the database. Other examples are also possible.
In one example, the database may be accessed by a computing device to identify an audio processing algorithm for a playback device to apply in a playback zone. In one example, the computing device accessing the database and identifying the audio processing algorithm may be the same computing device maintaining the database, as described above. In another example, the computing device may be a different computing device.
In some cases, accessing the database to identify an audio processing algorithm for the playback device to apply in the playback zone may be a part of a calibration of the playback device. Such a calibration of the playback device may be initiated by the playback device itself, by a server in communication with the playback device, or by a controller device. In one case, the calibration may be initiated because the playback device is new and the calibration is part of an initial setup of the playback device. In another case, the playback device may have been repositioned, either within the same playback zone or from one playback zone to another. In a further case, the calibration may be initiated by a user of the playback device, such as via the controller device.
In one example, calibration of the playback device may involve the computing device prompting the user of the playback device to indicate one or more characteristics of the playback zone, such as an approximate dimension of the playback zone, flooring or wall material, and amount of furniture, among other possibilities. The computing device may prompt the user via a user interface on a controller device. Based on the one or more characteristics of the playback zone as provided by the user, an audio processing algorithm corresponding to the one or more characteristics of the playback zone may be identified in the database, and the playback device may accordingly apply the identified audio processing algorithm when playing audio content in the playback zone.
In another example, calibration of the playback device may involve determining an acoustic characteristic of the playback zone and identifying a corresponding audio processing algorithm based on the acoustic characteristic of the playback zone. Determination of the acoustic characteristic of the playback zone may be similar to that described above. For instance, the playback device in the playback zone for which the playback device is being calibrated for may play a first audio signal and subsequently detect using a microphone of the playback device, a second audio signal. The second audio signal may then be based upon to determine an acoustic characteristic of the playback zone. Based on the determined acoustic characteristic, a corresponding audio processing algorithm may be identified in the database, and the playback device may accordingly apply the identified audio processing algorithm when playing audio content in the playback zone. As indicated above, application of the corresponding audio processing algorithm by the playback device when playing audio content in the playback zone may cause audio content rendered by the playback device in the playback zone to assume the predetermined audio characteristic, at least to some extent.
While discussions of the calibration of the playback device discussed above generally involve the database of audio processing algorithms, one having ordinary skill in the art will appreciate that the computing device may determine an audio processing algorithm for a playback zone without accessing the database. For instance, instead of identifying a corresponding audio processing algorithm in the database, the computing device may determine the audio processing algorithm by calculating the audio processing algorithm based on the acoustic characteristic of the playback zone (from the detected audio signal) and the predetermined audio characteristic, similar to that described above in connection to maintenance of and generation of audio processing algorithm entries for the database. Other examples are also possible.
In one case, the playback device to be calibrated may be one of a plurality of playback devices configured to synchronously play audio content in the playback zone. In such a case, determination of the acoustic characteristic of a playback zone may also involve audio signals played by other playback devices in the playback zone. In one example, during the determination of the audio processing algorithm, each of the plurality of playback devices in the playback zone may play audio signals at the same time such that the audio signal detected by the microphone of the playback device may include a portion corresponding to the audio signal played by the playback device, as well as portions of audio signals played by the other playback devices in the playback zone. An acoustic response of the playback zone may be determined based on the detected audio signal, and an acoustic characteristic of the playback zone, including the other playback devices, may be determined by removing an acoustic characteristic of the playback device being calibrated from the acoustic response of the playback zone. An audio processing algorithm may then be calculated or identified in the database based on the acoustic characteristic of the playback zone and applied by the playback device.
In another case, two or more playback devices in the plurality of playback devices in the playback zone may each have a respective built-in microphone, and may each be individually calibrated according to the descriptions above. In one instance, the acoustic characteristic of the playback zone may be determined based on a collection of audio signals detected by microphones of each of the two or more playback devices, and an audio processing algorithm corresponding to the acoustic characteristic may be identified for each of the two or more playback devices. Other examples are also possible.
As indicated above, the present discussions involve determining an audio processing algorithm for the playback device to apply based on acoustic characteristics of a particular playback zone the playback device is in. In one aspect, a computing device is provided. The computing device includes a processor, and memory having stored thereon instructions executable by the processor to cause the computing device to perform functions. The functions include causing a playback device in a playback zone to play a first audio signal, and receiving from the playback device, data indicating a second audio signal detected by a microphone of the playback device. The second audio signal includes a portion corresponding to the first audio signal. The functions further include based on the second audio signal and an acoustic characteristic of the playback device, determining an audio processing algorithm, and transmitting data indicating the determined audio processing algorithm to the playback device.
In another aspect, a computing device is provided. The computing device includes a processor, and memory having stored thereon instructions executable by the processor to cause the computing device to perform functions. The functions include causing a first playback device to play a first audio signal in a playback zone, causing a second playback device to play a second audio signal in the playback zone, and receiving from the first playback device, data indicating a third audio signal detected by a microphone of the first playback device. The third audio signal includes (i) a portion corresponding to the first audio signal, and (ii) a portion corresponding to the second audio signal played by a second playback device. The functions also include based on the third audio signal and an acoustic characteristic of the first playback device, determining an audio processing algorithm, and transmitting data indicating the determined audio processing algorithm to the first playback device.
In another aspect, a playback device is provided. The playback device includes a processor, a microphone, and memory having stored thereon instructions executable by the processor to cause the playback device to perform functions. The functions include while in a playback zone, playing a first audio signal, and detecting by the microphone, a second audio signal. The second audio signal includes a portion corresponding to the first audio signal. The functions also include based on the second audio signal and an acoustic characteristic of the playback device, determining an audio processing algorithm, and applying the determined audio processing algorithm to audio data corresponding to a media item when playing the media item in the playback zone.
In another aspect, a computing device is provided. The computing device includes a processor, and memory having stored thereon instructions executable by the processor to cause the computing device to perform functions. The functions include causing a playback device in a playback zone to play a first audio signal, and receiving data indicating a second audio signal detected by a microphone of the playback device. The second audio signal includes a portion corresponding to the first audio signal played by the playback device. The functions also include based on the second audio signal and a characteristic of the playback device, determining an acoustic characteristic of the playback zone, based on the acoustic characteristic of the playback zone, determining an audio processing algorithm, and causing to be stored in a database, an association between the audio processing algorithm and the acoustic characteristic of the playback zone.
In another aspect, a computing device is provided. The computing device includes a processor, and memory having stored thereon instructions executable by the processor to cause the computing device to perform functions. The functions include causing a playback device in a playback zone to play a first audio signal, and receiving (i) data indicating one or more characteristics of a playback zone, and (ii) data indicating a second audio signal detected by a microphone of the playback device. The second audio signal includes a portion corresponding to the audio signal played by the playback device. The functions also include based on the second audio signal and a characteristic of the playback device, determining an audio processing algorithm, and cause to be stored in a database, an association between the determined audio processing algorithm and at least one of the one or more characteristics of the playback zone.
In another aspect, a computing device is provided. The computing device includes a processor, and memory having stored thereon instructions executable by the processor to cause the playback device to perform functions. The functions include maintaining a database of (i) a plurality of audio processing algorithms and (ii) a plurality of playback zone characteristics. Each audio processing algorithm of the plurality of audio processing algorithms corresponds to at least one playback zone characteristic of the plurality of playback zone characteristics. The functions also include receiving data indicating one or more characteristics of a playback zone, based on the data, identifying in the database, an audio processing algorithm, and transmitting data indicating the identified audio processing algorithm.
While some examples described herein may refer to functions performed by given actors such as “users” and/or other entities, it should be understood that this is for purposes of explanation only. The claims should not be interpreted to require action by any such example actor unless explicitly required by the language of the claims themselves. It will be understood by one of ordinary skill in the art that this disclosure includes numerous other embodiments.
Further discussions relating to the different components of the example media playback system 100 and how the different components may interact to provide a user with a media experience may be found in the following sections. While discussions herein may generally refer to the example media playback system 100, technologies described herein are not limited to applications within, among other things, the home environment as shown in
a. Example Playback Devices
In one example, the processor 202 may be a clock-driven computing component configured to process input data according to instructions stored in the memory 206. The memory 206 may be a tangible computer-readable medium configured to store instructions executable by the processor 202. For instance, the memory 206 may be data storage that can be loaded with one or more of the software components 204 executable by the processor 202 to achieve certain functions. In one example, the functions may involve the playback device 200 retrieving audio data from an audio source or another playback device. In another example, the functions may involve the playback device 200 sending audio data to another device or playback device on a network. In yet another example, the functions may involve pairing of the playback device 200 with one or more playback devices to create a multi-channel audio environment.
Certain functions may involve the playback device 200 synchronizing playback of audio content with one or more other playback devices. During synchronous playback, a listener will preferably not be able to perceive time-delay differences between playback of the audio content by the playback device 200 and the one or more other playback devices. U.S. Pat. No. 8,234,395 entitled, “System and method for synchronizing operations among a plurality of independently clocked digital data processing devices,” which is hereby incorporated by reference, provides in more detail some examples for audio playback synchronization among playback devices.
The memory 206 may further be configured to store data associated with the playback device 200, such as one or more zones and/or zone groups the playback device 200 is a part of, audio sources accessible by the playback device 200, or a playback queue that the playback device 200 (or some other playback device) may be associated with. The data may be stored as one or more state variables that are periodically updated and used to describe the state of the playback device 200. The memory 206 may also include the data associated with the state of the other devices of the media system, and shared from time to time among the devices so that one or more of the devices have the most recent data associated with the system. Other embodiments are also possible.
The audio processing components 208 may include one or more of digital-to-analog converters (DAC), analog-to-digital converters (ADC), audio preprocessing components, audio enhancement components, and a digital signal processor (DSP), among others. In one embodiment, one or more of the audio processing components 208 may be a subcomponent of the processor 202. In one example, audio content may be processed and/or intentionally altered by the audio processing components 208 to produce audio signals. The produced audio signals may then be provided to the audio amplifier(s) 210 for amplification and playback through speaker(s) 212. Particularly, the audio amplifier(s) 210 may include devices configured to amplify audio signals to a level for driving one or more of the speakers 212. The speaker(s) 212 may include an individual transducer (e.g., a “driver”) or a complete speaker system involving an enclosure with one or more drivers. A particular driver of the speaker(s) 212 may include, for example, a subwoofer (e.g., for low frequencies), a mid-range driver (e.g., for middle frequencies), and/or a tweeter (e.g., for high frequencies). In some cases, each transducer in the one or more speakers 212 may be driven by an individual corresponding audio amplifier of the audio amplifier(s) 210. In addition to producing analog signals for playback by the playback device 200, the audio processing components 208 may be configured to process audio content to be sent to one or more other playback devices for playback.
Audio content to be processed and/or played back by the playback device 200 may be received from an external source, such as via an audio line-in input connection (e.g., an auto-detecting 3.5 mm audio line-in connection) or the network interface 214.
The microphone(s) 220 may include an audio sensor configured to convert detected sounds into electrical signals. The electrical signal may be processed by the audio processing components 208 and/or the processor 202. The microphone(s) 220 may be positioned in one or more orientations at one or more locations on the playback device 200. The microphone(s) 220 may be configured to detect sound within one or more frequency ranges. In one case, one or more of the microphone(s) 220 may be configured to detect sound within a frequency range of audio that the playback device 200 is capable or rendering. In another case, one or more of the microphone(s) 220 may be configured to detect sound within a frequency range audible to humans. Other examples are also possible.
The network interface 214 may be configured to facilitate a data flow between the playback device 200 and one or more other devices on a data network. As such, the playback device 200 may be configured to receive audio content over the data network from one or more other playback devices in communication with the playback device 200, network devices within a local area network, or audio content sources over a wide area network such as the Internet. In one example, the audio content and other signals transmitted and received by the playback device 200 may be transmitted in the form of digital packet data containing an Internet Protocol (IP)-based source address and IP-based destination addresses. In such a case, the network interface 214 may be configured to parse the digital packet data such that the data destined for the playback device 200 is properly received and processed by the playback device 200.
As shown, the network interface 214 may include wireless interface(s) 216 and wired interface(s) 218. The wireless interface(s) 216 may provide network interface functions for the playback device 200 to wirelessly communicate with other devices (e.g., other playback device(s), speaker(s), receiver(s), network device(s), control device(s) within a data network the playback device 200 is associated with) in accordance with a communication protocol (e.g., any wireless standard including IEEE 802.11a, 802.11b, 802.11g, 802.11n, 802.11ac, 802.15, 4G mobile communication standard, and so on). The wired interface(s) 218 may provide network interface functions for the playback device 200 to communicate over a wired connection with other devices in accordance with a communication protocol (e.g., IEEE 802.3). While the network interface 214 shown in
In one example, the playback device 200 and one other playback device may be paired to play two separate audio components of audio content. For instance, playback device 200 may be configured to play a left channel audio component, while the other playback device may be configured to play a right channel audio component, thereby producing or enhancing a stereo effect of the audio content. The paired playback devices (also referred to as “bonded playback devices”) may further play audio content in synchrony with other playback devices.
In another example, the playback device 200 may be sonically consolidated with one or more other playback devices to form a single, consolidated playback device. A consolidated playback device may be configured to process and reproduce sound differently than an unconsolidated playback device or playback devices that are paired, because a consolidated playback device may have additional speaker drivers through which audio content may be rendered. For instance, if the playback device 200 is a playback device designed to render low frequency range audio content (i.e. a subwoofer), the playback device 200 may be consolidated with a playback device designed to render full frequency range audio content. In such a case, the full frequency range playback device, when consolidated with the low frequency playback device 200, may be configured to render only the mid and high frequency components of audio content, while the low frequency range playback device 200 renders the low frequency component of the audio content. The consolidated playback device may further be paired with a single playback device or yet another consolidated playback device.
By way of illustration, SONOS, Inc. presently offers (or has offered) for sale certain playback devices including a “PLAY:1,” “PLAY:3,” “PLAY:5,” “PLAYBAR,” “CONNECT:AMP,” “CONNECT,” and “SUB.” Any other past, present, and/or future playback devices may additionally or alternatively be used to implement the playback devices of example embodiments disclosed herein. Additionally, it is understood that a playback device is not limited to the example illustrated in
b. Example Playback Zone Configurations
Referring back to the media playback system 100 of
As shown in
In one example, one or more playback zones in the environment of
As suggested above, the zone configurations of the media playback system 100 may be dynamically modified, and in some embodiments, the media playback system 100 supports numerous configurations. For instance, if a user physically moves one or more playback devices to or from a zone, the media playback system 100 may be reconfigured to accommodate the change(s). For instance, if the user physically moves the playback device 102 from the balcony zone to the office zone, the office zone may now include both the playback device 118 and the playback device 102. The playback device 102 may be paired or grouped with the office zone and/or renamed if so desired via a control device such as the control devices 126 and 128. On the other hand, if the one or more playback devices are moved to a particular area in the home environment that is not already a playback zone, a new playback zone may be created for the particular area.
Further, different playback zones of the media playback system 100 may be dynamically combined into zone groups or split up into individual playback zones. For instance, the dining room zone and the kitchen zone 114 may be combined into a zone group for a dinner party such that playback devices 112 and 114 may render audio content in synchrony. On the other hand, the living room zone may be split into a television zone including playback device 104, and a listening zone including playback devices 106, 108, and 110, if the user wishes to listen to music in the living room space while another user wishes to watch television.
c. Example Control Devices
The processor 302 may be configured to perform functions relevant to facilitating user access, control, and configuration of the media playback system 100. The memory 304 may be configured to store instructions executable by the processor 302 to perform those functions. The memory 304 may also be configured to store the media playback system controller application software and other data associated with the media playback system 100 and the user.
The microphone(s) 310 may include an audio sensor configured to convert detected sounds into electrical signals. The electrical signal may be processed by the processor 302. In one case, if the control device 300 is a device that may also be used as a means for voice communication or voice recording, one or more of the microphone(s) 310 may be a microphone for facilitating those functions. For instance, the one or more of the microphone(s) 310 may be configured to detect sound within a frequency range that a human is capable of producing and/or a frequency range audible to humans. Other examples are also possible.
In one example, the network interface 306 may be based on an industry standard (e.g., infrared, radio, wired standards including IEEE 802.3, wireless standards including IEEE 802.11a, 802.11b, 802.11g, 802.11n, 802.11ac, 802.15, 4G mobile communication standard, and so on). The network interface 306 may provide a means for the control device 300 to communicate with other devices in the media playback system 100. In one example, data and information (e.g., such as a state variable) may be communicated between control device 300 and other devices via the network interface 306. For instance, playback zone and zone group configurations in the media playback system 100 may be received by the control device 300 from a playback device or another network device, or transmitted by the control device 300 to another playback device or network device via the network interface 306. In some cases, the other network device may be another control device.
Playback device control commands such as volume control and audio playback control may also be communicated from the control device 300 to a playback device via the network interface 306. As suggested above, changes to configurations of the media playback system 100 may also be performed by a user using the control device 300. The configuration changes may include adding/removing one or more playback devices to/from a zone, adding/removing one or more zones to/from a zone group, forming a bonded or consolidated player, separating one or more playback devices from a bonded or consolidated player, among others. Accordingly, the control device 300 may sometimes be referred to as a controller, whether the control device 300 is a dedicated controller or a network device on which media playback system controller application software is installed.
The user interface 308 of the control device 300 may be configured to facilitate user access and control of the media playback system 100, by providing a controller interface such as the controller interface 400 shown in
The playback control region 410 may include selectable (e.g., by way of touch or by using a cursor) icons to cause playback devices in a selected playback zone or zone group to play or pause, fast forward, rewind, skip to next, skip to previous, enter/exit shuffle mode, enter/exit repeat mode, enter/exit cross fade mode. The playback control region 410 may also include selectable icons to modify equalization settings, and playback volume, among other possibilities.
The playback zone region 420 may include representations of playback zones within the media playback system 100. In some embodiments, the graphical representations of playback zones may be selectable to bring up additional selectable icons to manage or configure the playback zones in the media playback system, such as a creation of bonded zones, creation of zone groups, separation of zone groups, and renaming of zone groups, among other possibilities.
For example, as shown, a “group” icon may be provided within each of the graphical representations of playback zones. The “group” icon provided within a graphical representation of a particular zone may be selectable to bring up options to select one or more other zones in the media playback system to be grouped with the particular zone. Once grouped, playback devices in the zones that have been grouped with the particular zone will be configured to play audio content in synchrony with the playback device(s) in the particular zone. Analogously, a “group” icon may be provided within a graphical representation of a zone group. In this case, the “group” icon may be selectable to bring up options to deselect one or more zones in the zone group to be removed from the zone group. Other interactions and implementations for grouping and ungrouping zones via a user interface such as the user interface 400 are also possible. The representations of playback zones in the playback zone region 420 may be dynamically updated as playback zone or zone group configurations are modified.
The playback status region 430 may include graphical representations of audio content that is presently being played, previously played, or scheduled to play next in the selected playback zone or zone group. The selected playback zone or zone group may be visually distinguished on the user interface, such as within the playback zone region 420 and/or the playback status region 430. The graphical representations may include track title, artist name, album name, album year, track length, and other relevant information that may be useful for the user to know when controlling the media playback system via the user interface 400.
The playback queue region 440 may include graphical representations of audio content in a playback queue associated with the selected playback zone or zone group. In some embodiments, each playback zone or zone group may be associated with a playback queue containing information corresponding to zero or more audio items for playback by the playback zone or zone group. For instance, each audio item in the playback queue may comprise a uniform resource identifier (URI), a uniform resource locator (URL) or some other identifier that may be used by a playback device in the playback zone or zone group to find and/or retrieve the audio item from a local audio content source or a networked audio content source, possibly for playback by the playback device.
In one example, a playlist may be added to a playback queue, in which case information corresponding to each audio item in the playlist may be added to the playback queue. In another example, audio items in a playback queue may be saved as a playlist. In a further example, a playback queue may be empty, or populated but “not in use” when the playback zone or zone group is playing continuously streaming audio content, such as Internet radio that may continue to play until otherwise stopped, rather than discrete audio items that have playback durations. In an alternative embodiment, a playback queue can include Internet radio and/or other streaming audio content items and be “in use” when the playback zone or zone group is playing those items. Other examples are also possible.
When playback zones or zone groups are “grouped” or “ungrouped,” playback queues associated with the affected playback zones or zone groups may be cleared or re-associated. For example, if a first playback zone including a first playback queue is grouped with a second playback zone including a second playback queue, the established zone group may have an associated playback queue that is initially empty, that contains audio items from the first playback queue (such as if the second playback zone was added to the first playback zone), that contains audio items from the second playback queue (such as if the first playback zone was added to the second playback zone), or a combination of audio items from both the first and second playback queues. Subsequently, if the established zone group is ungrouped, the resulting first playback zone may be re-associated with the previous first playback queue, or be associated with a new playback queue that is empty or contains audio items from the playback queue associated with the established zone group before the established zone group was ungrouped. Similarly, the resulting second playback zone may be re-associated with the previous second playback queue, or be associated with a new playback queue that is empty, or contains audio items from the playback queue associated with the established zone group before the established zone group was ungrouped. Other examples are also possible.
Referring back to the user interface 400 of
The audio content sources region 450 may include graphical representations of selectable audio content sources from which audio content may be retrieved and played by the selected playback zone or zone group. Discussions pertaining to audio content sources may be found in the following section.
d. Example Audio Content Sources
As indicated previously, one or more playback devices in a zone or zone group may be configured to retrieve for playback audio content (e.g. according to a corresponding URI or URL for the audio content) from a variety of available audio content sources. In one example, audio content may be retrieved by a playback device directly from a corresponding audio content source (e.g., a line-in connection). In another example, audio content may be provided to a playback device over a network via one or more other playback devices or network devices.
Example audio content sources may include a memory of one or more playback devices in a media playback system such as the media playback system 100 of
In some embodiments, audio content sources may be regularly added or removed from a media playback system such as the media playback system 100 of
The above discussions relating to playback devices, controller devices, playback zone configurations, and media content sources provide only some examples of operating environments within which functions and methods described below may be implemented. Other operating environments and configurations of media playback systems, playback devices, and network devices not explicitly described herein may also be applicable and suitable for implementation of the functions and methods.
As indicated above, some examples discussed herein relate to maintaining a database of audio processing algorithms. In some cases, maintenance of a database may further involve generating and/or updating entries of audio processing algorithms for the database. Each of the audio processing algorithms in the database may correspond to one or more characteristics of the playback zone. In one example, the one or more characteristics of the playback zone may include an acoustic characteristic of the playback zone. While the discussions below may generally relate to determining an audio processing algorithm to be stored as an entry in a database, one having ordinary skill in the art will appreciate that similar functions may also be performed to update existing entries in the database. The database may be accessed to identify an audio processing algorithm for a playback device to apply when playing audio content in a particular playback zone.
a. Example Database of Audio Processing Algorithms and Corresponding Acoustic Characteristics of Playback Zones
Method 500 may include one or more operations, functions, or actions as illustrated by one or more of blocks 502-510. Although the blocks are illustrated in sequential order, these blocks may also be performed in parallel, and/or in a different order than those described herein. Also, the various blocks may be combined into fewer blocks, divided into additional blocks, and/or removed based upon the desired implementation. In addition, for the method 500 and other processes and methods disclosed herein, the flowchart shows functionality and operation of one possible implementation of present embodiments. In this regard, each block may represent a module, a segment, or a portion of program code, which includes one or more instructions executable by a processor for implementing specific logical functions or steps in the process. The program code may be stored on any type of computer readable medium, for example, such as a storage device including a disk or hard drive.
The computer readable medium may include non-transitory computer readable medium, for example, such as computer-readable media that stores data for short periods of time like register memory, processor cache and Random Access Memory (RAM). The computer readable medium may also include non-transitory media, such as secondary or persistent long term storage, like read only memory (ROM), optical or magnetic disks, compact-disc read only memory (CD-ROM), for example. The computer readable media may also be any other volatile or non-volatile storage systems. The computer readable medium may be considered a computer readable storage medium, for example, or a tangible storage device. In addition, for the method 500 and other processes and methods disclosed herein, each block may represent circuitry that is wired to perform the specific logical functions in the process.
As shown in
As discussed previously, the database may be accessed to identify an audio processing algorithm for a playback device to apply when playing audio content in a playback zone. As such, in one example, the method 500 may be performed for a variety of different playback zones to build a database of audio processing algorithms corresponding to a variety of different playback environments.
At block 502, the method 500 involves causing a playback device in a playback zone to play a first audio signal. The playback device may be a playback device similar to the playback device 200 shown in
In one example, the first audio signal may be used for determining an acoustic response of the playback zone. As such, the first audio signal may be a test signal or measurement signal representative of audio content that may be played by the playback device during regular use by a user. Accordingly, the first audio signal may include audio content with frequencies substantially covering a renderable frequency range of the playback device or a frequency range audible to a human.
In one example, the playback zone may be a playback zone representative of one of a plurality of playback environments within which the playback device may play audio content during regular use by a user. Referring to
In one case, the playback zone may be a model playback zone built to simulate a listening environment within which the playback device may play audio content. In one instance, the playback zone may be one of a plurality of playback zones built to simulate the plurality of playback environments. The plurality of playback zones may be built for purposes of populating such a database of audio processing algorithms. In such a case, certain characteristics of the playback zone may be predetermined and/or known. For instance, a dimension of the playback zone, a flooring or wall material of the playback zone (or other features that may affects an audio reflectivity characteristic of the playback zone), a number of furniture in the playback zone, or sizes and types of the furniture in the playback zone, among other possibilities may be characteristics of the playback zone that may be predetermined and/or known.
In another case, the playback zone may be a room within a household of a user of the playback device. For instance, as part of building the database, users of the playback device, such as customers and/or testers, may be invited to use their playback devices to perform the functions of method 500 to build the database. In some cases, the certain characteristics of the user playback zone may not be known. In some other cases, some or all of the certain characteristics of the user playback zone may be provided by the user. The database populated from performing the functions of method 500 may include entries based on simulated playback zones and/or user playback zones.
While block 502 involves the computing device causing the playback device to play the first audio signal, one having ordinary skill in the art will appreciate that playback of the first audio signal by the playback device may not necessarily be caused or initiated by the computing device. For instance, a controller device may send a command to the playback device to cause the playback device to play the first audio signal. In another instance, the playback device may play the first audio signal without receiving a command from the computing device or controller. Other examples are also possible.
At block 504, the method 500 involves receiving data indicating a second audio signal detected by a microphone of the playback device. As indicated above, the playback device may be a playback device similar to the playback device 200 shown in
While the playback device is playing the first audio signal, or shortly thereafter, the microphone of the playback device may detect the second audio signal. The second audio signal may include detectable audio signals present in the playback zone. For instance, the second audio signal may include a portion corresponding to the first audio signal played by the playback device.
In one example, the computing device may receive data indicating the detected second audio signal from the playback device as a media stream while the microphone detects the second audio signal. In another example, the computing device may receive from the playback device, data indicating the second audio signal once detection of the first audio signal by the microphone of the playback device is complete. In either case, the playback device may process the detected second audio signal (via an audio processing component, such as the audio processing component 208 of the playback device 200) to generate the data indicating the second audio signal, and transmit the data to the computing device. In one instance, generating the data indicating the second audio signal may involve converting the second audio signal from an analog signal to a digital signal. Other examples are also possible.
At block 506, the method 500 involves based on the second audio signal and a characteristic of the playback device, determining an acoustic characteristic of the playback zone. As indicated above, the second audio signal may include portion corresponding to the first audio signal played by the playback device in the playback zone.
The characteristic of the playback device may include one or more of an acoustic characteristic of the playback device, specifications of the playback device (i.e. number of transducers, frequency range, amplifier wattage, etc.), and a model of the playback device. In some cases, the acoustic characteristic of the playback device and/or specifications of the playback device may be associated with the model of the playback device. For instance, a particular model of playback devices may have substantially the same specifications and acoustic characteristics. In one example, a database of models of playback devices, acoustic characteristics of the models of playback devices, and/or specifications of the models of playback devices may be maintained on the computing device or another device in communication with the computing device.
In one example, an acoustic response from the playback device playing the first audio signal in the playback zone may be represented by a relationship between the first audio signal and the second audio signal. Mathematically, if the first audio signal is f(t), the second audio signal is s(t), and the acoustic response of the playback device playing the first audio signal in the playback zone is hr(t), then
s(t)=f(t)⊗hr(t) (1)
where ⊗ represents the mathematical function of convolution. As such, given the second audio signal s(t) that is detected by the microphone of the playback device, and the first signal f(t) that was played by the playback device, hr(t) may be calculated.
In one case, because the first audio signal f(t) was played by the playback device, the acoustic response hr(t) may include (i) an acoustic characteristic of the playback device and (ii) the acoustic characteristic of the playback zone that is independent of the playback device. Mathematically, this relationship may be represented as
hr(t)=hp(t)+hroom(t) (2)
where hp(t) is the acoustic characteristic of the playback device, and hroom(t) is the acoustic characteristic of the playback zone, independent of the playback device. As such, the acoustic characteristic of the playback zone that is independent of the playback device may be determined by removing the acoustic characteristic of the playback device from the acoustic response of the playback zone to the first audio signal played by the playback device. In other words,
hroom(t)=hr(t)−hp(t). (3)
In one example, the acoustic characteristic of the playback device hp(t) may be determined by placing the playback device or a representative playback device of the same model in an anechoic chamber, causing the playback device to play a measurement signal in the anechoic chamber, and detecting a response signal by the microphone of the playback device. The measurement signal played by the playback device in the anechoic chamber may be similar to the first audio signal f(t) discussed above. For instance, the measurement signal may have audio content with frequencies substantially covering the renderable frequency range of the playback device or the frequency range audible to a human.
The acoustic characteristic of the playback device hp(t) may represent a relationship between the played measurement signal and the detected response signal. For instance, if the measurement signal has a first signal magnitude at a particular frequency, and the detected response signal has a second signal magnitude at the particular frequency different from the first signal magnitude, then the acoustic characteristic of the playback device hp(t) may indicate signal amplification or attenuation at the particular frequency.
Mathematically, if the measurement signal is x(t), the detected response signal is y(t), and the acoustic characteristic of the playback device in the anechoic chamber is hp(t), then
y(t)=x(t)⊗hp(t). (4)
Accordingly, hp(t) may be calculated based on the measurement signal x(t) and the detected response signal y(t). As indicated above, hp(t) may be the representative acoustic characteristic for playback devices of the same model as that used in the anechoic chamber.
In one example, as indicated above, the reference acoustic characteristic hp(t) may be stored in association with the model of the playback device and/or specifications of the playback device. In one example, hp(t) maybe stored on the computing device. In another example, hp(t) may be stored on the playback device and other playback devices of the same model. In a further case, an inverse of hp(t), represented as hp−1(t), may be stored instead of hp(t).
Referring back to block 506, the acoustic characteristic of the playback zone hroom(t) may accordingly be determined based on the first audio signal f(t), the second audio signal s(t), and the acoustic characteristic hp(t) of the playback device. In one example, the inverse of the acoustic characteristic of the playback device, hp−1(t) may be applied to the equation (2). In other words,
h−1p(t)⊗hr(t)=h−1p(t)⊗ hp(t)+h−1p(t)⊗ hroom(t)=I(t)+h−1p(t)⊗hroom(t) (5)
where I(t) is an impulse signal. The acoustic characteristic of the playback zone hroom(t) may then be simplified as:
hroom(t)=hp(t)⊗[h−1p(t)⊗hr(t)−I(t)]. (6)
At block 506, the method 500 involves based on the acoustic characteristic of the playback zone and a predetermined audio signal, determining an audio processing algorithm. In one example, the audio processing algorithm may be determined such that an application of the determined audio processing algorithm by the playback device when playing the first audio signal in the playback zone may produce a third audio signal having an audio characteristic substantially the same as a predetermined audio characteristic, or assumes the predetermined audio characteristic, at least to some extent.
In one example, the predetermined audio characteristic may be an audio frequency equalization that is considered good-sounding. In one case, the predetermined audio characteristic may involve an equalization that is substantially even across the renderable frequency range of the playback device. In another case, the predetermined audio characteristic may involve an equalization that is considered pleasing to a typical listener. In a further case, the predetermined audio characteristic may involve a frequency response that is considered suitable for a particular genre of music.
Whichever the case, the computing device may determine the audio processing algorithm based on the acoustic characteristic and the predetermined audio characteristic. In one example, if the acoustic characteristic of the playback zone is one in which a particular audio frequency is more attenuated than other frequencies, and the predetermined audio characteristic involves an equalization in which the particular audio frequency is minimally attenuated, the corresponding audio processing algorithm may involve an increased amplification at the particular audio frequency.
If the predetermined audio characteristic is represented by a predetermined audio signal z(t), and the audio processing algorithm is represented by p(t), a relationship between the predetermined audio signal z(t), the audio processing algorithm, and the acoustic characteristic of the playback zone hroom(t) may be mathematically described as:
z(t)=p(t)⊗hroom(t). (7)
Accordingly, the audio processing algorithm p(t) may be mathematically described as:
p(t)=z(t)⊗hroom−1(t) (8)
In some cases, determining the audio processing algorithm may involve determining one or more parameters for the audio processing algorithm (i.e. coefficients for p(t)). For instance, the audio processing algorithm may include certain signal amplification gains at certain corresponding frequencies of the audio signal. As such, parameters indicating the certain signal amplification and/or the certain corresponding frequencies of the audio signal may be identified to determine the audio processing algorithm p(t).
At block 510, the method 500 involves causing to be stored in a database, an association between the audio processing algorithm and the acoustic characteristic of the playback zone. As such, an entry that includes the acoustic characteristic of the playback zone hroom(t), and the corresponding audio processing algorithm p(t) as determined at block 504 and 506 may be added to the database. In one example, the database may be stored on local memory storage of the computing device. In another example, if the database is stored on another device, the computing device may transmit the audio processing algorithm and acoustic characteristic of the playback zone to the other device to be stored in the database. Other examples are also possible.
As indicated above, the playback zone for which the audio processing algorithm was determined may be a model playback zone used to simulate a listening environment within which the playback device may play audio content, or a room of a user of the playback device. In some cases, the database may include entries generated based on audio signals played and detected within model playback zones as well as entries generated based on audio signals played and detected within a room of a user of a playback device.
As further shown, entry 604 of the database 600 may include a playback zone acoustic characteristic hroom−1(t)−2 and processing algorithm coefficients w2, x2, y2, and z2, entry 606 of the database 600 may include a playback zone acoustic characteristic hroom−1(t)−3 and processing algorithm coefficients w3, x3, y3, and z3, and entry 608 of the database 600 may include a playback zone acoustic characteristic hroom−1(t)−4 and processing algorithm coefficients w4, x4, y4, and z4.
One having ordinary skill in the art will appreciate that database 600 is just one example of a database that may be populated and maintained by performing the functions of method 500. In one example, the playback zone acoustic characteristics may be stored in a different format or mathematical state (i.e. inversion vs non-inverse functions). In another example, the audio processing algorithms may be stored as function and/or equalization functions. Other examples are also possible.
In one example, some of the functions described above may be performed multiple times for the same playback device in the same playback zone to determine the acoustic characteristic of the playback zone hroom(t) and the corresponding processing algorithm p(t). For instance, blocks 502-506 may be performed multiple times to determine a plurality of acoustic characteristics of the playback zone. A combined (i.e. averaged) acoustic characteristic of the playback zone may be determined from the plurality of acoustic characteristics, and the corresponding processing algorithm p(t) may be determined based on the combined acoustic characteristic of the playback zone. An association between the corresponding processing algorithm p(t) and the acoustic characteristic of the playback zone hroom(t) or hroom−1(t) may then be stored in the database. In some cases, the first audio signal played by the playback device in the playback zone may be substantially the same audio signal during each of the iterations of the functions. In some other cases, the first audio signal played by the playback device in the playback zone may be a different audio signal for some or each of the iterations of the functions. Other examples are also possible.
The method 500 as described above (or some variation of the method 500) may further be performed to generate other entries in the database. For instance, given that the playback device is a first playback device, the playback zone is a first playback zone, and the audio processing algorithm is a first audio processing algorithm, the method 500 may additionally or alternatively be performed using a second playback device in a second playback zone. In one example, the second playback device may play a fourth audio signal in the second playback zone and a microphone of the second playback device may detected a fifth audio signal that includes a portion of the fourth audio signal played by the second playback device. The computing device may then receive data indicating the fifth audio signal and determine an acoustic characteristic of the second playback zone based on the fifth audio signal and a characteristic of the second playback device.
Based on the acoustic characteristic of the second playback zone, the computing device may determine a second audio processing algorithm such that applying of the determined second audio processing algorithm by the second playback device when playing the fourth audio signal in the playback zone produces a sixth audio signal having an audio characteristic substantially the same as the predetermined audio characteristic, represented by the predetermined audio signal z(t) shown in equations (7) and (8). The computing device may then cause to be stored in the database, an association between the second audio processing algorithm and the acoustic characteristic of the second playback zone.
While many playback zones may be similar in dimension, building material, and/or furniture types and arrangements, it is unlikely that two playback zones will have the same exact playback zone acoustic characteristic. As such, rather than storing an individual entry for each unique playback zone acoustic characteristic and their respective corresponding audio processing algorithms, which may require an impractical amount of memory storage, entries for similar or substantially the same playback zone acoustic characteristics may be combined.
In one case, acoustic characteristics of two playback zones may be similar when the two playback zones are substantially similar rooms. In another case, the computing device may, as suggested above, be performing the method 500 for the same playback device in the same playback zone multiple times. In a further case, the computing device may be performing method 500 for a different playback device in the same playback zone. In yet another case, the computing device may be performing method 500 for the playback device in the same playback zone, but in a different location within the playback zone. Other examples are also possible.
Whichever the case, during the process of generating entries of playback zone acoustic characteristic and corresponding audio processing algorithms, the computing device may determine that two playback zones have substantially the same playback zone acoustic characteristics. The computing device may then responsively determine a third audio processing algorithm based on the first audio processing algorithm and the second audio processing algorithm. For example, the computing device may determine the third audio processing algorithm by taking an average of the parameters of the first and second audio processing algorithms.
The computing device may then store in the database, an association between the third audio processing algorithm and the substantially the same acoustic characteristics. In one example, the database entry for the third audio processing algorithm may have a corresponding acoustic characteristic determined based on an average of the two substantially the same acoustic characteristics. In some cases, as suggested above, the database may have only one entry for the substantially the same acoustic characteristics in the interest of conserving storage memory. As such, the entries for the acoustic characteristics of the first playback zone and the second playback zone may be discarded in favor of the entry for the third audio processing algorithm. Other examples are also possible.
While the discussions above generally refer to the method 500 as being performed by a computing device, one having ordinary skill in the art will appreciate that, as indicated above, the functions of method 500 may alternatively be performed by one or more other devices, such as one or more servers, one or more playback devices, and/or one or more controller devices. In other words, one or more of the blocks 502-510 may be performed by the computing device, while one or more others of the blocks 502-510 may be performed by one or more other computing devices.
In one example, as described above, playback of the first audio signal by the playback device at block 502 may be performed by the playback device without any external command. Alternatively, the playback device may play the first audio signal in response to a command from a controller device and/or another playback device. In another example, blocks 502-506 may be performed by one or more playback devices or one or more controller devices, and the computing device may perform block 508 and 510. In yet another example, blocks 502-508 may be performed by one or more playback devices or one or more controller devices, and the computing device may only perform the functions of storing the audio processing algorithm at block 510. Other examples are also possible.
b. Example Database of Audio Processing Algorithms and Corresponding One or More Characteristics of Playback Zones
As indicated previously, a playback zone may have one or more playback zone characteristics. The one or more playback zone characteristics may include an acoustic characteristic of the playback zone, as discussed above. The one or more characteristics of the playback zone may also include one or more of a (a) a dimension of the playback zone, (b) an audio reflectivity characteristic of the playback zone (c) an intended use of the playback zone, (d) a number of furniture in the playback zone, (e) size of furniture in the playback zone, and (f) types of furniture in the playback zone. In one case, the audio reflectivity characteristic of the playback zone may be related to flooring and/or wall materials of the playback zone.
In some examples, an association between a determined audio processing algorithm, such as p(t) discussed above, and additional one or more characteristics of the playback zone may be stored in the database.
Method 700 may include one or more operations, functions, or actions as illustrated by one or more of blocks 702-708. Although the blocks are illustrated in sequential order, these blocks may also be performed in parallel, and/or in a different order than those described herein. Also, the various blocks may be combined into fewer blocks, divided into additional blocks, and/or removed based upon the desired implementation.
As shown in
At block 702, the method 700 involves the computing device causing a playback device in a playback zone to play a first audio signal. In one example, block 702 may include the same, or substantially the same functions as that of block 502 described in connection to
At block 704, the method 700 involves receiving (i) data indicating one or more characteristics of the playback zone, and (ii) data indicating a second audio signal detected by a microphone of the playback device. In one example, block 704 may include the same, or substantially the same functions as that of block 504 described in connection to
In addition to that described previously in connection to block 504, block 704 also involves receiving data indicating one or more characteristics of the playback zone. As indicated above, the playback zone may be a model playback zone used to simulate a listening environment within which the playback device may play audio content. In such a case, some of the one or more playback zone characteristics for the playback zone may be known. For instance, dimensions, floor plan, construction materials, and furnishings for the playback zone may be known. In one case, model playback zones may be constructed for the purposes of determining audio processing algorithms for a database, in which case, some of the one or more playback zone characteristics may be predetermined. In another case, the playback zone may be a room of a user of the playback device. As indicated above, such characteristics of the playback zone may contribute to the acoustic characteristic of the playback zone.
In one example, the computing device may receive the data indicating the one or more playback zone characteristics via a controller interface of a controller devices used by a user or an acoustics engineer. In another example, the computing device may receive the data indicating the one or more characteristics of the playback zone from the playback device in the playback zone. For instance, the data indicating the one or more characteristics may be received along with data indicating the second audio signal. The data indicating the one or more playback zone characteristics may be received before, during, or after playback of the first audio signal by the playback device at block 702. Other examples are also possible.
At block 706, the method 700 involves based on the second audio signal and a characteristic of the playback device, determining an audio processing algorithm. In one example, block 706 may include the same or similar functions as that described above in blocks 506 and 508 of
As discussed previously, application of the determined audio processing algorithm by the playback device when playing the first audio signal in the playback zone may produce a third audio signal having an audio characteristic substantially the same as a predetermined audio characteristic, or assumes the predetermined audio characteristic, at least to some extent. In one case, the predetermined audio characteristic may be the same or substantially the same as the predetermined audio characteristic represented as the predetermined audio signal p(t) discussed above. Other examples are also possible.
At block 708, the method 800 involves causing to be stored in a database, an association between the determined audio processing algorithm and at least one of the one or more characteristics of the playback zone. In one example, block 708 may include the same or similar functions as that described above in blocks 510. In this case however, the computing device may cause to be stored in the database, an association between the audio processing algorithm and at least one of the one or more characteristics in addition to, or instead of the acoustic characteristic of the playback zone.
As indicated above, the playback zone for which the audio processing algorithm was determined may be a model playback zone used to simulate a listening environment within which the playback device may play audio content, or a room of a user of the playback device. In some cases, the database may include entries generated based on audio signals played and detected within model playback zones as well as entries generated based on audio signals played and detected within a room of a user of a playback device.
In addition to the playback zone acoustic characteristics, the database 650 may also include zone dimensions information, indicating dimensions of the playback zone having the corresponding playback zone acoustic characteristic and the audio processing algorithm determined based on the corresponding playback zone acoustic characteristic. For instance, as shown, the entry 652 may have a zone dimension of a1×b1×c1, the entry 654 may have a zone dimension of a2×b2×c2, the entry 656 may have a zone dimension of a3×b3×c3, and the entry 654 may have a zone dimension of a4×b4×c4. As such, in this example, the one or more characteristics stored in association with the determined audio processing algorithm include the acoustic characteristic of the playback zone and dimensions of the playback zone. Other examples are also possible.
One having ordinary skill in the art will appreciate that database 650 is just one example of a database that may be populated and maintained by performing the functions of method 700. In one example, the playback zone acoustic characteristics may be stored in a different format or mathematical state (i.e. inversion vs non-inverse functions). In another example, the audio processing algorithms may be stored as function and/or equalization functions. In yet another example, the database 650 may include only zone dimensions and corresponding audio processing algorithms, and not the corresponding acoustic characteristics of the playback zone. Other examples are also possible.
Similar to method 500, the method 700 as described above (or some variation of the method 700) may further be performed to generate other entries in the database. For instance, given that the playback device is a first playback device, the playback zone is a first playback zone, and the audio processing algorithm is a first audio processing algorithm, the method 600 may additionally or alternatively be performed using a second playback device in a second playback zone. In one example, the second playback device may play a fourth audio signal in the second playback zone and a microphone of the second playback device may detect a fifth audio signal that includes a portion of the fourth audio signal played by the second playback device. The computing device may then receive (i) data indicating one or more characteristics of the second playback zone, and (ii) data indicating the fifth audio signal detected by a microphone of a second playback device in the second playback zone.
The computing device may then determine an acoustic characteristic of the second playback zone based on the fifth audio signal and a characteristic of the second playback device. Based on the acoustic characteristic of the second playback zone, the computing device may determine a second audio processing algorithm such that applying of the determined second audio processing algorithm by the second playback device when playing the fourth audio signal in the playback zone produces a sixth audio signal having an audio characteristic substantially the same as the predetermined audio characteristic, represented by the predetermined audio signal z(t) shown in equations (7) and (8). The computing device may then cause to be stored in a database, an association between the second audio processing algorithm and at least one of the one or more characteristics of the second playback zone.
Similar to that discussed above in connection to the method 500, during the process of generating entries for the database, the computing device may determine that two playback zones have similar or substantially the same playback zone acoustic characteristics. Accordingly, as also discussed above, the computing device may combine the playback zone acoustic characteristics and determined audio processing algorithms corresponding to the playback zone acoustic characteristics (i.e. by averaging), and store the combined playback zone acoustic characteristic and combined audio processing algorithm as a single entry in the database. Other examples are also possible.
Similar to the case of method 500, while the discussions above generally refer to the method 700 as being performed by a computing device, one having ordinary skill in the art will appreciate that the functions of method 700 may alternatively be performed by one or more other computing devices, such as one or more servers, one or more playback devices, and/or one or more controller devices. In other words, one or more of the blocks 702-708 may be performed by the computing device, while one or more others of the blocks 702-708 may be performed by one or more other computing devices. The other computing devices may include one or more playback devices, one or more controller devices, and/or one or more servers.
In one example, as described above, playback of the first audio signal by the playback device at block 702 may be performed by the playback device without any external command. Alternatively, the playback device may play the first audio signal in response to a command from a controller device and/or another playback device. In another example, blocks 702-706 may be performed by one or more playback devices or one or more controller devices, and the computing device may perform block 708. Other examples are also possible.
As indicated above, some examples described herein involve calibrating a playback device for a playback zone. In some cases, calibration of the playback deice may involve determining an audio processing algorithm for the playback device to apply when playing audio content in the playback zone.
In one example, playback devices 804 and 806 may be part of a media playback system and may be configured to play audio content in synchrony, such as that shown and discussed above in connection to the media playback system 100 of
In one example, the controller device 808 may be a device that can be used to control the media playback system. In one case, the controller device 808 may be similar to the control device 300 of
In one example, the computing device 802 may be a server in communication with the media playback system. The computing device 802 may be configured to maintain a database of information associated with the media playback system, such as registration numbers associated with the playback devices 804 and 806. The computing device 802 may also be configured to maintain a database of audio processing algorithms, as described in the previous section. Other examples are also possible.
Methods 900, 1000, and 1100, as will be discussed below provide functions that may be performed for calibration of a playback device in a playback zone, such as the playback devices 804 and 806 in the playback zone 810.
a. First Example Method for Determining an Audio Processing Algorithm Based on a Detected Audio Signal
Method 900 may include one or more operations, functions, or actions as illustrated by one or more of blocks 902-908. Although the blocks are illustrated in sequential order, these blocks may also be performed in parallel, and/or in a different order than those described herein. Also, the various blocks may be combined into fewer blocks, divided into additional blocks, and/or removed based upon the desired implementation.
As shown in
At block 902, the method 900 involves causing a playback device in a playback zone to play a first audio signal. Referencing
In one example, the computing device 802 may determine that the playback device 804 is to be calibrated for the playback zone 810, and responsively cause the playback device 804 in the playback zone 810 to play the first audio signal. In one case, the computing device 802 may determine that the playback device 804 is to be calibrated based on an input received from a user indicating that the playback device 804 is to be calibrated. In one instance, the input may be received from the user via the controller device 808. In another case, the computing device 802 may determine that the playback device 804 is to be calibrated because the playback device 804 is a new playback device, or newly moved to the playback zone 810. In a further case, calibration of the playback device 804 (or any other playback devices in the media playback system) may be performed periodically. As such, the computing device 802 may determine that the playback device 804 is to be calibrated based on a calibration schedule of the playback device 804. Other examples are also possible. Responsive to determining that the playback device 804 is to be calibrated, the computing device 802 may then cause the playback device 804 to play the first audio signal.
While block 902 involves the computing device 802 causing the playback device 804 to play the first audio signal, one having ordinary skill in the art will appreciate that playback of the first audio signal by the playback device 804 may not necessarily be caused or initiated by the computing device 802. For instance, the controller device 808 may send a command to the playback device 804 to cause the playback device 804 to play the first audio signal. In another instance, the playback device 806 may cause the playback device 804 to play the first audio signal. In a further instance, the playback device 804 may play the first audio signal without receiving a command from the computing device 802, playback device 806, or controller device 808. In one example, the playback device 804 may determine, based on a movement of the playback device 804, or a change in the playback zone of the playback device 804, that a calibration is to be performed, and responsive play the first audio signal. Other examples are also possible.
As suggested, the first audio signal may be a test signal or measurement signal for calibrating the playback device 804 for the playback one 810. As such, the first audio signal may be representative of audio content that may be played by the playback device during regular use by a user. Accordingly, the first audio signal may include audio content with frequencies substantially covering a renderable frequency range of the playback device or a frequency range audible to a human. In another example, the first audio signal may be a favorite or commonly played audio track of a user of the playback device.
At block 904, the method 900 involves receiving from the playback device, a second audio signal detected by a microphone of the playback device. Continuing with the examples above, given the playback device 804 is similar to the playback device 200 of
While the playback device 804 is playing the first audio signal, or shortly thereafter, the microphone of the playback device 804 may detect the second audio signal. The second audio signal may include sounds present in the playback zone. For instance, the second audio signal may include a portion corresponding to the first audio signal played by the playback device 804.
In one example, the computing device 802 may receive data indicating the first audio signal from the playback device 804 as a media stream while the microphone detects the second audio signal. In another example, the computing device 802 may receive from the playback device 804, data indicating the second audio signal once detection of the second audio signal by the microphone of the playback device 804 is complete. In either case, the playback device 804 may process the detected second audio signal (via an audio processing component, such as the audio processing component 208 of the playback device 200) to generate the data indicating the second audio signal, and transmit the data to the computing device 802. In one instance, generating the data indicating the second audio signal may involve converting the second audio signal from an analog signal to a digital signal. Other examples are also possible.
At block 906, the method 900 involves based on the second audio signal and an acoustic characteristic of the playback device, determining an audio processing algorithm. In one example, the acoustic characteristic of the playback device may be hp(t) as discussed above in connection to block 506 of the method 500 shown in
As suggested above, the reference playback device may be of the same model as the playback device 804 being calibrated for the playback zone 810. Also similar to that discussed above in connection to block 506, the computing device may accordingly determine an acoustic characteristic of the playback zone based on the acoustic characteristic of the playback device and the second audio signal.
In one example, the computing device 802 may determine an audio processing algorithm based on the acoustic characteristic of the playback zone similar to that discussed above in connection to block 508. As such, the computing device 802 may determine the audio processing algorithm based on the acoustic characteristic of the playback zone and a predetermined audio characteristic, such that an application of the determined audio processing algorithm by the playback device 804 when playing the first audio signal in the playback zone 810 may produce a third audio signal having an audio characteristic substantially the same as the predetermined audio characteristic, or assumes the predetermined audio characteristic, at least to some extent.
In another example, the computing device 802 may select from a plurality of audio processing algorithms, an audio processing algorithm corresponding to the acoustic characteristic of the playback zone 810. For instance, the computing device may access a database, such as the databases 600 and 650 of
In some cases, an acoustic characteristic that exactly matches the determined acoustic characteristic of the playback zone 810 may not be found in the database. In such a case, an audio processing algorithm corresponding to an acoustic characteristic in the database that is the most similar to the acoustic characteristic of the playback zone 810 may be identified. Other examples are also possible.
At block 908, the method 900 involves transmitting data indicating the determined audio processing algorithm to the playback device. Continuing with the examples above, the computing device 802 (or one or more other devices) may transmit the data indicating the determined audio processing algorithm to the playback device 804. The data indicating the determined audio processing algorithm may also include a command to cause the playback device 804 to apply the determined audio processing algorithm when playing audio content in the playback zone 810. In one example, applying the audio processing algorithm to the audio content may modify a frequency equalization of the audio content. In another example, applying the audio processing algorithm to the audio content may modify a volume range of the audio content. Other examples are also possible.
In some cases, a playback zone may include multiple playback devices configured to play audio content in synchrony. For instance, as indicated above, playback devices 804 and 806 may be configured to play audio content in synchrony in the playback zone 810. In such a case, calibration of one of the playback devices may involve the other playback devices.
In one example, a playback zone such as the playback zone 810 may include a first playback device, such as the playback device 804, and a second playback device, such as the playback device 806, configured to play audio content in synchrony. Calibration of the playback device 804, as coordinated and performed by the computing device 802, may involve causing the playback device 804 to play a first audio signal and causing the playback device 806 to play a second audio signal.
In one case, the computing device 802 may cause the playback device 806 to play the second audio signal in synchrony with playback of the first audio signal by the playback device 804. In one instance, the second audio signal may be orthogonal to the first audio signal such that a component of the synchronously played audio content played by either of the playback devices 804 and 806 may be discernable. In another case, the computing device may cause the playback device 806 to play the second audio signal after playback of the first audio signal by the playback device 804 is complete. Other examples are also possible.
The computing device 802 may then receive from the playback device 804, a third audio signal detected by a microphone of the playback device 804, similar to that discussed in connection to block 904. In this case however, the third audio signal may include both a portion corresponding to the first audio signal played by the playback device 804, and a portion corresponding to the second audio signal played by playback device 806.
Based on the third audio signal and an acoustic characteristic of the playback device 804, the computing device 802 may then determine an audio processing algorithm, and transmit data indicating the determined audio processing algorithm to the playback device 804 for the playback device 804 to apply when playing audio content in the playback zone 810, similar to that described above in connection to blocks 906 and 908.
In one case, as indicated above, the playback device 806 may also have a microphone and may also be calibrated similarly to that described above. As indicated, the first audio signal played by the playback device 804 and the second audio signal played by the playback device 806 may be orthogonal, or otherwise discernable. For instance, as also indicated above, the playback device 806 may play the second audio signal after playback of the first audio signal by the playback device 804 is completed. In another instance, the second audio signal may have a phase that is orthogonal to a phase of the first audio signal. In yet another instance, the second audio signal may have a different and/or varying frequency range than the first audio signal. Other examples are also possible.
Whichever the case, discernable first and second audio signals may allow the computing device 802 to parse from the third audio signal detected by the playback device 804, a contribution of the playback device 804 to the detected third audio signal, and a contribution of the playback device 806 to the detected third audio signal. Respective audio processing algorithms may then be determined for the playback device 804 and the playback device 806.
The respective audio processing algorithms may be determined similar to that discussed above in connection to block 508. In one case, a first acoustic characteristic of the playback zone may be determined based on the third audio signal detected by the playback device 604, and a second acoustic characteristic of the playback zone may be determined based on a fourth audio signal detected by the playback device 806. Similar to the third audio signal, the fourth audio signal may also include a portion corresponding to the first audio signal played by the playback device 804 and a portion corresponding to the second audio signal played by the playback device 806.
Respective audio processing algorithms for the playback device 804 and the playback device 806 may then be determined based on the first acoustic characteristic of the playback zone and the second acoustic characteristic of the playback zone either individually or in combination. In some instances, a combination of the first acoustic characteristic of the playback zone and the second acoustic characteristic of the playback zone may represent a more comprehensive acoustic characteristic of the playback zone than either the first or second acoustic characteristic of the playback zone individually. The respective audio processing algorithms may then be transmitted to the playback device 804 and the playback device 806 to apply when playing audio content in the playback zone 810. Other examples are also possible.
While the discussions above generally refer to the method 900 as being performed by the computing device 802 of
Further, in some cases, one or more of the blocks 902-908 may be performed by the computing device 802, while one or more others of the blocks 902-908 may be performed by one or more other devices. For instance, blocks 902 and 904 may be performed by one or more of the playback device 804, the playback device 806, and the playback device 808. In other words, a coordinating device other than the computing device 802 may coordinate calibration of the playback device 804 for the playback zone 810.
In some cases, at block 906, the coordinating device may transmit the second audio signal to the computing device 802 such that the computing device 802 may determine the audio processing algorithm based on the second audio signal and the acoustic characteristic of the playback device. The acoustic characteristic of the playback device may be provided to the computing device 802 by the coordinating device, or provided from another device on which characteristics of the playback device is stored. In one case, the computing device 802 may perform the calculations of block 906 because the computing device 802 has more processing power than the coordinating device.
In one example, upon determining the audio processing algorithm, the computing device 802 may transmit the determined audio processing algorithm directly to the playback device 804 for the playback device 804 to apply when playing audio content in the playback zone 810. In another example, upon determining the audio processing algorithm, the computing device 802 may transmit the determined audio processing algorithm to the coordinating device, and the coordinating device may perform block 908 and transmit the determined processing algorithm to the playback device 804 (if the coordinating device is not also the playback device 804). Other examples are also possible.
b. Second Example Methods for Determining an Audio Processing Algorithm Based on a Detected Audio Signal
In some cases, as described above, calibration of a playback device in a playback zone may be coordinated and performed by a computing device such as a server, or a controller device. In some other cases, as also described above, calibration of a playback device may be coordinated and/or performed by the playback device being calibrated.
Method 1000 may include one or more operations, functions, or actions as illustrated by one or more of blocks 1002-1008. Although the blocks are illustrated in sequential order, these blocks may also be performed in parallel, and/or in a different order than those described herein. Also, the various blocks may be combined into fewer blocks, divided into additional blocks, and/or removed based upon the desired implementation.
As shown in
At block 1002, the method 1000 involves while in a playback zone, playing a first audio signal. Referring to
At block 1004, the method 1000 involves detecting by a microphone, a second audio signal. The second audio signal may include a portion corresponding to the first audio signal played by the playback device. In one example, block 1004 may be similar to block 904, but performed by the playback device 804 being calibrated rather than the computing device 802. Nevertheless, any discussions above in connection to block 904 may also be applicable, sometimes with some variation, to block 1004.
At block 1006, the method 1000 involves based on the second audio signal and an acoustic characteristic of the playback device, determining an audio processing algorithm. In one example, block 1006 may be similar to block 906, but performed by the playback device 804 being calibrated rather than the computing device 802. Nevertheless, any discussions above in connection to block 906 may also be applicable, sometimes with some variation, to block 1006.
In one case, functions for determining the audio processing algorithm, as discussed in connection to block 906, may be performed wholly by the playback device 804 that is being calibrated for the playback zone 810. As such, the playback device 804 may determine an acoustic characteristic of the playback zone 610 based on the second audio signal and an acoustic characteristic of the playback device 804. In one case, the playback device 804 may have stored locally, the acoustic characteristic of the playback device 804. In another case, the playback device 804 may receive from another device, the acoustic characteristic of the playback device 804.
In one example, the playback device 804 may then select from a plurality of audio processing algorithms, an audio processing algorithm corresponding to the acoustic characteristic of the playback zone 610. For instance, the playback device 804 may access a database such the databases 600 and 650 shown in and described above in connection to
In another example, similar to functions described above in connection to block 906 of the method 900 and/or block 508 of the method 500, the playback device 804 may calculate the audio processing algorithm based on the acoustic characteristics of the playback zone 610 and a predetermined audio characteristic, such that an application of the determined audio processing algorithm by the playback device 804 when playing the first audio signal in the playback zone 810 may produce a third audio signal having an audio characteristic substantially the same as the predetermined audio characteristic, or assumes the predetermined audio characteristic, at least to some extent.
In a further example, as discussed in previous section, another device other than the playback device 804 may perform some or all of the functions of block 1006. For instance, the playback device 804 may transmit data indicating the detected second audio signal to a computing device, such as the computing device 802, another playback device such as the playback device 806, a controller device such as the controller device 808, and/or some other device in communication with the playback device 804, and request an audio processing algorithm. In another instance, the playback device 804 may determine the acoustic characteristic of the playback zone 810 based on the detected audio signal, and transmit data indicating the determined acoustic characteristic of the playback zone 810 to the other device with a request for an audio processing algorithm based on the determined acoustic characteristic of the playback zone 810.
In other words, in one aspect, the playback device 804 may determine the audio processing algorithm by requesting from the other device, an audio processing algorithm based on the detected second audio signal and/or acoustic characteristic of the playback zone 810 provided to the other device by the playback device 804
In a case where the playback device 804 provides data indicating the detected second audio signal but not the acoustic characteristic of the playback zone 810, the playback device 804 may also transmit the acoustic characteristic of the playback device 804 along with the data indicating the detected second audio signal such that the other device may determine the acoustic characteristic of the playback zone 810. In another case, the device receiving the data indicating the detected second audio signal may determine based on the data, a model of the playback device 804 transmitting the data, and determine an acoustic characteristic of the playback device 804 based on the model of the playback device 804 (i.e. a playback device acoustic characteristic database). Other examples are also possible.
The playback device 804 may then receive the determined audio processing algorithm. In one case, the playback device 804 may send the second audio signal to the other device because the other device has more processing power than the playback device 804. In another case, the playback device 804 and one or more other devices may perform the calculations and functions in parallel for an efficient use of processing power. Other examples are also possible.
At block 1008, the method 800 involves applying the determined audio processing algorithm to audio data corresponding to a media item when playing the media item. In one example, application of the audio processing algorithm to the audio data of the media item by the playback device 804 when playing the media item in the playback zone 810 may modify a frequency equalization of the media item. In another example, application of the audio processing algorithm to the audio data of the media item by the playback device 804 when playing the media item in the playback zone 810 may modify a volume range of the media item. In one example, the playback device 804 may store in local memory storage, the determined audio processing algorithm and apply the audio processing algorithm when playing audio content in the playback zone 810.
In one example, the playback device 804 may be calibrated for different configurations of the playback device 804. For instance, the playback device 804 may be calibrated for a first configuration involving individual playback in the playback zone 810, as well as for a second configuration involving synchronous playback with the playback device 806 in the playback zone 810. In such a case, a first audio processing algorithm determined, stored, and applied for the first playback configuration of the playback device, and a second audio processing algorithm determined, stored, and applied for the second playback configuration of the playback device.
The playback device 804 may then determine based on a playback configuration the playback device 804 is in at a given time, which audio processing algorithm to apply when playing audio content in the playback zone 810. For instance, if the playback device 804 is playing audio content in the playback zone 810 without the playback device 806, the playback device 804 may apply the first audio processing algorithm. On the other hand, if the playback device 804 is playing audio content in the playback zone 810 in synchrony with the playback device 806, the playback device 804 may apply the second audio processing algorithm. Other examples are also possible.
c. Example Method for Determining an Audio Processing Algorithm Based on Playback Zone Characteristics
In the discussions above, determination of an audio processing algorithm may be generally based on determining an acoustic characteristic of the playback zone, as determined based on an audio signal detected by a playback device in the playback zone. In some cases, an audio processing algorithm may also be identified based on other characteristics of the playback zone, in addition to or instead of the acoustic characteristic of the playback zone.
Method 1100 may include one or more operations, functions, or actions as illustrated by one or more of blocks 1102-1108. Although the blocks are illustrated in sequential order, these blocks may also be performed in parallel, and/or in a different order than those described herein. Also, the various blocks may be combined into fewer blocks, divided into additional blocks, and/or removed based upon the desired implementation.
As shown in
At block 1102, the method 1100 involves maintaining a database of (i) a plurality of audio processing algorithms and (ii) a plurality of playback zone characteristics. In one example, the database may be similar to the databases 600 and 650 as shown in and described above in connection to
At block 1104, the method 1100 involves receiving data indicating one or more characteristics of a playback zone. In one example, the one or more characteristics of the playback zone may include an acoustic characteristic of the playback zone. In another example, the one or more characteristics of the playback zone may include a dimension of the playback zone, a flooring material of the playback zone, a wall material of the playback zone, an intended use of the playback zone, an number of furniture in the playback zone, a size of furniture in the playback zone, and types of furniture in the playback zone, among other possibilities.
In one example, referring again to
In one case, the one or more characteristics may include an acoustic characteristic of the playback zone 810. In such a case, the playback device 804 in the playback zone 810 may play a first audio signal and detect by a microphone of the playback device 804, a second audio signal that includes a portion corresponding to the first audio signal. In one instance, the data indicating the one or more characteristics may be data indicating the detected second audio signal. In another instance, based on the detected second audio signal and an acoustic characteristic of the playback device 804, the acoustic characteristic of the playback zone 810 may be determined, similar to that discussed previously. The data indicating the one or more characteristics may then indicate the acoustic characteristic of the playback zone. In either instance, data indicating the one or more characteristics may then be received by at least one of the one or more devices performing the method 1100.
In another case, the one or more characteristics may include a dimension of the playback zone, a flooring material of the playback zone, and a wall material of the playback zone etc. In such a case, a user may be prompted via a controller interface provided by a controller device such as the controller device 808, to enter or select one or more characteristics of the playback zone 810. For instance, the controller interface may provide a list of playback zone dimensions, and/or a list of furniture arrangements, among other possibilities for the user to select from. The data indicating the one or more characteristics of the playback zone 810, as provided by the user, may then be received by at least one of the one or more devices performing the method 1100.
At block 1106, the method 1100 involves based on the data, identifying in the database, an audio processing algorithm. Referring to the case where the one or more characteristics include the acoustic characteristic of the playback zone 810, an audio processing algorithm may be identified in the database based on the acoustic characteristics of the playback zone 810. For instance, referring to the database 600 of
Referring to a case where the one or more characteristics include dimensions of the playback zone, among other characteristics, an audio processing algorithm may be identified in the database based on the dimensions of the playback zone. For instance, referring to the database 650 of
In some cases, more than one audio processing algorithm may be identified based on the one or more characteristics of the playback zone indicated in the received data. For instance, the acoustic characteristic of the playback zone 810 may be determined as hroom−1(t)−3, which corresponds to audio processing algorithm parameters w3, x3, y3, and z3, as provided in entry 656 of the database 650 of
In one example, the audio processing algorithm corresponding to a matching or substantially matching acoustic characteristic may be prioritized. In another example, an average of the audio processing algorithms (i.e. an averaging of the parameters) may be calculated, and the average audio processing algorithm may be the identified audio processing algorithm. Other examples are also possible.
At block 1108, the method 1100 involves transmitting data indicating the identified audio processing algorithm. Continuing with the examples above, the data indicating the identified audio processing algorithm may be transmitted to the playback device 804 being calibrated for the playback zone 810. In one case, the data indicating the identified audio processing algorithm may be transmitted directly to the playback device 804. In another case, such as if the calibration of the playback device 804 is coordinated by the controller device 808, and if the audio processing algorithm was identified by the computing device 802, the data indicating the identified audio processing algorithm may be transmitted to the playback device 804 from the computing device 802 via the controller device 808. Other examples are also possible.
As indicated above, the functions of method 1100 may be performed by one or more of one or more servers, one or more playback devices, and/or one or more controller devices. In one example, maintenance of the database at block 1102 may be performed by the computing device 802, and receiving of data indicating the one or more characteristics of the playback zone at block 1104 may be performed by the controller device 808 (the data may be provided to the controller device 808 by the playback device 804 being calibrated in the playback zone 810). Block 1106 may be performed by the controller device 808 communicating with the computing device 802 to access the database maintained by the computing device 802 to identify the audio signal processing, and block 1108 may involve the computing device 802 transmitting the data indicating the identified audio processing algorithm to the playback device 804 either directly or via the controller device 808.
In another example, the functions of method 1100 may be performed wholly or substantially wholly by one device. For instance, the computing device 802 may maintain the database as discussed in connection to block 1102.
The computing device 802 may then coordinate calibration of the playback device 804. For instance, the computing device 802 may cause the playback device 804 to play a first audio signal and detect a second audio signal, receive from the playback device 804 data indicating the detected second audio signal, and determine an acoustic characteristic of the playback zone 810 based on the data from the playback device 804. In another instance, the computing device 802 may cause the controller device 808 to prompt a user to provide one or more characteristics of the playback zone 810 (i.e. dimensions etc., as discussed above) and receive data indicating the user-provided characteristics of the playback zone 810.
The computing device may then, at block 1106 identify an audio processing algorithm based on the received data, and at block 1108, transmit data indicating the identified audio processing algorithm to the playback device 804. The computing device 802 may also transmit a command for the playback device 804 to apply the identified audio processing algorithm when playing audio content in the playback zone 810. Other examples are also possible.
The description above discloses, among other things, various example systems, methods, apparatus, and articles of manufacture including, among other components, firmware and/or software executed on hardware. It is understood that such examples are merely illustrative and should not be considered as limiting. For example, it is contemplated that any or all of the firmware, hardware, and/or software aspects or components can be embodied exclusively in hardware, exclusively in software, exclusively in firmware, or in any combination of hardware, software, and/or firmware. Accordingly, the examples provided are not the only way(s) to implement such systems, methods, apparatus, and/or articles of manufacture.
Additionally, references herein to “embodiment” means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one example embodiment of an invention. The appearances of this phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. As such, the embodiments described herein, explicitly and implicitly understood by one skilled in the art, can be combined with other embodiments.
The specification is presented largely in terms of illustrative environments, systems, procedures, steps, logic blocks, processing, and other symbolic representations that directly or indirectly resemble the operations of data processing devices coupled to networks. These process descriptions and representations are typically used by those skilled in the art to most effectively convey the substance of their work to others skilled in the art. Numerous specific details are set forth to provide a thorough understanding of the present disclosure. However, it is understood to those skilled in the art that certain embodiments of the present disclosure can be practiced without certain, specific details. In other instances, well known methods, procedures, components, and circuitry have not been described in detail to avoid unnecessarily obscuring aspects of the embodiments. Accordingly, the scope of the present disclosure is defined by the appended claims rather than the forgoing description of embodiments.
When any of the appended claims are read to cover a purely software and/or firmware implementation, at least one of the elements in at least one example is hereby expressly defined to include a tangible, non-transitory medium such as a memory, DVD, CD, Blu-ray, and so on, storing the software and/or firmware.
Patent | Priority | Assignee | Title |
Patent | Priority | Assignee | Title |
10045142, | Apr 12 2016 | Sonos, Inc. | Calibration of audio playback devices |
10154359, | Sep 09 2014 | Sonos, Inc. | Playback device calibration |
10206052, | Dec 22 2015 | BRAGI GmbH | Analytical determination of remote battery temperature through distributed sensor array system and method |
4306113, | Nov 23 1979 | Method and equalization of home audio systems | |
4342104, | Nov 02 1979 | University Court of the University of Edinburgh | Helium-speech communication |
4504704, | Aug 31 1982 | Pioneer Electronic Corporation | Loudspeaker system |
4592088, | Oct 14 1982 | Matsushita Electric Industrial Co., Ltd. | Speaker apparatus |
4628530, | Feb 23 1983 | Fujifilm Electronic Imaging Limited | Automatic equalizing system with DFT and FFT |
4631749, | Jun 22 1984 | NEC Corporation | ROM compensated microphone |
4694484, | Feb 18 1986 | MOTOROLA, INC , A CORP OF DE | Cellular radiotelephone land station |
4773094, | Dec 23 1985 | Dolby Laboratories Licensing Corporation | Apparatus and method for calibrating recording and transmission systems |
4995778, | Jan 07 1989 | UMFORMTECHNIK ERFURT GMBH | Gripping apparatus for transporting a panel of adhesive material |
5218710, | Jun 19 1989 | Pioneer Electronic Corporation | Audio signal processing system having independent and distinct data buses for concurrently transferring audio signal data to provide acoustic control |
5255326, | May 18 1992 | Interactive audio control system | |
5323257, | Aug 09 1991 | Sony Corporation | Microphone and microphone system |
5386478, | Sep 07 1993 | Harman International Industries, Inc. | Sound system remote control with acoustic sensor |
5440644, | Jan 09 1991 | ELAN HOME SYSTEMS, L L C | Audio distribution system having programmable zoning features |
5553147, | May 11 1993 | One Inc. | Stereophonic reproduction method and apparatus |
5581621, | Apr 19 1993 | CLARION CO , LTD | Automatic adjustment system and automatic adjustment method for audio devices |
5757927, | Mar 02 1992 | Trifield Productions Ltd. | Surround sound apparatus |
5761320, | Jan 09 1991 | Core Brands, LLC | Audio distribution system having programmable zoning features |
5910991, | Aug 02 1996 | Apple Inc | Method and apparatus for a speaker for a personal computer for selective use as a conventional speaker or as a sub-woofer |
5923902, | Feb 20 1996 | Yamaha Corporation | System for synchronizing a plurality of nodes to concurrently generate output signals by adjusting relative timelags based on a maximum estimated timelag |
5939656, | Nov 25 1997 | Kabushiki Kaisha Kawai Gakki Seisakusho | Music sound correcting apparatus and music sound correcting method capable of achieving similar audibilities even by speaker/headphone |
6018376, | Aug 19 1996 | MATSUSHITA ELECTRIC INDUSTRIAL CO , LTD | Synchronous reproduction apparatus |
6032202, | Jan 06 1998 | Sony Corporation | Home audio/video network with two level device control |
6072879, | Jun 17 1996 | Yamaha Corporation | Sound field control unit and sound field control device |
6111957, | Jul 02 1998 | CIRRUS LOGIC INC | Apparatus and method for adjusting audio equipment in acoustic environments |
6256554, | Apr 14 1999 | CERBERUS BUSINESS FINANCE, LLC | Multi-room entertainment system with in-room media player/dispenser |
6363155, | Sep 24 1997 | Studer Professional Audio AG | Process and device for mixing sound signals |
6404811, | May 13 1996 | Google Technology Holdings LLC | Interactive multimedia system |
6469633, | Jan 06 1997 | D&M HOLDINGS US INC | Remote control of electronic devices |
6522886, | Nov 22 1999 | Qwest Communications International Inc | Method and system for simultaneously sharing wireless communications among multiple wireless handsets |
6573067, | Jan 29 1998 | Yale University | Nucleic acid encoding sodium channels in dorsal root ganglia |
6611537, | May 30 1997 | HAIKU ACQUISITION CORPORATION; CENTILLIUM COMMUNICATIONS, INC | Synchronous network for digital media streams |
6631410, | Mar 16 2000 | Sharp Kabushiki Kaisha | Multimedia wired/wireless content synchronization system and method |
6639989, | Sep 25 1998 | Nokia Technologies Oy | Method for loudness calibration of a multichannel sound systems and a multichannel sound system |
6643744, | Aug 23 2000 | NINTENDO CO , LTD | Method and apparatus for pre-fetching audio data |
6704421, | Jul 24 1997 | ATI Technologies, Inc. | Automatic multichannel equalization control system for a multimedia computer |
6721428, | Nov 13 1998 | Texas Instruments Incorporated | Automatic loudspeaker equalizer |
6757517, | May 10 2001 | DEDICATED LICENSING LLC | Apparatus and method for coordinated music playback in wireless ad-hoc networks |
6760451, | Aug 03 1993 | Compensating filters | |
6766025, | Mar 15 1999 | NXP B V | Intelligent speaker training using microphone feedback and pre-loaded templates |
6778869, | Dec 11 2000 | Sony Corporation; Sony Electronics, Inc. | System and method for request, delivery and use of multimedia files for audiovisual entertainment in the home environment |
6798889, | Nov 12 1999 | CREATIVE TECHNOLOGY, INC | Method and apparatus for multi-channel sound system calibration |
6862440, | May 29 2002 | TAHOE RESEARCH, LTD | Method and system for multiple channel wireless transmitter and receiver phase and amplitude calibration |
6916980, | Apr 23 2002 | Kabushiki Kaisha Kawai Gakki Seisakusho | Acoustic control system for electronic musical instrument |
6931134, | Jul 28 1998 | Multi-dimensional processor and multi-dimensional audio processor system | |
6985694, | Sep 07 2000 | DEDICATED LICENSING LLC | Method and system for providing an audio element cache in a customized personal radio broadcast |
6990211, | Feb 11 2003 | Hewlett-Packard Development Company, L.P. | Audio system and method |
7031476, | Jun 13 2000 | Sharp Kabushiki Kaisha | Method and apparatus for intelligent speaker |
7039212, | Sep 12 2003 | VIPER BORROWER CORPORATION, INC ; VIPER HOLDINGS CORPORATION; VIPER ACQUISITION CORPORATION; DEI SALES, INC ; DEI HOLDINGS, INC ; DEI INTERNATIONAL, INC ; DEI HEADQUARTERS, INC ; POLK HOLDING CORP ; Polk Audio, Inc; BOOM MOVEMENT, LLC; Definitive Technology, LLC; DIRECTED, LLC | Weather resistant porting |
7058186, | Dec 01 1999 | MATSUSHITA ELECTRIC INDUSTRIAL CO , LTD | Loudspeaker device |
7072477, | Jul 09 2002 | Apple Inc | Method and apparatus for automatically normalizing a perceived volume level in a digitally encoded file |
7103187, | Mar 30 1999 | AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE LIMITED | Audio calibration system |
7130608, | Dec 03 1999 | Telefonaktiegolaget LM Ericsson (publ) | Method of using a communications device together with another communications device, a communications system, a communications device and an accessory device for use in connection with a communications device |
7130616, | Apr 25 2000 | MUSICQUBED INNOVATIONS, LLC | System and method for providing content, management, and interactivity for client devices |
7143939, | Dec 19 2000 | Intel Corporation | Wireless music device and method therefor |
7187947, | Mar 28 2000 | RPX Corporation | System and method for communicating selected information to an electronic device |
7236773, | May 31 2000 | Nokia Mobile Phones Limited | Conference call method and apparatus therefor |
7289637, | Feb 06 2001 | Robert Bosch GmbH | Method for automatically adjusting the filter parameters of a digital equalizer and reproduction device for audio signals for implementing such a method |
7295548, | Nov 27 2002 | Microsoft Technology Licensing, LLC | Method and system for disaggregating audio/visual components |
7312785, | Oct 22 2001 | Apple Inc | Method and apparatus for accelerated scrolling |
7391791, | Dec 17 2001 | IMPLICIT NETWORKS, INC | Method and system for synchronization of content rendering |
7477751, | Apr 23 2003 | LYON, RICHARD H | Method and apparatus for sound transduction with minimal interference from background noise and minimal local acoustic radiation |
7483538, | Mar 02 2004 | Apple, Inc; Apple Inc | Wireless and wired speaker hub for a home theater system |
7483540, | Mar 25 2002 | Bose Corporation | Automatic audio system equalizing |
7489784, | Nov 19 2003 | ONKYO KABUSHIKI KAISHA D B A ONKYO CORPORATION | Automatic sound field correcting device and computer program therefor |
7490044, | Jun 08 2004 | Bose Corporation | Audio signal processing |
7492909, | Apr 05 2001 | MOTOROLA SOLUTIONS, INC | Method for acoustic transducer calibration |
7519188, | Sep 18 2003 | Bose Corporation | Electroacoustical transducing |
7529377, | Jul 29 2005 | KLIPSCH GROUP, INC | Loudspeaker with automatic calibration and room equalization |
7571014, | Apr 01 2004 | Sonos, Inc | Method and apparatus for controlling multimedia players in a multi-zone system |
7590772, | Aug 22 2005 | Apple Inc | Audio status information for a portable electronic device |
7630500, | Apr 15 1994 | Bose Corporation | Spatial disassembly processor |
7630501, | May 14 2004 | Microsoft Technology Licensing, LLC | System and method for calibration of an acoustic system |
7643894, | May 09 2002 | CLEARONE INC | Audio network distribution system |
7657910, | Jul 26 1999 | AMI ENTERTAINMENT NETWORK, LLC | Distributed electronic entertainment method and apparatus |
7664276, | Sep 23 2004 | Cirrus Logic, INC | Multipass parametric or graphic EQ fitting |
7676044, | Dec 10 2003 | Sony Corporation | Multi-speaker audio system and automatic control method |
7689305, | Mar 26 2004 | Harman International Industries, Incorporated | System for audio-related device communication |
7720237, | Sep 07 2004 | SOUND UNITED, LLC | Phase equalization for multi-channel loudspeaker-room responses |
7742740, | May 06 2002 | TUNNEL IP LLC | Audio player device for synchronous playback of audio signals with a compatible device |
7769183, | Jun 21 2002 | SOUND UNITED, LLC | System and method for automatic room acoustic correction in multi-channel audio environments |
7796068, | Jul 16 2007 | RAZ, GIL M | System and method of multi-channel signal calibration |
7835689, | May 06 2002 | TUNNEL IP LLC | Distribution of music between members of a cluster of mobile audio devices and a wide area network |
7853341, | Jan 25 2002 | Apple, Inc; Apple Inc | Wired, wireless, infrared, and powerline audio entertainment systems |
7876903, | Jul 07 2006 | Harris Corporation | Method and apparatus for creating a multi-dimensional communication space for use in a binaural audio system |
7925203, | Jan 22 2003 | Qualcomm Incorporated | System and method for controlling broadcast multimedia using plural wireless network connections |
7949140, | Oct 18 2005 | Sony Corporation | Sound measuring apparatus and method, and audio signal processing apparatus |
7949707, | Jun 16 1999 | DIGIMEDIA TECH, LLC | Internet radio receiver with linear tuning interface |
7961893, | Oct 19 2005 | Sony Corporation | Measuring apparatus, measuring method, and sound signal processing apparatus |
7970922, | Jul 11 2006 | Concert Technology Corporation | P2P real time media recommendations |
7987294, | Oct 17 2006 | D&M HOLDINGS, INC | Unification of multimedia devices |
8005228, | Jun 21 2002 | SOUND UNITED, LLC | System and method for automatic multiple listener room acoustic correction with low filter orders |
8014423, | Feb 18 2000 | POLARIS POWERLED TECHNOLOGIES, LLC | Reference time distribution over a network |
8045721, | Dec 14 2006 | Google Technology Holdings LLC | Dynamic distortion elimination for output audio |
8045952, | Jan 22 1998 | GOLDEN IP LLC | Method and device for obtaining playlist content over a network |
8050652, | Jan 22 1998 | GOLDEN IP LLC | Method and device for an internet radio capable of obtaining playlist content from a content server |
8063698, | May 02 2008 | Bose Corporation | Bypassing amplification |
8074253, | Jul 22 1998 | TouchTunes Music Corporation | Audiovisual reproduction system |
8103009, | Jan 25 2002 | Apple, Inc; Apple Inc | Wired, wireless, infrared, and powerline audio entertainment systems |
8116476, | Dec 27 2007 | Sony Corporation | Audio signal receiving apparatus, audio signal receiving method and audio signal transmission system |
8126172, | Dec 06 2007 | Harman International Industries, Incorporated | Spatial processing stereo system |
8131390, | May 09 2002 | CLEARONE INC | Network speaker for an audio network distribution system |
8139774, | Mar 03 2010 | Bose Corporation | Multi-element directional acoustic arrays |
8144883, | May 06 2004 | Bang & Olufsen A/S | Method and system for adapting a loudspeaker to a listening position in a room |
8160276, | Jan 09 2007 | Generalplus Technology Inc. | Audio system and related method integrated with ultrasound communication functionality |
8160281, | Sep 08 2004 | Samsung Electronics Co., Ltd. | Sound reproducing apparatus and sound reproducing method |
8170260, | Jun 23 2005 | AKG Acoustics GmbH | System for determining the position of sound sources |
8175292, | Jun 21 2001 | Bose Corporation | Audio signal processing |
8175297, | Jul 06 2011 | GOOGLE LLC | Ad hoc sensor arrays |
8194874, | May 22 2007 | VIPER BORROWER CORPORATION, INC ; VIPER HOLDINGS CORPORATION; VIPER ACQUISITION CORPORATION; DEI SALES, INC ; DEI HOLDINGS, INC ; DEI INTERNATIONAL, INC ; DEI HEADQUARTERS, INC ; POLK HOLDING CORP ; Polk Audio, Inc; BOOM MOVEMENT, LLC; Definitive Technology, LLC; DIRECTED, LLC | In-room acoustic magnitude response smoothing via summation of correction signals |
8229125, | Feb 06 2009 | Bose Corporation | Adjusting dynamic range of an audio system |
8233632, | May 20 2011 | GOOGLE LLC | Method and apparatus for multi-channel audio processing using single-channel components |
8234395, | Jul 28 2003 | Sonos, Inc | System and method for synchronizing operations among a plurality of independently clocked digital data processing devices |
8238547, | May 11 2004 | Sony Corporation | Sound pickup apparatus and echo cancellation processing method |
8238578, | Dec 03 2002 | Bose Corporation | Electroacoustical transducing with low frequency augmenting devices |
8243961, | Jun 27 2011 | GOOGLE LLC | Controlling microphones and speakers of a computing device |
8264408, | Nov 20 2007 | Nokia Technologies Oy | User-executable antenna array calibration |
8265310, | Mar 03 2010 | Bose Corporation | Multi-element directional acoustic arrays |
8270620, | Dec 16 2005 | MUSIC GROUP IP LTD | Method of performing measurements by means of an audio system comprising passive loudspeakers |
8279709, | Jul 18 2007 | Bang & Olufsen A/S | Loudspeaker position estimation |
8281001, | Sep 19 2000 | Harman International Industries, Incorporated | Device-to-device network |
8290185, | Jan 31 2008 | Samsung Electronics Co., Ltd. | Method of compensating for audio frequency characteristics and audio/video apparatus using the method |
8291349, | Jan 19 2011 | GOOGLE LLC | Gesture-based metadata display |
8300845, | Jun 23 2010 | Google Technology Holdings LLC | Electronic apparatus having microphones with controllable front-side gain and rear-side gain |
8306235, | Jul 17 2007 | Apple Inc.; Apple Inc | Method and apparatus for using a sound sensor to adjust the audio output for a device |
8325931, | May 02 2008 | Bose Corporation | Detecting a loudspeaker configuration |
8325935, | Mar 14 2007 | Qualcomm Incorporated | Speaker having a wireless link to communicate with another speaker |
8325944, | Nov 07 2008 | Adobe Inc | Audio mixes for listening environments |
8331585, | May 11 2006 | GOOGLE LLC | Audio mixing |
8332414, | Jul 01 2008 | Samsung Electronics Co., Ltd. | Method and system for prefetching internet content for video recorders |
8379876, | May 27 2008 | Fortemedia, Inc | Audio device utilizing a defect detection method on a microphone array |
8391501, | Dec 13 2006 | Google Technology Holdings LLC | Method and apparatus for mixing priority and non-priority audio signals |
8392505, | Sep 26 2008 | Apple Inc. | Collaborative playlist management |
8401202, | Mar 07 2008 | KSC Industries Incorporated | Speakers with a digital signal processor |
8433076, | Jul 26 2010 | Google Technology Holdings LLC | Electronic apparatus for generating beamformed audio signals with steerable nulls |
8452020, | Aug 20 2008 | Apple Inc.; Apple Inc | Adjustment of acoustic properties based on proximity detection |
8463184, | May 12 2005 | SYNDEFENSE | Wireless media system-on-chip and player |
8483853, | Sep 12 2006 | Sonos, Inc.; Sonos, Inc | Controlling and manipulating groupings in a multi-zone media system |
8488799, | Sep 11 2008 | ST PORTFOLIO HOLDINGS, LLC; ST CASE1TECH, LLC | Method and system for sound monitoring over a network |
8503669, | Apr 07 2008 | SONY INTERACTIVE ENTERTAINMENT INC | Integrated latency detection and echo cancellation |
8527876, | Jun 12 2008 | Apple Inc. | System and methods for adjusting graphical representations of media files based on previous usage |
8577045, | Sep 25 2007 | Google Technology Holdings LLC | Apparatus and method for encoding a multi-channel audio signal |
8577048, | Sep 02 2005 | Harman International Industries, Incorporated | Self-calibrating loudspeaker system |
8600075, | Sep 11 2007 | Samsung Electronics Co., Ltd. | Method for equalizing audio, and video apparatus using the same |
8620006, | May 13 2009 | Bose Corporation | Center channel rendering |
8682002, | Jul 02 2009 | Synaptics Incorporated | Systems and methods for transducer calibration and tuning |
8731206, | Oct 10 2012 | GOOGLE LLC | Measuring sound quality using relative comparison |
8755538, | Jun 30 2008 | Tuning sound feed-back device | |
8798280, | Mar 28 2006 | Genelec Oy | Calibration method and device in an audio system |
8819554, | Dec 23 2008 | AT&T Intellectual Property I, L.P. | System and method for playing media |
8831244, | May 10 2011 | III Holdings 4, LLC | Portable tone generator for producing pre-calibrated tones |
8855319, | May 25 2011 | XUESHAN TECHNOLOGIES INC | Audio signal processing apparatus and audio signal processing method |
8862273, | Jul 29 2010 | Empire Technology Development LLC | Acoustic noise management through control of electrical device operations |
8879761, | Nov 22 2011 | Apple Inc | Orientation-based audio |
8903526, | Jun 06 2012 | Sonos, Inc | Device playback failure recovery and redistribution |
8914559, | Dec 12 2006 | Apple Inc. | Methods and systems for automatic configuration of peripherals |
8930005, | Aug 07 2012 | Sonos, Inc.; Sonos, Inc | Acoustic signatures in a playback system |
8934647, | Apr 14 2011 | Bose Corporation | Orientation-responsive acoustic driver selection |
8934655, | Apr 14 2011 | Bose Corporation | Orientation-responsive use of acoustic reflection |
8942252, | Dec 17 2001 | IMPLICIT NETWORKS, INC | Method and system synchronization of content rendering |
8965033, | Aug 31 2012 | Sonos, Inc.; Sonos, Inc | Acoustic optimization |
8965546, | Jul 26 2010 | Qualcomm Incorporated | Systems, methods, and apparatus for enhanced acoustic imaging |
8977974, | Dec 08 2008 | Apple Inc.; Apple Inc | Ambient noise based augmentation of media playback |
8984442, | Nov 17 2006 | Apple Inc. | Method and system for upgrading a previously purchased media asset |
8989406, | Mar 11 2011 | Sony Corporation; SONY NETWORK ENTERTAINMENT INTERNATIONAL LLC | User profile based audio adjustment techniques |
8995687, | Aug 01 2012 | Sonos, Inc | Volume interactions for connected playback devices |
8996370, | Jan 31 2012 | Microsoft Technology Licensing, LLC | Transferring data via audio link |
9020153, | Oct 24 2012 | GOOGLE LLC | Automatic detection of loudspeaker characteristics |
9021153, | Feb 20 2008 | MEDIATEK INC | Direct memory access system and method using the same |
9065929, | Aug 02 2011 | Apple Inc.; Apple Inc | Hearing aid detection |
9084058, | Dec 29 2011 | SONOS, INC , A DELAWARE CORPORATION | Sound field calibration using listener localization |
9100766, | Oct 05 2009 | Harman International Industries, Incorporated | Multichannel audio system having audio channel compensation |
9106192, | Jun 28 2012 | Sonos, Inc | System and method for device playback calibration |
9179233, | Mar 30 2012 | Samsung Electronics Co., Ltd. | Apparatus and method for interfacing earphone |
9215545, | May 31 2013 | Bose Corporation | Sound stage controller for a near-field speaker-based audio system |
9219460, | Mar 17 2014 | Sonos, Inc | Audio settings based on environment |
9231545, | Sep 27 2013 | Sonos, Inc | Volume enhancements in a multi-zone media playback system |
9286384, | Sep 21 2011 | SONOS, INC , A DELAWARE CORPORATION | Methods and systems to share media |
9288597, | Jan 20 2014 | Sony Corporation | Distributed wireless speaker system with automatic configuration determination when new speakers are added |
9300266, | Feb 12 2013 | Qualcomm Incorporated | Speaker equalization for mobile devices |
9319816, | Sep 26 2012 | Amazon Technologies, Inc | Characterizing environment using ultrasound pilot tones |
9451377, | Jan 07 2014 | Howard, Massey | Device, method and software for measuring distance to a sound generator by using an audible impulse signal |
9462399, | Jul 01 2011 | Dolby Laboratories Licensing Corporation | Audio playback system monitoring |
9467779, | May 13 2014 | Apple Inc.; Apple Inc | Microphone partial occlusion detector |
9472201, | May 22 2013 | GOOGLE LLC | Speaker localization by means of tactile input |
9489948, | Nov 28 2011 | Amazon Technologies, Inc | Sound source localization using multiple microphone arrays |
9524098, | May 08 2012 | Sonos, Inc | Methods and systems for subwoofer calibration |
9538305, | Jul 28 2015 | Sonos, Inc | Calibration error conditions |
9538308, | Mar 14 2013 | Apple Inc | Adaptive room equalization using a speaker and a handheld listening device |
9560449, | Jan 17 2014 | Sony Corporation | Distributed wireless speaker system |
9560460, | Sep 02 2005 | Harman International Industries, Incorporated | Self-calibration loudspeaker system |
9609383, | Mar 23 2015 | Amazon Technologies, Inc | Directional audio for virtual environments |
9615171, | Jul 02 2012 | Amazon Technologies, Inc | Transformation inversion to reduce the effect of room acoustics |
9674625, | Apr 18 2011 | Apple Inc. | Passive proximity detection |
9689960, | Apr 04 2013 | Amazon Technologies, Inc | Beam rejection in multi-beam microphone systems |
9690271, | Apr 24 2015 | Sonos, Inc | Speaker calibration |
9706323, | Sep 09 2014 | Sonos, Inc | Playback device calibration |
9723420, | Mar 06 2013 | Apple Inc | System and method for robust simultaneous driver measurement for a speaker system |
9743207, | Jan 18 2016 | Sonos, Inc | Calibration using multiple recording devices |
9743208, | Mar 17 2014 | Sonos, Inc. | Playback device configuration based on proximity detection |
9763018, | Apr 12 2016 | Sonos, Inc | Calibration of audio playback devices |
9788113, | Jul 07 2015 | Sonos, Inc | Calibration state variable |
9860662, | Apr 01 2016 | Sonos, Inc | Updating playback device configuration information based on calibration data |
9864574, | Apr 01 2016 | Sonos, Inc | Playback device calibration based on representation spectral characteristics |
20010038702, | |||
20010042107, | |||
20010043592, | |||
20010053228, | |||
20020022453, | |||
20020026442, | |||
20020078161, | |||
20020089529, | |||
20020124097, | |||
20020126852, | |||
20020136414, | |||
20020146136, | |||
20030002689, | |||
20030031334, | |||
20030157951, | |||
20030161479, | |||
20030161492, | |||
20030179891, | |||
20030235311, | |||
20040024478, | |||
20040131338, | |||
20040237750, | |||
20050031143, | |||
20050063554, | |||
20050147261, | |||
20050157885, | |||
20060008256, | |||
20060026521, | |||
20060032357, | |||
20060195480, | |||
20060225097, | |||
20070003067, | |||
20070025559, | |||
20070032895, | |||
20070038999, | |||
20070086597, | |||
20070116254, | |||
20070121955, | |||
20070142944, | |||
20080002839, | |||
20080014989, | |||
20080065247, | |||
20080069378, | |||
20080077261, | |||
20080098027, | |||
20080136623, | |||
20080144864, | |||
20080175411, | |||
20080214160, | |||
20080232603, | |||
20080266385, | |||
20080281523, | |||
20090003613, | |||
20090024662, | |||
20090047993, | |||
20090063274, | |||
20090110218, | |||
20090138507, | |||
20090147134, | |||
20090180632, | |||
20090196428, | |||
20090202082, | |||
20090252481, | |||
20090304194, | |||
20090304205, | |||
20090316923, | |||
20100095332, | |||
20100128902, | |||
20100135501, | |||
20100142735, | |||
20100146445, | |||
20100162117, | |||
20100189203, | |||
20100195846, | |||
20100272270, | |||
20100296659, | |||
20100303248, | |||
20100303250, | |||
20100323793, | |||
20110007904, | |||
20110007905, | |||
20110087842, | |||
20110091055, | |||
20110135103, | |||
20110170710, | |||
20110234480, | |||
20110235808, | |||
20110268281, | |||
20120032928, | |||
20120051558, | |||
20120057724, | |||
20120093320, | |||
20120127831, | |||
20120140936, | |||
20120148075, | |||
20120183156, | |||
20120213391, | |||
20120215530, | |||
20120237037, | |||
20120243697, | |||
20120263325, | |||
20120268145, | |||
20120269356, | |||
20120275613, | |||
20120283593, | |||
20120288124, | |||
20130010970, | |||
20130028443, | |||
20130051572, | |||
20130066453, | |||
20130108055, | |||
20130129102, | |||
20130129122, | |||
20130166227, | |||
20130202131, | |||
20130211843, | |||
20130216071, | |||
20130223642, | |||
20130230175, | |||
20130259254, | |||
20130279706, | |||
20130305152, | |||
20130315405, | |||
20130329896, | |||
20130331970, | |||
20140003622, | |||
20140003623, | |||
20140003625, | |||
20140003626, | |||
20140003635, | |||
20140006587, | |||
20140016784, | |||
20140016786, | |||
20140016802, | |||
20140023196, | |||
20140029201, | |||
20140032709, | |||
20140037097, | |||
20140037107, | |||
20140052770, | |||
20140064501, | |||
20140079242, | |||
20140084014, | |||
20140086423, | |||
20140112481, | |||
20140119551, | |||
20140126730, | |||
20140161265, | |||
20140169569, | |||
20140180684, | |||
20140192986, | |||
20140219456, | |||
20140219483, | |||
20140226823, | |||
20140242913, | |||
20140267148, | |||
20140270202, | |||
20140270282, | |||
20140273859, | |||
20140279889, | |||
20140285313, | |||
20140286496, | |||
20140294200, | |||
20140294201, | |||
20140310269, | |||
20140321670, | |||
20140323036, | |||
20140334644, | |||
20140341399, | |||
20140344689, | |||
20140355768, | |||
20140355794, | |||
20150011195, | |||
20150016642, | |||
20150023509, | |||
20150031287, | |||
20150032844, | |||
20150036847, | |||
20150036848, | |||
20150043736, | |||
20150063610, | |||
20150078586, | |||
20150078596, | |||
20150100991, | |||
20150146886, | |||
20150149943, | |||
20150161360, | |||
20150195666, | |||
20150201274, | |||
20150208184, | |||
20150212788, | |||
20150220558, | |||
20150223002, | |||
20150229699, | |||
20150260754, | |||
20150271616, | |||
20150281866, | |||
20150289064, | |||
20150358756, | |||
20150382128, | |||
20160007116, | |||
20160011846, | |||
20160011850, | |||
20160014509, | |||
20160014510, | |||
20160014511, | |||
20160014534, | |||
20160014536, | |||
20160021458, | |||
20160021473, | |||
20160021481, | |||
20160027467, | |||
20160029142, | |||
20160035337, | |||
20160036881, | |||
20160037277, | |||
20160061597, | |||
20160070526, | |||
20160073210, | |||
20160119730, | |||
20160140969, | |||
20160165297, | |||
20160192098, | |||
20160192099, | |||
20160212535, | |||
20160239255, | |||
20160260140, | |||
20160309276, | |||
20160313971, | |||
20160316305, | |||
20160330562, | |||
20160366517, | |||
20170069338, | |||
20170083279, | |||
20170086003, | |||
20170105084, | |||
20170142532, | |||
20170207762, | |||
20170223447, | |||
20170230772, | |||
20170257722, | |||
20170280265, | |||
20170303039, | |||
20170311108, | |||
20170374482, | |||
20190037328, | |||
CN101366177, | |||
CN101491116, | |||
CN102318325, | |||
CN102893633, | |||
CN103988523, | |||
CN105163221, | |||
CN1447624, | |||
EP505949, | |||
EP772374, | |||
EP1133896, | |||
EP1349427, | |||
EP1389853, | |||
EP1825713, | |||
EP2043381, | |||
EP2161950, | |||
EP2194471, | |||
EP2197220, | |||
EP2429155, | |||
EP2591617, | |||
EP2613573, | |||
EP2835989, | |||
EP2860992, | |||
EP2974382, | |||
EP3128767, | |||
JP1069280, | |||
JP2002502193, | |||
JP2003143252, | |||
JP2003304590, | |||
JP2005086686, | |||
JP2005538633, | |||
JP2006017893, | |||
JP2006180039, | |||
JP2007068125, | |||
JP2007271802, | |||
JP2008228133, | |||
JP2009188474, | |||
JP2010081124, | |||
JP2011123376, | |||
JP2011164166, | |||
JP2011217068, | |||
JP2013253884, | |||
JP2280199, | |||
JP5199593, | |||
JP5211700, | |||
JP6327089, | |||
JP723490, | |||
KR1020060116383, | |||
KR1020080011831, | |||
WO182650, | |||
WO200153994, | |||
WO200182650, | |||
WO2003093950, | |||
WO2004066673, | |||
WO2007016465, | |||
WO2011139502, | |||
WO2013016500, | |||
WO2014032709, | |||
WO2014036121, | |||
WO2015024881, | |||
WO2015108794, | |||
WO2015178950, | |||
WO2016040324, | |||
WO2017049169, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Sep 15 2014 | SHEEN, TIMOTHY W | Sonos, Inc | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 047410 | /0813 | |
Apr 17 2018 | Sonos, Inc. | (assignment on the face of the patent) | / | |||
Jul 20 2018 | Sonos, Inc | JPMORGAN CHASE BANK, N A | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 046991 | /0433 | |
Oct 13 2021 | Sonos, Inc | JPMORGAN CHASE BANK, N A | SECURITY AGREEMENT | 058123 | /0206 | |
Oct 13 2021 | JPMORGAN CHASE BANK, N A | Sonos, Inc | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 058213 | /0597 |
Date | Maintenance Fee Events |
Apr 17 2018 | BIG: Entity status set to Undiscounted (note the period is included in the code). |
Sep 05 2023 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
Date | Maintenance Schedule |
Mar 24 2023 | 4 years fee payment window open |
Sep 24 2023 | 6 months grace period start (w surcharge) |
Mar 24 2024 | patent expiry (for year 4) |
Mar 24 2026 | 2 years to revive unintentionally abandoned end. (for year 4) |
Mar 24 2027 | 8 years fee payment window open |
Sep 24 2027 | 6 months grace period start (w surcharge) |
Mar 24 2028 | patent expiry (for year 8) |
Mar 24 2030 | 2 years to revive unintentionally abandoned end. (for year 8) |
Mar 24 2031 | 12 years fee payment window open |
Sep 24 2031 | 6 months grace period start (w surcharge) |
Mar 24 2032 | patent expiry (for year 12) |
Mar 24 2034 | 2 years to revive unintentionally abandoned end. (for year 12) |