personal listening device (pld) includes earphone housing having therein (a) inertial sensor to detect motion of pld and to generate motion signal, (b) pressure sensor to detect compression of portion of pld and to generate pressure sensor signal, and (c) speaker to receive anti-noise signal and desired audio signal from electronic device, and active noise control (anc) system to generate anti-noise signal as being one of first or second anti-noise signal. anc system includes processor, vibration detector to detect vibration of the pld based on at least one of motion signal or pressure sensor signal, and anc anti-noise generator to generate first anti-noise signal when vibrations are not detected by vibration detector, and to generate second anti-noise signal when vibrations are detected by vibration detector. second anti-noise signal is based on detected vibrations. Processor reconfigures anc system for anc anti-noise generator to generate second anti-noise signal. Other embodiments are described.
|
11. A method of active noise cancellation in a personal listening device (pld) comprising:
receiving by an active noise control (anc) system a reference microphone acoustic signal and an error microphone acoustic signal from the pld;
receiving by the anc system at least one of a motion signal or a pressure sensor signal from the pld, wherein the motion signal is based on a detected motion of the pld and the pressure sensor signal is based on a detected compression of a portion of the pld;
determining by the anc system whether vibrations of the pld are detected based on at least one of the motion signal or the pressure sensor signal;
when vibrations are not detected, generating by the anc system a first anti-noise signal based on the reference microphone acoustic signal and the error microphone acoustic signal; and
when vibrations are detected, generating by the anc system a second anti-noise signal, wherein generating by the anc system the second anti-noise signal includes reconfiguring the anc system.
19. A computer-readable non-transitory storage medium having stored therein instructions, when executed by a processor, causes an active noise control (anc) system to perform a method of active noise cancellation in a personal listening device (pld), the method comprising: receiving a reference microphone acoustic signal and an error microphone acoustic signal from the pld; receiving at least one of a motion signal or a pressure sensor signal from the pld, wherein the motion signal is based on a detected motion of the pld and the pressure sensor signal is based on a detected compression of a portion of the pld; determining whether vibrations of the pld are detected based on at least one of the motion signal or the pressure sensor signal; when vibrations are not detected, generating a first anti-noise signal based on the reference microphone acoustic signal and the error microphone acoustic signal; and when vibrations are detected, generating a second anti-noise signal, wherein the processor reconfigures the anc system to generate the second anti-noise signal.
1. A personal listening device (pld) comprising:
an earphone housing having therein (a) an inertial sensor to detect motion of the pld and to generate a motion signal, (b) a pressure sensor to detect compression of a portion of the pld and to generate pressure sensor signal, and (c) a speaker to receive an anti-noise signal and a desired audio signal from an electronic device; and
an active noise control (anc) system to generate the anti-noise signal as being one of a first anti-noise signal or a second anti-noise signal, the anc system includes
a processor,
a vibration detector coupled to the processor, the vibration detector to detect a vibration of the pld based on at least one of the motion signal or the pressure sensor signal, and
an anc anti-noise generator coupled to the processor, the anc anti-noise generator to generate the first anti-noise signal when vibrations are not detected by the vibration detector, and to generate the second anti-noise signal when vibrations are detected by the vibration detector, the second anti-noise signal being based on detected vibrations,
wherein the processor reconfigures the anc system for the anc anti-noise generator to generate the second anti-noise signal.
2. The pld in
3. The pld in
4. The pld in
to store a plurality of predetermined sensor data patterns including patterns that indicate the contexts of: walking, jumping, running, and vehicle motions or vibrations.
5. The pld in
the vibration detector matching at least one of the motion signal or the pressure sensor signal with at least one of the predetermined sensor data patterns.
6. The pld of
the processor locking filter coefficients of an adaptive filter included in the anc system or locking filtering by the adaptive filter included in the anc system.
7. The pld of
the processor changing a speed of updates made to an adaptive filter by an adaptive filter controller included in the anc system.
8. The pld of
the processor selecting predetermined adaptive filter coefficients associated with the at least one of the predetermined sensor data patterns, wherein the predetermined coefficients are stored in the memory device, and
the processor overriding filter coefficients of an adaptive filter, that were computed by an adaptive filter controller included in the anc system, with the predetermined filter coefficients.
9. The pld of
the processor applying a jacket on filter coefficients of an adaptive filter included in the anc system.
10. The pld of
the processor muting the anti-noise signal output from the speaker.
12. The method of
the anc system matching at least one of the motion signal or the pressure sensor signal with at least one of a plurality of predetermined sensor data patterns.
13. The method of
14. The method of
15. The method of
locking filter coefficients of an adaptive filter included in the anc system.
16. The method of
changing a speed of updates made to an adaptive filter by an adaptive filter controller included in the anc system.
17. The method of
selecting predetermined adaptive filter coefficients associated with the at least one of the predetermined sensor data patterns, wherein the predetermined coefficients are stored in the memory device, and
a processor overriding filter coefficients of an adaptive filter, that were computed by an adaptive filter controller included in the anc system, with the predetermined filter coefficients.
18. The method of
a processor applying a jacket on filter coefficients of an adaptive filter included in the anc system.
20. The computer-readable non-transitory storage medium of
21. The computer-readable non-transitory storage medium of
|
Embodiments of the invention relate generally to an apparatus and a method that improve the active noise control (ANC) in a personal listening device (PLD) by reducing artifacts generated by the ANC system in the noise-cancelling control signal when vibrations of the personal listening device are detected. More specifically, an embodiment of the invention is directed to a personal listening device having an active noise control (ANC) system that detects vibrations of the personal listening device and reduces the artifacts generated by the ANC system by reconfiguring the ANC system to generate an anti-noise signal that is based on the detected vibration.
Currently, some personal listening devices such as earbuds, earphones, and headphones include an active noise control (ANC), also referred to as acoustic noise cancellation, system that improves the listening experience for the user by cancelling the external or ambient (environmental) noises from being heard by the user. The ANC technique cancels the external or ambient sound by generating a control signal that causes the personal listening device to introduce an anti-noise, which is an additional, electronically controlled sound field designed to counteract or destructively interfere with the desired external or ambient sound.
In some ANC systems, a reference microphone included in the personal listening device (PLD) may be used to pick up the primary noise source and to generate a reference signal. In some ANC systems, an error microphone also coupled to the personal listening device (PLD) may be used to detect the unwanted noise being heard by the user and to generate an error signal that represents the residual noise that may still remain despite the ANC system being in operation. The error signal monitors the ANC system's performance. The reference signal and the error signal may then be used to control the adaptation of the filters in the ANC system.
However, personal listening devices that perform ANC often have issues performing the ANC in a stable manner. For instance, when using the personal listening device while walking, running, or being on a slightly rough bus ride, the sound field captured by the reference microphone and the error microphone may vary substantially from the unwanted ambient noise that is to be cancelled. As a result, the adaptive filters converge to a wrong solution and the anti-noise being generated in accordance with this incorrect solution may include audible artifacts that can be significant enough to cause the user to feel uncomfortable or even nauseous.
Generally, the invention relates to personal listening devices such as headphones (e.g., earphones, earbuds) that are part of an active noise control (ANC) system to generate an acoustic anti-noise signal that is driving a speaker in the headphone. Specifically, an embodiment of the invention pertains to improving the ANC of the personal listening devices by using signals from an accelerometer and/or signals from a pressure sensor included in the personal listening device (e.g., within an earphone housing) to detect vibrations in the personal listening device and adapting the ANC system to generate an anti-noise signal based on the detected vibrations.
In one embodiment of the invention, a personal listening device (PLD) includes an earphone/headphone housing having therein a speaker, an error microphone, an inertial sensor, and a pressure sensor. The PLD also includes an active noise control (ANC) system. The inertial sensor may detect motion of the PLD and generate a motion signal. The pressure sensor may detect compression of a portion of the PLD and generate pressure sensor signal. The speaker may receive an anti-noise signal and a desired audio signal from an electronic device. The ANC system may generate one of a first anti-noise signal or a second anti-noise signal to drive the speaker and hence, reduce the ambient sound that may be heard by a user of the PLD. The ANC system may include a processor, a vibration detector to detect a vibration of the PLD based on at least one of the motion signal or the pressure sensor signal, and an ANC adaptive anti-noise generator. The ANC adaptive anti-noise generator may generate the first anti-noise signal when vibrations are not detected. The ANC system may generate, when vibrations are detected, the second anti-noise signal based on detected vibrations. In one embodiment, the processor reconfigures the ANC system for the ANC anti-noise generator to generate the second anti-noise.
In another embodiment of the invention, a method of active noise cancellation in a PLD starts with an active noise control (ANC) system receiving a reference microphone acoustic signal and an error microphone acoustic signal from the PLD. The ANC system then receives at least one of a motion signal or a pressure sensor signal from the PLD. The motion signal is based on a detected motion of the PLD and the pressure sensor signal is based on a detected compression of a portion of the PLD. The ANC system then determines whether vibrations of the PLD are detected based on at least one of the motion signal or the pressure sensor signal. When vibrations are not detected, the ANC system generates a first anti-noise signal based on the reference microphone acoustic signal and the error microphone acoustic signal and when vibrations are detected, the ANC system generates a second anti-noise signal. The second anti-noise signal may be based on the detected vibration. The ANC system generating the second anti-noise signal includes reconfiguring the ANC system.
In another embodiment, a computer-readable storage medium has stored therein instructions that, when executed by a processor, causes an active noise control (ANC) system to perform a method of active noise cancellation in a PLD. The method starts with the ANC system receiving a reference microphone acoustic signal and an error microphone acoustic signal from the PLD. The ANC system then receives at least one of a motion signal or a pressure sensor signal from the PLD. The motion signal is based on a detected motion of the PLD and the pressure sensor signal is based on a detected compression of a portion of the PLD. The ANC system then determines whether vibrations of the PLD are detected based on at least one of the motion signal or the pressure sensor signal. When vibrations are not detected, the ANC system generates a first anti-noise signal based on the reference microphone acoustic signal and the error microphone acoustic signal. When vibrations are detected, the ANC system generates a second anti-noise signal, wherein the processor reconfigures the ANC system to generate the second anti-noise signal.
The above summary does not include an exhaustive list of all aspects of the present invention. It is contemplated that the invention includes all systems, apparatuses and methods that can be practiced from all suitable combinations of the various aspects summarized above, as well as those disclosed in the Detailed Description below and particularly pointed out in the claims filed with the application. Such combinations may have particular advantages not specifically recited in the above summary.
The embodiments of the invention are illustrated by way of example and not by way of limitation in the figures of the accompanying drawings in which like references indicate similar elements. It should be noted that references to “an” or “one” embodiment of the invention in this disclosure are not necessarily to the same embodiment, and they mean at least one. In the drawings:
In the following description, numerous specific details are set forth. However, it is understood that embodiments of the invention may be practiced without these specific details. In other instances, well-known circuits, structures, and techniques have not been shown to avoid obscuring the understanding of this description.
As shown in
Referring to
As shown in
As shown in
The inertial sensor 250 included in the personal listening device 200 may be a sensing device that measures proper acceleration in three directions, X, Y, and Z or in only one or two directions. For example, the inertial sensor 250 may be an accelerometer, a gyroscope, or microelectromechanical system (MEMS). In other embodiments, a force sensor or a position, orientation and movement sensor may be used in lieu of the inertial sensor 250. In one embodiment, the inertial sensor 250 detects motion of the PLD and generates a motion signal that is transmitted to the ANC system 300. For instance, when the user of the personal listening device 200 walks, runs, jumps or is on a rough or bumpy ride in a vehicle, the inertial sensor 250 may detect the vibrations of the personal listening device 200.
The pressure sensor 260 included in the personal listening device 200 may be a sensing device that measures the compression of a portion of the personal listening device 200 and to generate pressure sensor signal. The pressure sensor 260 may be an optical pressure sensor, a capacitive pressure sensor, a piezoelectric pressure sensor, an electromagnetic pressure sensor, etc. In one embodiment, the earpad portion of the personal listening device 200 may be made of a soft material (e.g., soft leather, semi-leather, special urethane, etc.). When the user of the personal listening device 200 walks, runs, or is on a rough or bumpy ride in a vehicle, the earpad portion of the personal listening device 200 may compress and decompress against the user's ear in accordance with the vibrations of the personal listening device 200. The pressure sensor 260 may detect the compression (and decompression) of the earpad portion, for instance, and generate a pressure sensor signal that is transmitted to the ANC system 300. In one embodiment, the pressure sensor signal may be used to determine whether the personal listening device is vibrating.
As shown in
As shown in
As shown in
The ANC adaptive anti-noise generator 340 also receives the error signal from the error microphone 230 as discussed above that monitors the performance of the ANC system 300. The error signal may be digitized and processed by the ANC adaptive anti-noise generator 340. In the implementation of the adaptive ANC system 300 based on the FXLMS algorithm, an identification of a secondary path is required. Thus, there are two adaptive filters operating simultaneously for each channel, the control filter and the secondary path filter. The identification and/or modeling of the transfer function for the secondary path can be performed online using the downlink (playback) signal as the training signal for the LMS algorithm.
The implementation of an adaptive ANC system 300 based on the FXLMS algorithm also uses the vibration detector 310 to detect when the personal listening device 200 is vibrating. When the personal listening device 200 is vibrating due to the user walking, running, jumping, etc., the reference signal from the reference microphone 220 and the error signal from the error microphone 230 may be inaccurate in that the signals may include the vibration and/or compression of the personal listening device 200 as part of the noise to be cancelled by the ANC system 300. Thus, the signals from the reference microphone 220 and from the error microphone 230 when the personal listening device 200 may act as a disturbance signal to the adaptive filter algorithms, possibly causing the divergence of the filters. Accordingly, the vibration detector 310 is used to determine when the personal listening device 200 is vibrating. When vibrations of the personal listening device 200 are detected, the processor 320 may prevent the corrupted reference signal and the corrupted error signal to be used to adapt the filter(s) 350 in the ANC adaptive anti-noise generator 340 of the ANC system 300. Thus, the at least one adaptive filter 350 is prevented from diverging or becoming unstable. In one embodiment, the ANC adaptive anti-noise generator 34 generates an anti-noise signal based on the reference signal and the error signal when vibrations are not detected. However, when the personal listening device 200 is vibrating, the anti-noise signal that is based on the reference signal and the error signal causes the personal listening device 200 to generate an anti-noise that includes artifacts. Accordingly, when the vibration detector 310 detects vibrations, the ANC adaptive anti-noise generator 340 generates a second anti-noise signal based on detected vibrations.
In one embodiment, the vibration detector 310 receives at least one of the motion signal from the inertial sensor 250 or the pressure sensor signal from the pressure sensor 260. The motion signal and the pressure sensor signal may be digitized and processed by the vibration detector 310 to determine if the personal listening device 200 is vibrating. In one embodiment, the memory device 330 stores a plurality of predetermined sensor data patterns including patterns that indicate the contexts of: walking, jumping, running, and vehicle motions or vibrations. In this embodiment, the vibration detector 310 establishes that vibrations of the personal listening device 200 are detected when the vibration detector 310 matches at least one of the motion signal or the pressure sensor signal with at least one of the predetermined sensor data patterns.
In one embodiment, when the vibration detector 310 detects vibrations, the processor 320 reconfigures the ANC system 300 for the ANC anti-noise generator 340 to generate the second anti-noise based on the detected vibrations. The processor 320 in the ANC system 300 may implement a feed forward, a feedback, or a hybrid noise control algorithm. The processor 320 may reconfigure the ANC system 300 by for example adapting the coefficients of an finite impulse response (FIR) filter (e.g., secondary path) using a LMS adaptive algorithm, adapting the coefficients of an FIR filter (e.g., the control filter path) according to a filtered-x LMS algorithm, and reconfigure the ANC system 300 to alter the adaptation of the FIR filters when vibration of the personal listening device 200 is detected. For instance, when vibrations are detected, the processor 320 may lock the filter coefficients of an adaptive filter 350 included in the ANC system 300 or the processor may alternatively lock filtering by the adaptive filter 350. The locking of the filter coefficients or the locking of the filtering may also be referred to as “freezing” the adaptive filter. Accordingly, the adaptive filter 350 remains in a previously acceptable state (e.g., not diverging or unstable) and generates anti-noise signals. In another embodiment, to reconfigure the ANC system 300, the processor 320 changes a speed of updates made to the adaptive filter 350 by the adaptive filter controller 360 included in the ANC system 300. For instance, if the vibration detector 310 matches the motion signal or the pressure signal with the predetermined sensor data pattern associated with the context of walking, the processor 320 may increase the speed of the adaptive filter updates in between the steps and may slowdown the speed of the adaptive filter updates when the user's step occurs (e.g., when the user's foot hits the ground). Accordingly, the ANC system 300 accounts for the pressure level change in the earcup due to the user's steps affecting the reference microphone signal from the reference microphone 220. In another embodiment, to reconfigure the ANC system 300 when vibrations are detected, the processor 320 selects predetermined adaptive filter coefficients associated with the at least one of the predetermined sensor data patterns. For instance, if the vibration detector 310 matches the motion signal or the pressure signal with the predetermined sensor data pattern associated with the context of walking, the processor 320 may select the predetermined adaptive filter coefficient associated with the context of walking. The predetermined adaptive filter coefficients associated with each of the contexts may be stored in the memory device 330. In this embodiment, the processor 320 overrides the filter coefficients of the adaptive filter 350, that were computed by the adaptive filter controller 360 included in the ANC system 300, with the predetermined filter coefficients that were selected. In another embodiment, to reconfigure the ANC system 300 when vibrations are detected, the processor 320 applies a jacket on filter coefficients of an adaptive filter 350 included in the ANC system 300. The jacket establishes a maximum and a minimum for desired filter coefficients. Accordingly, when the vibrations of the personal listening device 200 cause the adaptive filter controller 360 to generate erroneous coefficients for the adaptive filter 350 in the ANC system 300, the processor 320 applies the jacket to the erroneous coefficients which causes the erroneous coefficients that exceed the maximum established by the jacket or that fall below the minimum established by the jacket to be corrected by the processor 320. The corrected values of the coefficients are values that are within the jacket's established limits. In one embodiment, when vibrations are detected, the processor 320 may mute the anti-noise signal output from the speaker 240. However, it is noted that muting the anti-noise signal when the vibrations are detected in the personal listening device 200 may introduce artifacts in the acoustic signal being heard by the user.
Moreover, the following embodiments of the invention may be described as a process, which is usually depicted as a flowchart, a flow diagram, a structure diagram, or a block diagram. Although a flowchart may describe the operations as a sequential process, many of the operations can be performed in parallel or concurrently. In addition, the order of the operations may be re-arranged. A process is terminated when its operations are completed. A process may correspond to a method, a procedure, etc.
A general description of suitable electronic devices for performing these functions is provided below with respect to
Keeping the above points in mind,
While the invention has been described in terms of several embodiments, those of ordinary skill in the art will recognize that the invention is not limited to the embodiments described, but can be practiced with modification and alteration within the spirit and scope of the appended claims. The description is thus to be regarded as illustrative instead of limiting. There are numerous other variations to different aspects of the invention described above, which in the interest of conciseness have not been provided in detail. Accordingly, other embodiments are within the scope of the claims.
Patent | Priority | Assignee | Title |
10755690, | Jun 11 2018 | Qualcomm Incorporated | Directional noise cancelling headset with multiple feedforward microphones |
11044557, | Nov 02 2017 | ams AG | Method for determining a response function of a noise cancellation enabled audio device |
11696065, | Sep 22 2021 | HEWLETT-PACKARD DEVELOPMENT COMPANY, L P | Adaptive active noise cancellation based on movement |
11935512, | May 17 2022 | Apple Inc; Apple Inc. | Adaptive noise cancellation and speech filtering for electronic devices |
Patent | Priority | Assignee | Title |
8285344, | May 21 2008 | DP Technlogies, Inc. | Method and apparatus for adjusting audio for a user environment |
8320578, | Apr 30 2008 | HUAWEI TECHNOLOGIES CO , LTD | Headset |
20090082994, | |||
20090132197, | |||
20120140943, | |||
20130039507, | |||
20140056459, | |||
20140146976, | |||
20140314245, | |||
EP2779685, | |||
EP2779689, | |||
WO35243, | |||
WO2013022981, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Mar 11 2015 | TERLIZZI, JEFFREY | Apple Inc | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 035155 | /0411 | |
Mar 12 2015 | Apple Inc. | (assignment on the face of the patent) | / |
Date | Maintenance Fee Events |
Jun 08 2017 | ASPN: Payor Number Assigned. |
Sep 29 2020 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
Date | Maintenance Schedule |
Jul 11 2020 | 4 years fee payment window open |
Jan 11 2021 | 6 months grace period start (w surcharge) |
Jul 11 2021 | patent expiry (for year 4) |
Jul 11 2023 | 2 years to revive unintentionally abandoned end. (for year 4) |
Jul 11 2024 | 8 years fee payment window open |
Jan 11 2025 | 6 months grace period start (w surcharge) |
Jul 11 2025 | patent expiry (for year 8) |
Jul 11 2027 | 2 years to revive unintentionally abandoned end. (for year 8) |
Jul 11 2028 | 12 years fee payment window open |
Jan 11 2029 | 6 months grace period start (w surcharge) |
Jul 11 2029 | patent expiry (for year 12) |
Jul 11 2031 | 2 years to revive unintentionally abandoned end. (for year 12) |