In one example, a headset obtains a first audio signal including a user audio signal from a first microphone on the headset and a second audio signal including the user audio signal from a second microphone on the headset. The headset derives a first candidate signal from the first audio signal and a second candidate signal from the second audio signal. Based on the first audio signal and the second audio signal, the headset determines that a mechanical touch noise is present in one of the first audio signal and the second audio signal. In response to determining that the mechanical touch noise is present in one of the first audio signal and the second audio signal, the headset selects an output audio signal from a plurality of candidate signals including the first candidate signal and the second candidate signal. headset provides the output audio signal to a receiver device.
|
14. A method comprising:
obtaining a first audio signal including a user audio signal from a first microphone on a headset and a second audio signal including the user audio signal from a second microphone on the headset;
deriving a first candidate signal from the first audio signal and a second candidate signal from the second audio signal;
adaptively filtering the second audio signal using a first adaptive filter to generate an output of the first adaptive filter;
generating an error signal of the first adaptive filter based on the output of the first adaptive filter and the first audio signal;
determining that a mechanical touch noise is present in one of the first audio signal and the second audio signal based on the first audio signal, the second audio signal, the output of the first adaptive filter, and the error signal;
in response to determining that the mechanical touch noise is present in the one of the first audio signal and the second audio signal, selecting an output audio signal from a plurality of candidate signals including the first candidate signal and the second candidate signal; and
providing the output audio signal to a receiver device.
18. One or more non-transitory computer readable storage media encoded with instructions that, when executed by a processor, cause the processor to:
obtain a first audio signal including a user audio signal from a first microphone on a headset and a second audio signal including the user audio signal from a second microphone on the headset;
derive a first candidate signal from the first audio signal and a second candidate signal from the second audio signal;
adaptively filter the second audio signal using a first adaptive filter to generate an output of the first adaptive filter;
generate an error signal of the first adaptive filter based on the output of the first adaptive filter and the first audio signal;
determine that a mechanical touch noise is present in one of the first audio signal and the second audio signal based on the first audio signal, the second audio signal, the output of the first adaptive filter, and the error signal;
in response to determining that the mechanical touch noise is present in the one of the first audio signal and the second audio signal, select an output audio signal from a plurality of candidate signals including the first candidate signal and the second candidate signal; and
provide the output audio signal to a receiver device.
1. An apparatus comprising:
a first microphone;
a second microphone; and
a processor coupled to receive signals derived from outputs of the first microphone and the second microphone, wherein the processor is configured to:
obtain a first audio signal including a user audio signal from the first microphone on a headset and a second audio signal including the user audio signal from the second microphone on the headset;
derive a first candidate signal from the first audio signal and a second candidate signal from the second audio signal;
adaptively filter the second audio signal using a first adaptive filter to generate an output of the first adaptive filter;
generate an error signal of the first adaptive filter based on the output of the first adaptive filter and the first audio signal;
determine that a mechanical touch noise is present in one of the first audio signal and the second audio signal based on the first audio signal, the second audio signal, the output of the first adaptive filter, and the error signal;
in response to determining that the mechanical touch noise is present in the one of the first audio signal and the second audio signal, select an output audio signal from a plurality of candidate signals including the first candidate signal and the second candidate signal; and
provide the output audio signal to a receiver device.
2. The apparatus of
calculate a correlation value indicating a level of correlation between the error signal and the second audio signal; and
determine that the mechanical touch noise is present in the one of the first audio signal and the second audio signal based further on the correlation value.
3. The apparatus of
4. The apparatus of
determining that a signal-to-noise ratio of the error signal is greater than a first predefined threshold;
determining that a difference between a signal-to-noise ratio of the first audio signal and the signal-to-noise ratio of the error signal is greater than a second predefined threshold;
determining that a signal-to-noise ratio of the output of the first adaptive filter is less than the signal-to-noise ratio of the first audio signal;
determining that a difference between the signal-to-noise ratio of the first audio signal and a signal-to-noise ratio of the second audio signal is greater than a third predefined threshold; and
determining that the correlation value is less than a fourth predefined threshold.
5. The apparatus of
6. The apparatus of
update coefficients of the first adaptive filter when a signal-to-noise ratio of the first audio signal is greater than a first predefined threshold, when a signal-to-noise ratio of the second audio signal is greater than a second predefined threshold, and when a difference between the signal-to-noise ratio of the first audio signal and the signal-to-noise ratio of the second audio signal is between a third predefined threshold and a fourth predefined threshold.
7. The apparatus of
perform noise reduction on the second audio signal.
8. The apparatus of
9. The apparatus of
determining that a signal-to-noise ratio of the error signal is greater than a first predefined threshold;
determining that the correlation value is less than a second predefined threshold;
determining that an absolute value of a difference between a signal-to-noise ratio of the first audio signal and a signal-to-noise ratio of the second audio signal is greater than a third predefined threshold; and
determining that the signal-to-noise ratio of the first audio signal is greater than the signal-to-noise ratio of the second audio signal.
10. The apparatus of
adaptively filter the first audio signal using a second adaptive filter to generate an output of the second adaptive filter, wherein the output of the second adaptive filter is the first candidate signal; and
adaptively filter the second audio signal using a third adaptive filter to generate an output of the third adaptive filter, wherein the output of the third adaptive filter is the second candidate signal.
11. The apparatus of
combine the first audio signal and the second audio signal into a beamformed signal, wherein the beamformed signal is a third candidate signal in the plurality of candidate signals;
generate an error signal of the second adaptive filter based on the output of the second adaptive filter and the beamformed signal; and
generate an error signal of the third adaptive filter based on the output of the third adaptive filter and the beamformed signal.
12. The apparatus of
delay the first audio signal by a length of time equal to a difference between a time at which the user audio signal reaches one of the first microphone and the second microphone and a time at which the user audio signal reaches the other of the first microphone and the second microphone.
13. The apparatus of
determine that the mechanical touch noise is no longer present in the one of the first audio signal and the second audio signal;
in response to determining that the mechanical touch noise is no longer present in the one of the first audio signal and the second audio signal, select the default audio signal from the plurality of candidate signals; and
provide the default audio signal to the receiver device.
15. The method of
calculating a correlation value indicating a level of correlation between the error signal and the second audio signal; and
determining that the mechanical touch noise is present in the one of the first audio signal and the second audio signal based further on the correlation value.
16. The method of
delaying the first audio signal by a length of time equal to a difference between a time at which the user audio signal reaches one of the first microphone and the second microphone and a time at which the user audio signal reaches the other of the first microphone and the second microphone.
17. The method of
determining that the mechanical touch noise is no longer present in the one of the first audio signal and the second audio signal;
in response to determining that the mechanical touch noise is no longer present in the one of the first audio signal and the second audio signal, selecting the default audio signal from the plurality of candidate signals; and
providing the default audio signal to the receiver device.
19. The one or more non-transitory computer readable storage media of
calculate a correlation value indicating a level of correlation between the error signal and the second audio signal; and
determine that the mechanical touch noise is present in the one of the first audio signal and the second audio signal based further on the correlation value.
20. The one or more non-transitory computer readable storage media of
delay the first audio signal by a length of time equal to a difference between a time at which the user audio signal reaches one of the first microphone and the second microphone and a time at which the user audio signal reaches the other of the first microphone and the second microphone.
|
The present disclosure relates to audio signal control.
Local participants in conferencing sessions (e.g., online or web-based meetings) often use headsets with an integrated speaker and/or microphone to communicate with remote meeting participants. The microphone detects speech from the local participant for transmission to the remote meeting participants, but frequently picks up undesired mechanical touch noises along with the speech. Mechanical touch noises can be caused when the local participant touches the headset with their hands. When transmitted with the speech, the mechanical touch noises can be loud and disruptive, preventing the remote meeting participants from understanding the speech. This can be a hindrance to all meeting participants and reduce the effectiveness of the conferencing session.
In one example, a headset obtains a first audio signal including a user audio signal from a first microphone on the headset and a second audio signal including the user audio signal from a second microphone on the headset. The headset derives a first candidate signal from the first audio signal and a second candidate signal from the second audio signal. Based on the first audio signal and the second audio signal, the headset determines that a mechanical touch noise is present in one of the first audio signal and the second audio signal. In response to determining that the mechanical touch noise is present in one of the first audio signal and the second audio signal, the headset selects an output audio signal from a plurality of candidate signals including the first candidate signal and the second candidate signal. The headset provides the output audio signal to a receiver device.
With reference made to
Wireless communications interface 135 may be configured to operate in accordance with the Bluetooth® short-range wireless communication technology or any other suitable technology now known or hereinafter developed. Wireless communications interface 135 may enable communication with telephony device 120(1). Although wireless communications interface 135 is shown in
Headset 115(1) also includes microphones 140(1) and 140(2), audio processor 145, and speaker 150. Audio processor 145 may include one or more integrated circuits that convert audio detected by microphones 140(1) and 140(2) to digital signals that are supplied (e.g., as receive signals) to the processor 130 for wireless transmission via wireless communications interface 135 (e.g., when meeting attendee 105(1) speaks). Thus, processor 130 is coupled to receive signals derived from outputs of microphones 140(1) and 140(2) via audio processor 145. Audio processor 145 may also convert received audio (via wireless communication interface 135) to analog signals to drive speaker 150 (e.g., when meeting attendee 105(2) speaks).
Headset 115(1) may have a boom design or a boomless design. In a boomless design, headset 115(1) includes a first earpiece that houses microphone 140(1) and a second earpiece that houses microphone 140(1). One of the first and second earpieces may be configured for the left ear of meeting attendee 105(1), and the other of the first and second earpieces may be configured for the right ear of meeting attendee 105(1). Microphones 140(1) and 140(2) have approximately equal distances from the mouth of meeting attendee 105(1). In a boom design, headset 115(1) includes a boom that houses microphone 140(1) and an earpiece that houses microphone 140(2). The distances from microphones 140(1) and 140(2) and the mouth of meeting attendee 105(1) in the boomless design may be greater than the distance from microphone 140(1) and the mouth of meeting attendee 105(1) in the boom design. It will be appreciated that microphones 140(1) and 140(2) may be physical microphones or virtual microphones beamformed by an array of physical microphones to improve detection of a user audio signal (e.g., speech from meeting attendee 105(1)
At some point during the meeting, meeting attendee 105(1) may cause a mechanical touch noise in one or more of microphones 140(1) and 140(2). When meeting attendee 105(1) brushes a hand against microphone 140(1), for example, the brush produces a mechanical touch noise which is detected by microphone 140(1). Conventionally, the mechanical touch noise would heavily interfere with the online meeting between meeting attendees 105(1) and 105(2). For example, in some conventional headsets, the mechanical touch noise would drown out any speech from meeting attendee 105(1). Other conventional headsets might be configured to detect the mechanical touch noise and attenuate the outgoing audio signal, but if the mechanical touch noise occurs while meeting attendee 105(1) is talking, the attenuation can effectively mute the user audio signal.
Accordingly, mechanical touch noise control logic 155 is provided to alleviate noise interference due to mechanical touch noise. Briefly, mechanical touch noise control logic 155 causes processor 130 to perform operations to detect and remove mechanical touch noise. Mechanical touch noise control logic 155 enables headset 115(1) to reduce/eliminate mechanical touch noise without muting speech from meeting attendee 105(1). It will be appreciated that at least a portion of mechanical touch noise control logic 155 may be included in devices other than headset 115(1), such as communications server 110.
Microphones 140(1) and 140(2) may be arranged on headset 115(1) such that when meeting attendee causes a mechanical touch noise on one of microphones 140(1) and 140(2), the other of microphones 140(1) and 140(2) is minimally effected. For example, in a boom design, when meeting attendee 105(1) causes a mechanical touch noise in microphone 140(1) by adjusting the boom, microphone 140(2) in one of the earpieces may not pick up the mechanical touch noise. Similarly, in a boomless design, when meeting attendee 105(1) causes a mechanical touch noise in microphone 140(1) by adjusting one earpiece, microphone 140(2) in the other earpiece may not pick up the mechanical touch noise.
Based on the first audio signal 205 and the second audio signal 210, headset 115(1) determines that a mechanical touch noise is present in one of the first audio signal 205 and the second audio signal 210. Adder 228 generates error signal 230 based on the output 220 and the first audio signal 205. Correlation calculation function 235 calculates a correlation value (represented by arrow 240) indicating a level of correlation between error signal 230 and the second audio signal 210. Touch noise detection function 245 determines that the mechanical touch noise is present in one of the first audio signal 205 and the second audio signal 210 based on the first audio signal 205, the second audio signal 210, output 220, error signal 230, and correlation value 240.
In response to determining that the mechanical touch noise is present in one of the first audio signal 205 and the second audio signal 210, switch function 250 may select an output audio signal 255 from a plurality of candidate signals including the first candidate signal 215 and the second candidate signal 220. In one example, the second audio signal 210 should have a sufficient Signal-to-Noise Ratio (SNR) to be selected. Since the second candidate signal 220 is the output of adaptive filter 225, the phase of the second candidate signal 220 should follow that of the first candidate signal 215. Furthermore, switch function 250 may switch from first candidate signal 215 to second candidate signal 220 (e.g., rapidly/immediately) so as to avoid requiring linear interpolation between first candidate signal 215 and second candidate signal 220. It may be desirable to perform the switch when SNR levels of both first candidate signal 215 and second candidate signal 220 are low.
In one example, first candidate signal 215 may be a default audio signal because microphone 140(1) is located in the boom and is therefore expected to detect the user audio signal better than microphone 140(2) detects the user audio signal. Second candidate signal 220 may be considered a backup audio signal. When a mechanical touch noise is detected in first audio signal 205, switch function 250 may select the backup audio signal (second candidate signal 220) as output audio signal 255. After selecting the backup audio signal as the output audio signal 255, headset 115(1) may provide the output audio signal 255 to a receiver device (e.g., telephony device 120(2), which in turn communicates to telephony device 120(2)). Subsequently, touch noise detection function 245 may determine that the mechanical touch noise is no longer present in the first audio signal 205. In response to determining that the mechanical touch noise is no longer present in the first audio signal 205, switch function 250 may select the default audio signal (first candidate signal 215) and provide the default audio signal to the receiver device.
Because microphone 140(1) (boom) is closer to the mouth of meeting attendee 115(1) than microphone 140(2) (earpiece), microphone 140(1) may obtain the user audio signal before microphone 140(2). As such, delay function 260 may delay the first audio signal 205 by a length of time equal to a difference between a time at which the user audio signal reaches microphone 140(1) and a time at which the user audio signal reaches microphone 140(2). Delaying the first audio signal 205 may ensure that adaptive filter 225 converges. The length of time may be the maximum possible time delay between microphone 140(1) and microphone 140(2). The length of time depends on boom length, and may be approximately 0.5 milliseconds. Moreover, because microphone 140(2) is situated on an earpiece, which is further from the mouth of meeting attendee 115(1) than microphone 140(1), second audio signal 210 may have a higher noise floor than audio signal 205. Accordingly, noise reduction function 265 may perform noise reduction on second audio signal 210.
If user 105(1) does not wear headset 115(1) correctly (e.g., if microphone 140(1) is closer to the mouth of meeting attendee 115(1) than microphone 140(2)), microphone 140(1) (for example) may obtain the user audio signal before microphone 140(2). As such, delay function 260 may delay the first audio signal 205 by a length of time equal to a difference between a time at which the user audio signal reaches microphone 140(1) and a time at which the user audio signal reaches microphone 140(2). Delaying the first audio signal 205 may ensure that adaptive filter 225 converges. The length of time may be, for example, 0.25 milliseconds.
In this example, first candidate signal 610 is output 610 of adaptive filter 650, and the second candidate signal 620 is output 620 of adaptive filter 660. First audio signal 205 is the primary input for adaptive filter 650 and second audio signal 210 is the primary input for adaptive filter 660. Beamformed signal 630 is the reference input for adaptive filters 650 and 660. Adder 665 generates error signal 670 based on output 610 and beamformed signal 630. Adder 675 generates error signal 680 of adaptive filter 660 based on output 620 and beamformed signal 630. Adaptive filters 225, 650, and 660 may be controlled by the same coefficient update function. Adaptive filter coefficients may be updated in a similar manner as described in connection with
Based on the first audio signal 205 and the second audio signal 210, headset 115(1) determines that a mechanical touch noise is present in one of the first audio signal 205 and the second audio signal 210. Adaptive filter 225 generates error signal 230 based on the output 220 and the first audio signal 205. Correlation calculation function 235 calculates correlation value 240 indicating a level of correlation between error signal 230 and the second audio signal 210. Correlation calculation function 235 may calculate a correlation value 240 using any suitable calculation, such as similar to that described in connection with
Touch noise detection function 245 determines that the mechanical touch noise is present in one of the first audio signal 205 and the second audio signal 210 based on the first audio signal 205, the second audio signal 210, output 225, error signal 230, and correlation value 240. In response to determining that the mechanical touch noise is present in one of the first audio signal 205 and the second audio signal 210, switch function 250 may select output audio signal 255 from candidate signals 610, 620, and 630. Headset 115(1) may provide the output audio signal 255 to a receiver device (e.g., headset 115(2)).
In one example, beamformed signal 630 may be a default audio signal because beamformed signal 630 is expected to improve user audio signal detection compared to first and second candidate signals 610 and 620. First and second candidate signals 610 and 620 may be backup audio signals. When a mechanical touch noise is detected in beamformed signal 630, switch function 250 may select the backup audio signal (e.g., first candidate signal 620) as output audio signal 255. After selecting the backup audio signal as the output audio signal 255, headset 115(1) may provide the output audio signal 255 to a receiver device (e.g., headset 115(2)). Subsequently, touch noise detection function 245 may determine that the mechanical touch noise is no longer present in beamformed signal 630. In response to determining that the mechanical touch noise is no longer present in beamformed signal 630, switch function 250 may select the default audio signal (beamformed signal 630) and provide the default audio signal to the receiver device.
Described herein is a method to detect and remove a mechanical touching noise from an outgoing audio signal with multiple microphones implemented in a headset. The method may be used for headsets with or without a boom. Detection may be performed using an adaptive filter implemented between the microphones and calculation of signal correlations. After detection, a microphone signal without the mechanical touch noise may be used as the output audio signal.
In one form, an apparatus is provided. The apparatus comprises: a first microphone; a second microphone; and a processor coupled to receive signals derived from outputs of the first microphone and the second microphone, wherein the processor is configured to: obtain a first audio signal including a user audio signal from the first microphone on a headset and a second audio signal including the user audio signal from the second microphone on the headset; derive a first candidate signal from the first audio signal and a second candidate signal from the second audio signal; based on the first audio signal and the second audio signal, determine that a mechanical touch noise is present in one of the first audio signal and the second audio signal; in response to determining that the mechanical touch noise is present in one of the first audio signal and the second audio signal, select an output audio signal from a plurality of candidate signals including the first candidate signal and the second candidate signal; and provide the output audio signal to a receiver device.
In a one example, the processor is configured to determine that the mechanical touch noise is present in one of the first audio signal and the second audio signal by: adaptively filtering the second audio signal using a first adaptive filter to generate an output of the first adaptive filter; generating an error signal of the first adaptive filter based on the output of the first adaptive filter and the first audio signal; calculating a correlation value indicating a level of correlation between the error signal and the second audio signal, and determining that the mechanical touch noise is present in one of the first audio signal and the second audio signal based on the first audio signal, the second audio signal, the output of the first adaptive filter, the error signal, and the correlation value.
In one example, the apparatus further comprises a boom that houses the first microphone and an earpiece that houses the second microphone. In a further example, the processor is configured to determine that the mechanical touch noise is present in one of the first audio signal and the second audio signal based on the first audio signal, the second audio signal, the output of the first adaptive filter, the error signal, and the correlation value by: determining that a signal-to-noise ratio of the error signal is greater than a first predefined threshold; determining that a difference between a signal-to-noise ratio of the first audio signal and the signal-to-noise ratio of the error signal is greater than a second predefined threshold; determining that a signal-to-noise ratio of the output of the first adaptive filter is less than the signal-to-noise ratio of the first audio signal; determining that a difference between the signal-to-noise ratio of the first audio signal and a signal-to-noise ratio of the second audio signal is greater than a third predefined threshold; and determining that the correlation value is less than a fourth predefined threshold. In another further example, the first candidate signal is the first audio signal and the second candidate signal is the output of the first adaptive filter.
In yet another further example, the first candidate signal is the first audio signal and the second candidate signal is the output of the first adaptive filter. In still another further example, the processor is further configured to: update coefficients of the first adaptive filter when a signal-to-noise ratio of the first audio signal is greater than a first predefined threshold, when a signal-to-noise ratio of the second audio signal is greater than a second predefined threshold, and when a difference between the signal-to-noise ratio of the first audio signal and the signal-to-noise ratio of the third audio signal is between a second predefined threshold and a third predefined threshold. In yet another further example, the processor is further configured to: perform noise reduction on the second audio signal.
In another example, the apparatus further comprises a first earpiece that houses the first microphone and a second earpiece that houses the second microphone. In a further example, the processor is configured to determine that the mechanical touch noise is present in one of the first audio signal and the second audio signal based on the first audio signal, the second audio signal, the output of the first adaptive filter, the error signal, and the correlation value by: determining that a signal-to-noise ratio of the error signal is greater than a first predefined threshold; determining that the correlation value is less than a second predefined threshold; determining that an absolute value of a difference between a signal-to-noise ratio of the first audio signal and a signal-to-noise ratio of the second audio signal is greater than a third predefined threshold; and determining that the signal-to-noise ratio of the first audio signal is greater than the signal-to-noise ratio of the second audio signal.
In yet another further example, the processor is further configured to: adaptively filter the first audio signal using a second adaptive filter to generate an output of the second adaptive filter, wherein the output of the second adaptive filter is the first candidate signal; and adaptively filter the second audio signal using a third adaptive filter to generate an output of the third adaptive filter, wherein the output of the third adaptive filter is the second candidate signal. In one example, the processor is further configured to: combine the first audio signal and the second audio signal into a beamformed signal, wherein the beamformed signal is a third candidate signal in the plurality of candidate signals; generate an error signal of the second adaptive filter based on the output of the second adaptive filter and the beamformed signal; and generate an error signal of the third adaptive filter based on the output of the third adaptive filter and the beamformed signal.
In another form, a method is provided. The method comprises: obtaining a first audio signal including a user audio signal from a first microphone on a headset and a second audio signal including the user audio signal from a second microphone on the headset; deriving a first candidate signal from the first audio signal and a second candidate signal from the second audio signal; based on the first audio signal and the second audio signal, determining that a mechanical touch noise is present in one of the first audio signal and the second audio signal; in response to determining that the mechanical touch noise is present in one of the first audio signal and the second audio signal, selecting an output audio signal from a plurality of candidate signals including the first candidate signal and the second candidate signal; and providing the output audio signal to a receiver device.
In another form, one or more non-transitory computer readable storage media are provided. The non-transitory computer readable storage media are encoded with instructions that, when executed by a processor, cause the processor to: obtain a first audio signal including a user audio signal from a first microphone on a headset and a second audio signal including the user audio signal from a second microphone on the headset; derive a first candidate signal from the first audio signal and a second candidate signal from the second audio signal; based on the first audio signal and the second audio signal, determine that a mechanical touch noise is present in one of the first audio signal and the second audio signal; in response to determining that the mechanical touch noise is present in one of the first audio signal and the second audio signal, select an output audio signal from a plurality of candidate signals including the first candidate signal and the second candidate signal; and provide the output audio signal to a receiver device.
The above description is intended by way of example only. Although the techniques are illustrated and described herein as embodied in one or more specific examples, it is nevertheless not intended to be limited to the details shown, since various modifications and structural changes may be made within the scope and range of equivalents of the claims.
Bao, Feng, Robison, David William Nolan, Sundsbarm, Tor A.
Patent | Priority | Assignee | Title |
Patent | Priority | Assignee | Title |
8503689, | Oct 15 2010 | HEWLETT-PACKARD DEVELOPMENT COMPANY, L P | Integrated monophonic headset having wireless connectability to audio source |
9226068, | Apr 26 2012 | Cirrus Logic, Inc. | Coordinated gain control in adaptive noise cancellation (ANC) for earspeakers |
9810925, | Mar 13 2013 | SOLOS TECHNOLOGY LIMITED | Noise cancelling microphone apparatus |
20100046770, | |||
20130022214, | |||
20180012617, | |||
20180167754, | |||
WO2005036924, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Jan 02 2019 | BAO, FENG | Cisco Technology, Inc | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 047929 | /0633 | |
Jan 07 2019 | ROBISON, DAVID WILLIAM NOLAN | Cisco Technology, Inc | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 047929 | /0633 | |
Jan 07 2019 | SUNDSBARM, TOR A | Cisco Technology, Inc | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 047929 | /0633 | |
Jan 08 2019 | Cisco Technology, Inc. | (assignment on the face of the patent) | / |
Date | Maintenance Fee Events |
Jan 08 2019 | BIG: Entity status set to Undiscounted (note the period is included in the code). |
Mar 26 2024 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
Date | Maintenance Schedule |
Sep 29 2023 | 4 years fee payment window open |
Mar 29 2024 | 6 months grace period start (w surcharge) |
Sep 29 2024 | patent expiry (for year 4) |
Sep 29 2026 | 2 years to revive unintentionally abandoned end. (for year 4) |
Sep 29 2027 | 8 years fee payment window open |
Mar 29 2028 | 6 months grace period start (w surcharge) |
Sep 29 2028 | patent expiry (for year 8) |
Sep 29 2030 | 2 years to revive unintentionally abandoned end. (for year 8) |
Sep 29 2031 | 12 years fee payment window open |
Mar 29 2032 | 6 months grace period start (w surcharge) |
Sep 29 2032 | patent expiry (for year 12) |
Sep 29 2034 | 2 years to revive unintentionally abandoned end. (for year 12) |