Provided are methods and systems for providing situation-dependent transient noise suppression for audio signals. Different strategies (e.g., levels of aggressiveness) of transient suppression and signal restoration are applied to audio signals associated with participants in a video/audio conference depending on whether or not each participant is speaking (e.g., whether a voiced segment or an unvoiced/non-speech segment of audio is present). If no participants are speaking or there is an unvoiced/non-speech sound present, a more aggressive strategy for transient suppression and signal restoration is utilized. On the other hand, where voiced audio is detected (e.g., a participant is speaking), the methods and systems apply a softer, less aggressive suppression and restoration process.
Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.
1. A method performed by a teleconference computing device for suppressing transient noise in an audio signal, the method comprising: estimating a voice probability for a segment of the audio signal containing transient noise, the estimated voice probability being a probability that the segment contains voice data; responsive to determining that the estimated voice probability for the segment is greater than a threshold probability, suppressing the transient noise contained in the segment of the audio signal while reducing distortion of the voice data, including: calculating a spectral mean for the audio segment over a plurality of frequency bins of the audio segment, and for each frequency bin of the plurality of frequency bins of the audio segment, if a comparison of a current value of the magnitude of the frequency bin to the spectral mean and to a calculated factor of the spectral mean indicates that transient noise is present, suppressing the transient noise in the frequency bin, wherein the calculated factor of the spectral mean is a fixed spectral weighting that is configured to de-emphasize frequency bins of the plurality of frequency bins corresponding to frequencies at which the voice data is transmitted, wherein suppressing the transient noise includes adjusting the magnitude of the frequency bin to a new value between the spectral mean and the current value of the magnitude of the frequency bin; and responsive to determining that the estimated voice probability for the segment is less than the threshold probability, suppressing the transient noise contained in the segment of the audio signal while not reducing distortion of the voice data, including: calculating a spectral mean for the audio segment over the plurality of frequency bins of the audio segment, and for each frequency bin of the plurality of frequency bins of the audio segment, if a comparison of a magnitude of the frequency bin to the spectral mean indicates that transient noise is present, suppressing the transient noise in the frequency bin, wherein suppressing the transient noise includes adjusting the magnitude of the frequency bin to a new value between the spectral mean and the current value of the magnitude of the frequency bin, wherein the transient noise is at least one of feedback noise, fan noise, and button-clicking noise due to mechanical connection between an audio capture device and a keyboard or trackpad of the teleconferencing computing device.
A teleconference system suppresses transient noise (like feedback, fan noise, or keyboard clicks) in audio signals. It estimates the probability that a segment of audio contains speech. If the probability is high, it reduces noise in each frequency bin by comparing the bin's magnitude to the average magnitude across all bins, and a weighted factor that de-emphasizes frequencies where speech is common. If noise is detected, the bin's magnitude is adjusted towards the average. If the speech probability is low, noise is suppressed more aggressively by comparing each bin's magnitude to the average and adjusting the magnitude towards the average.
2. The method of claim 1 , wherein the estimated voice probability is based on voicing information received from a pitch estimator.
The method for suppressing transient noise in audio signals from claim 1 refines the voice probability estimation using voicing information from a pitch estimator. This estimator analyzes the audio to determine the fundamental frequency (pitch) of any speech present, and this information is then used to more accurately assess the likelihood that a segment contains voice data.
3. The method of claim 1 , wherein estimating the voice probability for the segment of the audio signal includes identifying regions of the segment containing voiced speech.
The method for suppressing transient noise in audio signals from claim 1 determines voice probability by identifying regions of the audio segment that contain voiced speech. This involves analyzing the audio signal to locate segments where the characteristics of voiced sounds are present.
4. The method of claim 3 , wherein identifying regions of the segment containing voiced speech includes identifying regions of the segment where the vocal folds are vibrating.
The method for suppressing transient noise in audio signals from claim 3 refines the identification of voiced speech regions by detecting areas where the vocal folds are vibrating. This technique analyzes the audio signal for patterns indicative of vocal fold vibration, a key characteristic of voiced sounds, to improve the accuracy of voice probability estimation.
5. The method of claim 1 further comprising: in response to the comparison of the magnitude of the frequency bin to the spectral mean and to the calculated factor of the spectral mean satisfying a first condition, calculating a new magnitude for the frequency bin; and in response to the comparison of the magnitude of the frequency bin to the spectral mean and to the calculated factor of the spectral mean satisfying a second condition, maintaining the magnitude for the frequency bin, wherein the first condition is different from the second condition.
The method for suppressing transient noise in audio signals from claim 1 involves comparing the magnitude of each frequency bin to the spectral mean and a spectral weighting factor, and depending on whether a first or second condition is met as a result of the comparison, it either calculates a new magnitude for the bin or maintains the existing magnitude. The conditions determine whether the bin is considered to contain transient noise that requires suppression.
6. The method of claim 1 further comprising: in response to the comparison of the magnitude of the frequency bin to the spectral mean satisfying a first condition, calculating a new magnitude for the frequency bin; and in response to the comparison of the magnitude of the frequency bin to the spectral mean satisfying a second condition, maintaining the magnitude for the frequency bin, wherein the first condition is different from the second condition.
The method for suppressing transient noise in audio signals from claim 1 involves comparing the magnitude of each frequency bin to the spectral mean, and depending on whether a first or second condition is met as a result of the comparison, it either calculates a new magnitude for the bin or maintains the existing magnitude. The conditions determine whether the bin is considered to contain transient noise that requires suppression.
7. The method of claim 5 , wherein the new magnitude for the frequency bin is calculated based on the previous magnitude, the spectral mean, and an estimated probability that a transient noise is present in the audio segment.
In the method for suppressing transient noise in audio signals described in claim 5 (where the magnitude of a frequency bin is compared to the spectral mean and a weighting factor, then adjusted based on a condition), the calculation of a new magnitude for a frequency bin uses the bin's previous magnitude, the spectral mean, and an estimated probability that transient noise is present in the audio segment. This probabilistic approach allows for more nuanced noise reduction.
8. The method of claim 6 , wherein the new magnitude for the frequency bin is calculated based on the previous magnitude, the spectral mean, and an estimated probability that a transient noise is present in the audio segment.
In the method for suppressing transient noise in audio signals described in claim 6 (where the magnitude of a frequency bin is compared to the spectral mean, then adjusted based on a condition), the calculation of a new magnitude for a frequency bin uses the bin's previous magnitude, the spectral mean, and an estimated probability that transient noise is present in the audio segment. This probabilistic approach allows for more nuanced noise reduction.
9. A teleconferencing computing system for suppressing transient noise in an audio signal, the system comprising: at least one processor; and a non-transitory computer-readable medium coupled to the at least one processor having instructions stored thereon which, when executed by the at least one processor, causes the at least one processor to: estimate a voice probability for a segment of the audio signal containing transient noise, the estimated voice probability being a probability that the segment contains voice data; responsive to determining that the estimated voice probability for the segment is greater than a threshold probability, suppress the transient noise contained in the segment of the audio signal while reducing distortion of the voice data, including: calculating a spectral mean for the audio segment over a plurality of frequency bins of the audio segment, and for each frequency bin of the plurality of frequency bins of the audio segment, if a comparison of a current value of the magnitude of the frequency bin to the spectral mean and to a calculated factor of the spectral mean indicates that transient noise is present, suppressing the transient noise in the frequency bin, wherein the calculated factor of the spectral mean is a fixed spectral weighting that is configured to de-emphasize frequency bins of the plurality of frequency bins corresponding to frequencies at which the voice data is transmitted, wherein suppressing the transient noise includes adjusting the magnitude of the frequency bin to a new value between the spectral mean and the current value of the magnitude of the frequency bin; and responsive to determining that the estimated voice probability for the segment is less than the threshold probability, suppress the transient noise contained in the segment of the audio signal while not reducing distortion of the voice data, including: calculating a spectral mean for the audio segment over a plurality of frequency bins of the audio segment, and for each frequency bin of the plurality of frequency bins of the audio segment, if a comparison of a magnitude of the frequency bin to the spectral mean indicates that transient noise is present, suppress the transient noise in the frequency bin, wherein suppressing the transient noise includes adjusting the magnitude of the frequency bin to a new value between the spectral mean and the current value of the magnitude of the frequency bin, wherein the transient noise is at least one of feedback noise, fan noise, and button-clicking noise due to mechanical connection between an audio capture device and a keyboard or trackpad of the teleconferencing computing device.
A teleconference system suppresses transient noise (like feedback, fan noise, or keyboard clicks) in audio signals. It includes a processor and memory storing instructions. The system estimates the probability that a segment of audio contains speech. If the probability is high, it reduces noise in each frequency bin by comparing the bin's magnitude to the average magnitude across all bins, and a weighted factor that de-emphasizes frequencies where speech is common. If noise is detected, the bin's magnitude is adjusted towards the average. If the speech probability is low, noise is suppressed more aggressively by comparing each bin's magnitude to the average and adjusting the magnitude towards the average.
10. The system of claim 9 , the estimated voice probability is based on voicing information received from a pitch estimator.
The system for suppressing transient noise in audio signals from claim 9 refines the voice probability estimation using voicing information from a pitch estimator. This estimator analyzes the audio to determine the fundamental frequency (pitch) of any speech present, and this information is then used to more accurately assess the likelihood that a segment contains voice data.
11. The system of claim 9 , wherein the at least one processor is further caused to: identify regions of the segment where the vocal folds are vibrating; and determine that the regions of the segment where the vocal folds are vibrating are regions containing voiced speech.
The system for suppressing transient noise in audio signals from claim 9 identifies regions where vocal folds vibrate and classifies these as regions containing voiced speech. This involves analyzing the audio signal to locate segments where the characteristics of vocal fold vibration are present, thereby improving the accuracy of voice probability estimation.
12. The system of claim 9 , wherein the at least one processor is further caused to: in response to the comparison of the magnitude of the frequency bin to the spectral mean and to the calculated factor of the spectral mean satisfying a first condition, calculate a new magnitude for the frequency bin; and in response to the comparison of the magnitude of the frequency bin to the spectral mean and to the calculated factor of the spectral mean satisfying a second condition, maintain the magnitude for the frequency bin, wherein the first condition is different from the second condition.
The system for suppressing transient noise in audio signals from claim 9 involves comparing the magnitude of each frequency bin to the spectral mean and a spectral weighting factor, and depending on whether a first or second condition is met as a result of the comparison, it either calculates a new magnitude for the bin or maintains the existing magnitude. The conditions determine whether the bin is considered to contain transient noise that requires suppression.
13. The system of claim 9 , wherein the at least one processor is further caused to: in response to the comparison of the magnitude of the frequency bin to the spectral mean satisfying a first condition, calculate a new magnitude for the frequency bin; and in response to the comparison of the magnitude of the frequency bin to the spectral mean satisfying a second condition, maintain the magnitude for the frequency bin, wherein the first condition is different from the second condition.
The system for suppressing transient noise in audio signals from claim 9 involves comparing the magnitude of each frequency bin to the spectral mean, and depending on whether a first or second condition is met as a result of the comparison, it either calculates a new magnitude for the bin or maintains the existing magnitude. The conditions determine whether the bin is considered to contain transient noise that requires suppression.
14. The system of claim 12 , wherein the at least one processor is further caused to: calculate the new magnitude for the frequency bin based on the previous magnitude, the spectral mean, and an estimated probability that a transient noise is present in the audio segment.
In the system for suppressing transient noise in audio signals described in claim 12 (where the magnitude of a frequency bin is compared to the spectral mean and a weighting factor, then adjusted based on a condition), the calculation of a new magnitude for a frequency bin uses the bin's previous magnitude, the spectral mean, and an estimated probability that transient noise is present in the audio segment. This probabilistic approach allows for more nuanced noise reduction.
15. The system of claim 13 , wherein the at least one processor is further caused to: calculate the new magnitude for the frequency bin based on the previous magnitude, the spectral mean, and an estimated probability that a transient noise is present in the audio segment.
In the system for suppressing transient noise in audio signals described in claim 13 (where the magnitude of a frequency bin is compared to the spectral mean, then adjusted based on a condition), the calculation of a new magnitude for a frequency bin uses the bin's previous magnitude, the spectral mean, and an estimated probability that transient noise is present in the audio segment. This probabilistic approach allows for more nuanced noise reduction.
16. A method performed by a teleconference computing device for suppressing transient noise in an audio signal, the method comprising: estimating a voice probability for a segment of the audio signal containing transient noise, the estimated voice probability being a probability that the segment contains voice data; responsive to determining that the estimated voice probability for the segment is greater than a threshold probability, suppressing the transient noise contained in the segment of the audio signal while reducing distortion of the voice data, including: calculating a spectral mean for the audio segment over a plurality of frequency bins of the audio segment, and for each frequency bin of the plurality of frequency bins of the audio segment, if a comparison of a current value of the magnitude of the frequency bin to the spectral mean and to a calculated factor of the spectral mean indicates that transient noise is present, suppressing the transient noise in the frequency bin, wherein the calculated factor of the spectral mean is a fixed spectral weighting that is configured to de-emphasize frequency bins of the plurality of frequency bins corresponding to frequencies at which the voice data is transmitted, wherein suppressing the transient noise includes adjusting the magnitude of the frequency bin to a new value between the spectral mean and the current value of the magnitude of the frequency bin; and responsive to determining that the estimated voice probability for the segment is less than the threshold probability, suppressing the transient noise contained in the segment of the audio signal while not reducing distortion of the voice data, including: calculating a spectral mean for the audio segment over the plurality of frequency bins of the audio segment, and for each frequency bin of the plurality of frequency bins of the audio segment, if a comparison of a magnitude of the frequency bin to the spectral mean indicates that transient noise is present, suppressing the transient noise in the frequency bin, wherein suppressing the transient noise includes adjusting the magnitude of the frequency bin to a new value between the spectral mean and the current value of the magnitude of the frequency bin, wherein the transient noise is at least one of feedback noise, fan noise, and button-clicking noise due to mechanical connection between an audio capture device and a keyboard or trackpad of the teleconferencing computing device.
A teleconference system suppresses transient noise (like feedback, fan noise, or keyboard clicks) in audio signals. It estimates the probability that a segment of audio contains speech. If the probability is high, it reduces noise in each frequency bin by comparing the bin's magnitude to the average magnitude across all bins, and a weighted factor that de-emphasizes frequencies where speech is common. If noise is detected, the bin's magnitude is adjusted towards the average. If the speech probability is low, noise is suppressed more aggressively by comparing each bin's magnitude to the average and adjusting the magnitude towards the average.
17. The method of claim 16 , further comprising: in response to the comparison of the magnitude of the frequency bin to the spectral mean and to the calculated factor of the spectral mean satisfying a first condition, calculating a new magnitude for the frequency bin; and in response to the comparison of the magnitude of the frequency bin to the spectral mean and to the calculated factor of the spectral mean satisfying a second condition, maintaining the magnitude for the frequency bin, wherein the first condition is different from the second condition.
The method for suppressing transient noise in audio signals from claim 16 involves comparing the magnitude of each frequency bin to the spectral mean and a spectral weighting factor, and depending on whether a first or second condition is met as a result of the comparison, it either calculates a new magnitude for the bin or maintains the existing magnitude. The conditions determine whether the bin is considered to contain transient noise that requires suppression.
18. The method of claim 16 , further comprising: in response to the comparison of the magnitude of the frequency bin to the spectral mean satisfying a first condition, calculating a new magnitude for the frequency bin; and in response to the comparison of the magnitude of the frequency bin to the spectral mean satisfying a second condition, maintaining the magnitude for the frequency bin, wherein the first condition is different from the second condition.
The method for suppressing transient noise in audio signals from claim 16 involves comparing the magnitude of each frequency bin to the spectral mean, and depending on whether a first or second condition is met as a result of the comparison, it either calculates a new magnitude for the bin or maintains the existing magnitude. The conditions determine whether the bin is considered to contain transient noise that requires suppression.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
March 31, 2014
August 1, 2017
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.