Patentable/Patents/US-10418049
US-10418049

Audio processing apparatus and control method thereof

PublishedSeptember 17, 2019
Assigneenot available in USPTO data we have
Inventorsnot available in USPTO data we have
Technical Abstract

The present invention makes it possible to reduce noise from a driving unit with a two-channel microphone configuration. An audio processing apparatus has a first microphone whose main acquisition target is sound from outside of the apparatus, a second microphone whose main acquisition target is driving noise from the driving unit, and a noise removing unit that generates two-channel audio data in which driving noise made by the driving unit of the apparatus has been reduced based on the difference between time-series audio data acquired by the first microphone and time-series audio data acquired by the second microphone. This noise removing unit has two adaptive filter units that respectively perform filter processing on time-series audio data from the first microphone and time-series audio data from the second microphone, and generates stereo two-channel audio data.

Patent Claims
7 claims

Legal claims defining the scope of protection, as filed with the USPTO.

1

1. An audio processing apparatus, comprising: a driving unit; a first microphone whose main acquisition target is sound from outside of the apparatus; a second microphone whose main acquisition target is driving noise from the driving unit, compared with the first microphone; and a noise removing unit configured to generate two-channel audio data in which driving noise made by the driving unit has been reduced, based on a difference between time-series audio data acquired by the first microphone and time-series audio data acquired by the second microphone, wherein the noise removing unit includes: a determination unit configured to determine whether or not the driving noise occurred based on the difference between time-series audio data acquired by the first microphone and time-series audio data acquired by the second microphone, a correlation processing unit configured to obtain a correlation value between phases of time-series audio data acquired by the first microphone and time-series audio data acquired by the second microphone in a case where the determination unit determines that the driving noise occurred, a generation unit configured to generate time-series audio data for which an error of an incident angle of sound from the outside to the first microphone and the second microphone was determined to exceed a preset threshold, out of time-series audio data acquired by the first microphone and time-series audio data acquired by the second microphone, based on the correlation value, a first adaptive filter configured to receive inputs of time-series audio data acquired by the first microphone and time-series audio data corresponding to the first microphone and generated by the generation unit, perform adaptive filter processing, and generate audio data of one channel of stereo, and a second adaptive filter configured to receive inputs of time-series audio data acquired by the second microphone and time-series audio data corresponding to the second microphone and generated by the generation unit, perform adaptive filter processing, and generate audio data of the other channel of stereo.

2

2. The apparatus according to claim 1 , wherein the determination unit determines that time-series audio data acquired by the first microphone includes driving noise in a case where time-series audio data acquired by the second microphone is larger than a preset threshold.

3

3. The apparatus according to claim 1 , wherein letting that time-series audio data from the first microphone and time-series audio data from the second microphone that have been acquired from the determination unit be M_x[t] and S_x[t], and φ ms = ∑ j = 1 M ⁢ ⁢ M_x ⁡ [ t ] · S_x ⁡ [ t + j ] M ⁢ ⁢ ( j = 0 , 1 , 2 , … ⁢ , M ) , the correlation processing unit determines M at which φms is positive and maximum, as a correlation value.

4

4. The apparatus according to claim 1 , wherein the first microphone is a microphone whose main target is sound propagated from outside of the apparatus via a first opening portion provided at a predetermined position of a case of the audio processing apparatus, the second microphone is a microphone that converts sound that enters the apparatus via a second opening portion whose area is smaller than that of the first opening portion, into an electrical signal, and a volume of a space between the second microphone and the second opening portion is larger than a volume of space between the first microphone and the first opening portion in order to allow driving noise from the driving unit of the audio processing apparatus to be propagated to the second microphone.

5

5. The apparatus according to claim 1 , wherein an image capturing unit is provided between the first microphone and the second microphone.

6

6. A control method of an audio processing apparatus that includes a driving unit, a first microphone whose main acquisition target is sound from outside of the apparatus, and a second microphone whose main acquisition target is driving noise from the driving unit, compared with the first microphone, the method comprising: removing noise so as to generate two-channel audio data in which driving noise made by the driving unit has been reduced, based on a difference between time-series audio data acquired by the first microphone and time-series audio data acquired by the second microphone, wherein the removing includes: determining whether or not the driving noise occurred based on the difference between time-series audio data acquired by the first microphone and time-series audio data acquired by the second microphone, obtaining a correlation value between phases of time-series audio data acquired by the first microphone and time-series audio data acquired by the second microphone in a case where it is determined that the driving noise occurred in this determining, generating time-series audio data for which an error of an incident angle of sound from the outside to the first microphone and the second microphone was determined to exceed a preset threshold, out of time-series audio data acquired by the first microphone and time-series audio data acquired by the second microphone, based on the obtained correlation value, receiving inputs of time-series audio data acquired by the first microphone and time-series audio data corresponding to the first microphone and generated in the generating, performing adaptive filter processing, and generating audio data of one channel of stereo, and receiving inputs of time-series audio data acquired by the second microphone and time-series audio data corresponding to the second microphone and generated in the generating, performing adaptive filter processing, and generating audio data of the other channel of stereo.

7

7. A non-transitory computer-readable storage medium that stores a program of steps of a noise removing method that is read out and executed by a processor in an audio processing apparatus that includes a driving unit, a first microphone whose main acquisition target is sound from outside of the apparatus, and a second microphone whose main acquisition target is driving noise from the driving unit, compared with the first microphone, the method comprising: removing noise so as to generate two-channel audio data in which driving noise made by the driving unit has been reduced, based on a difference between time-series audio data acquired by the first microphone and time-series audio data acquired by the second microphone, wherein the removing includes: determining whether or not the driving noise occurred based on the difference between time-series audio data acquired by the first microphone and time-series audio data acquired by the second microphone, obtaining a correlation value between phases of time-series audio data acquired by the first microphone and time-series audio data acquired by the second microphone in a case where it is determined that the driving noise occurred in this determining, generating time-series audio data for which an error of an incident angle of sound from the outside to the first microphone and the second microphone was determined to exceed a preset threshold, out of time-series audio data acquired by the first microphone and time-series audio data acquired by the second microphone, based on the obtained correlation value, receiving inputs of time-series audio data acquired by the first microphone and time-series audio data corresponding to the first microphone and generated in the generating, performing adaptive filter processing, and generating audio data of one channel of stereo, and receiving inputs of time-series audio data acquired by the second microphone and time-series audio data corresponding to the second microphone and generated in the generating, performing adaptive filter processing, and generating audio data of the other channel of stereo.

Classification Codes (CPC)

Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.

Patent Metadata

Filing Date

August 8, 2018

Publication Date

September 17, 2019

Want to explore more patents?

Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.

Citation & reuse

Analysis on this page is generated by Patentable — an AI-powered patent intelligence platform. AI-generated summaries, explanations, and analysis may be reused with attribution and a visible link back to the canonical URL below. Patent abstracts and claims are USPTO public domain.

Cite as: Patentable. “Audio processing apparatus and control method thereof” (US-10418049). https://patentable.app/patents/US-10418049

© 2026 Patentable. All rights reserved.

Patentable is a research and drafting-assistant tool, not a law firm, and does not provide legal advice. Documents we generate are drafts for review by a licensed patent attorney.