Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.
1. A method for interactive and user guided manipulation of multichannel audio content, the method including the steps of: (a) providing a content preview facility for replay and review of the multichannel audio content by a user; (b) providing a user interface for user selection of a segment of the multichannel audio content having an unsatisfactory audio content, wherein the segment of the multichannel audio content starts at a starting time when the user makes a first user gesture in response to a presence of an audio activity in the unsatisfactory audio content during a replaying of the multichannel audio content and ends at an ending time when the user makes a second user gesture in response to an absence of the audio activity in the unsatisfactory audio content during the replaying of the multichannel audio content, wherein the segment of the multichannel audio content includes an audio clip within a time duration between the starting time and the ending time; (c) processing the multichannel audio content to determine associated audio object activity spatial or signal space regions, to create a time line of activity where one or more spatial or signal space regions are active at any given time; (d) temporally correlating the user's selection of the segment of the multichannel audio content against at least one of the active spatial or signal space regions; (e) signal processing audio emanating from the correlated active spatial or signal space region, to determine at least one processed alternative of modified audio; (f) providing the user with an interactive playback facility to listen to the at least one processed alternative of modified audio; and (g) upon user approval, updating the multichannel audio content to incorporate the processed alternative into the multichannel audio content, wherein step (c) involves performing a scene analysis of the multichannel audio content for determining the object activity spatial or signal space regions.
The method involves interactive manipulation of multichannel audio content, addressing the challenge of identifying and correcting unsatisfactory audio segments. A content preview facility allows users to replay and review the audio. Users can select problematic segments by making gestures when audio activity begins and ends, defining a clip between those points. The system analyzes the multichannel audio to identify spatial or signal space regions where activity occurs, creating a timeline of active regions. The selected segment is correlated with these regions to isolate the problematic audio. Signal processing is applied to generate modified audio alternatives, which the user can preview interactively. Upon approval, the modified audio is incorporated into the original content. The analysis includes scene analysis to determine object activity regions, ensuring precise targeting of audio adjustments. This approach enables precise, user-guided correction of audio issues in multichannel content.
2. A method as claimed in claim 1 , wherein step (d) involves comparing the user's selection of the segment of the multichannel audio content to the activity of the one or more spatial or signal space regions over time.
3. A method as claimed in claim 1 , wherein step (e) involves processing the audio emanating from the correlated active spatial or signal space region using a number of different techniques, the number corresponding to a number of processed alternatives of modified audio.
This invention relates to audio processing systems that enhance or modify audio signals based on spatial or signal space regions. The problem addressed is the need to process audio from specific regions of interest in a way that generates multiple modified audio alternatives for further selection or analysis. The method involves identifying an active spatial or signal space region, such as a location in a room or a frequency band, from which audio is being captured. Once this region is identified, the audio emanating from it is processed using multiple distinct techniques. Each technique produces a different modified version of the original audio, resulting in a set of processed alternatives. These alternatives may include noise reduction, frequency adjustment, spatial filtering, or other modifications tailored to the specific application. The number of processing techniques applied corresponds directly to the number of modified audio outputs generated, allowing for flexibility in how the audio is subsequently used. This approach enables adaptive audio enhancement, where the most suitable processed version can be selected based on real-time conditions or user preferences. The invention is particularly useful in applications like speech recognition, noise cancellation, and spatial audio rendering.
4. A method as claimed in claim 1 , wherein step (e) involves applying at least one filter to an audio object associated with the correlated active spatial or signal space region.
5. A method as claimed in claim 1 , wherein step (e) involves applying either enhancement or diminution filters, depending on the user's choice, to respectively enhance or reduce the relative importance of an audio object associated with the correlated active spatial or signal space region.
6. A method as claimed in claim 1 , wherein step (e) involves signal processing to determine a plurality of processed alternatives of modified audio; and wherein step (f) involves providing the user with an interactive playback facility to listen to the plurality of processed alternatives of modified audio, and receiving the user's selection of one of the plurality of processed alternatives of modified audio.
7. A method as claimed in claim 1 , wherein the user interface for the user selection of a segment includes a button activation interface.
A method for user interaction with a segmented interface involves selecting a specific segment through a button activation interface. The system presents a user interface displaying multiple segments, each representing a distinct portion of content or functionality. The button activation interface allows the user to select a desired segment by pressing or activating a button, which may be physical or virtual. Upon activation, the system processes the selection and performs an action associated with the chosen segment, such as displaying additional content, navigating to a different interface, or executing a function. The method ensures intuitive and efficient user interaction by simplifying the selection process through a straightforward button-based mechanism. This approach is particularly useful in applications where quick and precise segment selection is required, such as in multimedia playback, navigation systems, or interactive displays. The button activation interface may include features like haptic feedback or visual confirmation to enhance user experience. The method may also incorporate additional user interface elements, such as menus or icons, to further assist in segment selection and navigation. The overall system aims to improve usability and responsiveness in interactive applications.
8. A method as claimed in claim 7 , wherein said button activation interface comprises depressing a single button for a time period whilst audio content is unsatisfactory.
9. A method as claimed in claim 1 , further comprising the step of: (h) iteratively searching the multichannel audio content for a further segment of multichannel content having active spatial or signal space regions, setting the segment in step (d) to the further segment, and applying the processing of steps (c) to (f) to the identified further segments.
10. A method as claimed in claim 1 , wherein said step (e) further comprises utilising a number of changes in activity state to determine which active spatial or signal space region to apply signal processing to.
11. A system comprising: one or more processors that execute instructions to carry out a method for the interactive and user guided manipulation of multichannel audio content, the method including: analysing separate spatial characteristics of audio sources in the multichannel audio content producing corresponding approximate audio spatial characteristics for the audio sources, wherein a scene analysis of the multichannel audio content is performed for determining the audio sources in the multichannel audio content; receiving selection by a user of at least one problematic audio segment of the multichannel audio content having an unsatisfactory audio content for analysis, wherein the problematic audio segment of the multichannel audio content starts at a starting time when the user makes a first user gesture in response to a presence of an audio activity in the unsatisfactory audio content during a replaying of the multichannel audio content and ends at an ending time when the user makes a second user gesture in response to an absence of the audio activity in the unsatisfactory audio content during the replaying of the multichannel audio content, wherein the problematic audio segment of the multichannel audio content includes an audio clip within a time duration between the starting time and the ending time; correlating the selected audio segment with an audio source selected from the audio sources; selectively applying signal processing to alter audio characteristics of the selected audio source relative to other non selected audio sources in the audio sources; displaying a number of alternative audio filtered segments of the selected audio source for review by the user, and selection of a desired response; and integrating audio effects of the selected audio source into the multichannel audio content upon selection by the user.
12. A system as claimed in claim 11 , wherein the method further comprises filtering unit adapted to apply at least one filter to alter the audio characteristics of the selected audio source relative to the other non-selected audio sources.
The system relates to audio processing, specifically for managing multiple audio sources in an environment where selective enhancement or modification of one audio source is desired while maintaining the integrity of other sources. The problem addressed is the need to dynamically adjust the audio characteristics of a chosen audio source without disrupting the overall audio experience, which is particularly useful in applications like conference calls, live broadcasts, or immersive audio environments. The system includes a filtering unit designed to apply at least one filter to modify the audio characteristics of a selected audio source relative to non-selected sources. This filtering can include adjustments to volume, frequency response, spatial positioning, or other acoustic properties. The filtering unit operates in conjunction with a selection mechanism that identifies the primary audio source to be enhanced or altered, ensuring that modifications are applied precisely to the intended source while leaving other sources unmodified. The system may also incorporate real-time monitoring to dynamically adjust filtering parameters based on changing conditions, such as background noise or user preferences. This approach allows for targeted audio enhancement without requiring manual intervention, improving clarity and intelligibility in multi-source audio environments.
13. A system as claimed in claim 12 , wherein the method further comprises applies either enhancement or diminution filters to said selected audio source depending on a user's choice.
14. A system as claimed in claim 11 , wherein the method further comprises comparing the user's selection of the problematic audio segment of the multichannel audio content to an activity of the one or more audio sources.
15. A system as claimed in claim 11 , wherein the method further comprises reviewing other portions of the multichannel audio content for other sound sources to be correlated to the selected audio segment.
Unknown
March 23, 2021
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.