10643592

Virtual / Augmented Reality Display and Control of Digital Audio Workstation Parameters

PublishedMay 5, 2020
Assigneenot available in USPTO data we have
Technical Abstract

Patent Claims
26 claims

Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.

Claim 1

Original Legal Text

1. A system, comprising: an interface configured to: receive motion control data from one or more sensors; receive a first parameter value associated with a music composition from a digital audio workstation; and receive a second parameter value associated with the music composition from the digital audio workstation; and a processor configured to: convert the motion control data to one or more manipulations of one or more virtual objects; map the one or more manipulations of the one or more virtual objects to at least a first command that adjusts the first parameter value and a second command that adjusts the second parameter value; send the first command to the digital audio workstation using a first audio input protocol recognized by the digital audio workstation; and send the second command to the digital audio workstation using a second audio input protocol recognized by the digital audio workstation.

Plain English Translation

The system enables real-time control of music composition parameters using motion data. It addresses the challenge of integrating physical gestures or movements into digital audio workflows, allowing musicians or producers to manipulate audio parameters intuitively. The system includes an interface that receives motion control data from sensors, such as those tracking hand movements or body gestures, and retrieves parameter values from a digital audio workstation (DAW). These parameters, which could include volume, pitch, or effects settings, are dynamically adjusted based on the motion data. A processor converts the motion data into manipulations of virtual objects, which are then mapped to commands that modify the DAW parameters. These commands are sent to the DAW using compatible audio input protocols, ensuring seamless integration. The system supports multiple protocols to accommodate different DAW requirements, enabling flexible and responsive control over music production elements through physical interaction. This approach enhances creativity by bridging the gap between physical movement and digital audio manipulation.

Claim 2

Original Legal Text

2. The system of claim 1 , wherein the one or more sensors include one or more gesture trackers attached to one or more human body parts.

Plain English Translation

The system relates to a wearable technology domain, specifically for tracking human movement and gestures. The problem addressed is the need for accurate, real-time monitoring of body movements to enhance applications such as virtual reality, rehabilitation, or motion analysis. Traditional systems often rely on external cameras or bulky equipment, which can be inconvenient or limit mobility. The system includes one or more sensors, such as gesture trackers, attached directly to human body parts. These sensors detect and record movements, providing precise data on gestures and motion. The system may also include processing components to analyze the sensor data, enabling applications like gesture recognition, biomechanical analysis, or interactive control. The sensors are designed to be lightweight and unobtrusive, ensuring comfort and natural movement for the user. This approach eliminates the need for external tracking devices, improving accuracy and usability in various environments. The system can be used in medical settings for rehabilitation, in gaming for immersive experiences, or in industrial applications for ergonomic assessments. The direct attachment of sensors to body parts ensures high-fidelity data capture, addressing limitations of previous systems that relied on indirect or external tracking methods.

Claim 3

Original Legal Text

3. The system of claim 1 , wherein the first audio input protocol and the second audio input protocol are two of the following three protocols: Musical Instrument Digital Interface, Human User Interface Protocol, and Open Sound Control.

Plain English Translation

This invention relates to a system for processing audio input signals using multiple communication protocols. The system addresses the challenge of integrating audio devices that operate on different protocols, which can lead to compatibility issues and limited interoperability in audio applications. The system includes at least two audio input interfaces, each configured to receive audio signals according to distinct protocols. The first audio input protocol and the second audio input protocol are selected from three specific protocols: Musical Instrument Digital Interface (MIDI), Human User Interface Protocol (HUI), and Open Sound Control (OSC). MIDI is a widely used protocol for transmitting musical performance data between electronic instruments and computers. HUI is a protocol designed for controlling hardware devices, such as mixing consoles, from software applications. OSC is a flexible protocol for communication among computers, sound synthesizers, and other multimedia devices. The system processes the received audio signals from these interfaces, enabling seamless integration and control of audio devices that use different protocols. This allows for enhanced flexibility in audio production, performance, and control applications.

Claim 4

Original Legal Text

4. The system of claim 1 , wherein the first parameter value, the second parameter value, or both the first parameter value and the second parameter value are associated with volume control.

Plain English Translation

A system for managing audio parameters in an electronic device includes a processor and a memory storing instructions that, when executed, configure the processor to adjust audio output based on user input. The system monitors at least two parameter values related to audio processing, such as volume levels, gain settings, or other audio control metrics. These parameters can be dynamically adjusted in response to user interactions, environmental conditions, or predefined settings. The system ensures that changes to these parameters are synchronized across multiple audio channels or devices to maintain consistent audio output. The system may also include a user interface for displaying or modifying the parameter values in real time. The parameter values can be stored in a data structure accessible by the processor to facilitate rapid adjustments. The system may further include error handling mechanisms to prevent parameter values from exceeding predefined limits, ensuring stable audio performance. The system is particularly useful in applications requiring precise audio control, such as multimedia playback, communication devices, or audio processing software.

Claim 5

Original Legal Text

5. The system of claim 1 , wherein the first parameter value, the second parameter value, or both the first parameter value and the second parameter value are associated with sound recording or playback of the music composition.

Plain English Translation

This invention relates to a system for managing parameter values associated with sound recording or playback of a music composition. The system includes a processor and a memory storing instructions that, when executed, cause the processor to perform operations. These operations include receiving a first parameter value and a second parameter value, where at least one of these values is associated with sound recording or playback of the music composition. The system processes these values to generate an output, such as a modified audio signal or a control signal for playback devices. The system may also include a user interface for adjusting these parameter values in real-time during recording or playback. The parameters can include audio effects, volume levels, equalization settings, or other sound processing attributes. The system ensures that the parameter values are synchronized with the music composition, allowing for precise control over the audio output. This invention addresses the need for flexible and accurate parameter management in music production and playback systems, improving the quality and customization of audio experiences.

Claim 6

Original Legal Text

6. The system of claim 1 , wherein the first parameter value, the second parameter value, or both the first parameter value and the second parameter value are associated with audio dynamic range compression.

Plain English Translation

This invention relates to audio processing systems, specifically those involving dynamic range compression. Dynamic range compression is a technique used to reduce the volume of loud sounds or boost the volume of quiet sounds, making audio more consistent and suitable for various playback environments. The challenge addressed by this system is the need for precise control over compression parameters to achieve desired audio quality while avoiding artifacts like distortion or unnatural sound. The system includes a processor configured to adjust audio signals based on at least two parameter values. These parameters influence the compression process, such as threshold, ratio, attack, or release times, which determine how aggressively the system reduces loud sounds or preserves quiet ones. The system allows for dynamic adjustment of these parameters in real-time, ensuring optimal compression tailored to different audio content or listening conditions. Additionally, the system may include a user interface or automated logic to select or modify these parameter values based on predefined settings or adaptive algorithms. The invention improves upon existing compression systems by providing flexible control over multiple parameters, enabling finer tuning of audio output. This enhances audio clarity and consistency across various applications, such as music production, broadcasting, or consumer electronics. The system may also integrate with other audio processing stages, such as equalization or noise reduction, to further refine the sound. By dynamically adjusting compression parameters, the system ensures high-quality audio reproduction in diverse environments.

Claim 7

Original Legal Text

7. The system of claim 1 , wherein the processor is configured to convert the motion control data including by being configured to convert real-world finger, hand, and arm movements to corresponding virtual finger, hand, and arm movements in a virtual space.

Plain English Translation

This invention relates to a motion control system that translates real-world human movements into virtual actions within a digital environment. The system addresses the challenge of accurately capturing and converting physical gestures, such as finger, hand, and arm movements, into precise virtual representations in a virtual space. The system includes a processor that processes motion control data to enable this conversion, ensuring that the virtual movements closely mirror the real-world actions. The processor is configured to analyze input data from sensors or tracking devices, which detect the user's physical movements, and then generate corresponding virtual movements in a simulated environment. This allows for intuitive and responsive interaction in applications such as virtual reality, augmented reality, gaming, or other interactive digital systems. The system enhances user experience by providing a seamless and natural transition between physical and virtual actions, improving accuracy and reducing latency in motion tracking. The invention aims to overcome limitations in existing motion control technologies, such as lag, imprecision, or the inability to capture fine motor details, thereby enabling more immersive and realistic virtual interactions.

Claim 8

Original Legal Text

8. The system of claim 1 , wherein the processor is configured to map the one or more manipulations of the one or more virtual objects including by being configured to map collisions with the one or more virtual objects to one or more Musical Instrument Digital Interface note parameter commands.

Plain English Translation

This invention relates to a system for converting physical interactions with virtual objects into musical output using MIDI (Musical Instrument Digital Interface) commands. The system addresses the challenge of translating real-time physical manipulations of virtual objects into precise musical control signals, enabling intuitive and dynamic musical expression. The system includes a processor that processes sensor data to detect physical manipulations of one or more virtual objects in a virtual environment. These manipulations may include movements, rotations, or collisions involving the virtual objects. The processor is configured to map these manipulations to MIDI note parameter commands, such as note-on, note-off, pitch bend, or modulation, allowing the physical interactions to generate corresponding musical notes or effects. For example, a collision between a virtual object and another object or boundary may trigger a specific MIDI note or modify an existing note's parameters. The system may also include a display for rendering the virtual environment and input devices, such as motion sensors or controllers, to capture physical interactions. The processor further processes the sensor data to determine the nature and intensity of the manipulations, ensuring accurate mapping to MIDI commands. This enables real-time musical feedback based on physical gestures, enhancing interactive music creation and performance. The system may be used in applications like virtual musical instruments, interactive installations, or gaming environments where physical actions influence sound generation.

Claim 9

Original Legal Text

9. The system of claim 1 , wherein the processor is configured to map the one or more manipulations of the one or more virtual objects including by being configured to map virtual button presses to one or more Human User Interface Protocol transport control commands.

Plain English Translation

This invention relates to a system for mapping user interactions with virtual objects to standardized control commands in a Human User Interface Protocol (HUIP) environment. The system addresses the challenge of translating diverse virtual object manipulations into a consistent set of transport control commands that can be processed by HUIP-compatible devices or systems. The system includes a processor that processes input data representing manipulations of one or more virtual objects, such as virtual button presses, and converts these manipulations into corresponding HUIP transport control commands. These commands are then transmitted to a target device or system for execution. The mapping ensures compatibility and interoperability between different virtual interfaces and HUIP-compliant systems, enabling seamless control of devices or applications. The system may also include input interfaces for receiving user interactions and output interfaces for transmitting the generated HUIP commands. The processor may further apply additional processing, such as filtering or normalization, to the input data before mapping it to the appropriate HUIP commands. This approach simplifies integration with existing HUIP infrastructure while maintaining responsiveness and accuracy in command execution.

Claim 10

Original Legal Text

10. The system of claim 1 , wherein the processor is configured to map the one or more manipulations of the one or more virtual objects including by being configured to map movement of one of the virtual objects in three-dimensional virtual or augmented reality space to three separate commands adjusting three separate parameter values.

Plain English Translation

A system for manipulating virtual objects in three-dimensional virtual or augmented reality environments addresses the challenge of efficiently controlling multiple parameters of virtual objects with intuitive user interactions. The system includes a processor that processes user inputs to manipulate one or more virtual objects in a virtual or augmented reality space. The processor is configured to map these manipulations, including movements of virtual objects, to multiple commands that adjust separate parameter values. For example, moving a virtual object in three-dimensional space can simultaneously adjust three distinct parameters, such as position, orientation, and scale, based on the direction and magnitude of the movement. This allows users to modify multiple aspects of a virtual object with a single gesture, improving interaction efficiency and reducing the need for sequential adjustments. The system may also include input devices, such as controllers or gesture-tracking sensors, to capture user manipulations and output devices, such as displays or haptic feedback systems, to provide visual or tactile feedback. The processor further processes spatial data to ensure accurate mapping between user inputs and the resulting parameter adjustments, enhancing precision in virtual object manipulation. This approach streamlines complex interactions in virtual or augmented reality applications, such as design, gaming, or training simulations.

Claim 11

Original Legal Text

11. The system of claim 1 , wherein the processor is configured to map the one or more manipulations of the one or more virtual objects including by being configured to map one or more shape changes of a virtual pyramid to one or more parameters associated with the virtual pyramid.

Plain English Translation

This invention relates to a system for manipulating virtual objects in a digital environment, particularly focusing on mapping physical interactions with virtual objects to specific parameters of those objects. The system addresses the challenge of intuitively controlling complex virtual objects, such as a virtual pyramid, by translating user manipulations into meaningful changes in the object's properties. The processor in the system is configured to detect and interpret user actions, such as shape changes applied to a virtual pyramid, and correlate these actions with predefined parameters associated with the pyramid. For example, altering the pyramid's dimensions or angles could adjust its structural properties, visual appearance, or other attributes. The system ensures that user interactions are accurately reflected in the virtual object's behavior, enhancing usability and precision in digital modeling, simulation, or interactive applications. This approach simplifies complex object manipulation by providing a direct and intuitive mapping between physical gestures and virtual object parameters, improving efficiency and user experience in virtual environments.

Claim 12

Original Legal Text

12. The system of claim 1 , wherein the processor is configured to send the first command and send the second command including by being configured to send the first command, the second command, or both the first command and the second command wirelessly.

Plain English Translation

A system for wirelessly transmitting commands between devices in a networked environment addresses the need for reliable and flexible communication in distributed systems. The system includes a processor that generates and sends commands to control operations across multiple devices. The processor is configured to transmit a first command and a second command, either individually or simultaneously, using wireless communication protocols. This wireless transmission capability ensures that commands can be sent without physical connections, improving system flexibility and reducing infrastructure requirements. The system may also include additional components, such as memory for storing command data or interfaces for device interaction, to support the command transmission process. By enabling wireless command delivery, the system enhances operational efficiency and adaptability in environments where wired connections are impractical or unavailable. The technology is particularly useful in applications requiring remote control, such as industrial automation, smart home systems, or IoT networks, where seamless and reliable communication is essential.

Claim 13

Original Legal Text

13. The system of claim 1 , wherein the processor is configured to send the first command and send the second command including by being configured to send the first command, the second command, or both the first command and the second command to a plug-in embedded in the digital audio workstation.

Plain English Translation

A system for managing audio processing in a digital audio workstation (DAW) includes a processor configured to send commands to a plug-in embedded within the DAW. The system addresses the challenge of efficiently controlling audio processing tasks by allowing the processor to send a first command, a second command, or both commands to the plug-in. The plug-in, integrated into the DAW, executes these commands to modify audio signals in real-time or during post-processing. The processor dynamically adjusts command execution based on user input or predefined settings, ensuring seamless integration with the DAW's workflow. This approach enhances flexibility and precision in audio manipulation, enabling users to apply effects, adjustments, or automation with minimal latency. The system supports various audio processing functions, such as equalization, compression, or spatial effects, while maintaining compatibility with existing DAW architectures. By offloading command processing to the plug-in, the system optimizes performance and reduces computational overhead on the host system. The solution is particularly useful in professional audio production environments where real-time responsiveness and precise control are critical.

Claim 14

Original Legal Text

14. The system of claim 1 , wherein the processor is configured to send the first command and send the second command including by being configured to send the first command, the second command, or both the first command and the second command using Open Sound Control.

Plain English Translation

This invention relates to a system for controlling audio or multimedia devices using Open Sound Control (OSC), a protocol for communication among computers, sound synthesizers, and other multimedia devices. The system addresses the need for efficient, flexible, and standardized communication between control devices and audio/multimedia systems, particularly in scenarios requiring precise timing and synchronization. The system includes a processor configured to send commands to control one or more devices. The processor can transmit a first command, a second command, or both commands using Open Sound Control (OSC). OSC is a protocol designed for real-time control of audio and multimedia systems, offering low-latency communication and support for complex parameter structures. By using OSC, the system ensures compatibility with a wide range of devices and enables precise, high-speed control over audio processing, playback, and other multimedia functions. The processor may send the first command to initiate a specific action, such as starting playback or adjusting an audio parameter, while the second command may trigger a different function, such as stopping playback or modifying another parameter. The use of OSC allows these commands to be transmitted in a standardized format, reducing the need for proprietary protocols and simplifying integration with existing systems. The system may be used in applications such as live performances, audio production, or multimedia installations where reliable and synchronized control is essential.

Claim 15

Original Legal Text

15. The system of claim 1 , wherein the processor is configured to send the first command and send the second command including by being configured to perform at least one of the following data processing operations with respect to data associated with the first command, the second command, or both the first command and the second command: filter out repeat data, convert data to a lower volume format, or select a communication method based on data type.

Plain English Translation

This invention relates to a data processing system designed to optimize command transmission between devices, particularly in environments where bandwidth or processing efficiency is a concern. The system addresses the problem of redundant or inefficient data handling during command execution, which can lead to unnecessary resource consumption and delays. The system includes a processor configured to send a first command and a second command, where the processor performs data processing operations on the associated data to improve transmission efficiency. These operations include filtering out repeat data to eliminate redundancy, converting data into a lower-volume format to reduce transmission overhead, and selecting an appropriate communication method based on the data type to optimize bandwidth usage. The system ensures that only relevant and efficiently formatted data is transmitted, reducing unnecessary processing and communication overhead. By dynamically adjusting data handling based on content and context, the system enhances performance in applications such as distributed computing, IoT networks, or real-time control systems where efficient command execution is critical. The invention improves resource utilization and responsiveness by minimizing redundant transmissions and optimizing data representation.

Claim 16

Original Legal Text

16. The system of claim 1 , wherein the interface is further configured to receive feedback information from the digital audio workstation associated with the first command, the second command, or both the first command and the second command.

Plain English Translation

A system for integrating a digital audio workstation (DAW) with a hardware controller includes an interface that facilitates communication between the DAW and the controller. The interface is configured to transmit a first command to the DAW to initiate a first function, such as adjusting a parameter or triggering an effect, and a second command to the DAW to initiate a second function, such as recording or playback. The interface also receives feedback information from the DAW in response to these commands, allowing the controller to reflect the DAW's state or confirm command execution. This feedback may include status updates, parameter values, or error notifications, ensuring synchronization between the hardware and software. The system enhances workflow efficiency by enabling real-time interaction between the DAW and the controller, reducing manual input and improving accuracy. The feedback mechanism ensures that the controller accurately mirrors the DAW's operations, providing users with immediate visual or tactile confirmation of their actions. This integration is particularly useful in music production, live performance, and audio engineering, where precise control and responsiveness are critical.

Claim 17

Original Legal Text

17. The system of claim 1 , wherein the processor is further configured to provide haptic feedback data to a haptic feedback device.

Plain English Translation

A system for providing haptic feedback in a user interface environment addresses the challenge of enhancing user interaction by delivering tactile sensations. The system includes a processor that processes input data, such as user interactions or system events, to generate haptic feedback signals. These signals are transmitted to a haptic feedback device, which converts them into physical vibrations or forces that the user can feel. The haptic feedback device may be integrated into a wearable device, a handheld controller, or another input/output interface. The feedback can simulate textures, confirm actions, or provide directional guidance, improving user experience by making interactions more intuitive and immersive. The system may also include sensors to detect user movements or environmental conditions, allowing the haptic feedback to adapt dynamically. By integrating haptic feedback, the system enhances traditional visual and auditory feedback, making digital interactions more engaging and accessible.

Claim 18

Original Legal Text

18. The system of claim 1 , wherein the processor is further configured to send data associated with the one or more virtual objects to a headset display device.

Plain English Translation

A system for managing virtual objects in a computing environment includes a processor that generates and manipulates one or more virtual objects within a virtual space. The processor tracks the position and orientation of a user's headset display device and adjusts the virtual objects accordingly to maintain proper spatial alignment. The system also includes a memory for storing data related to the virtual objects and their interactions. Additionally, the processor sends data associated with the one or more virtual objects to the headset display device, enabling the device to render the virtual objects in a visually coherent manner. This ensures that the virtual objects appear correctly positioned and oriented relative to the user's perspective, enhancing immersion in the virtual environment. The system may also include input devices for user interaction, allowing the user to manipulate or interact with the virtual objects. The processor processes these inputs to update the virtual objects in real-time, providing a responsive and dynamic experience. The system is particularly useful in augmented reality (AR) or virtual reality (VR) applications where accurate spatial representation of virtual objects is critical for user engagement and interaction.

Claim 19

Original Legal Text

19. The system of claim 1 , wherein the interface is further configured to receive frequency domain data and stereo field position data associated with the music composition and the processor is further configured to send the frequency domain data and stereo field position data to a headset display device, wherein the stereo field position data is associated with the first parameter value or the second parameter value.

Plain English Translation

This invention relates to a system for processing and displaying audio data, particularly for music compositions, in a headset display device. The system addresses the challenge of accurately representing spatial audio characteristics in virtual or augmented reality environments, ensuring immersive and realistic sound localization. The system includes an interface that receives frequency domain data and stereo field position data associated with a music composition. The frequency domain data represents the spectral content of the audio, while the stereo field position data indicates the spatial positioning of sound sources within the composition. A processor within the system processes this data and sends it to a headset display device, which renders the audio in a way that aligns with the spatial cues provided by the stereo field position data. The stereo field position data is linked to parameter values that influence how the audio is spatially positioned. These parameters may adjust the perceived location of sound sources, enhancing the immersive experience. The system ensures that the audio rendering in the headset display device accurately reflects the intended spatial arrangement, improving realism and user engagement. This approach is particularly useful in applications such as virtual concerts, spatial audio editing, and immersive media experiences.

Claim 20

Original Legal Text

20. A method, comprising: receiving motion control data from one or more sensors; receiving a first parameter value associated with a music composition from a digital audio workstation; receiving a second parameter value associated with the music composition from the digital audio workstation; converting the motion control data to one or more manipulations of one or more virtual objects; mapping the one or more manipulations of the one or more virtual objects to at least a first command that adjusts the first parameter value and a second command that adjusts the second parameter value; sending the first command to the digital audio workstation using a first audio input protocol recognized by the digital audio workstation; and sending the second command to the digital audio workstation using a second audio input protocol recognized by the digital audio workstation.

Plain English Translation

This invention relates to a system for controlling digital audio workstations (DAWs) using motion-based inputs. The technology addresses the challenge of providing intuitive, gesture-based control over music production parameters, allowing users to manipulate audio elements in real-time without relying solely on traditional input devices like keyboards or mice. The method involves receiving motion control data from one or more sensors, which detect physical movements such as hand gestures or body motions. Additionally, it receives parameter values associated with a music composition from a DAW, such as volume levels, effects settings, or track positions. The system converts the detected motion data into manipulations of virtual objects, which are then mapped to specific commands that adjust the received parameter values. For example, a hand movement could be translated into a volume adjustment or a filter modulation. The method sends these commands to the DAW using different audio input protocols, ensuring compatibility with various DAW systems. This allows seamless integration with existing music production software, enabling real-time, motion-driven control over multiple audio parameters simultaneously. The approach enhances workflow efficiency and creativity by providing a more natural and immersive way to interact with digital audio environments.

Claim 21

Original Legal Text

21. A system, comprising: an interface configured to receive a parameter value associated with a music composition from a digital audio workstation and motion control data from a sensor; and a processor configured to: display a virtual object, wherein changes to the parameter value map to configuration changes of the virtual object; determine an updated parameter value based at least in part on the motion control data; display an updated virtual object; and send the updated parameter value to the digital audio workstation.

Plain English Translation

This system integrates music composition and interactive visual feedback by linking parameter adjustments in a digital audio workstation (DAW) to dynamic changes in a virtual object. The system includes an interface that receives parameter values from the DAW, such as volume, pitch, or effects settings, and motion control data from a sensor, such as a motion tracking device or gesture input. A processor displays a virtual object whose appearance or behavior changes in response to the parameter values, creating a visual representation of the music composition. The system also processes motion control data to determine updated parameter values, which are then sent back to the DAW to modify the music composition in real time. This creates a bidirectional feedback loop where musical adjustments influence the virtual object, and user gestures or motion can further refine the composition. The system enhances creative workflows by providing intuitive, real-time visual feedback and enabling hands-on control of audio parameters through motion inputs. This approach is particularly useful for live performances, interactive installations, or collaborative music production environments where visual and auditory elements are tightly coupled.

Claim 22

Original Legal Text

22. The system of claim 21 , wherein the virtual object is a virtual drum.

Plain English Translation

A system for interactive virtual environments includes a virtual object that is a virtual drum. The virtual drum is designed to simulate the appearance and behavior of a physical drum, allowing users to interact with it in a virtual space. The system enables users to strike or manipulate the virtual drum, generating realistic audio and visual responses that mimic the sound and movement of a real drum. This virtual drum can be integrated into virtual reality (VR), augmented reality (AR), or other immersive digital environments, providing an engaging and interactive experience for users. The system may include sensors or input devices to detect user interactions, such as hand movements or gestures, and translate those actions into corresponding virtual drum responses. The virtual drum can be customized in terms of size, material, and sound characteristics to suit different applications, such as music production, gaming, or educational simulations. The system enhances user engagement by offering a realistic and responsive virtual drumming experience within a digital environment.

Claim 23

Original Legal Text

23. The system of claim 21 , wherein the virtual object is a virtual fader or virtual slider that is larger in comparison with other virtual objects than a corresponding real-world fader or real-world slider is in comparison with other real-world objects.

Plain English Translation

This invention relates to virtual control systems, particularly for audio or media editing interfaces. The problem addressed is the difficulty in precisely manipulating small virtual controls, such as faders or sliders, in digital environments, which can lead to usability issues and reduced accuracy in tasks like audio mixing or video editing. The system includes a virtual control interface where virtual objects, such as faders or sliders, are intentionally designed to be larger in proportion to other virtual objects than their real-world counterparts are to other real-world objects. This exaggeration in size improves visibility and ease of interaction, allowing users to manipulate controls more accurately without sacrificing screen space for other interface elements. The system may also include additional virtual objects, such as buttons or knobs, which are proportionally adjusted to maintain a balanced and intuitive user experience. The virtual controls are displayed on a display device and can be interacted with using input devices like touchscreens, mice, or styluses. The system ensures that the exaggerated size of the virtual faders or sliders does not disrupt the overall layout or functionality of the interface, providing a more efficient and user-friendly editing experience.

Claim 24

Original Legal Text

24. The system of claim 21 , wherein the virtual object is a virtual button hovering over a virtual arm.

Plain English Translation

A system for interactive virtual environments includes a virtual object, such as a button, positioned in a three-dimensional space. The virtual button is designed to hover over a virtual arm, allowing users to interact with it in a natural and intuitive manner. The system may include sensors or tracking mechanisms to detect user movements, enabling the virtual button to respond to gestures or proximity. The virtual arm may be part of a virtual avatar or a representation of the user's own arm in an augmented reality environment. The button can trigger actions, such as selecting an item, navigating a menu, or controlling a device, when activated. The system may also include feedback mechanisms, such as visual or haptic responses, to confirm user interactions. This approach enhances user engagement by providing a more immersive and responsive interface in virtual or augmented reality applications. The system may be used in gaming, training simulations, or industrial control systems where intuitive interaction is essential.

Claim 25

Original Legal Text

25. The system of claim 21 , wherein the virtual object includes at least one component that is grabbable and movable with a virtual hand.

Plain English Translation

This invention relates to virtual reality (VR) systems that enable user interaction with virtual objects. A key challenge in VR is providing intuitive and realistic manipulation of virtual objects, which is essential for applications like training simulations, gaming, and remote work environments. The system includes a virtual object that can be interacted with using a virtual hand, where the object has at least one component that is specifically designed to be grabbable and movable. This component allows users to physically engage with the virtual object in a natural way, enhancing immersion and usability. The system may include additional features such as haptic feedback to simulate the sensation of touching and moving the object, ensuring a more realistic experience. The grabbable component can be part of a larger virtual object, such as a tool, appliance, or piece of equipment, and may be designed to respond to user gestures like grasping, pulling, or rotating. The system may also include tracking mechanisms to monitor the position and orientation of the virtual hand and object, ensuring accurate and responsive interactions. This approach improves user engagement by making virtual object manipulation more intuitive and lifelike.

Claim 26

Original Legal Text

26. The system of claim 21 , wherein the virtual object is a virtual pyramid-shaped object.

Plain English Translation

A system for displaying virtual objects in an augmented reality (AR) environment addresses the challenge of providing visually distinct and interactive 3D elements that enhance user engagement. The system generates and renders virtual objects that can be overlaid onto real-world scenes captured by a camera or other imaging device. These virtual objects are designed to interact with the physical environment, allowing users to manipulate, observe, or analyze them in real time. In one implementation, the system includes a virtual pyramid-shaped object. This pyramid-shaped object is a 3D geometric figure with a polygonal base and triangular sides, which can be rendered with various textures, colors, or transparency levels to improve visibility and user interaction. The pyramid may be positioned, scaled, or rotated within the AR environment based on user input or predefined parameters. The system may also support dynamic adjustments to the pyramid's appearance, such as changing its size, orientation, or material properties in response to environmental conditions or user actions. The pyramid-shaped object can be used in applications such as architectural visualization, educational simulations, or gaming, where distinct and easily recognizable 3D shapes are beneficial. The system ensures that the virtual pyramid integrates seamlessly with the real-world background, maintaining spatial coherence and realism. Additional features may include collision detection, shadow casting, or lighting effects to enhance the object's presence in the AR scene.

Patent Metadata

Filing Date

Unknown

Publication Date

May 5, 2020

Inventors

Gregory Stephen Barbone
Ryan Gilligan

Want to explore more patents?

Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.

Citation & reuse

Analysis on this page is generated by Patentable — an AI-powered patent intelligence platform. AI-generated summaries, explanations, FAQs, and analysis may be reused with attribution and a visible link back to the canonical URL below. Patent abstracts and claims are USPTO public domain.

Cite as: Patentable. “VIRTUAL / AUGMENTED REALITY DISPLAY AND CONTROL OF DIGITAL AUDIO WORKSTATION PARAMETERS” (10643592). https://patentable.app/patents/10643592

© 2026 Nomic Interactive Technology LLC. Machine-readable context available at /api/llm-context/10643592. See llms.txt for full attribution policy.