Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.
1. A real-time collaborative vehicle control system comprising: a plurality of computing devices each comprising a communications infrastructure coupled to each of a processor, a memory, and a collaborative intent application stored on each memory and configured to run on each processor, and a user interface coupled to a display and configured to receive input from a user; a collaborative server in networked communication with the plurality of computing devices, the collaboration server including a processor and a memory; a vehicle controller configured to receive commands from the collaborative server; and a vehicle operatively controlled by the vehicle controller, wherein the control system is configured to perform the following steps, wherein computing device steps are performed substantially simultaneously on each of the plurality of computing devices: display, on each of the computing devices, vehicle control information, and a collaboratively controlled graphical indication having a coordinate location in relation to the vehicle control information; receive, on each of the computing devices, repeatedly in real-time, user input of a user intent vector through the user interface, the user intent vector having a direction in relation to the user control information and a magnitude, send, repeatedly in real-time, the user intent vector to the collaboration server, responsively determine, repeatedly in real-time by the collaboration server, a group intent vector from the plurality of received user intent vectors, and determine, repeatedly in real-time by the collaboration server, an updated coordinate location based on the group intent vector; determine, repeatedly in real-time by the collaboration server, at least one vehicle command in response to the updated coordinate location; send, repeatedly in real-time by the collaboration server, the at least one a vehicle command to the vehicle controller, whereby the vehicle operates in response to the at least one vehicle command; send, repeatedly in real-time by the collaboration server, the updated coordinate location to the plurality of computing devices; and update, repeatedly in real-time by the computing devices, the location of the collaboratively controlled graphical indication using the received updated coordinate location, whereby a closed-loop system is formed between the collaboration server and each collaborative intent application.
This system enables real-time collaborative control of a vehicle by multiple users through networked computing devices. The technology addresses the challenge of coordinating multiple operators to control a vehicle in real-time, ensuring synchronized input and responsive vehicle operation. Each computing device includes a processor, memory, and a collaborative intent application that interfaces with a display and user input system. A central collaboration server communicates with these devices and a vehicle controller, which directly controls the vehicle. The system displays vehicle control information and a graphical indication on each device, allowing users to input intent vectors—directional commands with magnitude—via their interfaces. These inputs are sent to the server in real-time, where they are aggregated into a group intent vector. The server updates the graphical indication's position based on this group intent and generates corresponding vehicle commands, which are sent to the controller. The vehicle responds to these commands while the updated graphical indication is displayed on all devices, forming a closed-loop feedback system. This approach ensures that multiple users can collaboratively influence vehicle control in a synchronized and responsive manner.
2. The real-time collaborative vehicle control system of claim 1 , wherein the vehicle is a flying drone vehicle.
A real-time collaborative vehicle control system enables multiple autonomous vehicles to coordinate their movements in real time to achieve a shared objective. The system addresses the challenge of ensuring safe and efficient operation of autonomous vehicles in dynamic environments where independent decision-making may lead to conflicts or inefficiencies. The system includes a central control unit that receives real-time data from each vehicle, processes the data to determine optimal control commands, and transmits those commands back to the vehicles. The vehicles execute the commands to adjust their movements, ensuring coordinated behavior. In one implementation, the vehicle is a flying drone. The system allows multiple drones to collaborate in tasks such as surveillance, delivery, or environmental monitoring. The central control unit processes sensor data from each drone, such as position, velocity, and obstacle detection, to generate control signals that prevent collisions and optimize flight paths. The drones may also share data among themselves to enhance situational awareness and adapt to changing conditions. The system ensures that the drones operate as a cohesive unit, improving efficiency and safety in applications where autonomous coordination is critical.
3. The real-time collaborative vehicle control system of claim 2 , wherein the at least one control axis includes at least one of a control axis indicating forward/backward motion of the vehicle and a control axis indicating leftward/rightward motion of the vehicle.
This invention relates to a real-time collaborative vehicle control system designed to enhance coordination among multiple vehicles or operators during navigation and maneuvering tasks. The system addresses challenges in synchronized control, particularly in scenarios where precise movement along multiple axes is required, such as in autonomous or semi-autonomous vehicle operations, remote-controlled vehicles, or multi-operator environments. The system includes a control interface that allows users or automated systems to input commands for vehicle movement. These commands are processed in real time to adjust the vehicle's motion along at least one control axis. The system specifically supports control axes for forward/backward motion and leftward/rightward motion, enabling precise directional adjustments. Additional control axes may also be incorporated to manage other aspects of vehicle movement, such as rotation or altitude, depending on the application. The collaborative aspect of the system ensures that multiple inputs, whether from human operators or automated systems, are integrated seamlessly to avoid conflicts and maintain smooth, coordinated movement. This is particularly useful in applications like fleet management, where multiple vehicles must operate in unison, or in remote-controlled systems where multiple operators may need to share control responsibilities. The real-time processing capability ensures that adjustments are made instantaneously, minimizing delays and improving overall system responsiveness.
4. The real-time collaborative vehicle control system of claim 2 , wherein the collaboratively controlled graphical indication is influenced by a simulated spring force, said simulated spring force configured to pull the displayed collaboratively controlled graphical indication towards an origin position on the at least one control axis.
This invention relates to real-time collaborative vehicle control systems, specifically for enhancing coordination between multiple operators controlling a vehicle or system. The problem addressed is the lack of intuitive feedback mechanisms in collaborative control environments, which can lead to misalignment or conflicts between operators' inputs. The system provides a graphical indication that visually represents the combined control inputs from multiple operators. This indication is dynamically adjusted based on a simulated spring force, which pulls the displayed graphical indication toward a predefined origin position on a control axis. The spring force simulates a physical restoring force, ensuring the graphical indication stabilizes near the origin when no active control inputs are present. This helps operators maintain awareness of the system's neutral state and reduces unintended deviations. The system can be applied to various collaborative control scenarios, such as remote vehicle operation, multi-user interfaces, or shared control systems, where precise coordination is critical. The simulated spring force provides a natural, responsive feedback mechanism that improves operator collaboration and control accuracy.
5. The real-time collaborative vehicle control system of claim 1 , wherein the vehicle control information includes at least one control axis, wherein a location of the graphical indication relative to the at least one control axis indicates the at least one command sent to the vehicle.
This invention relates to real-time collaborative vehicle control systems, addressing the challenge of enabling multiple users to simultaneously control a vehicle through intuitive graphical interfaces. The system allows users to interact with a shared display showing a vehicle's control interface, where graphical indications (e.g., markers or cursors) represent commands sent to the vehicle. These commands are mapped to specific control axes, such as steering, acceleration, or braking, with the position of the graphical indication relative to the control axis determining the command's magnitude or direction. For example, moving a graphical marker along a steering axis may adjust the vehicle's steering angle proportionally. The system processes these inputs in real time, ensuring synchronized control among multiple users while maintaining vehicle stability and safety. The graphical interface may include multiple control axes, allowing simultaneous adjustment of different vehicle functions. The invention enhances collaborative vehicle operation by providing a visual, intuitive method for users to influence vehicle behavior dynamically.
6. The real-time collaborative vehicle control system of claim 5 , wherein the first control axis and the second control axis intersect at an origin location.
A real-time collaborative vehicle control system enables multiple vehicles to coordinate their movements in real-time to achieve a shared objective, such as formation flying or synchronized maneuvers. The system addresses the challenge of maintaining precise spatial relationships between vehicles while accounting for dynamic environmental conditions and individual vehicle capabilities. The system includes a control mechanism that defines a first control axis and a second control axis, which intersect at a common origin point. These axes serve as reference frames for coordinating vehicle movements, allowing each vehicle to adjust its position and orientation relative to the others. The intersection at the origin ensures a consistent reference point for all vehicles, simplifying the calculation of relative positions and reducing the risk of misalignment. The system may also incorporate feedback mechanisms to dynamically adjust the control axes based on real-time sensor data, ensuring continuous synchronization. This approach enhances coordination accuracy and reliability, particularly in applications where precise formation control is critical, such as autonomous drone swarms or coordinated aerial surveillance. The system may further include communication protocols to enable seamless data exchange between vehicles, ensuring that all participants maintain awareness of the shared control framework.
7. The real-time collaborative vehicle control system of claim 5 , wherein the at least one control axis includes a first control axis oriented vertically and a second control axis oriented horizontally.
This invention relates to a real-time collaborative vehicle control system designed to enhance coordination between multiple vehicles or vehicle components. The system addresses the challenge of synchronizing control inputs across different axes to improve stability, efficiency, and safety in dynamic environments. The system includes a control mechanism that manages at least one control axis, which in this embodiment comprises a first control axis oriented vertically and a second control axis oriented horizontally. These axes allow for precise adjustments in both vertical and horizontal directions, enabling fine-tuned control over vehicle movements. The system may also incorporate sensors, communication modules, and processing units to gather real-time data, analyze it, and distribute control commands to ensure seamless coordination. By integrating multiple control axes, the system can handle complex maneuvers, such as balancing, steering, or adjusting vehicle orientation, while maintaining stability and responsiveness. This approach is particularly useful in autonomous or semi-autonomous vehicles, robotic systems, or other applications requiring precise multi-axis control. The system's ability to process and respond to data in real time ensures that adjustments are made dynamically, reducing the risk of errors and improving overall performance.
8. The real-time collaborative vehicle control system of claim 1 , the system further comprising a camera coupled to the vehicle and operatively controlled by the vehicle controller.
A real-time collaborative vehicle control system enables multiple vehicles to share data and coordinate actions in real-time to improve safety, efficiency, and traffic flow. The system addresses challenges in autonomous and semi-autonomous driving, such as collision avoidance, lane management, and adaptive cruise control, by allowing vehicles to communicate and respond to dynamic road conditions collectively. The system includes a vehicle controller that processes sensor data, such as from cameras, to detect obstacles, lane markings, and other vehicles. The camera is mounted on the vehicle and is controlled by the vehicle controller to capture real-time visual data. This data is used to enhance situational awareness, enabling the vehicle to make informed decisions, such as adjusting speed, steering, or braking based on surrounding traffic. The system may also integrate with other sensors, such as LiDAR or radar, to provide a comprehensive understanding of the environment. By sharing this data with nearby vehicles, the system facilitates collaborative decision-making, reducing the risk of accidents and improving traffic flow. The camera's real-time control ensures accurate and timely data collection, supporting adaptive responses to changing conditions. This approach enhances vehicle autonomy while maintaining safety and efficiency in diverse driving scenarios.
9. The real-time collaborative vehicle control system of claim 8 , wherein the camera is configured to stream live video to the plurality of computing devices.
A real-time collaborative vehicle control system enables multiple users to remotely operate a vehicle simultaneously. The system includes a vehicle equipped with sensors, actuators, and a camera, along with a network-connected server and multiple computing devices for user input. The camera captures live video of the vehicle's surroundings, which is streamed to the computing devices in real time. Users can view the video feed and provide control inputs, such as steering, acceleration, or braking commands, which are transmitted to the server. The server processes these inputs, resolves conflicts between conflicting commands, and sends a unified control signal to the vehicle's actuators. The system allows multiple users to collaborate in controlling the vehicle, with the server ensuring safe and coordinated operation. The live video stream provides real-time situational awareness to all users, enhancing decision-making and coordination. This technology is useful for applications like remote vehicle operation, autonomous driving assistance, or multi-user control in specialized vehicles.
10. The real-time collaborative vehicle control system of claim 8 , wherein each of the plurality of computing devices displays the live video on a same display as the collaboratively controlled graphical indication.
The invention relates to a real-time collaborative vehicle control system designed to enhance situational awareness and coordination among multiple operators controlling a vehicle. The system addresses the challenge of effectively sharing live video feeds and control inputs in real-time to improve decision-making and vehicle maneuvering in collaborative environments. The system includes a plurality of computing devices, each connected to a vehicle and configured to receive live video from one or more cameras mounted on the vehicle. Each computing device displays the live video feed alongside a collaboratively controlled graphical indication, which represents shared control inputs from multiple operators. This graphical indication is dynamically updated in real-time based on input from all connected devices, ensuring that all operators have a synchronized view of the vehicle's status and intended actions. The system further includes a communication network that facilitates real-time data exchange between the computing devices, allowing for seamless collaboration. The live video feed and graphical indication are displayed on the same screen, eliminating the need for operators to switch between different displays or interfaces. This integrated approach reduces cognitive load and improves response times, making the system particularly useful in applications such as remote-controlled vehicles, autonomous driving assistance, or multi-operator vehicle control scenarios. The invention ensures that all operators have a consistent and up-to-date understanding of the vehicle's environment and control status, enhancing safety and efficiency.
11. The real-time collaborative vehicle control system of claim 1 , wherein the at least one vehicle command includes at least one command for camera operation.
A real-time collaborative vehicle control system enables multiple vehicles to share and execute coordinated control commands in real time. The system addresses challenges in autonomous and semi-autonomous vehicle operations, such as synchronization of actions, data sharing, and dynamic decision-making across multiple vehicles. The system includes a communication network that allows vehicles to exchange data and commands, ensuring that each vehicle can adjust its operations based on real-time inputs from other vehicles. This collaboration improves safety, efficiency, and coordination in scenarios like platooning, traffic management, and emergency response. The system includes at least one vehicle command that directs specific actions for individual vehicles. One such command is for camera operation, allowing vehicles to adjust their onboard cameras in real time. This may include tasks like focusing, zooming, or activating specific camera modules to capture relevant data for navigation, obstacle detection, or environmental monitoring. The camera commands are dynamically generated based on shared data from other vehicles, ensuring that all vehicles in the network have the necessary visual information to make informed decisions. This enhances situational awareness and improves the overall performance of the collaborative vehicle network.
12. The real-time collaborative vehicle control system of claim 1 , wherein the at least one command for camera operation includes at least one of forward/backward tilt and leftward/rightward pan.
This invention relates to real-time collaborative vehicle control systems, specifically for managing camera operations in a coordinated manner. The system addresses the challenge of efficiently controlling multiple cameras in a vehicle, such as those used for surveillance, autonomous driving, or remote monitoring, by enabling precise and synchronized adjustments. The system includes a control module that processes input commands to adjust camera positions, ensuring seamless coordination between different cameras. The commands for camera operation include forward/backward tilt and leftward/rightward pan, allowing for dynamic adjustments to capture desired views. The system may also integrate with other vehicle control functions, such as navigation or obstacle detection, to enhance situational awareness. By enabling real-time adjustments, the system improves the accuracy and responsiveness of camera-based monitoring, supporting applications in autonomous vehicles, security systems, and remote operation. The collaborative control ensures that multiple cameras work in unison, reducing the need for manual intervention and improving overall efficiency.
13. The real-time collaborative vehicle control system of claim 1 , wherein the system is configured to display a graphical indication of the user input.
The real-time collaborative vehicle control system enables multiple users to simultaneously control a vehicle, such as a drone or autonomous vehicle, through shared input. The system addresses the challenge of coordinating multiple control inputs in real-time to ensure safe and efficient vehicle operation. It aggregates and processes input signals from multiple users, resolves conflicts between conflicting commands, and executes a unified control output to the vehicle. The system prioritizes inputs based on predefined rules, such as user roles or input urgency, to maintain stability and prevent unsafe maneuvers. The system includes a user interface that allows each user to provide control inputs, such as steering, acceleration, or navigation commands. These inputs are transmitted to a central processing unit, which analyzes and integrates them into a single control signal. The system also includes a feedback mechanism to inform users of the vehicle's current state and the effects of their inputs. A key feature of the system is the display of a graphical indication of user input. This visual feedback helps users understand how their commands are being processed and integrated with others' inputs, improving collaboration and reducing confusion. The graphical indication may include visual representations of input sources, conflict resolution outcomes, or the vehicle's response to combined commands. This feature enhances transparency and user confidence in the collaborative control process. The system ensures real-time responsiveness, allowing for dynamic adjustments to control inputs as conditions change.
14. The real-time collaborative vehicle control system of claim 13 , wherein the graphical indication is a U-shaped magnet icon.
The invention relates to real-time collaborative vehicle control systems, which enable multiple vehicles to coordinate their movements in real-time to avoid collisions and improve traffic flow. The system addresses the challenge of ensuring safe and efficient vehicle interactions in dynamic environments, such as urban traffic or autonomous vehicle fleets, where traditional control methods may fail to account for real-time changes. The system includes a graphical user interface that provides visual feedback to operators or autonomous systems, indicating potential collision risks or coordination opportunities. Specifically, the system displays a U-shaped magnet icon as a graphical indication to represent the relative positioning and movement of nearby vehicles. This icon visually conveys the direction and strength of attractive or repulsive forces between vehicles, helping operators or autonomous systems adjust their trajectories accordingly. The U-shaped design may signify a magnetic-like interaction, where vehicles are either drawn together (e.g., for platooning) or repelled (e.g., to avoid collisions). The system dynamically updates the icon based on real-time sensor data, ensuring accurate and timely feedback for collision avoidance and cooperative maneuvering. This enhances situational awareness and decision-making in collaborative vehicle control scenarios.
15. The real-time collaborative vehicle control system of claim 14 , wherein the system is configured to change at least one of the size, orientation, and location of the magnet icon based on the user input.
A real-time collaborative vehicle control system enables multiple users to jointly operate a vehicle through a shared interface. The system addresses the challenge of coordinating control inputs from multiple operators in real-time, ensuring smooth and synchronized vehicle movement. The system includes a graphical user interface displaying a magnet icon representing the vehicle, which users can manipulate to control the vehicle's movement. The system is configured to adjust the magnet icon's size, orientation, and location based on user input, allowing for precise and intuitive control. By dynamically modifying the icon's properties, the system provides visual feedback and enhances the collaborative control experience. The adjustments ensure that the vehicle responds accurately to the combined inputs of all users, improving coordination and reducing conflicts between operators. This system is particularly useful in applications where multiple individuals need to work together to navigate a vehicle, such as in remote-controlled or autonomous systems with shared control interfaces. The ability to modify the magnet icon's characteristics in real-time ensures that the vehicle's movement aligns with the collective intentions of the users, enhancing safety and efficiency.
16. The real-time collaborative vehicle control system of claim 1 , wherein the collaboratively controlled graphical indication is displayed on a control area corresponding to a plan area of operation of the vehicle.
This invention relates to a real-time collaborative vehicle control system designed to enhance coordination among multiple vehicles operating in a shared environment. The system addresses the challenge of managing vehicle operations in dynamic settings where multiple vehicles must avoid collisions, optimize routes, and maintain situational awareness. The system includes a graphical user interface that provides real-time visual feedback to operators, displaying collaboratively controlled graphical indications that represent the planned movements or operational states of the vehicles. These indications are dynamically updated based on input from multiple vehicles, ensuring that all operators have a shared understanding of the operational environment. The graphical indications are displayed in a control area that corresponds to a plan area of operation, allowing operators to visualize and adjust vehicle movements within a defined spatial context. The system may also include features such as conflict detection, automated collision avoidance, and adaptive routing to further improve safety and efficiency. By providing a unified, real-time view of vehicle operations, the system enables seamless coordination and reduces the risk of errors or conflicts in shared operational spaces.
17. The real-time collaborative vehicle control system of claim 16 , wherein the collaboratively controlled graphical indication represents a location of the vehicle in the control area.
The invention relates to real-time collaborative vehicle control systems, which enable multiple users to jointly manage and monitor vehicle operations within a defined control area. The system addresses the challenge of coordinating vehicle movements and ensuring situational awareness among multiple operators, particularly in environments where vehicles operate autonomously or semi-autonomously. The system includes a graphical user interface that displays a control area and provides collaborative control features. Users can interact with the interface to issue commands, such as navigation instructions or operational adjustments, to one or more vehicles. The system processes these inputs in real time, ensuring that all users receive synchronized updates and maintain a shared understanding of the vehicle's status and location. A key feature is the collaboratively controlled graphical indication, which visually represents the vehicle's position within the control area. This indication is dynamically updated based on real-time data from the vehicle, allowing users to track its movements and respond to changes in the environment. The system may also incorporate additional visual elements, such as boundaries or obstacles, to enhance situational awareness and prevent conflicts between vehicles or operators. The collaborative aspect of the system enables multiple users to contribute to vehicle control, with the system resolving any conflicting inputs to ensure safe and efficient operation. The graphical interface may also include tools for assigning control priorities or roles to different users, ensuring that the system adapts to varying operational needs. Overall, the invention improves coordination and safety in multi-user vehicle control scenarios.
18. The real-time collaborative vehicle control system of claim 16 , the control area further including a display of plan coordinate axes.
A real-time collaborative vehicle control system enables multiple users to simultaneously control a vehicle or robotic system in a shared environment. The system addresses challenges in coordinating multiple operators, ensuring safety, and maintaining situational awareness during collaborative tasks. The system includes a control interface that allows users to input commands, a processing unit that interprets and synchronizes these commands, and a communication module that transmits control signals to the vehicle. The control area of the system features a display of plan coordinate axes, providing a visual reference for spatial orientation and movement. This helps users align their actions with a common coordinate system, reducing errors and improving precision in collaborative operations. The system may also include conflict resolution mechanisms to handle competing commands from different users, ensuring smooth and safe operation. The plan coordinate axes display enhances user interaction by providing a clear, standardized reference for positioning and navigation, making it easier for multiple operators to work together effectively. This system is particularly useful in applications such as remote-controlled vehicles, autonomous drones, or robotic systems where coordinated control is essential.
19. The real-time collaborative vehicle control system of claim 1 , wherein the collaboratively controlled graphical indication is an icon indicating the orientation of the vehicle.
A real-time collaborative vehicle control system enables multiple users to simultaneously control a vehicle's movement and orientation through a shared graphical interface. The system addresses the challenge of coordinating vehicle operations among multiple operators, ensuring synchronized control inputs and reducing conflicts. The system includes a graphical interface displaying a vehicle representation and control elements that multiple users can manipulate in real time. The system processes these inputs to generate control signals for the vehicle, ensuring that all users' actions are integrated into a single command set. The system also provides feedback to users, such as visual indicators, to confirm their inputs and the vehicle's current state. One specific feature is a graphical icon that visually represents the vehicle's orientation, allowing users to easily understand and adjust the vehicle's direction. This icon dynamically updates as the vehicle moves, ensuring that all users have a consistent and accurate reference for orientation control. The system may also include conflict resolution mechanisms to handle simultaneous or conflicting inputs from different users, ensuring smooth and safe vehicle operation. The collaborative control system is particularly useful in applications where multiple operators need to work together, such as in remote-controlled or autonomous vehicle scenarios.
20. The real-time collaborative vehicle control system of claim 1 , wherein the collaboratively controlled graphical indication has at least one of a simulated mass value and a simulated damping value, the at least one of the simulated mass value and the simulated damping value selected to slow a displayed collaboratively controlled motion of the collaboratively controlled graphical indication to better match dynamics of the vehicle.
This invention relates to real-time collaborative vehicle control systems, specifically improving the synchronization between graphical representations of vehicle motion and actual vehicle dynamics. The system addresses the challenge of ensuring that visual feedback in collaborative control interfaces accurately reflects real-world vehicle behavior, which is critical for operator situational awareness and control precision. The system includes a graphical indication that visually represents the motion of a vehicle in real time. This graphical indication is collaboratively controlled, meaning its movement is influenced by both automated control inputs and human operator inputs. To enhance realism, the graphical indication is assigned simulated physical properties, such as mass and damping values. These properties are selected to intentionally slow the displayed motion, ensuring it more closely aligns with the actual dynamics of the vehicle. By adjusting these simulated parameters, the system mitigates discrepancies between the visual representation and the vehicle's true motion, improving operator confidence and control accuracy. The system may be used in applications where multiple operators or automated systems collaborate to control a vehicle, such as in remote operation, autonomous driving, or teleoperation scenarios. The simulated mass and damping values act as a tuning mechanism to harmonize the visual feedback with the vehicle's physical behavior, reducing lag and enhancing responsiveness. This approach ensures that the graphical representation remains a reliable and intuitive tool for monitoring and controlling vehicle motion in real time.
Unknown
September 17, 2019
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.