Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.
1. A non-transitory computer readable medium comprising computer readable code executable by one or more processors to: cause a visual content to be displayed on a display device of a vehicle in accordance with a request from a mobile device to control a functionality of the vehicle; receive a location of a mobile device in a vehicle coordinate system of the vehicle, wherein the mobile device is separate from the vehicle, wherein the location of the mobile device is determined in accordance with the displayed visual content, and wherein an image is received as part of a request from the mobile device to control functionality of the vehicle; and control functionality of the vehicle for the location of the mobile device in the vehicle.
2. The non-transitory computer readable medium of claim 1 , wherein the image comprises a portion of the vehicle, and wherein the computer readable code to determine the location of the mobile device within the vehicle further comprises computer readable code to: determine a camera position of a camera of the mobile device relative to the portion of the vehicle in accordance with the displayed visual content, and determine the location of the mobile device based on the determined camera position relative to the portion of the vehicle.
3. The non-transitory computer readable medium of claim 2 , wherein the camera position of the camera relative to the portion of the vehicle is further determined in accordance with depth information for the display device from a depth sensor of the mobile device.
4. The non-transitory computer readable medium of claim 2 , wherein the camera position of the camera is further determined in accordance with depth information for the portion of the vehicle from a model of the vehicle.
5. The non-transitory computer readable medium of claim 2 , wherein the camera position of the camera is further determined in accordance with an identification of the displayed visual content on the display device, wherein the location of the mobile device is further determined based on the visual content as it is presented in the image.
6. A system comprising: one or more processors; and a computer readable medium comprising computer readable code executable by the one or more processors to: cause a visual content to be displayed on a display device of a vehicle in accordance with a request from a mobile device to control a functionality of the vehicle; receive a location of a mobile device in a vehicle coordinate system of the vehicle, wherein the mobile device is separate from the vehicle, wherein the location of the mobile device is determined in accordance with the displayed visual content, and wherein an image is received as part of a request from the mobile device to control functionality of the vehicle; and control functionality of the vehicle for the location of the mobile device in the vehicle.
This invention relates to a vehicle control system that integrates with a mobile device to enable remote functionality control based on the mobile device's location within the vehicle. The system addresses the challenge of providing intuitive, location-aware vehicle control through a mobile device, ensuring that commands are executed in relation to the user's precise position. The system includes processors and a computer-readable medium with executable code. It displays visual content on a vehicle's display device in response to a request from a mobile device, which may include an image used to determine the mobile device's location within the vehicle's coordinate system. The system then processes this location data to control vehicle functions, such as adjusting settings or activating features, based on the mobile device's position. For example, a user could request climate control adjustments or seat positioning by interacting with the displayed content, and the system would execute these commands relative to the user's detected location. The invention ensures that vehicle functionality is controlled accurately and contextually, enhancing user experience by aligning actions with the user's physical position within the vehicle. This approach improves safety and convenience by reducing manual input and enabling more precise, location-based automation.
7. The system of claim 6 , wherein the image comprises a portion of the vehicle, and wherein the computer readable code to determine the location of the mobile device within the vehicle further comprises computer readable code to: determine a camera position of a camera of the mobile device relative to the portion of the vehicle in accordance with the displayed visual content, and determine the location of the mobile device based on the determined camera position relative to the portion of the vehicle.
8. The system of claim 7 , wherein the camera position of the camera relative to the portion of the vehicle is further determined in accordance with depth information for the display device from a depth sensor of the mobile device.
9. The system of claim 7 , wherein the camera position of the camera is further determined in accordance with depth information for the portion of the vehicle from a model of the vehicle.
10. The system of claim 7 , wherein the camera position of the camera is further determined in accordance with an identification of the displayed visual content on the display device, wherein the location of the mobile device is further determined based on the visual content as it is presented in the image.
11. A method comprising: causing a visual content to be displayed on a display device of a vehicle in accordance with a request from a mobile device to control a functionality of the vehicle; receiving a location of a mobile device in a vehicle coordinate system of the vehicle, wherein the mobile device is separate from the vehicle, wherein the location of the mobile device is determined in accordance with the displayed visual content, and wherein an image is received as part of a request from the mobile device to control functionality of the vehicle; and controlling functionality of the vehicle for the location of the mobile device in the vehicle.
12. The method of claim 11 , wherein the image comprises a portion of the vehicle, and wherein the method further comprises: determining a camera position of a camera of the mobile device relative to the portion of the vehicle in accordance with the displayed visual content, and determining the location of the mobile device based on the determined camera position relative to the portion of the vehicle.
13. The method of claim 12 , wherein the camera position is determined in accordance with depth information for the portion of the vehicle from a depth sensor of the mobile device.
This invention relates to determining the position of a camera relative to a vehicle using depth information from a mobile device. The problem addressed is accurately positioning a camera to capture images or video of a vehicle, particularly for applications like virtual showrooms, insurance assessments, or vehicle inspections. Traditional methods rely on manual positioning or fixed setups, which can be imprecise or inconvenient. The method involves using a mobile device equipped with a depth sensor to capture depth information about a portion of the vehicle. This depth data is then used to determine the optimal position of the camera relative to the vehicle. The depth sensor provides spatial measurements, allowing the system to calculate the camera's position in three-dimensional space. This ensures that the camera is correctly aligned with the vehicle, improving the accuracy and consistency of captured images or video. The invention may also include additional steps, such as capturing an image of the vehicle using the camera positioned according to the depth information. The depth sensor can be part of the mobile device, such as a smartphone or tablet, which simplifies the setup by eliminating the need for external equipment. The method ensures that the camera is positioned at an optimal distance and angle to capture high-quality images of the vehicle, reducing errors and improving efficiency in applications requiring precise visual documentation.
14. The method of claim 12 , wherein the camera position is further determined in accordance with depth information for the portion of the vehicle from a model of the vehicle.
15. The method of claim 12 , wherein the camera position of the camera is further determined in accordance with an identification of the displayed visual content on the display device, wherein the location of the mobile device is further determined based on the visual content as it is presented in the image.
Unknown
March 2, 2021
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.