11288872

Systems and Methods for Providing Augmented Reality Support for Vehicle Service Operations

PublishedMarch 29, 2022
Assigneenot available in USPTO data we have
Technical Abstract

Patent Claims
19 claims

Legal claims defining the scope of protection, as filed with the USPTO.

1

1. A method of providing an augmented reality presentation of a component of a vehicle using a virtual reality/augmented reality (VR/AR) device that is movable relative to the component of the vehicle, the method comprising: determining, by the VR/AR device, a vehicle type; retrieving, by the VR/AR device, a virtual object model file associated with the vehicle type; capturing, by a camera of the VR/AR device, at least one image of the vehicle, the at least one image including an image of a physical marker located at a predetermined location of the vehicle that is at a fixed position relative to the vehicle; receiving, by the VR/AR device, a selection of an assembly of the vehicle; determining, by the VR/AR device and based on the at least one image, a position and an orientation of the VR/AR device with respect to the physical marker; and presenting, by the VR/AR device and based on the determined position and orientation of the VR/AR device, an augmented reality depiction of the vehicle including both an output of the camera and an assembly detail model that is included in the virtual object model file and is associated with the selected assembly, wherein the selected assembly comprises a portion of the vehicle that is not visible via the camera of the VR/AR device from the determined position.

2

2. The method of claim 1 , wherein the virtual object model file is based on a computer-aided design (CAD) model used to design the vehicle.

3

3. The method of claim 1 , wherein the virtual object model file includes a context model that represents assemblies including at least one of a cab and frame rails.

4

4. The method of claim 3 , further comprising: receiving a command to switch from an augmented reality mode to a virtual reality mode; switching to virtual reality mode by ceasing presentation of an output of the camera of the VR/AR device and instead beginning presentation of the context model along with the assembly detail model.

5

5. The method of claim 3 , wherein the assembly detail model is at a first level of detail, and wherein the context model is at a second level of detail.

6

6. The method of claim 5 , wherein the first level of detail includes metadata about components depicted by the assembly detail model, and the second level of detail does not include metadata.

7

7. The method of claim 5 , wherein the first level of detail includes two or more sub-assemblies or components, and wherein the second level of detail does not include separate sub-assemblies or components.

8

8. The method of claim 5 , wherein the first level of detail includes data at a first spatial resolution, and the second level of detail includes data at a second spatial resolution lower than the first spatial resolution.

9

9. The method of claim 1 , further comprising presenting reference information about components represented by portions of the assembly detail model visible in the display.

10

10. A system for use with a vehicle that includes a cab, a set of frame rails, and wire harness, comprising: a virtual reality/augmented reality (VR/AR) device movable relative to the vehicle, and that includes at least one processor, memory that is operatively connected to the at least one processor, a camera, and a display; wherein the memory stores instructions that, when executed by the at least one processor, cause the VR/AR device to: determine a type of the vehicle; retrieve a virtual object model file associated with the vehicle type; receive a selection of an assembly of the vehicle, wherein the assembly is the wire harness; capture, by the camera, at least one image of the vehicle, the at least one image including an image of a physical marker located at a predetermined location of the vehicle that is at a fixed position relative to the vehicle; determine a position and an orientation of the VR/AR device with respect to the physical marker; and present, based on the determined position and orientation of the VR/AR device, an augmented reality depiction of the vehicle including both an output of the camera and an assembly detail model that is included in the virtual object model file and is associated with the wire harness, wherein the wire harness is not visible via the camera from the determined position.

11

11. The system of claim 10 , wherein the image includes a marker on the vehicle and determining the position and orientation includes determining the position and orientation based on detection of the marker in the image.

12

12. The system of claim 10 , wherein the virtual object model file includes a context model that represents assemblies including at least one of a cab and frame rails, and wherein the instructions, when executed by the at least one processor, further cause the VR/AR device to: receive a command to switch from the augmented reality depiction to the virtual reality depiction; and switch to the virtual reality depiction by ceasing presentation of the output of the camera and instead beginning presentation of the context model of the virtual object model file along with the assembly detail model.

13

13. A method of providing an augmented reality presentation of a component of a vehicle using a virtual reality/augmented reality (VR/AR) device movable relative to the vehicle, the method comprising: retrieving, by the VR/AR device, a virtual object model file associated with the vehicle; capturing, by a camera of the VR/AR device, at least one image of the vehicle, the at least one image including an image of a physical marker located at a predetermined location of the vehicle that is at a fixed position relative to the vehicle; receiving, by the VR/AR device, a selection of an assembly of the vehicle; determining, by the VR/AR device and based on the at least one image, a position and an orientation of the VR/AR device with respect to the physical marker; and presenting, by the VR/AR device and based on the determined position and orientation of the VR/AR device, an augmented reality depiction of the vehicle including both an output of the camera and an assembly detail model that is included in the virtual object model file and is associated with the selected assembly, wherein the selected assembly comprises a portion of the vehicle that is not visible via the camera of the VR/AR device from the determined position.

14

14. The method of claim 13 , wherein the virtual object model file is based on a computer-aided design (CAD) model used to design the vehicle.

15

15. The method of claim 13 , wherein the virtual object model file includes a context model that represents assemblies including at least one of a cab and frame rails.

16

16. The method of claim 15 , further comprising: receiving a command to switch from an augmented reality mode to a virtual reality mode; switching to virtual reality mode by ceasing presentation of an image captured by a camera of the VR/AR device and instead beginning presentation of the context model along with the assembly detail model.

17

17. The method of claim 15 , wherein the assembly detail model is at a first level of detail, and wherein the context model is at a second level of detail.

18

18. The method of claim 17 , wherein the first level of detail includes metadata about components depicted by the assembly detail model, and the second level of detail does not include the metadata.

19

19. The method of claim 13 , wherein the image includes a marker on the vehicle and determining the position and orientation includes determining the position and orientation based on detection of the marker in the image.

Patent Metadata

Filing Date

Unknown

Publication Date

March 29, 2022

Inventors

David Wei-Cheng Yin
Dirk Maiwald
William Timothy Ryan JR.

Want to explore more patents?

Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.

Citation & reuse

Analysis on this page is generated by Patentable — an AI-powered patent intelligence platform. AI-generated summaries, explanations, and analysis may be reused with attribution and a visible link back to the canonical URL below. Patent abstracts and claims are USPTO public domain.

Cite as: Patentable. “SYSTEMS AND METHODS FOR PROVIDING AUGMENTED REALITY SUPPORT FOR VEHICLE SERVICE OPERATIONS” (11288872). https://patentable.app/patents/11288872

© 2026 Patentable. All rights reserved.

Patentable is a research and drafting-assistant tool, not a law firm, and does not provide legal advice. Documents we generate are drafts for review by a licensed patent attorney.

SYSTEMS AND METHODS FOR PROVIDING AUGMENTED REALITY SUPPORT FOR VEHICLE SERVICE OPERATIONS — David Wei-Cheng Yin | Patentable