A novel electronic system provides a mixed-reality live environment sharing between a surrogate visitor, who is on-site at a physical landmark, and remotely-located visitors via holographic space live streaming. This novel electronic system reduces the logistical complexity and bottlenecks for providing mixed-reality holographic environments to a large number of participants in real-time by virtualizing the visitors' mixed-reality experiences through a perspective of the surrogate visitor, who may be an on-site curator or a qualified tour guide. The surrogate visitor wears or carries a mixed-reality recording device to scan the physical landmark via walk-through, and a holographic mixed-reality space synthesis module and graphics processing components generate a holographic instance of the physical landmark, which is subsequently teleported to the remotely-located visitors own spaces for superimposition of the holographic instance in their own spaces for immersive mixed-reality experience through head-mounted displays, without creating an overcrowded condition to the physical landmark itself.
Legal claims defining the scope of protection, as filed with the USPTO.
1. A surrogate visitor holographic mixed-reality (HMR) live environment sharing system with remote visitors, the system comprising: a physical landmark with a physical structure and a physical object that attracts tourists or academics; a mixed-reality (MR) recording device worn or carried by a surrogate visitor to the physical landmark, wherein the MR recording device is configured to scan the surrogate visitor's walk-through visualization of the physical landmark containing the physical structure and the physical object, and to produce a digitized output of scanned information; a walk-through map creation engine, a holographic mixed-reality (HMR) synthesis module, and a graphics processing server that generate a holographic mixed-reality (HMR) space as a real-time holographic instance of the physical structure and the physical object of the physical landmark from the digitized output of scanned information from the MR recording device, wherein the walk-through map creation engine intelligently and automatically generates a 3D map of a designer-specified physical space with a mixed-reality artificial layer incorporating virtual coordinates correlated to the designer-specified physical space, when a mixed-reality experience designer walks through the designer-specified physical space while wearing a first head-mounted display (HMD) device connected to the walk-through map creation engine, and wherein the 3D map newly constructed by the walk-through map creation engine is subsequently stored in a 3D map database; a user experience choreography engine and a 3D holographic database executed in the graphics processing server, wherein the user experience choreography engine allows the mixed-reality experience designer to retrieve the 3D map from the 3D map database and select and position a user-controllable 3D holographic object retrieved from the 3D holographic database within the virtual coordinates of the mixed-reality artificial layer, which is graphically superimposed on the designer-specified physical space, and wherein the user experience choreography engine also provides a timed choreographic sequence of interactions in a mixed-reality experience scenario incorporated into multiple mixed-reality (MR) artificial layers, wherein each mixed-reality artificial layer embeds a custom time-sequenced interactivity among the user-controllable 3D holographic object, physical objects present in the designer-specified physical space, and a mixed-reality experience viewer immersed in the timed choreographic sequence of interactions in the mixed-reality experience scenario while also being present at the designer-specified physical space; a mixed-reality experience designer creator module containing a mixed-reality experience construction interface, which is executed and displayed on the one or more portable electronic devices utilized by the mixed-reality experience designer to construct the timed choreographic sequence of interactions in the mixed-reality experience scenario for the mixed-reality experience viewer, wherein the mixed-reality experience designer creator module is connected to the walk-through map creation engine, the 3D map database, the user experience choreography engine, and the 3D holographic database; a mixed-reality experience viewer module connected to the mixed-reality experience designer creator module, and containing a viewer's mixed-reality visualization interface executed and displayed by the one or more portable electronic devices utilized by the mixed-reality experience viewer, wherein the mixed-reality experience viewer immerses in a mixed-reality environment that intermixes the user-controllable 3D holographic object on the virtual coordinates of the mixed-reality artificial layer with one or more physical objects present in the designer-specified physical space; a holographic mixed-reality (HMR) space streaming server that provides a live streaming of the HMR space to a second head-mounted display (HMD) device worn by a remotely-located visitor who is not present at the physical landmark; and the second HMD device worn by the remotely-located visitor executing a holographic mixed-reality (HMR) space sharing app on the second HMD device to visualize the HMR space as the real-time holographic instance of the physical structure and the physical object of the physical landmark, wherein the HMR space is superimposed on the remotely-located visitor's own space external to the physical landmark.
2. The surrogate visitor holographic mixed-reality (HMR) live environment sharing system of claim 1 , wherein the HMR space sharing app on the second HMD device also allows the remotely-located visitor to insert digital annotations to a selected holographic object or a selected holographic structure in the HMR space that represents the real-time holographic instance of the physical landmark.
3. The surrogate visitor holographic mixed-reality (HMR) live environment sharing system of claim 2 , wherein the digital annotations are comments, notes, multimedia information, or questions that are shared as computerized graphics in real-time in the HMR space with the surrogate visitor, on-site visitors, or other remotely-located visitors who are also utilizing head-mounted displays to experience the HMR space.
4. The surrogate visitor holographic mixed-reality (HMR) live environment sharing system of claim 1 , wherein the surrogate visitor also provides a real-time tour guide or curation session to the remotely-located visitor in the HMR space that represents the real-time holographic instance of the physical landmark.
5. The surrogate visitor holographic mixed-reality (HMR) live environment sharing system of claim 1 , wherein the surrogate visitor is a certified museum curator, a licensed tour guide, or a mixed-reality experience designer.
6. The surrogate visitor holographic mixed-reality (HMR) live environment sharing system of claim 1 , wherein the remotely-located visitor's own space external to the physical landmark is a classroom, a home space, or an office space.
7. The surrogate visitor holographic mixed-reality (HMR) live environment sharing system of claim 1 , wherein the physical landmark is a museum, an archaeological site, a historical site, a cultural site, a sports stadium, or another tourist destination.
8. The surrogate visitor holographic mixed-reality (HMR) live environment sharing system of claim 1 , wherein the physical structure is a wall or a boundary of the physical landmark, and wherein the physical object is an exhibited object, a sports venue, or a person of interest.
9. The surrogate visitor holographic mixed-reality (HMR) live environment sharing system of claim 1 , wherein the live streaming of the HMR space to the second head-mounted display (HMD) device worn by the remotely-located visitor is a museum exhibition curation event, a sports event, a concert event, or a guided event at a tourist attraction.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
November 29, 2019
May 4, 2021
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.