Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.
1. An apparatus, comprising: a first processor operatively coupled to a first memory, the first processor configured to receive a data set associated with an object and user information associated with a spatial position of a first user with reference to the object and in a virtual environment, the data set including a spatial data series of the object, the first processor configured to receive a set of inputs from the first user, the set of inputs being associated with a set of predetermined properties associated with a portion of the object, the first processor configured to generate a look-up table based on the set of inputs; a second processor operatively coupled to a second memory, the second processor configured to render, based on the data set, the look-up table and the user information, a first instance of the portion of the object in the virtual environment, the first instance of the portion of the object being from a perspective of the first user, the perspective being based on the spatial position of the first user, the first processor or the second processor configured to: generate a data package associated with the object and including at least one predetermined property from the set of predetermined properties, receive, from the first user, instructions related to sharing of the data package, the instructions including an authorization from the first user and to a second user to store the data package in a non-volatile memory associated with a user device associated with the second user, transmit, to a third processor of the user device, via a peer-to-peer connection with the third processor, the data package associated with the object such that the user device renders, based on the data package and user information associated with a spatial position of a second user with reference to the object and in the virtual environment, a second instance of the portion of the object in the virtual environment, and from a perspective of the second user, the perspective being based on the spatial position of the second user, the transmitting being such that a portion of the data package is stored in a volatile memory associated with the third processor for a period of time and, based on the authorization, also stored in a non-volatile memory associated with the third processor, and, after the period of time, the portion of the data package is erased from the volatile memory associated with the third processor but, based on the authorization, not erased from the non-volatile memory associated with the third processor, the second processor configured to receive manipulation information related to a manipulation of the first instance of the portion of the object by the first user, the second processor configured to render, based on the manipulation information, an updated first instance of the portion of the object that manifests an effect of the manipulation in the virtual environment.
This invention relates to a system for sharing and rendering object data in a virtual environment. The system addresses the challenge of enabling users to interact with and share portions of objects in a virtual space while managing data storage and access permissions. The apparatus includes two processors, each coupled to a memory. The first processor receives a data set associated with an object, including spatial data, and user information indicating a first user's position relative to the object in the virtual environment. The first processor also receives inputs from the first user, which define properties of a portion of the object, and generates a look-up table based on these inputs. The second processor uses the data set, look-up table, and user information to render the object portion from the first user's perspective. The system allows the first user to generate a data package containing object properties and share it with a second user via a peer-to-peer connection. The data package is temporarily stored in volatile memory and, if authorized, permanently stored in non-volatile memory on the second user's device. The second user's device renders the object portion from their own perspective. The system also supports real-time manipulation of the object by the first user, with updates rendered in the virtual environment. This enables collaborative interaction with shared object data while controlling data persistence and access.
2. The apparatus of claim 1 , wherein the first processor or the second processor is configured to: generate an updated data package, based on the data package associated with the object and including the manipulation information, transmit, via the peer-to-peer connection, the updated data package to the third processor such that an updated second instance of the portion of the object can be rendered by the third processor, the updated second instance of the portion of the object manifesting the effect of the manipulation.
3. The apparatus of claim 2 , wherein the manipulation information is first manipulation information related to a first manipulation by the first user, the effect of the first manipulation is a first effect, the updated first instance of the portion of the object is a first updated first instance of the portion of the object, and the updated data package is a first updated data package, the first processor further configured to: receive, from the third processor via the peer-to-peer connection, a second updated data package including second manipulation information related to a second manipulation of the second instance of the portion of the object, the second manipulation being performed by the second user, and the second processor configured to render, based on the second manipulation information, a second updated first instance of the portion of the object that manifests the second effect of the second manipulation.
4. The apparatus of claim 1 , wherein: the first processor or the second processor is configured to receive a set of measurement inputs from the user and based on the set of measurement inputs, add a measurement annotation to the data set such that the measurement annotation is presented with a rendering of the first instance of the portion of the object; and the first processor or the second processor is configured to generate an updated data package including the data set and including the measurement annotation, and transmit, via the peer-to-peer connection, the updated data package to the third processor such that an updated second instance of the portion of the object is rendered by the third processor, the updated second instance of the portion of the object including a presentation of the measurement annotation.
5. The apparatus of claim 1 , wherein the spatial data series includes a series of multi-dimensional data including images or point-cloud data collected using at least one of Computed Tomography (CT), Magnetic Resonance Imaging (MRI), Positron Emission Tomography, Confocal Imaging, Light Microscopy, Electron Microscopy, Electroencephalography (EEG), Magnetocardiography (MCG), or Magnetoencephalography.
6. The apparatus of claim 1 , wherein the user device renders the second instance by defining a measure of a level of completion of rendering of the second instance at the user device, and the transmitting to the third processor of the user device includes transmitting instructions such that the user device transmits, to the first processor or the second processor, the measure of the level of completion of rendering of the second instance at the user device.
7. The apparatus of claim 1 , wherein the set of predetermined properties includes a transparency property and a color property, and the set of inputs includes a set of keys, each key from the set of keys configured to provide information including a first value associated with the transparency property and a second value associated with the color property, the first processor or the second processor configured to interpolate the information obtained from each key from the set of keys to generate the look-up table.
8. The apparatus of claim 1 , wherein the first processor or the second processor is configured to transmit the data package associated with the object in chunks.
9. The apparatus of claim 1 , wherein the set of predetermined properties includes a threshold property configured to set a viewable range of the instance of the portion of the object.
10. The apparatus of claim 1 , wherein the first memory and the second memory are part of the same volatile memory.
11. The apparatus of claim 1 , wherein the first memory and the second memory are part of the same non-volatile memory.
12. The apparatus of claim 1 , wherein the first memory is a non-volatile memory and the second memory is a volatile memory.
13. The apparatus of claim 1 , wherein the first processor is the same as the second processor.
A system for processing data includes a first processor and a second processor, where the first processor is the same as the second processor. The system also includes a memory storing instructions that, when executed by the first processor, cause the first processor to perform operations. These operations include receiving a first data stream, processing the first data stream to generate a first output, and transmitting the first output to a second processor. The second processor, which is the same as the first processor, executes instructions to receive the first output, process the first output to generate a second output, and transmit the second output to an external device. The system may also include a communication interface for transmitting and receiving data between the processors and external devices. The apparatus may further include a power supply to provide electrical power to the processors and other components. The use of a single processor for both the first and second processing tasks reduces hardware complexity and cost while ensuring consistent performance. This configuration is particularly useful in embedded systems or real-time processing applications where resource efficiency is critical.
14. The apparatus of claim 1 , wherein the first processor is different from the second processor.
15. The apparatus of claim 1 , wherein the spatial data series includes a multidimensional dataset.
The invention relates to an apparatus for processing spatial data, addressing the challenge of efficiently handling and analyzing complex spatial datasets. The apparatus includes a data acquisition module that collects spatial data from one or more sources, such as sensors, imaging devices, or databases. This data is processed by a data processing module, which organizes and structures the spatial data into a spatial data series. The spatial data series may include a multidimensional dataset, allowing for the representation of data in multiple dimensions, such as time, space, or other variables. The apparatus further includes an analysis module that performs computations, transformations, or statistical analyses on the spatial data series to extract meaningful insights. The results are then output through a display or storage module for further use. The multidimensional dataset capability enables the apparatus to handle complex spatial relationships and dependencies, improving accuracy and efficiency in applications such as environmental monitoring, medical imaging, or autonomous navigation. The apparatus may also include additional features, such as data filtering, noise reduction, or real-time processing, to enhance performance.
16. A non-transitory processor-readable medium storing code representing instructions to be executed by a processor, the code comprising code to cause the processor to: receive data including medical images associated with an object; extract a data set associated with a structure of the object and user information associated with a spatial position of a user with reference to the object in a virtual environment; receive a set of inputs from the user, the set of inputs being associated with a set of predetermined properties associated with a portion of the object in the virtual environment; render, based on the set of inputs and the user information, an instance of the portion of the object in the virtual environment, the rendering including defining a measure of a level of completion associated with the rendering; receive manipulation information related to a manipulation of the rendered instance of the portion of the object by the user and in the virtual environment; render, based on the manipulation information, an updated instance of the portion of the object that manifests an effect of the manipulation in the virtual environment; and record media associated with the manipulation and the rendering of the updated instance of the portion of the object, the media including audio and spatial information associated with the rendering of the updated instance of the portion of the object, from a perspective of the user, and the perspective being based on the spatial position of the user.
17. The non-transitory processor-readable medium of claim 16 , wherein the set of predetermined properties includes transparency, position, viewability, and color, and the set of inputs includes a set of keys, each key from the set of keys configured to provide information including a first value associated with the transparency property and a second value associated with the color property, the code to cause the processor to render the instance of the portion of the object includes code to cause the processor to interpolate the information obtained from each key from the set of keys to generate a look-up-table, the rendering the instance being based on the look-up-table.
18. The non-transitory processor-readable medium of claim 16 , the code further comprising code to cause the processor to: receive a set of annotation inputs from the user; display, with the instance of the portion of the object and based on the annotation inputs, an annotation associated with the portion of the object; generate an updated data set, the updated data set including the annotation incorporated in association with the portion of the object such that the annotation is presented with a rendering of the portion of the object; and save the updated data set in a non-volatile memory associated with the processor.
19. The non-transitory processor-readable medium of claim 16 , wherein the user is a first user and the instance of the portion of the object is a first instance of the portion of the object, the code further comprising code to cause the processor to: generate a data package associated with the object; receive, from the first user, instructions related to sharing of the data package; transmit, in chunks, the data package to a user device associated with a second user such that a portion of the data package is stored in a volatile memory associated with the user device and not stored in a non-volatile memory associated with the user device for a period of time to render a second instance of the portion of the object at the user device, and, after the period of time, the portion of the data package is erased from the volatile memory.
20. The non-transitory processor-readable medium of claim 16 , wherein the data set includes spatial data obtained via a spatial data series collected using at least one of Computed Tomography (CT), Magnetic Resonance Imaging (MRI), Positron Emission Tomography, Confocal Imaging, Light Microscopy, Electron Microscopy, Electroencephalography (EEG), Magnetocardiography (MCG), or Magnetoencephalography.
21. The non-transitory processor-readable medium of claim 16 , the code further comprising code to cause the processor to: transmit the measure of the level of completion associated with the rendering of the instance of the portion.
22. A method, comprising: receiving, from a first device and at a second device, (1) a data package associated with a first instance of a portion of an object in a virtual environment, the data package including a data set associated with a multi dimensional structure of the object, (2) first user information including a spatial position of a first user, associated with the first device, with reference to the object in the virtual environment, and (3) a first set of inputs associated with a set of predetermined properties of the object; receiving, at the second device, second user information including a spatial position of a second user associated with the second device with reference to the object in the virtual environment; transforming, based on the second user information, the first set of inputs into a second set of inputs; generating, based on the second set of inputs, a look-up-table; and rendering, at the second device and based on (i) the data set, (ii) the second set of inputs, and (iii) the look-up-table, a second instance of the portion of the object in the virtual environment, the second instance of the portion of the object being from a perspective of the second user, and the perspective being based on the spatial position of the second user; defining a measure of a level of completion associated with the rendering of the second instance at the second device; and transmitting, to the first device, the measure of the level of completion associated with the rendering of the second instance at the second device.
23. The method of claim 22 , further comprising: providing access to a set of controls to manipulate the second instance of the portion of the object to the second user associated with the second device, to the first device, based on the measure of the level of completion associated with the rendering of the second instance at the second device reaching a threshold value.
24. The method of claim 22 , wherein the data package includes a spatial recording and an audio recording of a rendering of the first instance of the portion of the object at the first device.
This invention relates to a system for capturing and processing spatial and audio data of a rendered object. The technology addresses the challenge of accurately recording and transmitting the visual and auditory experience of a rendered object, such as a 3D model or virtual environment, to ensure consistent playback across different devices. The method involves generating a data package that includes both a spatial recording and an audio recording of a rendered portion of an object. The spatial recording captures the visual representation of the object as it appears on a first device, while the audio recording captures the corresponding sound associated with that rendering. This data package is then used to reconstruct the original rendering experience on a second device, ensuring that the visual and auditory elements are synchronized and accurately reproduced. The method may also involve encoding the spatial and audio data in a standardized format to facilitate compatibility across different platforms and devices. By preserving both the visual and auditory aspects of the rendering, the invention enables a more immersive and consistent user experience when sharing or replaying the recorded content.
25. The method of claim 22 , further comprising: presenting, at the second device, a set of controls configured to receive a manipulation information from the second user, the manipulation information being related to a manipulation of the second instance of the portion of the object; receiving, via the set of controls, the manipulation information from the second user; rendering, based on the manipulation information, an updated second instance of the portion of the object that manifests an effect of the manipulation in the virtual environment; generating an updated data package including the manipulation information; and transmitting, to the first device, the updated data package such that an updated first instance of the portion of the object can be rendered at the first device, the updated first instance of the portion of the object manifesting the effect of the manipulation by the second user.
26. The method of claim 22 , further comprising: presenting, at the second device, a set of controls configured to receive a manipulation information from the second user, the manipulation information being related to a manipulation of the second instance of the portion of the object; determining the measure of the level of completion associated with the rendering of the second instance to be below a threshold value; presenting, based on the determining, the set of controls to be at an inactive state such that the manipulation information from the second user cannot be received via the set of controls.
27. The method of claim 22 , wherein the receiving includes receiving device information associated with the second device, the device information including a sampling information, the rendering the second instance includes defining a scaling factor based on the sampling information, the rendering of the second instance being based on the scaling factor.
This invention relates to a method for processing and rendering media content between devices, particularly addressing challenges in adapting media streams for optimal display on different devices with varying capabilities. The method involves receiving media content from a first device and transmitting it to a second device, where the content is rendered in a format compatible with the second device's specifications. The method includes receiving device information from the second device, which contains sampling information such as resolution, frame rate, or other display parameters. Based on this sampling information, a scaling factor is defined to adjust the media content for proper rendering on the second device. The scaling factor ensures that the media content is displayed at an appropriate size, resolution, or aspect ratio, maintaining visual quality and compatibility across devices. This approach enables seamless media sharing and playback between devices with different display characteristics, improving user experience in multimedia applications. The method may also involve additional steps such as encoding, decoding, or transcoding the media content to further optimize compatibility and performance.
28. The method of claim 22 , further comprising storing the data package in a volatile memory associated with the second device and not storing the data package in a non-volatile memory associated with the second device, for a period of time, the rendering of the second instance being within the period of time; and erasing, from the volatile memory and after the period of time, the data package stored in the volatile memory.
29. The method of claim 22 , further comprising receiving, from the first device, permission information associated with the data package; and storing, based on the permission information, the data package in a non-volatile memory associated with the second device.
30. An apparatus, comprising: a first processor operatively coupled to a non-volatile memory, the first processor configured to receive a data set associated with an object and user information associated with a spatial position of a user with reference to the object and in a virtual environment, the data set including a spatial data series of the object, the first processor configured to receive permission information associated with the data set and a set of inputs from the user, the set of inputs being associated with a set of predetermined properties associated with a portion of the object, the first processor configured to generate a look-up table based on the set of inputs; and a second processor operatively coupled to a volatile memory, the second processor configured to render, based on the look-up table and the user information, an instance of the portion of the object in the virtual environment, the instance of the portion of the object being from a perspective of the user, the perspective being based on the spatial position of the user, the second processor further configured to receive manipulation information related to a manipulation of the instance of the portion of the object by the user, and to render, based on the manipulation information, an updated instance of the portion of the object that manifests an effect of the manipulation in the virtual environment, the first processor further configured to store, based on the permission information, the data set in the non-volatile memory.
Unknown
February 23, 2021
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.