Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.
1. A method comprising the steps of: obtaining an output of an image sensor, the output being representative of a real-world environment comprising at least one real-world object; determining, based on the at least one real-world object within the output, information representative of at least one weather condition; inserting a virtual object into the output representative of the real-world environment; analyzing the information representative of the at least one weather condition using a neural network to determine meta data representative of at least one modification to the virtual object; modifying the virtual object using the meta data, such that the virtual object will appear to be affected by the at least one weather condition; preparing the at least one modified virtual object for display; and displaying the modified virtual object on a display.
This invention relates to augmented reality (AR) systems that dynamically adjust virtual objects based on real-world weather conditions. The method captures an image of a real-world environment using an image sensor, identifying objects within the scene to infer weather conditions such as rain, snow, or fog. A virtual object is then inserted into the image. A neural network analyzes the weather conditions and generates metadata specifying modifications to the virtual object, such as texture changes, lighting adjustments, or motion effects, to make it appear naturally affected by the weather. The modified virtual object is then rendered and displayed, ensuring visual coherence with the real-world environment. The system enhances AR experiences by ensuring virtual elements realistically interact with environmental factors, improving immersion and user engagement. The neural network enables adaptive adjustments without manual input, allowing seamless integration of virtual and real-world elements under varying weather conditions.
2. The method according to claim 1 , wherein the information representative of at least one weather condition comprises any of: wind direction and magnitude; and whether it is raining, hailing, or snowing.
This invention relates to a method for collecting and processing weather data to enhance the operation of autonomous vehicles or other systems that rely on environmental conditions. The method involves gathering information representative of at least one weather condition, such as wind direction and magnitude, or whether precipitation is occurring in the form of rain, hail, or snow. This data is used to adjust the behavior of the system, improving safety and efficiency. The method may also include determining the position of a vehicle relative to a reference point, such as a charging station, and using this positional data in conjunction with the weather information to optimize navigation or other functions. The system may further involve transmitting the collected weather data to a remote server for analysis or distribution to other vehicles or devices. The method ensures that the system adapts dynamically to changing weather conditions, reducing risks and improving performance in real-time.
3. The method according to claim 1 , wherein the information representative of at least one weather condition is based on a predefined region of the output of the image sensor.
A system and method for analyzing weather conditions using image sensor data. The invention addresses the challenge of accurately detecting and monitoring weather conditions, such as precipitation, fog, or visibility changes, in real-time using visual data from an image sensor. The method involves capturing an image or video stream from an image sensor, such as a camera, and processing the sensor output to extract information representative of at least one weather condition. The key innovation is the use of a predefined region within the sensor's output to focus the analysis, improving accuracy and efficiency. This predefined region may be selected based on factors such as sensor positioning, environmental context, or known weather patterns. The extracted weather information can then be used for applications like autonomous vehicle navigation, weather forecasting, or environmental monitoring. The method may also include filtering or enhancing the sensor data to reduce noise and improve detection reliability. By analyzing specific regions of the sensor output, the system avoids unnecessary processing of irrelevant areas, optimizing computational resources while maintaining high accuracy in weather condition assessment.
4. The method according to claim 3 , comprising obtaining information representative of at least one weather condition for a plurality of predefined regions to determine a plurality of modifications to apply to the at least one virtual object.
This invention relates to dynamically adjusting virtual objects in a digital environment based on weather conditions. The problem addressed is the lack of realism in virtual environments where virtual objects do not respond to real-world weather conditions, reducing immersion and accuracy. The solution involves obtaining weather data for multiple predefined regions and using this data to modify virtual objects accordingly. For example, if rain is detected in a specific region, a virtual object like a car or a building in that region may be adjusted to appear wet or have water effects applied. The modifications can include visual changes, such as texture adjustments, or functional changes, like altering behavior based on weather conditions. The system ensures that virtual objects in different regions respond appropriately to local weather, enhancing realism and contextual relevance. The method may also involve tracking weather changes over time to dynamically update the virtual objects in real-time or near-real-time. This approach improves the accuracy and immersion of virtual environments by aligning virtual objects with real-world weather conditions across multiple regions.
5. The method according to claim 1 , wherein the information representative of at least one weather condition further comprises depth information obtained from a depth sensor, mono-depth convolutional neural network, or microphone.
This invention relates to systems and methods for enhancing environmental awareness in autonomous vehicles or robotic systems by integrating weather condition data with depth information. The technology addresses the challenge of accurately perceiving and navigating dynamic environments where weather conditions like rain, fog, or snow can obscure sensor data and reduce system reliability. The method involves collecting information representative of weather conditions using sensors such as cameras, lidar, or radar. This weather data is then combined with depth information obtained from various sources, including depth sensors, mono-depth convolutional neural networks, or microphones. The depth information helps improve the accuracy of environmental perception by providing additional spatial context, allowing the system to better interpret and respond to weather-induced distortions in sensor readings. For example, depth data can help distinguish between rain droplets and actual obstacles, or compensate for reduced visibility in foggy conditions. By integrating weather and depth data, the system enhances situational awareness, enabling more reliable decision-making in autonomous navigation. This approach improves safety and performance in adverse weather conditions, making it particularly useful for self-driving cars, drones, and other autonomous platforms operating in unpredictable environments. The method ensures that depth information is dynamically adjusted based on real-time weather conditions, allowing for adaptive and robust environmental perception.
6. The method according to claim 5 , wherein the step of analyzing further comprises using the depth information to determine whether the virtual object is partially obscured.
This invention relates to computer vision and augmented reality systems, specifically addressing the challenge of accurately rendering virtual objects in real-world environments. The method involves analyzing depth information from a captured image to determine whether a virtual object is partially obscured by real-world objects. By processing depth data, the system identifies occlusions, allowing for realistic integration of virtual elements into the scene. This ensures that virtual objects appear correctly positioned relative to real-world obstacles, enhancing the realism of augmented reality applications. The technique improves upon prior methods by leveraging depth information to dynamically adjust the visibility and positioning of virtual objects, reducing visual artifacts and improving user experience in augmented reality environments. The system may also include steps for capturing images, detecting objects, and generating depth maps, which are used to refine the occlusion analysis. This approach is particularly useful in applications such as gaming, navigation, and industrial training, where accurate spatial awareness is critical. The method ensures that virtual objects interact realistically with the physical environment, providing a seamless and immersive experience for users.
7. A device comprising: an image sensor for capturing a representation of a real-world environment comprising at least one real-world object; a display interface for outputting the representation to a display; and at least one processor for modifying a virtual object; the processor arranged to: determine, based on the at least one real-world object within the output, information representative of at least one weather condition; insert the virtual object into the representation of the real-world environment; analyze the information representative of the at least one weather condition using a neural network to determine meta data representative of at least one modification to the virtual object; modify the virtual object using the meta data, such that the virtual object will appear to be affected by the at least one weather condition; and provide the modified virtual object to a display controller for outputting to the display.
This invention relates to augmented reality (AR) systems that dynamically adjust virtual objects based on real-world weather conditions. The device captures an image of a real-world environment containing objects like buildings, trees, or other elements using an image sensor. The captured image is displayed on a screen. A processor analyzes the image to detect weather conditions, such as rain, snow, or fog, by examining visual cues like reflections, shadows, or atmospheric effects. A neural network processes this data to generate metadata that determines how a virtual object should be modified to appear as if it is affected by the detected weather. For example, if rain is detected, the virtual object may be altered to show water droplets or a wet surface. The modified virtual object is then rendered into the displayed image, creating a seamless AR experience where virtual elements interact realistically with environmental conditions. This approach enhances immersion by ensuring virtual objects respond dynamically to real-world weather, improving visual coherence in AR applications.
8. The device of claim 7 , wherein the at least one processor is any of an image signal processor, a neural processing unit, a central processing unit, and a digital signal processor.
The invention relates to a computing device configured for processing data, particularly in applications requiring high-performance computation such as image processing, neural network operations, or signal processing. The device includes at least one processor, which may be an image signal processor (ISP), neural processing unit (NPU), central processing unit (CPU), or digital signal processor (DSP), to execute specialized tasks efficiently. The processor is designed to handle data inputs, perform computations, and generate outputs based on the processed data. The device may also include memory for storing instructions and data, as well as interfaces for receiving inputs and transmitting outputs. The processor's architecture is optimized for tasks such as image analysis, machine learning inference, or real-time signal processing, ensuring low latency and high throughput. This design addresses the need for specialized processing units in modern computing systems, where general-purpose CPUs alone may not provide the necessary performance for demanding workloads. The invention aims to improve efficiency, reduce power consumption, and enhance processing speed for specific applications.
9. The device of claim 7 , further comprising a depth sensor for obtaining depth data associated with the real-world environment.
A device for augmented reality (AR) applications includes a display system for presenting virtual content to a user, where the display system is configured to adjust the virtual content based on the user's gaze direction. The device also includes a gaze tracking system to determine the user's gaze direction and a processing system to modify the virtual content in response to the gaze direction. The processing system can adjust the virtual content's position, orientation, or other properties to enhance the user's perception of the virtual content in the real-world environment. Additionally, the device includes a depth sensor to obtain depth data associated with the real-world environment. This depth data can be used to improve the alignment and interaction of virtual content with real-world objects, ensuring accurate placement and realistic integration. The depth sensor may use techniques such as structured light, time-of-flight, or stereo vision to capture depth information. The device may also include a camera system to capture images of the real-world environment, which can be combined with the depth data to enhance AR rendering. The processing system can use the depth data to determine the distance and spatial relationships between real-world objects and the virtual content, enabling more immersive and interactive AR experiences.
10. The device of claim 7 , wherein the information representative of the at least one weather condition comprises any of: wind direction and magnitude; and whether it is raining, hailing or snowing.
A weather monitoring and analysis system collects and processes environmental data to provide real-time weather conditions. The system includes sensors that detect atmospheric parameters such as wind direction and magnitude, as well as precipitation events like rain, hail, or snow. These sensors transmit the collected data to a processing unit, which analyzes the information to determine current weather states. The system may also include a display or communication module to relay the processed data to users or other systems. The technology addresses the need for accurate, localized weather monitoring to support applications such as aviation, agriculture, or disaster management. By providing detailed and timely weather information, the system enhances decision-making and safety in weather-sensitive operations. The sensors may be deployed in various environments, including outdoor installations or mobile platforms, to ensure comprehensive coverage. The system's ability to distinguish between different types of precipitation and measure wind characteristics enables precise weather assessments. This technology improves upon traditional weather monitoring methods by offering real-time, high-resolution data tailored to specific applications.
11. The device of claim 7 , wherein the processor is further arranged to obtain depth data from the representation of the real-world environment.
This invention relates to a device for processing depth data in a real-world environment, addressing the challenge of accurately capturing and utilizing three-dimensional spatial information for applications such as augmented reality, robotics, or autonomous navigation. The device includes a processor configured to generate a representation of the real-world environment, which may involve capturing or reconstructing the environment in a digital format. The processor is further arranged to obtain depth data from this representation, enabling the device to determine distances or spatial relationships between objects within the environment. This depth data can be used for various purposes, such as object detection, collision avoidance, or environmental mapping. The device may also include additional components, such as sensors or cameras, to enhance the accuracy and detail of the captured representation. By integrating depth data extraction, the device improves the precision and functionality of systems that rely on spatial awareness, such as augmented reality displays or robotic navigation systems. The invention ensures that depth information is accurately derived from the environment's representation, enabling more reliable and context-aware applications.
12. The device of claim 7 , further comprising storage for storing the information representative of at least one weather condition.
A system for environmental monitoring and data processing includes a sensor array configured to detect and measure environmental parameters such as temperature, humidity, air pressure, and precipitation. The system processes these measurements to generate information representative of weather conditions, such as current weather states, forecasts, or historical trends. The processed data is stored in a dedicated storage module, allowing for long-term analysis, retrieval, and comparison of weather-related information. The storage module may be integrated with the sensor array or a separate computing unit, ensuring data persistence and accessibility. The system may also include communication interfaces to transmit the stored weather data to external devices or networks for further analysis or dissemination. This invention addresses the need for accurate, localized weather monitoring by providing a compact, self-contained device capable of continuous environmental data collection and storage. The stored weather data can be used for applications such as climate research, agricultural planning, or smart infrastructure management.
13. The device of claim 7 , wherein the processor determines the information representative of at least one weather condition based on a predefined region of the representation.
A system for analyzing weather conditions using image data processes a representation of a scene to extract weather-related information. The system includes an imaging device that captures the scene, a processor that analyzes the image data, and a display that presents the extracted weather information. The processor identifies specific regions within the image that correspond to predefined areas of interest, such as sky regions or ground regions, and analyzes these regions to determine weather conditions like cloud cover, precipitation, or temperature. The system may also incorporate additional sensors, such as temperature or humidity sensors, to enhance the accuracy of the weather analysis. The processor applies image processing techniques, including segmentation and pattern recognition, to distinguish between different weather phenomena within the captured image. The extracted weather information is then displayed in a user-friendly format, allowing users to quickly assess current weather conditions. This system is particularly useful for outdoor applications where real-time weather monitoring is essential, such as in agriculture, aviation, or environmental monitoring. The predefined regions of the image help focus the analysis on relevant areas, improving the accuracy and efficiency of the weather determination process.
14. The device of claim 7 , wherein the display is a head-mounted display.
A head-mounted display system is designed to provide immersive visual experiences by projecting images directly onto a user's field of view. The system includes a display unit mounted on a headgear, such as glasses or goggles, to ensure the display remains in a fixed position relative to the user's eyes. The display unit generates visual content, which may include augmented reality (AR) overlays, virtual reality (VR) environments, or other interactive visual data. The system may also incorporate sensors, such as cameras or motion trackers, to detect the user's environment or head movements, allowing for real-time adjustments to the displayed content. Additionally, the system may include input devices, such as buttons, touchpads, or voice recognition, to enable user interaction with the displayed content. The head-mounted display may be wirelessly connected to external devices, such as smartphones or computers, to stream or process visual data. The system is particularly useful in applications like gaming, training simulations, medical visualization, and industrial inspections, where a hands-free, immersive display enhances user experience and productivity. The design ensures comfort, stability, and high-resolution visual output to minimize eye strain and maximize immersion.
15. The device of claim 7 , wherein the display is a transparent display.
A transparent display device is provided for use in augmented reality (AR) or heads-up display (HUD) applications. The device includes a transparent display panel that overlays a real-world view, allowing digital content to be superimposed onto the physical environment. The transparent display enables users to see both the displayed information and the background simultaneously, enhancing situational awareness. The device may incorporate additional features such as a camera for capturing environmental data, sensors for tracking user interactions, and processing components for generating and rendering AR content. The transparent display can be integrated into wearable devices, such as smart glasses or AR headsets, or mounted on vehicles for HUD applications. The system may also include input mechanisms, such as touch or gesture recognition, to allow users to interact with the displayed content. The transparent display technology ensures minimal visual obstruction while providing clear, high-contrast digital overlays, improving usability in AR and HUD systems. The device may further include calibration mechanisms to align digital content with the real-world view accurately, ensuring a seamless AR experience.
16. A non-transitory computer readable storage medium comprising a set of computer-readable instructions stored thereon which, when executed by at least one processor, cause the at least one processor to: obtain an output of an image sensor, the output being representative of a real-world environment comprising at least one real-world object; determine, based on the at least one real-world object within the output, information representative of at least one weather condition; inserting a virtual object into the output representative of the real-world environment; analyze the information representative of the at least one weather condition using a neural network to determine meta data representative of at least one modification to the virtual object modify the virtual object using the meta data, such that the virtual object will appear to be affected by the at least one weather condition; preparing the at least one modified virtual object for display; and display the modified virtual object on a display.
This invention relates to augmented reality (AR) systems that dynamically adjust virtual objects based on real-world weather conditions. The system captures an image of a real-world environment using an image sensor, identifying real-world objects within the scene. It then analyzes these objects to determine weather conditions, such as rain, snow, or fog. A neural network processes this weather information to generate metadata that dictates how a virtual object should be modified to appear as if it is affected by the detected weather. For example, if rain is detected, the virtual object may be altered to show water droplets or a wet surface. The modified virtual object is then prepared for display and rendered in the AR environment, ensuring it appears realistic and interactive with the surrounding weather conditions. This approach enhances immersion by making virtual elements respond dynamically to environmental factors, improving the realism of AR applications in gaming, navigation, or other interactive systems. The system automates the adaptation process, reducing manual adjustments and improving user experience.
Unknown
December 8, 2020
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.