Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.
1. A tiled camera array, comprising: a framework comprising an imaging surface; a first plurality of cameras arranged, with a first density, in a first tiled array on the imaging surface, wherein each camera of the first plurality of cameras comprises a first resolution; and a second plurality of cameras arranged, with a second density, in a second tiled array on the imaging surface, wherein each camera of the second plurality of cameras comprises a second resolution; wherein: the first tiled array is interspersed among the second tiled array; the first resolution is greater than the second resolution; the second density is greater than the first density; and the first plurality of cameras and the second plurality of cameras cooperate with each other to capture a light-field volume within an environment, wherein a plurality of subviews are captured by each camera in the first and second plurality of cameras and a confidence map of a tertiary subview of the plurality of subviews is used to generate a virtual view by selecting, for inclusion in the virtual view, one or more regions of the tertiary subview having a higher confidence in the confidence map than corresponding regions of a second confidence map.
This invention relates to imaging systems and specifically addresses the challenge of capturing detailed light-field information efficiently. The system is a tiled camera array built on a framework that includes an imaging surface. This surface hosts two distinct tiled arrays of cameras. The first array consists of a plurality of cameras, each with a first resolution, arranged at a first density. The second array comprises a second plurality of cameras, each with a second resolution, arranged at a second density. Key features of the arrangement are: the first tiled array is interspersed among the second tiled array; the first resolution is higher than the second resolution; and the second density is greater than the first density. These two camera arrays work together to capture a light-field volume within an environment. Each camera in both arrays captures multiple subviews. To generate a virtual view, a confidence map of a specific tertiary subview is utilized. Regions within this tertiary subview that exhibit higher confidence, as indicated by its confidence map, are selected for inclusion in the virtual view. This selection process is guided by comparing the confidence map of the tertiary subview with a second confidence map, prioritizing regions with higher confidence.
2. The tiled camera array of claim 1 , further comprising a processor configured to use the light-field volume to generate a virtual view depicting the environment from a virtual viewpoint.
A tiled camera array captures light-field data from an environment using multiple cameras arranged in a grid pattern. Each camera captures light rays from different angles, allowing the reconstruction of a three-dimensional light-field volume that encodes directional and positional information about the light rays. This light-field volume enables the generation of virtual views from arbitrary viewpoints within the captured scene. A processor analyzes the light-field data to synthesize images or videos from perspectives that were not directly captured by the physical cameras. The virtual view can be rendered in real-time or post-processed, providing flexibility in perspective selection. The system may include additional processing to enhance image quality, such as super-resolution techniques or depth estimation, to improve the accuracy of the virtual view. This technology is useful in applications like virtual reality, augmented reality, 3D imaging, and immersive media, where dynamic viewpoint changes are required. The tiled camera array and light-field processing enable the creation of immersive visual experiences by simulating views from positions not physically occupied by the cameras.
3. The tiled camera array of claim 1 , wherein the first tiled array comprises a first hexagonal lattice.
A tiled camera array system captures high-resolution images by arranging multiple cameras in a specific geometric pattern. The problem addressed is the need for compact, high-resolution imaging systems that avoid the bulk and complexity of traditional single-lens solutions. The invention uses a tiled array of cameras, where each camera captures a portion of a scene, and the images are stitched together to form a complete high-resolution image. The array is arranged in a hexagonal lattice pattern, which optimizes spatial efficiency and minimizes gaps between camera fields of view. This configuration allows for dense packing of cameras while maintaining uniform coverage and reducing distortion. The hexagonal lattice also simplifies the stitching process by ensuring consistent overlap between adjacent cameras. The system may include additional features such as overlapping fields of view, synchronized capture timing, and image processing algorithms to align and merge the individual camera outputs. The result is a compact, high-resolution imaging solution suitable for applications like surveillance, medical imaging, and industrial inspection.
4. The tiled camera array of claim 3 , wherein the second tiled array comprises a second hexagonal lattice that is denser than the first hexagonal lattice, the second tiled array defining a first plurality of spaced-apart voids that accommodate the first hexagonal lattice.
A tiled camera array system addresses the challenge of capturing high-resolution images while minimizing hardware complexity and cost. The system includes multiple camera modules arranged in a first hexagonal lattice pattern, where each module captures a portion of a scene. To enhance resolution and fill gaps in the captured image, a second tiled array is integrated. This second array features a denser hexagonal lattice structure, meaning the camera modules are more closely packed than in the first array. The second array is designed with a first set of spaced-apart voids that align with the positions of the first hexagonal lattice, allowing the two arrays to interlock without overlapping. This configuration ensures seamless integration, where the denser array fills the gaps left by the sparser array, improving overall image resolution and coverage. The system optimizes spatial efficiency by combining different lattice densities, enabling high-resolution imaging without increasing the physical footprint of the camera array. This approach is particularly useful in applications requiring compact, high-performance imaging solutions, such as surveillance, medical imaging, or advanced photography.
5. The tiled camera array of claim 4 , further comprising a third plurality of cameras arranged, with a third density, in a third tiled array on the imaging surface, wherein each camera of the third plurality of cameras comprises a third resolution.
6. The tiled camera array of claim 5 , wherein: the first and second tiled arrays are interspersed among the third tiled array; the second resolution is greater than the third resolution; the third density is greater than the second density; and the third plurality of cameras is configured to cooperate with the first plurality of cameras and the second plurality of cameras to capture the light-field volume.
7. The tiled camera array of claim 6 , wherein the third tiled array comprises a third hexagonal lattice that is denser than the second hexagonal lattice, the third tiled array defining a second plurality of spaced-apart voids that accommodate the second hexagonal lattice.
8. The tiled camera array of claim 1 , wherein the imaging surface comprises a hexagonal shape.
9. A method, comprising: arranging a first plurality of cameras of a tiled camera array with a first density in a first tiled array on an imaging surface of a framework, wherein each camera of the first plurality of cameras comprises a first resolution; and arranging a second plurality of cameras the tiled camera array with a second density, in a second tiled array on the imaging surface, wherein each camera of the second plurality of cameras comprises a second resolution; and interspersing the first tiled array among the second tiled array, wherein: the first resolution is greater than the second resolution; the second density is greater than the first density; and the first plurality of cameras and the second plurality of cameras cooperate with each other to capture a light-field volume within an environment, wherein a plurality of subviews are captured by each camera in the first and second plurality of cameras and a confidence map of a tertiary subview of the plurality of subviews is used to generate a virtual view by selecting, for inclusion in the virtual view, one or more regions of the tertiary subview having a higher confidence in the confidence map than corresponding regions of a second confidence map.
10. The method of claim 9 , further comprising: configuring a processor of the tiled camera array to use the light-field volume to generate a virtual view depicting the environment from a virtual viewpoint.
A tiled camera array captures light-field data from an environment, where multiple cameras with overlapping fields of view record light rays from different perspectives. This data forms a light-field volume, which encodes directional and positional information about the light rays. The system processes this volume to reconstruct a three-dimensional representation of the environment, enabling depth estimation and scene reconstruction. Additionally, the processor of the tiled camera array generates a virtual view from a user-defined viewpoint by synthesizing the light-field data. This virtual view simulates the environment as seen from a perspective that may differ from the physical camera positions, allowing for interactive navigation or augmented reality applications. The method leverages the light-field volume to render high-fidelity images from arbitrary viewpoints, enhancing immersive visualization and spatial analysis. The approach improves upon traditional multi-camera setups by providing more accurate depth perception and dynamic viewpoint adjustments without requiring additional physical cameras.
11. The method of claim 9 , wherein the first tiled array comprises a first hexagonal lattice.
12. The method of claim 11 , wherein the second tiled array comprises a second hexagonal lattice that is denser than the first hexagonal lattice, the second tiled array defining a first plurality of spaced-apart voids that accommodate the first hexagonal lattice.
13. The method of claim 12 , wherein the tiled camera array further comprises a third plurality of cameras arranged, with a third density, in a third tiled array on the imaging surface, wherein each camera of the third plurality of cameras comprises a third resolution.
14. The method of claim 13 , further comprising: interspersing the first and second tiled arrays among the third tiled array, wherein: the second resolution is greater than the third resolution; the third density is greater than the second density; and the third plurality of cameras is configured to cooperate with the first plurality of cameras and the second plurality of cameras to capture the light-field volume.
15. The method of claim 14 , wherein the third tiled array comprises a third hexagonal lattice that is denser than the second hexagonal lattice, the third tiled array defining a second plurality of spaced-apart voids that accommodate the second hexagonal lattice.
16. The method of claim 15 , wherein the imaging surface comprises a hexagonal shape.
Unknown
March 16, 2021
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.