An optical system includes a multispectral sensor; an optical filter including a plurality of optical channels that is disposed over the multispectral sensor; and a lens that is disposed over the optical filter. The lens is configured to direct first light that originates from a scene to the optical filter. The optical filter is configured to pass one or more portions of the first light to the multispectral sensor. The multispectral sensor is configured to generate, based on the one or more portions of the first light, spectral data associated with the scene.
Legal claims defining the scope of protection, as filed with the USPTO.
. An optical system, comprising:
. The optical system of, wherein the white balance information indicates an estimated illumination of the scene by ambient light.
. The optical system of, wherein the estimated illumination is based on a field of view (FOV) of the multispectral sensor that is substantially same as a FOV of the image sensor.
. The optical system of, wherein, to process the spectral data to determine the white balance information, the at least one processor is configured to:
. The optical system of, wherein the image of the scene is a color corrected image of the scene.
. The optical system of, wherein the optical filter includes:
. The optical system of, wherein the spectral range is greater than or equal to 420 nanometers and less than 780 nanometers.
. The optical system of, wherein the optical filter further includes:
. The optical system of, wherein the lens is not configured to focus the first light on the multispectral sensor.
. The optical system of,
. A system, comprising:
. The system of, wherein the optical filter is disposed directly on an input surface of the multispectral sensor.
. The system of, wherein the optical filter is further configured to:
. The system of, further comprising:
. The system of, wherein the system is a user device.
. A system, comprising:
. The system of, wherein the white balance information indicates an estimated illumination of the scene.
. The system of, wherein the first light is ambient light.
. The system of, wherein the white balance information is based on a field of view (FOV) of the multispectral sensor that is substantially same as a FOV of the image sensor.
. The system of, wherein, to process the spectral data to determine the white balance information, the at least one processor is configured to:
Complete technical specification and implementation details from the patent document.
This application is a continuation of U.S. patent application Ser. No. 18/056,015, filed Nov. 16, 2022, which claims priority to U.S. Provisional Patent Application No. 63/264,985, entitled “OPTICAL SYSTEM,” filed on Dec. 6, 2021, the contents of which are incorporated by reference herein in their entirety.
An image capture device may include an image sensor and various components associated with the image sensor, such as a lens, an aperture, and/or a light source. One example of an image capture device is a user device, such as a smartphone or a tablet. An image capture device may provide various image capture modes, such as a portrait mode, a macro mode, and/or a panoramic mode, among other examples.
In some implementations, an optical system includes a multispectral sensor including a plurality of multispectral sensor elements; an optical filter including a plurality of optical channels that is disposed over the multispectral sensor; a lens that is disposed over the optical filter; and an image sensor including a plurality of image sensor elements, wherein: the lens is configured to direct first light that originates from a scene to the optical filter, the optical filter is configured to pass one or more portions of the first light to the multispectral sensor, the multispectral sensor is configured to generate, based on the one or more portions of the first light, spectral data associated with the scene, and the image sensor is configured to generate image data based on second light that originates from the scene.
In some implementations, an optical system includes an optical filter including a plurality of optical channels that is disposed over a multispectral sensor; and a lens that is disposed over the optical filter, wherein: the lens is configured to direct first light that originates from a scene to the optical filter, the optical filter is configured to pass one or more portions of the first light to the multispectral sensor to permit the multispectral sensor to generate spectral data associated with the scene that can be used to determine white balance information associated with the scene. In some implementations, an optical filter includes a plurality of optical channels that includes: a first set of one or more optical channels that are configured to have a first transmittance level that is greater than or equal to 90% for light associated with a spectral range; a second set of one or more optical channels that are configured to have a second transmittance level that is less than or equal to 7% for light associated with the spectral range; and a plurality of other sets of one or more optical channels, wherein a particular set of one or more optical channels, of the plurality of other sets of one or more optical channels, are configured to have a particular transmittance level that is greater than or equal to 20% for light associated with a particular spectral subrange of the spectral range.
The following detailed description of example implementations refers to the accompanying drawings. The same reference numbers in different drawings may identify the same or similar elements. The following description uses a spectrometer as an example. However, the techniques, principles, procedures, and methods described herein may be used with any sensor, including but not limited to other optical sensors and spectral sensors.
A multispectral sensor (e.g., of a spectrometer) captures multispectral data within specific wavelength ranges across the electromagnetic spectrum. This multispectral data may be useful for various purposes, such as chemical composition analysis of a material, determining an amount and/or type of light that is present at a particular area in a field of view of the multispectral sensor, and/or other examples. In some cases, the multispectral sensor can be used to perform hyperspectral imaging, which uses more spectral bands and/or a tighter grouping of spectral bands than is typically used with multispectral imaging. However, the terms “multispectral” and “hyperspectral” are used interchangeably for the purposes of the implementations described herein.
An image sensor captures image data associated with an image of a scene in the visible spectral range (e.g., for user consumption or for use with applications of a user device). In many cases, the image sensor may be associated with a camera of a user device, such as a mobile phone, a laptop, and/or a tablet, among other examples. A processor associated with the user device then processes the image data (e.g., using a global illumination color correction technique, such as an automatic white balancing (AWB) technique) to perform one or more color adjustment corrections and presents the image data (e.g., via a display of the user device) as an image that appears to be “color corrected” to a user of the user device. For example, the processor may use one or more AWB algorithms to automatically correct (e.g., with minimal input from a user of the user device) the image data based on ambient light (e.g., associated with the scene).
In some cases, when using an AWB technique to color, the processor of the user device estimates an illumination of the scene and performs, based on the estimated illumination, one or more color adjustment corrections on the image data. The processor can determine the estimated illumination based on user input (e.g., that indicates illumination conditions of the scene, such as an outside illumination condition, a cloudy illumination condition, an inside illumination condition, or another illumination condition), based on using software to analyze the image data of the image, and/or based on spectral data received from an ambient light sensor (e.g., that is included in or associated with the user device). However, these approaches may not accurately represent the illumination within the scene as captured by the camera of the user device (e.g., within a field of view (FOV) of the camera). Consequently, the processor of the user device often processes the image data of the image based on an incorrect, or non-representative, estimated illumination of the scene, which causes the processor to present the image data as an image that is inaccurately color corrected.
Some implementations described herein provide an optical system that includes a lens, an optical filter, a multispectral sensor, and/or one or more other optical components. In some implementations, the optical system includes an image sensor. The optical filter may be a multi-channel spectral filter and may be disposed on or adjacent to the multispectral sensor. The multispectral sensor may capture spectral data associated with the scene, such as when light (e.g., ambient light) from the scene is directed by the lens (and filtered by the optical filter) to the multispectral sensor. In some implementations, the multispectral sensor may be configured to be an ambient light sensor. The image sensor may capture image data associated with the scene, such as when other light (e.g., ambient light) from the scene is directed by the lens (or another lens of the optical system) to the image sensor.
In some implementations, the lens of the optical system may be configured to provide a same, or similar, FOV to the multispectral sensor as that of the image sensor. The lens may not need to focus light on the multispectral sensor, which allows the lens to be positioned anywhere in the optical system such that a size (e.g., a footprint) of the optical system is smaller than a size of a typical ambient light detection system. Accordingly, the optical system may be implemented within a user device, which may not be possible when using a typical ambient light detection system.
Further, in some implementations, the lens may be an imaging lens that includes a region (e.g., a focusing region, such as with a high modulation transfer function (MTF)) that provides focused light on the image sensor, and another region (e.g., a non-focusing region, such as with a low MTF) that provides unfocused light to the multispectral sensor (e.g., via the optical filter). In this way, the optical system uses unfocused light (e.g., to facilitate generation of spectral data) that would otherwise be blocked by a typical camera (e.g., to minimize an effect of unwanted light on an image sensor of the camera). The optical filter and the multispectral filter may also be disposed proximate to the imaging sensor within the optical system. In this way, an ambient light sensing functionality and imaging functionality may be combined into a single optical system, which reduces a size, a cost, and a complexity of the optical system as compared to using separate ambient light detection devices and image capturing devices to produce similar results. In some implementations, the optical system may include a processor that processes the spectral data to determine white balance information associated with the scene. The white balance information may indicate an estimated illumination of the scene (e.g., by ambient light). The estimated illumination of the scene indicated by the white balance information is more accurate than that which would be determined using another illumination estimation technique (e.g., as described above), because the estimated illumination is based on the FOV of the multispectral sensor, which is the same as, or similar to, the FOV of the image sensor. Further, the optical filter may include a set of one or more “clear” optical channels (e.g., that pass light associated with a spectral range, such as the visible light range) and a set of one or more “darkened” optical channels (e.g., that block, or minimize passage of, light associated with the spectral range). Accordingly, the processor may identify portions of the spectral data that are associated with the set of one or more clear optical channels and the set of one or more darkened optical channels to normalize, denoise, and/or otherwise process the spectral data to generate white balance information that indicates a more accurate estimated illumination of the scene. Accordingly, the processor may process, based on the white balance information, the image data to generate a more accurate color corrected image (e.g., that is more accurate than a color corrected image generated using a less accurate estimated illumination).
In some implementations, the optical filter may be manufactured using a more efficient manufacturing process. For example, when the optical filter includes ten sets of one or more optical channels (e.g., a set of one or more clear optical channels, a set of one or more darkened optical channels, and eight sets of one or more narrow color range optical channels), a manufacturing process may be used that requires only five “spins” of a patterned lithography and thin film deposition process.
are diagrams of an example implementationdescribed herein. As shown in, example implementationmay include an optical filterthat includes a plurality of optical channels.shows an input-side view of the optical filter;shows an input-side view of the optical filterin association with an example configuration of the plurality of optical channels;shows a cross-sectional, side view of a first example configuration of an optical channelof the plurality of optical channels; andshows a cross-sectional, side view of a second example configuration of an optical channel. As shown in, the plurality of optical channelsmay be arranged in a regular pattern, such as a two-dimensional pattern. In some implementations, the plurality of optical channelsmay be arranged in a non-regular pattern, such as a spiral pattern. As further shown in, each optical channelmay have a polygonal shape, such as a rectangular shape. In some implementations, each optical channelmay have a non-polygonal shape, such as a circular shape.
In some implementations, an optical channel, of the plurality of optical channelsmay be configured to pass light associated with a spectral range (e.g., to pass light that has a wavelength that is greater than or equal to a lower bound of the spectral range and that is less than an upper bound of the spectral range). For example, the optical channelmay be configured to have a transmittance level that satisfies a “passing” transmittance level threshold for light associated with the spectral range. That is, the optical channelmay be configured to have a transmittance level that is greater than or equal to the passing transmittance level threshold for light associated with the spectral range, where the passing transmittance level threshold is greater than or equal to 20%, 35%, 50%, 65%, 75%, 85%, 90%, 95%, or 99%, among other examples (and less than or equal to 100%). The spectral range may be, for example, one or more portions of a visible spectral range (e.g., greater than or equal to 420 nanometers (nm) and less than 780 nm) and/or another spectral range, such as a near-infrared (NIR) spectral range (e.g., greater than or equal to 780 nm and less than 1000 nm), and/or an ultraviolet (UV) spectral range (e.g., greater than or equal to 100 nm and less than 420 nm).
Additionally, or alternatively, an optical channel, of the plurality of optical channels, may be configured to block (or minimize passage of) light associated with a spectral range (e.g., to block or minimize passage of light that has a wavelength that is greater than or equal to a lower bound of the spectral range and that is less than an upper bound of the spectral range). For example, the optical channelmay be configured to have a transmittance level that satisfies a “blocking” transmittance level threshold for light associated with the spectral range. That is, the optical channelmay be configured to have a transmittance level that is less than or equal to the blocking transmittance level threshold for light associated with the spectral range, where the transmittance level threshold is less than or equal to 1%, 3%, 5%, 7%, 10%, 15%, 20%, 35%, or 50%, among other examples (and greater than or equal to 0%).
In some implementations, the plurality of optical channelsmay include a first set of one or more optical channels-that are associated with passing light associated with a spectral range (e.g., one or more “clear” optical channels-), a second set of one or more optical channels-that are associated with blocking (or minimizing passage of) light associated with the spectral range (e.g., one or more “darkened” optical channels-), and/or a plurality of other sets of one or more optical channels-that are associated with passing light associated with respective spectral subranges of the spectral range.
For example, the first set of one or more optical channels-may be configured to have a first transmittance level that satisfies (e.g., is greater than or equal to) a first transmittance level threshold (e.g., that is greater than or equal to 50%, 65%, 75%, 85%, 90%, 95%, or 99%, among other examples) for light associated with the spectral range. The second set of one or more optical channels-may be configured to have a second transmittance level that satisfies (e.g., is less than or equal to) a second transmittance level threshold (e.g., that is less than or equal to 1%, 3%, 5%, 7%, 10%, 15%, 20%, 35%, or 50%, among other examples) for light associated with the spectral range. A particular set of one or more optical channels-, of the plurality of other sets of one or more optical channels-, may be configured to have a particular transmittance level that satisfies (e.g., is greater than or equal to) another transmittance level threshold (e.g., that is greater than or equal to 50%, 65%, 75%, 85%, 90%, 95%, or 99%, among other examples) for light associated with a particular spectral subrange of the spectral range.
shows an example configuration of the plurality of optical channelswhen the plurality of optical channelsinclude the first set of one or more optical channels-, the second set of one or more optical channels-, and the plurality of other sets of one or more optical channels-(shown as eight sets of one or more optical channels-through-). Accordingly, each optical channel-may be associated with passing light associated with the spectral range (e.g., as indicated by no shading and no patterning) and each optical channel-may be associated with blocking (or minimizing passage of) light associated with the spectral range (e.g., as indicated by black shading). Each optical channel-may be associated with passing light associated with a particular spectral subrange of the spectral range (e.g., as indicated by particular patterning). That is, each optical channel-may be associated with passing light associated with a particular “color.” For example, each optical channel-may be associated with passing light associated with a first spectral subrange of the spectral range (e.g., as indicated by broad, left-to-right diagonal patterning),-may be associated with passing light associated with a second spectral subrange of the spectral range (e.g., as indicated by grid patterning),-may be associated with passing light associated with a third spectral subrange of the spectral range (e.g., as indicated by diamond patterning), and so on.
As further shown in, the first set of one or more optical channels-, the second set of one or more optical channels-, and the plurality of other sets of one or more optical channels-may be arranged in a non-periodic, two-dimensional pattern. For example, each optical channel-, each optical channel-, and each optical channel-may be arranged in a random, or pseudo-random, position within the two-dimensional pattern of the plurality of optical channels. In some implementations, the first set of one or more optical channels-, the second set of one or more optical channels-, and the plurality of other sets of one or more optical channels-may be arranged in a periodic (e.g., a non-random), two-dimensional pattern, or another type of pattern.
are diagrams of example configurations of an optical channeldescribed herein. As shown in, the optical channelmay include a first mirror, one or more spacer layers, and/or a second mirror. As shown in, the first mirrorand/or the second mirrormay each include a dielectric mirror. For example, the first mirrorand/or the second mirrormay each include a set of alternating dielectric layers, such as an alternating set of layers comprising at least a hydrogenated silicon (Si:H) material and a set of layers comprising at least a silicon dioxide (SiO) material. Alternatively, as shown in, the first mirrorand/or the second mirrormay each include a metallic mirror, such as comprising at least a silver (Ag) material.
As further shown in, the one or more spacer layersmay be disposed between the first mirrorand the second mirror(e.g., the one or more spacer layersmay be disposed on the first mirror, and the second mirrormay be disposed on the one or more spacer layers). The one or more spacer layersmay comprise, for example, at least an oxide material (e.g. a niobium-titanium-oxide (NbTiO) material, a niobium oxide (NbO) material, a titanium oxide (TiO) material, and/or tantalum oxide (TaO) material), a nitride material (e.g., that includes a silicon nitride (SiN) material and/or an aluminum nitride (AlN) material), a silicon material (e.g., that includes a silicon and hydrogen (SiH) material, a hydrogenated silicon (Si:H) material, a silicon carbide (SiC) material, and/or a silicon (Si) material), and/or a germanium (Ge) material. In some implementations, a thickness of the one or more spacer layersmay be configured to provide a particular distance between the first mirrorand the second mirror, such as to cause the optical channelto pass light associated with a spectral range (or a spectral subrange), or, alternatively, to cause the optical channelto block (or minimize passage of) light associated with the spectral range (or the spectral subrange), as described elsewhere herein.
While some implementations described herein provide specific examples of the optical filter, the optical filtermay be any type of optical filter. For example, the optical filtermay be a spectral filter, a multispectral filter, an optical interference filter, a bandpass filter, a blocking filter, a long-wave pass filter, a short-wave pass filter, a dichroic filter, a linear variable filter (LVF), a circular variable filter (CVF), a Fabry-Perot filter (e.g., a Fabry-Perot cavity filter), a Bayer filter, a plasmonic filter, a photonic crystal filter, a nanostructure and/or metamaterial filter, an absorbent filter (e.g., comprising organic dyes, polymers, glasses, and/or the like), and/or another type of optical filter.
As indicated above,are provided as examples. Other examples may differ from what is described with regard to.
are diagrams of an example implementationdescribed herein. As shown in, example implementationmay include an optical system. The optical systemmay be associated with, and/or may be included in, a user device (e.g., a user device, as described herein).each show a different configuration of the optical system. As shown in, the optical systemmay include a multispectral sensor, the optical filter, and/or a lens. The optical systemmay be configured to collect and process lightthat originates from a scene. The scenemay include variations in local illumination (e.g., the sceneincludes an area associated with a tree illuminated by sunlight, an area associated with a shadow cast by the tree, and an area associated with a person walking by the tree with a part of the person illuminated by the sunlight and another part of the person in the shadow of the tree).
The multispectral sensormay include a plurality of multispectral sensor elements (not shown). The plurality of multispectral sensor elements may provide information related to light (e.g., the light) that impinges on the plurality of multispectral sensor elements. For example, an individual multispectral sensor element, of the plurality of multispectral sensor elements, may provide an indication of intensity of light that impinges on the multispectral sensor element (e.g., active/inactive, or a more granular indication of intensity). As another example, the multispectral sensor element may provide an indication of a wavelength or wavelength range of light that impinges on the multispectral sensor element (e.g., red light, blue light, green light, ultraviolet light, and/or infrared light, among other examples). The multispectral sensormay be configured to collect respective information from individual multispectral sensor elements, of the plurality of multispectral sensor elements, to generate spectral data. For example, the multispectral sensormay be configured to generate spectral data associated with the scene(e.g., that indicates a spectral profile of the scene). The spectral data may include spectral information about light associated with a spectral range (e.g., one or more portions of the visible spectral range and/or another spectral range).
The optical filtermay be disposed over the multispectral sensor. For example, the optical filtermay be disposed directly on an input surface of the multispectral sensor. Alternatively, the optical filtermay be disposed proximate to the input surface of the multispectral sensor, and a gap (e.g., an air gap, or a gap comprising one or more materials) may separate the optical filterand the input surface of the multispectral sensor. The optical filtermay be configured to pass one or more portions of light (e.g., that impinges on the input surface of the optical filter) to the multispectral sensor(e.g., the input surface of the multispectral sensor) and/or may be configured to block (or minimize passage of) one or more other portions of the light (e.g., that impinges on the input surface of the optical filter). For example, the optical filtermay be configured to pass one or more portions of the lightto the multispectral sensorand/or to block (or minimize passage of) one or more other portions of the light.
The lensmay be disposed over the optical filter. For example, the lensmay be disposed directly on the input surface of the optical filter. Alternatively, the lensmay be disposed proximate to the input surface of the optical filter, and a gap (e.g., an air gap, or a gap comprising one or more materials) may separate the lensand the input surface of the optical filter. The lensmay be configured to receive light and to direct the light to the optical filter. For example, the lensmay be configured to receive the lightfrom the sceneand to direct the lightto the input surface of the optical filter. The lensmay be configured to collimate, converge, diverge, and/or otherwise direct light to the optical filter. In some implementations, the lensmay be a “non-imaging” lens (e.g., that is associated with a low MTF), and may therefore not be configured to focus the light on the optical filter. This may enable the lensto be thinner (as compared to an “imaging” lens that is associated with a high MTF) and/or to reduce a thickness of a gap between the lensand the optical filter. The lensmay comprise glass, plastic, and/or a similar material. Accordingly, as shown in, the lightmay originate from the sceneand may propagate to the lens. The lensmay direct the lightto the optical filter. The optical filtermay pass one or more portions of the light to the multispectral sensorand/or may block (or minimize passage of) one or more other portions of the light. The multispectral sensormay generate, based on the one or more portions of the light, spectra data associated with the scene. The spectral data then may be used to determine white balance information associated with the scene(e.g., as described herein).
As shown in, the optical systemmay additionally include an image sensor. As further shown in, the multispectral sensorand the optical filtermay each be divided into one or more portions (e.g., that are arranged proximate to the image sensor, such as around one or more sides of the image sensor). For example, the multispectral sensormay be divided into a first multispectral sensor portion-and a second multispectral sensor portion-, and the optical filtermay be divided into a first optical filter portion-and a second optical filter portion-. Accordingly, the optical systemmay be configured to collect and process first lightand second lightthat originate from the scene, as described herein.
The image sensormay include a plurality of image sensor elements (not shown). The plurality of image sensor elements may provide information related to light that impinges on the plurality of image sensor elements. For example, an individual image sensor element, of the plurality of image sensor elements, may provide an indication of intensity of light that impinges on the image sensor element (e.g., active/inactive, or a more granular indication of intensity). As another example, the image sensor element may provide an indication of a wavelength or wavelength range of light that impinges on the image sensor element (e.g., red light, blue light, green light, ultraviolet light, and/or infrared light, among other examples). The image sensormay be configured to collect respective information from individual image sensor elements, of the plurality of image sensor elements, to generate image data. For example, the image sensormay be configured to generate image data associated with the scene. The image data may include image information about light associated with a spectral range (e.g., the visible spectral range and/or another spectral range), such as an amount and/or location of red light, green light, and/or blue light in the scene.
In some implementations, the lensmay include a first region(e.g., an outer region of the lens, such as a perimeter region of the lensthat is not associated with an imaging region of the lens) and a second region(e.g., an inner region of the lens, such as a central region of the lensthat is associated with the imaging region of the lens). The lensmay be disposed over (e.g., directly on, or separated by a gap) the one or more portions of the optical filter, and the first regionof the lensmay be configured to receive the first lightand to direct the first lightto the one or more portions of the optical filter. Additionally, or alternatively, the lensmay be disposed over (e.g., directly on, or separated by a gap) the image sensor, and the second regionof the lensmay be configured to receive the second lightand to direct the second lightto the image sensor. In this way, a single lensmay direct light associated with the scenethat is to be imaged to the image sensor, and may direct other light associated with the scenethat is to be analyzed (e.g., to determine white balance information associated with the scene) to the multispectral sensorvia the optical filter. In some implementations, the lensmay be an “imaging” lens (e.g., that is associated with a high MTF), and may therefore be configured to provide the second lightas focused light on the multispectral sensorand to provide the first lightas non-focused light on the optical filter.
Accordingly, as shown in, the first lightand the second lightmay originate from the sceneand may propagate to the first regionand the second regionof the lens, respectively. The first regionof the lensmay direct the first lightto the one or more portions of the optical filter. Each of the one or more portions of the optical filtermay pass one or more portions of the first lightto a corresponding portion of the multispectral sensorand/or may block (or minimize passage of) one or more other portions of the first light. The multispectral sensormay generate, based on the one or more portions of the first light, spectral data associated with the scene. The spectral data then may be used to determine white balance information associated with the scene(e.g., as described herein). Additionally, the second regionof the lensmay direct the second lightto the image sensor. The image sensormay generate, based on the second light, image data associated with the scene. The image data then may be used to generate (e.g., based on the white balance information) an image of the scene(e.g., as described herein).
As shown in, the optical systemmay include a first lensand a second lens, instead of a single lens. In this way, the first lightand the second light that originate from the scenemay propagate to different lenses in the optical system.
The first lensmay be disposed over (e.g., directly on, or separated by a gap) the optical filter, and may be configured to receive the first lightand to direct the first lightto the optical filter(e.g., in a similar manner as that of the lensdescribed herein in relation to). In some implementations, the first lensmay be a “non-imaging” lens (e.g., that is associated with a low MTF), and may therefore be configured to provide the first lightas non-focused light on the optical filter.
The second lensmay be disposed over (e.g., directly on, or separated by a gap) the image sensor, and may be configured to receive the second lightand to direct the second lightto the image sensor(e.g., in a similar manner as that of the lensdescribed herein in relation to). In some implementations, the second lensmay be an “imaging” lens (e.g., that is associated with a high MTF), and may therefore be configured to provide the second lightas focused light on the image sensor.
Accordingly, as shown in, the first lightand the second lightmay originate from the sceneand may propagate to the first lensand the second lens, respectively. The first lensmay direct the first lightto the optical filter. The optical filtermay pass one or more portions of the first lightto the multispectral sensorand/or may block (or minimize passage of) one or more other portions of the first light. The multispectral sensormay generate, based on the one or more portions of the first light, spectral data associated with the scene. The spectral data then may be used to determine white balance information associated with the scene(e.g., as described herein). Additionally, the second lensmay direct the second lightto the image sensor. The image sensormay generate, based on the second light, image data associated with the scene. The image data then may be used to generate (e.g., based on the white balance information) an image of the scene(e.g., as described herein).
As indicated above,are provided as examples. Other examples may differ from what is described with regard to.
are diagramsof example transmission plots associated with the optical filterdescribed herein.
shows an example transmission plotfor a “clear” optical channel-of the optical filterthat is configured to pass light associated with a spectral range. Here, the transmission plotindicates that the optical channel-has a transmission level that is greater than or equal to 90% for light associated with the visible spectral range (e.g., greater than or equal to 420 nm and less than 780 nm) and a portion of the NIR spectral range (e.g., greater than or equal to 780 nm and less than 900 nm).
shows an example transmission plotfor a “darkened” optical channel-of the optical filterthat is configured to block (or minimize passage of) light associated with a spectral range. Here, the transmission plotindicates that the optical channel-has a transmission level that is less than or equal to 7% for light associated with a portion of the UV spectral range (e.g., greater than or equal to 350 nm and less than 420 nm), the visible spectral range (e.g., greater than or equal to 420 nm and less than 780 nm) and the NIR spectral range (e.g., greater than or equal to 780 nm and less than 1000 nm).
shows an example transmission plotfor optical channels-that are configured to pass light associated with spectral subranges of a spectral range. Here, the transmission plotindicates that the optical channels-have transmission levels that are greater than or equal to 20% for light associated with different spectral subranges of the visible spectral range (e.g., greater than or equal to 420 nm and less than 780 nm). For example, as shown by curve, a first optical channel-(e.g., that corresponds to optical channel-in) has a transmission level that is greater than or equal to 20% for a first spectral subrange (e.g., greater than or equal to 420 nm and less than 430 nm); as shown by curve, a second optical channel-(e.g., that corresponds to optical channel-in) has a transmission level that is greater than or equal to 20% for a second spectral subrange (e.g., greater than or equal to 440 nm and less than 460 nm); as shown by curve, a third optical channel-(e.g., that corresponds to optical channel-in) has a transmission level that is greater than or equal to 20% for a third spectral subrange (e.g., greater than or equal to 470 nm and less than 490 nm); as shown by curve, a fourth optical channel-(e.g., that corresponds to optical channel-in) has a transmission level that is greater than or equal to 20% for a fourth spectral subrange (e.g., greater than or equal to 515 nm and less than 535 nm); as shown by curve, a fifth optical channel-(e.g., that corresponds to optical channel-in) has a transmission level that is greater than or equal to 20% for a fifth spectral subrange (e.g., greater than or equal to 555 nm and less than 575 nm); as shown by curve, a sixth optical channel-(e.g., that corresponds to optical channel-in) has a transmission level that is greater than or equal to 20% for a sixth spectral subrange (e.g., greater than or equal to 595 nm and less than 605 nm); as shown by curve, a seventh optical channel-(e.g., that corresponds to optical channel-in) has a transmission level that is greater than or equal to 20% for a seventh spectral subrange (e.g., greater than or equal to 630 nm and less than 640 nm); and as shown by curve, an eighth optical channel-(e.g., that corresponds to optical channel-in) has a transmission level that is greater than or equal to 20% for a eighth spectral subrange (e.g., greater than or equal to 675 nm and less than 680 nm).
As indicated above,are provided as examples. Other examples may differ from what is described with regard to.
is a diagram of an example environmentin which systems and/or methods described herein may be implemented. As shown in, the environmentmay include an optical system, a processor, an image sensor, a multispectral sensor, a user device, and a network. Devices of the environmentmay interconnect via wired connections, wireless connections, or a combination of wired and wireless connections.
As shown in, optical systemmay comprise the processor, the image sensor, and/or the multispectral sensor. In some implementations, the optical systemmay be included in the user device. The optical systemmay correspond to the optical systemdescribed herein.
The processoris implemented in hardware, firmware, and/or a combination of hardware and software. The processoris a central processing unit (CPU), a graphics processing unit (GPU), an accelerated processing unit (APU), a microprocessor, a microcontroller, a digital signal processor (DSP), a field-programmable gate array (FPGA), an application-specific integrated circuit (ASIC), or another type of processing component. In some implementations, the processorincludes one or more processors capable of being programmed to perform a function, such as to process image data and/or spectral data as described herein.
The image sensorincludes a device capable of sensing light (e.g., in the visible spectrum). For example, the image sensormay include an image sensor, a multispectral sensor, and/or a spectral sensor, among other examples. In some implementations, the image sensormay include a charge-coupled device (CCD) sensor, a complementary metal-oxide semiconductor (CMOS) sensor, a front-side illumination (FSI) sensor, a back-side illumination (BSI) sensor, and/or a similar sensor. In some implementations, the image sensormay be included in a camera or a similar device. The image sensormay correspond to the image sensordescribed herein.
The multispectral sensorincludes a device capable of sensing light (e.g., in the visible spectrum and/or a nonvisible spectrum). For example, the multispectral sensormay include an image sensor, a multispectral sensor, a spectral sensor, and/or the like. In some implementations, multispectral sensormay include a CCD sensor, a CMOS sensor, an FSI sensor, a BSI sensor, and/or a similar sensor. In some implementations, the multispectral sensormay be included in a camera or a similar device. The multispectral sensormay correspond to the multispectral sensordescribed herein.
The user deviceincludes one or more devices capable of receiving, generating, storing, processing, and/or providing information as described herein. For example, the user devicemay include a communication and/or computing device, such as a mobile phone (e.g., a smart phone, a radiotelephone, and/or the like), a computer (e.g., a laptop computer, a tablet computer, a handheld computer, and/or the like), a gaming device, a wearable communication device (e.g., a smart wristwatch, a pair of smart eyeglasses, and/or the like), or a similar type of device. In some implementations, the user devicemay receive information from and/or transmit information to optical system(e.g., via the network).
The networkincludes one or more wired and/or wireless networks. For example, the networkmay include a cellular network (e.g., a long-term evolution (LTE) network, a code division multiple access (CDMA) network, a 3G network, a 4G network, a 5G network, another type of next generation network, and/or the like), a public land mobile network (PLMN), a local area network (LAN), a wide area network (WAN), a metropolitan area network (MAN), a telephone network (e.g., the Public Switched Telephone Network (PSTN)), a private network, an ad hoc network, an intranet, the Internet, a fiber optic-based network, a cloud computing network, or the like, and/or a combination of these or other types of networks.
The number and arrangement of devices and networks shown inare provided as an example. In practice, there may be additional devices and/or networks, fewer devices and/or networks, different devices and/or networks, or differently arranged devices and/or networks than those shown in. Furthermore, two or more devices shown inmay be implemented within a single device, or a single device shown inmay be implemented as multiple, distributed devices. Additionally, or alternatively, a set of devices (e.g., one or more devices) of environmentmay perform one or more functions described as being performed by another set of devices of environment.
is a diagram of example components of a deviceassociated with an optical system. The devicemay correspond to the optical system, the processor, the image sensor, the multispectral sensor, and/or the user device. In some implementations, the optical system, the processor, the image sensor, the multispectral sensor, and/or the user devicemay include one or more devicesand/or one or more components of the device. As shown in, the devicemay include a bus, a processor, a memory, an input component, an output component, and/or a communication component.
Unknown
November 6, 2025
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.