An image sensor includes a plurality of optical filters, a plurality of transmissive members, an imaging section, and a signal processing section. The optical filters transmit visible rays having a wavelength enabling visual recognition of a primary color, and the transmissive members transmit infrared rays. A plurality of imaging elements of the imaging section are constituted by a plurality of groups. Each of the imaging elements includes optical filters or transmissive members. The signal processing section determines the luminance of each pixel of a produced image, based on measurement values measured by the imaging elements of a group corresponding to the pixel. At least one imaging element of each group is provided with a transmissive member, and the remaining one or more imaging elements are provided with the optical filters having no color or a primary color allocated to the group.
Legal claims defining the scope of protection, as filed with the USPTO.
1. An image sensor for producing an image comprising: a plurality of optical filters each transmitting visible rays having a wavelength enabling visual recognition of any one of a plurality of primary colors, and blocking visible rays having a different wavelength; a plurality of transmissive members each transmitting at least infrared rays; an imaging section including a plurality of imaging elements arranged, being two-dimensionally spread, in a state where each of the imaging elements is associated with one of the plurality of optical filters and the plurality of transmissive members, with visible rays or infrared rays entering the respective plurality of imaging elements, the visible rays having passed through the optical filters corresponding to the respective imaging elements, the infrared rays having passed through the transmissive members corresponding to the respective plurality of imaging elements; and a production section producing the image by dividing the plurality of imaging elements into a plurality of groups, causing each of the plurality of groups to correspond to one of a plurality of pixels included in the image, and determining a luminance of each of the plurality of pixels, based on measurement values of visible rays and infrared rays measured by the plurality of imaging elements belonging to the group corresponding to the pixel, for each pixel, a value of the luminance of a different primary color not allocated to the pixel is calculated based on values of the luminance of the primary color allocated to different pixels located around the pixel concerned, wherein: the plurality of imaging elements include the plurality of groups; one of the plurality of primary colors is allocated to each of the plurality of groups; the transmissive members are provided, being associated with at least one of the plurality of imaging elements belonging to a corresponding one of the groups, with the optical filters being provided so as to be associated with the remaining one or more imaging elements belonging to the group, the optical filters having no color or having a primary color allocated to the group; and the optical filters transmit visible rays having a wavelength enabling visual recognition of the primary color allocated to the group.
2. The image sensor according to claim 1 wherein: the plurality of transmissive members transmit infrared rays and block visible rays; the production section produces a color image and/or a high sensitivity image; in response to the production section producing the color image, the production section calculates, for each of the plurality of pixels, a luminance of the primary color allocated to the group corresponding to the pixel, on the basis of a difference between a value based on measurement values measured by the imaging elements corresponding to the respective plurality of optical filters belonging to the group, and a value based on measurement values measured by the imaging elements corresponding to the transmissive members belonging to the group; and in response to the production section producing the high sensitivity image, the production section calculates a luminance of each of the plurality of pixels, on the basis of a sum of a value based on measurement values measured by the plurality of imaging elements belonging to the group corresponding the pixel, and corresponding to the respective plurality of optical filters, and a value based on measurement values measured by the imaging elements belonging to the group, and corresponding to the transmissive members.
3. The image sensor according to claim 1 wherein: the plurality of transmissive members transmit infrared rays and visible rays; the production section produces a color image and/or a high sensitivity image; in response to the production section producing the color image, the production section calculates, for each of the plurality of pixels, a luminance of a primary color different from the primary color allocated to the group corresponding to the pixel, on the basis of a difference between a value based on measurement values measured by the imaging elements corresponding to the respective plurality of optical filters belonging to the group, and a value based on measurement values measured by the imaging elements corresponding to the transmissive members belonging to the group; and in response to the production section producing the high sensitivity image, the production section calculates a luminance of each of the plurality of pixels, on the basis of a sum of a value based on measurement values measured by the plurality of imaging elements belonging to the group corresponding the pixel, and corresponding to the respective plurality of optical filters, and a value based on measurement values measured by the imaging elements belonging to the group, and corresponding to the transmissive members.
4. The image sensor according to claim 1 wherein: the image sensor is installed in a vehicle.
5. The image sensor according to claim 1 wherein: the image produced by the image sensor is used for drive assist for a vehicle.
6. The image sensor according to claim 1 wherein: for each primary color allocated to one of the plurality of groups, there is a corresponding filter group comprising three optical filters of the same primary color and one transmissive member.
7. An image sensor for producing an image comprising: a plurality of optical filters each transmitting visible rays having a wavelength enabling visual recognition of any one of a plurality of primary colors, and blocking visible rays having a different wavelength; a plurality of transmissive members each transmitting at least infrared rays; an imaging section including a plurality of imaging elements arranged, being two-dimensionally spread, in a state where each of the imaging elements is associated with one of the plurality of optical filters and the plurality of transmissive members, with visible rays or infrared rays entering the respective plurality of imaging elements, the visible rays having passed through the optical filters corresponding to the respective imaging elements, the infrared rays having passed through the transmissive members corresponding to the respective plurality of imaging elements; and a production section producing the image by dividing the plurality of imaging elements into a plurality of groups, causing each of the plurality of groups to correspond to one of a plurality of pixels included in the image, and determining a luminance of each of the plurality of pixels, based on measurement values of visible rays and infrared rays measured by the plurality of imaging elements belonging to the group corresponding to the pixel, for each primary color allocated to one of the plurality of groups, there is a corresponding filter group comprising three optical filters of the same primary color and one transmissive member, wherein: the plurality of imaging elements include the plurality of groups; one of the plurality of primary colors is allocated to each of the plurality of groups; the transmissive members are provided, being associated with at least one of the plurality of imaging elements belonging to a corresponding one of the groups, with the optical filters being provided so as to be associated with the remaining one or more imaging elements belonging to the group, the optical filters having no color or having a primary color allocated to the group; and the optical filters transmit visible rays having a wavelength enabling visual recognition of the primary color allocated to the group.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
September 27, 2017
April 21, 2020
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.