An image processing device according to the invention includes: a lens information acquisition unit; a color mixture information determination unit; mosaic image acquisition unit that, when the color mixture information determination unit determines that the color mixture information is unidentified, reads, from the color imaging element, a second mosaic image obtained by reducing the number of types of first pixels in the first mosaic image which includes a pixel of a first color formed by at least one color and a pixel of a second color formed by at least one color and in which the number of types of first pixels determined by the arrangement of pixels that are adjacent to a first pixel, which is the pixel of the first color, at a minimum pixel pitch in four directions is equal to or greater than 4; a color mixture correction unit; and a synchronization unit.
Legal claims defining the scope of protection, as filed with the USPTO.
1. An imaging apparatus that generates three-layer color data on the basis of a first mosaic image, the image processing device comprising: a color imaging element in which color filters are provided in a predetermined color filter arrangement on a plurality of pixels that are two-dimensionally arranged; a processing device configured to: acquire information of a lens which is used to capture an image; determine whether color mixture information used for color mixture correction is identified or unidentified on the basis of the lens information; read, from the color imaging element, from the color imaging element, a second mosaic image obtained by reducing the number of types of first pixels in the first mosaic image which includes a pixel of a first color formed by at least one color and a pixel of a second color formed by at least two colors other than the first color and in which the number of types of first pixels determined by the arrangement of pixels that are adjacent to a first pixel, which is the pixel of the first color, at a minimum pixel pitch in four directions is equal to or greater than 4, when the processor determines that the color mixture information is unidentified, and read the first mosaic image from the color imaging element when the processor determines that the color mixture information is identified; perform the color mixture correction for the first mosaic image when the processor determines that the color mixture information is identified; and generate colors of three layers from the first mosaic image subjected to the color mixture correction or the second mosaic image, wherein the first color is formed by a color having a higher contribution ratio for obtaining a brightness signal than the second color; and an encoder that encodes the image data processed by the image processing device.
2. The imaging apparatus according to claim 1 , wherein, when the processing device is configured to determine that the color mixture information is identified, the processing device is configured to read the first mosaic image from the color imaging element or the processing device is configured to read a third mosaic image obtained by reducing the number of types of first pixels from the color imaging element.
3. The imaging apparatus according to claim 2 , wherein, in the third mosaic image, the types of first pixels have regularity or a single type of the first pixels is arranged in a first direction and a second direction perpendicular to the first direction, and the first pixels are arranged on a straight line extending in the first direction.
4. The imaging apparatus according to claim 2 , wherein, in the third mosaic image, the types of first pixels have regularity or a single type of the first pixels is arranged in a first direction and a second direction perpendicular to the first direction, the first pixels are arranged on a straight line extending in the first direction, and the first pixel and a second pixel, which is the pixel of the second color, are arranged on a straight line extending in the second direction.
5. The imaging apparatus according to claim 1 , wherein the second mosaic image is acquired or generated by reducing the number of types of first pixels in the first mosaic image using an extraction process.
6. The imaging apparatus according to claim 5 , wherein an extraction rate can be changed when the number of types of first pixels is reduced by the extraction process.
7. The imaging apparatus according to claim 1 , wherein, in the second mosaic image, the types of first pixels have regularity or a single type of the first pixels is arranged in a first direction and a second direction perpendicular to the first direction, and the first pixels are arranged on a straight line extending in the first direction.
8. The imaging apparatus according to claim 1 , wherein, in the second mosaic image, the types of first pixels have regularity or a single type of the first pixels is arranged in a first direction and a second direction perpendicular to the first direction, the first pixels are arranged on the straight line extending in the first direction, and the first pixel and a second pixel, which is the pixel of the second color, are arranged on a straight line extending in the second direction.
9. The imaging apparatus according to claim 1 , wherein the type of first pixel is determined by the arrangement of the pixels which are adjacent to the first pixel at the minimum pixel pitch in the four directions and a base structure of the imaging element.
10. The imaging apparatus according to claim 1 , wherein the second mosaic image includes two types of first pixels.
11. The imaging apparatus according to claim 1 further comprising: an imaging unit including an imaging optical system of a lens interchangeable type and an imaging element on which an object image is formed through the imaging optical system.
12. An imaging apparatus that generates three-layer color data on the basis of a first mosaic image, the imaging apparatus comprising: a color imaging element in which color filters are provided in a predetermined color filter arrangement on a plurality of pixels that are two-dimensionally arranged; a processor configured to: acquire information of a lens which is used to capture an image; determine whether color mixture information used for color mixture correction is identified or unidentified on the basis of the lens information; read the first mosaic image from the color imaging element; generate a second mosaic image obtained by reducing the number of types of first pixels in the first mosaic image which includes a pixel of a first color formed by at least one color and a pixel of a second color formed by at least two colors other than the first color and in which the number of types of first pixels determined by the arrangement of pixels that are adjacent to a first pixel, which is the pixel of the first color, at a minimum pixel pitch in four directions is equal to or greater than 4, when the processor determines that the color mixture information is unidentified; perform the color mixture correction for the first mosaic image when the processor determines that the color mixture information is identified; and generate colors of three layers from the first mosaic image subjected to the color mixture correction or the second mosaic image, wherein the first color is formed by a color having a higher contribution ratio for obtaining a brightness signal than the second color; and an encoder that encodes the image data processed by the image processing device.
13. The imaging apparatus according to claim 12 , wherein, when the processing device is configured to determine that the color mixture information is identified, the processing device is configured to generate the first mosaic image or the processing device is configured to generate a third mosaic image obtained by reducing the number of types of first pixels.
14. The imaging apparatus according to claim 13 , wherein, in the third mosaic image, the types of first pixels have regularity or a single type of the first pixels is arranged in a first direction and a second direction perpendicular to the first direction, and the first pixels are arranged on a straight line extending in the first direction.
15. The imaging apparatus according to claim 12 , wherein the second mosaic image is acquired or generated by reducing the number of types of first pixels in the first mosaic image using an extraction process.
16. The imaging apparatus according to claim 15 , wherein an extraction rate can be changed when the number of types of first pixels is reduced by the extraction process.
17. The imaging apparatus according to claim 12 , wherein, in the second mosaic image, the types of first pixels have regularity or a single type of the first pixels is arranged in a first direction and a second direction perpendicular to the first direction, and the first pixels are arranged on a straight line extending in the first direction.
18. The imaging apparatus according to claim 12 , wherein, in the second mosaic image, the types of first pixels have regularity or a single type of the first pixels is arranged in a first direction and a second direction perpendicular to the first direction, the first pixels are arranged on the straight line extending in the first direction, and the first pixel and a second pixel, which is the pixel of the second color, are arranged on a straight line extending in the second direction.
19. An image processing method using the imaging apparatus according to claim 1 that generates three-layer color data on the basis of a first mosaic image obtained from a single color imaging element in which color filters are provided in a predetermined color filter arrangement on a plurality of pixels that are two-dimensionally arranged, comprising: a lens information acquisition step of acquiring information of a lens which is used to capture an image; a color mixture information determination step of determining whether color mixture information used for color mixture correction is identified or unidentified on the basis of the lens information; a mosaic image acquisition step of, when the color mixture information is determined to be unidentified in the color mixture information determination step, reading, from the color imaging element, a second mosaic image obtained by reducing the number of types of first pixels in the first mosaic image which includes a pixel of a first color formed by at least one color and a pixel of a second color formed by at least two colors other than the first color and in which the number of types of first pixels determined by the arrangement of pixels that are adjacent to a first pixel, which is the pixel of the first color, at a minimum pixel pitch in four directions is equal to or greater than 4, and when the color mixture information is determined to be identified in the color mixture information determination step, reading the first mosaic image from the color imaging element; a color mixture correction step of performing the color mixture correction for the first mosaic image when the color mixture information is determined to be identified in the color mixture information determination step; and a synchronization step of generating colors of three layers from the first mosaic image subjected to the color mixture correction or the second mosaic image, wherein the first color is formed by a color having a higher contribution ratio for obtaining a brightness signal than the second color.
20. An image processing method using the imaging apparatus according to claim 12 that generates three-layer color data on the basis of a first mosaic image obtained from a single color imaging element in which color filters are provided in a predetermined color filter arrangement on a plurality of pixels that are two-dimensionally arranged, comprising: a lens information acquisition step of acquiring information of a lens which is used to capture an image; a color mixture information determination step of determining whether color mixture information used for color mixture correction is identified or unidentified on the basis of the lens information; a mosaic image acquisition step of reading the first mosaic image from the color imaging element; a mosaic image generation step of, when the color mixture information is determined to be unidentified in the color mixture information determination step, generating a second mosaic image obtained by reducing the number of types of first pixels in the first mosaic image which includes a pixel of a first color formed by at least one color and a pixel of a second color formed by at least two colors other than the first color and in which the number of types of first pixels determined by the arrangement of pixels that are adjacent to a first pixel, which is the pixel of the first color, at a minimum pixel pitch in four directions is equal to or greater than 4; a color mixture correction step of performing the color mixture correction for the first mosaic image when the color mixture information is determined to be identified in the color mixture information determination step; and a synchronization step of generating colors of three layers from the first mosaic image subjected to the color mixture correction or the second mosaic image, wherein the first color is formed by a color having a higher contribution ratio for obtaining a brightness signal than the second color.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
December 17, 2014
February 23, 2016
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.