An imaging unit 23 generates an image signal of a captured image. An optical sensor unit 25 generates a sensor signal that has a wider view angle than that of the imaging unit 23 and is according to a spectral characteristic upon obtaining the captured image. A controller 50 determines reliability of a light-source estimation result based on the image signal generated by the imaging unit 23, using a light-source estimation result based on the sensor signal generated by the optical sensor unit 25. For example, the controller 50 classifies the light-source estimation result based on the image signal into categories of light sources capable of being estimated based on the sensor signal, and compares the category into which the light-source estimation result is classified with the light source estimated based on the sensor signal. In a case where the light source estimated based on the sensor signal is not changed when the category into which the light-source estimation result is classified is changed, it is determined that the light-source estimation result based on the image signal is not reliable, and an adjustment value of white balance adjustment is not updated. Then, the white balance adjustment can accurately and stably be performed.
Legal claims defining the scope of protection, as filed with the USPTO.
3. The image processing device according to claim 1, wherein, in a case where the imaging element successively generates a plurality of image signals of each image of a plurality of images, the white balance setting unit is further configured to determine the reliability of the second light-source estimation result based on a second image signal of the plurality of image signals or following image signals from the plurality of image signals.
4. The image processing device according to claim 1, wherein the white balance setting unit is further configured to determine the reliability of the second light-source estimation result in a case where a view-angle difference between the view angle of the captured image and the view angle of the optical sensor unit is one of equal to or greater than a determined value.
5. The image processing device according to claim 1, wherein the white balance setting unit is further configured to set the white balance adjustment value based on the second light-source estimation result in a case where the reliability of the second light-source estimation result is not determined.
6. The image processing device according to claim 1, wherein the optical sensor unit has sensitivity in at least an infrared region.
7. The image processing device according to claim 1, wherein the view angle of the optical sensor unit includes the view angle of the captured image.
8. The image processing device according to claim 1, further comprising a white balance adjustment unit configured to execute white balance adjustment to the image signal based on the white balance adjustment value.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
May 16, 2019
November 1, 2022
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.