There is provided an information processing apparatus, an information processing method, and a program for reducing any drop in the accuracy of color correction, the information processing apparatus using a captured image captured by a calibrated imaging section imaging a projected image projected to a projection plane by a calibrated projection section in order to set color correction information as the information for correcting a color of each pixel of the projection section. This technology may be applied to electronic equipment having the functions of both a projector and a camera, or to a computer for controlling such electronic equipment.
Legal claims defining the scope of protection, as filed with the USPTO.
1. An information processing apparatus comprising: a color correction information setting section configured to use a captured image captured by a calibrated imaging section imaging a projected image projected to a projection plane by a calibrated projection section in order to set color correction information as information for correcting a color of the projection section, and set the color correction information based on shape information or color information of the projection plane, wherein the color correction information setting section sets the color correction information for a pixel of the projection section based on the shape information or the color information of a portion of the projection plane to which the pixel belongs, and wherein the color correction information setting section is implemented via at least one processor.
2. The information processing apparatus according to claim 1 , wherein the shape information of the projection plane indicates a flat, curved, or uneven plane, or made up of multiple planes.
3. The information processing apparatus according to claim 1 , wherein the color information of at least one color of the projection plane includes any color or colors, or includes any pattern or design of the projection plane.
4. The information processing apparatus according to claim 1 , wherein the color correction information setting section further sets the color correction information using environment information of the projection section indicative of an effect on color attributable to the projected image being projected onto the projection plane.
5. The information processing apparatus according to claim 4 , wherein, based on a captured image captured of the projection plane to which the projected image has yet to be projected, the color correction information setting section further obtains an illumination component of the projection plane for the projection section, wherein the color correction information setting section obtains, from the projected image, a gain amount of the color correction information in white for the projection section, and wherein the color correction information setting section sets the color correction information using the illumination component, the gain amount, and the environment information for the projection section.
6. The information processing apparatus according to claim 1 , wherein the color correction information includes information for correcting a color of each pixel of the projection section.
7. The information processing apparatus according to claim 6 , further comprising: an adjustment section configured to adjust, for each pixel of the projection section, a projection level of the projection section projecting the projected image, based on a pixel value of each pixel of the captured image, wherein the color correction information setting section sets the color correction information based on the adjusted projection level, and wherein the adjustment section is implemented via at least one processor.
8. The information processing apparatus according to claim 7 , wherein the adjustment section adjusts the projection level for the projection section so that the pixel value of each pixel of the captured image converges on a target value for each pixel.
9. The information processing apparatus according to claim 8 , wherein the adjustment section adjusts the projection level for the projection section so that the pixel value converges on a target value for an entirety of the projected image.
10. The information processing apparatus according to claim 7 , further comprising: an initial value setting section configured to set an initial value of the projection level for the projection section based on the pixel value of each pixel of the captured image and on a correspondence relation between each pixel of the projection section and each pixel of the imaging section, wherein the adjustment section adjusts the initial value of the projection level set by the initial value setting section for each pixel of the projection section, and wherein the initial value setting section is implemented via at least one processor.
11. The information processing apparatus according to claim 10 , further comprising: a correspondence relation setting section configured to obtain the correspondence relation between each pixel of the projection section and each pixel of the imaging section based on the projected image and on the captured image, wherein the correspondence relation setting section is implemented via at least one processor.
12. The information processing apparatus according to claim 10 , wherein the initial value setting section sets the initial value of the projection level for each pixel of the projection section based on depth information and normal line information about the projection plane.
13. The information processing apparatus according to claim 12 , further comprising: a depth/normal line information setting section configured to set the depth information and the normal line information, wherein the initial value setting section sets the initial value of the projection level for each pixel of the projection section based on the depth information and the normal line information set by the depth/normal line information setting section, and wherein the depth/normal line information setting section is implemented via at least one processor.
14. The information processing apparatus according to claim 12 , wherein the color correction information setting section sets the color correction information for each of a plurality of projection imaging apparatuses each including the projection section and the imaging section.
15. The information processing apparatus according to claim 14 , wherein the adjustment section sets as a target value a smallest of luminance values, observed by an observer, of projected images projected to the projection plane by the projection sections of all of the projection imaging apparatuses, and wherein the adjustment section further adjusts the projection level for the projection sections in such a manner that the luminance values converge on the target value.
16. The information processing apparatus according to claim 14 , wherein, when a difference in angle between each of the projection imaging apparatuses and the projection plane is larger than a predetermined threshold value, the color correction information setting section adjusts the color correction information based on an angle formed between a projection imaging apparatus having the projection section and the imaging section, and the projection plane.
17. The information processing apparatus according to claim 10 , wherein the initial value setting section further sets the initial value of the projection level for each pixel of the projection section based on information about reflectance corresponding to an incidence angle of the projected image relative to the projection plane.
18. The information processing apparatus according to claim 17 , further comprising: a reflectance information setting section configured to set information about the reflectance, wherein the reflectance information setting section is implemented via at least one processor.
19. The information processing apparatus according to claim 7 , wherein the color correction information setting section sets the color correction information using the projected image projected by the projection section of which the projection level for each pixel is adjusted by the adjustment section.
20. The information processing apparatus according to claim 1 , wherein the color correction information setting section sets the color correction information based on information about the projected image and information about the captured image.
21. The information processing apparatus according to claim 1 , further comprising: the projection section and the imaging section.
22. The information processing apparatus according to claim 21 , wherein another information processing apparatus includes the projection section and the imaging section, and wherein the color correction information setting section further sets the color correction information based on information about the projected image projected by a projection section of the another information processing apparatus and information about the captured image captured by an imaging section of the another information processing apparatus.
23. The information processing apparatus according to claim 1 , wherein the shape information includes information indicating a shape of the projection plane.
24. The information processing apparatus according to claim 1 , wherein the color information includes information indicating at least one color of the projection plane.
25. An information processing method comprising: using a captured image captured by a calibrated imaging section imaging a projected image projected to a projection plane by a calibrated projection section in order to set color correction information as information for correcting a color of the projection section; and setting the color correction information based on shape information or color information of the projection plane, wherein the color correction information for a pixel of the projection section is set based on the shape information or the color information of a portion of the projection plane to which the pixel belongs.
26. A non-transitory computer-readable medium having embodied thereon a program, which when executed by a computer causes the computer to execute a method, the method comprising: using a captured image captured by a calibrated imaging section imaging a projected image projected to a projection plane by a calibrated projection section in order to set color correction information as information for correcting a color of the projection section; and setting the color correction information based on shape information or color information of the projection plane, wherein the color correction information for a pixel of the projection section is set based on the shape information or the color information of a portion of the projection plane to which the pixel belongs.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
January 4, 2019
March 24, 2020
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.