Face Detection and Tracking

1. A method for face detection and tracking using an image-based capture device, comprising: generating a depth image of a scene; generating a mask image from the depth image; detecting a position of a face of a user in the scene using the mask image; determining an intensity of the face using a first color channel of the mask image by undoing a gamma correction of the mask image and averaging a mean intensity and a median intensity of the face within the mask image; and adjusting a gain level of the first color channel of the image-based capture device directed at the scene to achieve a target intensity of the face.

2. The method of claim 1 , comprising adjusting an exposure time of the image-based capture device to improve a light level of the face.

3. The method of claim 2 , comprising estimating the light level of the face based on a green gain level, a blue gain level, a red gain level, and an exposure time of the image-based capture device.

4. The method of claim 3 , comprising increasing the exposure time of one or more cameras within the image-based capture device if the light level of the face is too low.

5. The method of claim 3 , comprising providing feedback to the user if the light level of the face is above a first threshold value or below a second threshold value.

6. The method of claim 1 , comprising: detecting a position of a face for each of a plurality of users in the scene using the mask image; determining an average of face intensities for the plurality of users using a first color channel of the mask image; and adjusting a gain level of a first color channel of the image-based capture device directed at the scene to achieve a target face intensity for the plurality of users.

7. The method of claim 1 , wherein detecting the position of the face of the user in the scene using the mask image comprises locating a proximate region of the face of the user versus a background within the mask image.

8. A face detection and tracking system, comprising: an image-based capture device, comprising a camera component that generates a depth image and a color image of a scene; and a computing device in operative communication with the image-based capture device, wherein the computing device comprises a processor configured to: generate a mask image from the depth image and the color image; detect a position of a face of a user in the scene using the mask image; determine an intensity of the face using a green color channel of the mask image; and direct the image-based capture device to adjust a green gain level of the green color channel to achieve a target intensity of the face, wherein the target intensity of the face is determined by undoing a gamma correction of the mask image and averaging a mean intensity and a median intensity of the face within the mask image, wherein the mean intensity and the median intensity comprise intensities within the green color channel.

9. The face detection and tracking system of claim 8 , wherein the computing device comprises a processor configured to direct the image-based capture device to adjust an exposure time to improve a light level of the face.

10. The face detection and tracking system of claim 9 , wherein the computing device comprises a processor configured to direct the image-based capture device to increase an exposure time if a filtered green gain level of the green color channel exceeds a high water mark threshold.

11. The face detection and tracking system of claim 9 , wherein the computing device comprises a processor configured to direct the image-based capture device to decrease an exposure time if a filtered green gain level of the green color channel is below a low water mark threshold.

12. The face detection and tracking system of claim 8 , wherein the computing device comprises a processor configured to direct the image-based capture device to adjust a red gain level or a blue gain level, or both, to achieve a color balance of the face.

13. The face detection and tracking system of claim 8 , wherein the computing device comprises a processor configured to direct the image-based capture device to adjust a red gain level and a blue gain level to a fixed difference from the green gain level to achieve a basic skin color balance of the face.

14. The face detection and tracking system of claim 8 , wherein the image-based capture device comprises an IR projector, an IR camera, and an RGB camera, and wherein the IR projector, the IR camera, and the RGB camera are temporally synchronized.

15. One or more non-volatile computer-readable storage media for storing computer readable instructions, the computer-readable instructions providing a face detection and tracking system when executed by one or more processing devices, the computer-readable instructions comprising code configured to: generate a mask image from a depth image of a scene; detect a position of a face of a user within a capture area of the scene using a face detection module; determine an intensity of the face using a first color channel of the mask image by undoing a gamma correction of the mask image and averaging a mean intensity and a median intensity of the face within the mask image; and adjust a gain level of the first color channel of an image-based capture device using a settings adjustment module to achieve a target intensity of the face.

16. The computer-readable storage media of claim 15 , wherein the computer-readable instructions comprise code configured to: adjust an exposure time of the image-based capture device using the settings adjustment module to improve a light level of the face.

17. The computer-readable storage media of claim 15 , wherein the computer-readable instructions comprise code configured to: track movements and features of the face using a face tracking module.

18. The computer-readable storage media of claim 15 , wherein the gain level of the first color channel comprises a green gain level of a green color channel.