Gaze direction-based adaptive pre-filtering of video data

1. A method, comprising: tracking a gaze of an individual; filtering a first frame of video data representing at least a portion of an environment of the individual using a multi-layer low-pass filter, wherein the multi-layer low-pass filter comprises at least a first layer and a second layer, wherein the first layer has a first filtering resolution setting for a first subset of the first frame, wherein the second layer has a second filtering resolution setting for a second subset of the first frame, wherein the first subset includes one or more data elements positioned along a first direction of the gaze with respect to the first frame and corresponds to a first region of the environment, and wherein at least a portion of the second subset surrounds at least a portion of the first subset and corresponds to a second region of the environment that surrounds the first region; compressing a result of said filtering; and transmitting, via a network, at least a portion of a result of said compressing to a video processing engine configured to generate a modified visual representation of the environment.

2. The method as recited in claim 1 , further comprising: determining a modified direction of the gaze of the individual with respect to a second frame of video data; and identifying, within the second frame of video data, another subset of data elements to be filtered using the first layer, wherein the other subset includes one or more data elements positioned along the modified direction of the gaze.

3. The method as recited in claim 1 , wherein said tracking, said filtering and said compressing is performed at a wearable device.

4. The method as recited in claim 3 , wherein the wearable device comprises a head-mounted display (HMD) device of a mixed reality system.

5. The method as recited in claim 1 , further comprising: identifying a blending target set of data elements corresponding to a border region between the first subset of the first frame and the second subset of the first frame, wherein said filtering comprises: applying the first layer of the filter to the blending target set to obtain a first filtering output; applying the second layer of the filter to the blending target set to obtain a second filtering output; and combining, using a blending function, the first filtering output and the second filtering output.

6. The method as recited in claim 1 , wherein the perimeter of the first subset of the first frame comprises one of: (a) a circle, (b) an oval, (c) or a polygon.

7. The method as recited in claim 1 , wherein values of one or more parameters of the multi-layer low-pass filter are set based at least in part on feedback obtained from one or more individuals, wherein the one or more parameters comprise one or more of: (a) a number of layers in the multi-layer low-pass filter, (b) a size of a subset of a frame which is to be filtered using a particular layer of the multi-layer low-pass filter or (c) a filtering resolution setting of a particular layer of the multi-layer low-pass filter.

8. The method as recited in claim 7 , further comprising: obtaining said feedback in response to determining that a re-calibration request has been submitted by the individual.

9. The method as recited in claim 7 , wherein the feedback comprises an indication that a direction of the gaze of the individual differs from an expected direction.

10. A system, comprising: one or more processors; one or more sensors; and one or more memories, wherein the one or more memories store program instructions that when executed on the one or more processors perform a method comprising: filtering, using a multi-layer low-pass filter, a first frame of video data representing at least a portion of an environment of an individual, wherein the multi-layer low-pass filter comprises at least a first layer and a second layer, wherein the first layer has a first filtering resolution setting for a first subset of the first frame, wherein the second layer has a second filtering resolution setting for a second subset of the first frame, wherein the first subset includes one or more data elements positioned along a first direction of a gaze of the individual with respect to the first frame and corresponds to a first region of the environment, wherein at least a portion of the second subset surrounds at least a portion of the first subset and corresponds to a second region of the environment that surrounds the first region, and wherein the first direction is detected using at least one sensor of the one or more sensors; compressing a result of said filtering; and transmitting, via a network, at least a portion of a result of said compressing to a video processing engine configured to generate a modified visual representation of the environment.

11. The system as recited in claim 10 , wherein the method further comprises: determining a modified direction of the gaze of the individual with respect to a second frame of video data; and identifying, within the second frame of video data, another subset of data elements to be filtered using the first layer, wherein the other subset includes one or more data elements positioned along the modified direction of the gaze.

12. The system as recited in claim 10 , wherein the method further comprises: identifying a blending target set of data elements corresponding to a border region between the first subset of the first frame and the second subset of the first frame, wherein said filtering comprises: applying the first layer of the filter to the blending target set to obtain a first filtering output; applying the second layer of the filter to the blending target set to obtain a second filtering output; and combining, using a blending function, the first filtering output and the second filtering output.

13. The system as recited in claim 10 , wherein the perimeter of the first subset of the first frame comprises one of: (a) a circle, (b) an oval, (c) or a polygon.

14. The system as recited in claim 10 , wherein values of one or more parameters of the multi-layer low-pass filter are set based at least in part on feedback obtained from one or more individuals, wherein the one or more parameters comprise one or more of: (a) a number of layers in the multi-layer low-pass filter, (b) a size of a subset of a frame which is to be filtered using a particular layer of the multi-layer low-pass filter or (c) a filtering resolution setting of a particular layer of the multi-layer low-pass filter.

15. The system as recited in claim 14 , wherein the method further comprises: obtaining said feedback in response to determining that a re-calibration request has been submitted by the individual.

16. A non-transitory computer-accessible storage medium storing program instructions that when executed on one or more processors cause the one or more processors to perform a method comprising: filtering, using a multi-layer low-pass filter, a first frame of video data representing at least a portion of an environment of an individual, wherein the multi-layer low-pass filter comprises at least a first layer and a second layer, wherein the first layer has a first filtering resolution setting for a first subset of the first frame, wherein the second layer has a second filtering resolution setting for a second subset of the first frame, wherein the first subset includes one or more data elements positioned along a first direction of a gaze of the individual with respect to the first frame and corresponds to a first region of the environment, wherein at least a portion of the second subset surrounds at least a portion of the first subset and corresponds to a second region of the environment that surrounds the first region; compressing a result of the filtering; and causing a transmission, via a network, of at least a portion of a result of said compressing to a video processing engine configured to generate a modified visual representation of the environment.

17. The non-transitory computer-accessible storage medium as recited in claim 16 , wherein the method comprises: determining a modified direction of the gaze of the individual with respect to a second frame of video data; and identifying, within the second frame of video data, another subset of data elements to be filtered using the first layer, wherein the other subset includes one or more data elements positioned along the modified direction of the gaze.

18. The non-transitory computer-accessible storage medium as recited in claim 16 , wherein the method comprises: identifying a blending target set of data elements corresponding to a border region between the first subset of the first frame and the second subset of the first frame; and wherein the filtering comprises: applying the first layer to the blending target set to obtain a first filtering output; applying the second layer to the blending target set to obtain a second filtering output; and combining, using a blending function, the first filtering output and the second filtering output.

19. The non-transitory computer-accessible storage medium as recited in claim 16 , wherein the first frame of video data comprises a representation of a virtual object generated by one or more of: (a) a virtual reality application, (b) a mixed reality application or (c) an augmented reality application.

20. The non-transitory computer-accessible storage medium as recited in claim 16 , wherein values of one or more parameters of the multi-layer low-pass filter are set based at least in part on feedback obtained from one or more individuals, wherein the one or more parameters comprise one or more of: (a) a number of layers in the multi-layer low-pass filter, (b) a size of a subset of a frame which is to be filtered using a particular layer of the multi-layer low-pass filter or (c) a filtering resolution setting of a particular layer of the multi-layer low-pass filter.