Pan-warping and Modifying Sub-frames With an Up-sampled Frame Rate

1. A method comprising, by a computing device comprising a display that operates in a display cycle comprising a plurality of on-cycles of the display cycle and a plurality of off-cycles of the display cycle: accessing a first rendered frame generated based on a first viewing direction of a user, the first rendered frame being generated at a first frame rate and while the display is in a first off-cycle of the display cycle; generating, based on the first rendered frame and while the display is in a first on-cycle of the display cycle, one or more sub-frames at a second frame rate that is higher than the first frame rate, wherein a first sub-frame of the one or more sub-frames is generated by: determining a second viewing direction of the user based on sensor data; and applying one or more transformations to the first rendered frame based on the second viewing direction; and outputting the one or more sub-frames for display at the second frame rate.

2. The method of claim 1 , further comprising: accessing a second rendered frame generated at the first frame rate after outputting a threshold number of the one or more sub-frames for display.

3. The method of claim 1 , further comprising: generating the first rendered frame by: receiving data regarding an image to be rendered; and applying one or more geometric warp transformations to the image data based on the first viewing direction of the user.

4. The method of claim 1 , wherein the display cycle of the display comprises a duty cycle of one or more light emitters of the display.

5. The method of claim 1 , wherein applying one or more transformations to the first frame based on the second viewing direction further comprises: determining a difference between the first viewing direction and the second viewing direction related to a user eye movement the user; and electronically shifting the first rendered frame based on the difference related to the user eye movement.

6. The method of claim 5 , wherein the electronically shifting the first rendered frame is inversely proportional to the user eye movement.

7. The method of claim 1 , wherein applying one or more transformations to the first rendered frame further comprises: determining a scanline refresh rate of the display; and translating the first rendered frame based on the scanline refresh rate.

8. The method of claim 1 , further comprising: dithering the first sub-frame based on a color error calculated for each pixel of the first sub-frame, wherein the color error reflects a difference between a color precision of the display and a specified color of the pixel.

9. The method of claim 8 , wherein the color error is calculated based in part on one or more second pixels near each pixel of the display.

10. The method of claim 8 , wherein the color error for a pixel at a first location in the display is calculated based in part on a color output at the first location in the display in a previous sub-frame.

11. The method of claim 1 , further comprising: determining one or more non-uniformities in the display; and during generation of the first sub-frame, applying a transformation to the first rendered frame to correct the non-uniformities in the display.

12. The method of claim 11 , further comprising: determining one or more non-uniformities in an optics component of the display; and prior to accessing the first rendered frame, applying a transformation to the first rendered frame to correct the non-uniformities in the optics component of the display.

13. The method of claim 1 , further comprising: determining non-uniformities in the display or in an optics component of the display; categorizing the non-uniformities as causing high inter-sub-frame variation or as causing low inter-sub-frame variation; applying a transformation to the first rendered frame to correct non-uniformities categorized as causing low inter-sub-frame variation; and during generation of the first sub-frame, applying a transformation to the first rendered frame to correct non-uniformities categorized as causing high inter-sub-frame variation.

14. The method of claim 1 , wherein generating one or more sub-frames at the second frame rate further comprises: associating a first sub-frame of the one or more sub-frames with a first color channel, such that the first sub-frame comprises a plurality of intensities of the first color channel; and associating a second sub-frame of the one or more sub-frames with a second color channel, such that the second sub-frame comprises a plurality of intensities of the second color channel, wherein the second color channel is distinct from the first color channel.

15. The method of claim 1 , wherein the first rendered frame is generated by a different computing device than the one or more sub-frames.

16. The method of claim 1 , wherein the computing device that generated the one or more sub-frames is a component of a display system that comprises the display by which the one or more sub-frames are output.

17. A system comprising: one or more processors; a display that operates in a display cycle comprising a plurality of on-cycles of the display cycle and a plurality of off-cycles of the display cycle; and one or more computer-readable non-transitory storage media coupled to one or more of the processors and comprising instructions operable when executed by one or more of the processors to cause the system to: access a first rendered frame generated based on a first viewing direction of a user, the first rendered frame being generated at a first frame rate and while the display is in a first off-cycle of the display cycle; generate, based on the first rendered frame and while the display is in a first on-cycle of the display cycle, one or more sub-frames at a second frame rate that is higher than the first frame rate, wherein a first sub-frame of the one or more sub-frames is generated by: determining a second viewing direction of the user based on sensor data; and applying one or more transformations to the first rendered frame based on the second viewing direction; and output the one or more sub-frames for display at the second frame rate.

18. The system of claim 17 , wherein the instructions are further operable when executed by one or more of the processors to cause the system to: access a second rendered frame generated at the first frame rate after a threshold number of the one or more sub-frames are output for display.

19. One or more computer-readable non-transitory storage media embodying software that is operable when executed to: access a first rendered frame generated based on a first viewing direction of a user, the first rendered frame being generated at a first frame rate and while a display that operates in a display cycle comprising a plurality of on-cycles of the display cycle and a plurality of off-cycles of the display cycle is in a first off-cycle of the display cycle; generate, based on the first rendered frame and while the display is in a first on-cycle of the display cycle, one or more sub-frames at a second frame rate that is higher than the rendered first frame rate, wherein a first sub-frame of the one or more sub-frames is generated by: determining a second viewing direction of the user based on sensor data; and applying one or more transformations to the first frame based on the second viewing direction; and output the one or more sub-frames for display at the second frame rate.

20. The computer-readable non-transitory storage media of claim 19 , wherein the software is further operable when to: access a second rendered frame generated at the first frame rate after a threshold number of the one or more sub-frames are output for display.