Various methods are provided for the generation of motion vectors in the context of 3D computer-generated images. In one example, a method includes generating, for each pixel of one or more objects to be rendered in a current frame, a 1-phase motion vector (MV1) and a 0-phase motion vector (MV0), each MV1 and MV0 having an associated depth value, to thereby form an MV1 texture and an MV0 texture, each MV0 determined based on a camera MV0 and an object MV0, and outputting MV1 texture and the MV0 texture for image processing.
Legal claims defining the scope of protection, as filed with the USPTO.
2. The method of claim 1, wherein each MV1 represents a change in a position of a vertex at that pixel from the current frame to a previous frame, wherein each MV0 represents a change in a position of the vertex at that pixel from the previous frame to the current frame, wherein the camera MV0 represents a change in a position of the vertex at that pixel from the previous frame to the current due to a change in position or orientation of a virtual camera, and wherein the object MV0 represents a change in a position of the vertex at that pixel from the previous frame to the current due to a change in position of the object in a world space.
3. The method of claim 2, further comprising, for a selected pixel, determining the camera MV0 for the selected pixel based on a world space position of the selected pixel's corresponding vertex in the previous frame.
5. The method of claim 2, further comprising for a selected pixel, determining the object MV0 for the selected pixel based on an eye space position of a selected vertex corresponding to the selected pixel in the previous frame.
7. The method of claim 2, further comprising processing the MV1 texture and the MV0 texture based on each associated depth value, and wherein outputting the MV1 texture and the MV0 texture for image processing comprises outputting the processed MV1 texture and the processed MV0 texture for image processing.
8. The method of claim 7, wherein processing the MV1 texture and the MV0 texture comprises converting the MV1 texture to a set of MV1 pixel blocks and converting the MV0 texture to a set of MV0 pixel blocks.
9. The method of claim 8, wherein converting the MV1 texture to the set of MV1 pixel blocks comprises identifying, for each pixel block of a plurality of pixel blocks of the MV1 texture, a distribution of pixel types in that pixel block based on each associated depth value and converting the MV1 texture to the set of MV1 pixel blocks based on the distribution of pixel types for each pixel block.
11. The method of claim 8, wherein converting the MV0 texture to the set of MV0 pixel blocks comprises identifying, for each pixel block of a plurality of pixel blocks of the MV0 texture, a distribution of pixel types in that pixel block based on each associated depth value and converting the MV0 texture to the set of MV0 pixel blocks based on the distribution of pixel types for each pixel block.
13. The method of claim 2, further comprising applying a double-confirm process to each MV0 and each MV1, wherein the double-confirm process includes confirming each associated depth value.
14. The method of claim 13, wherein applying the double-confirm process includes, for a selected pixel in the current frame, double confirming the MV1 or MV0 for the selected pixel responsive to coordinates of the selected pixel in the current frame matching coordinates of that pixel mapped back to the previous frame using the MV1 or MV0 for the selected pixel, the coordinates of the selected pixel including a depth coordinate.
16. The system of claim 15, wherein the MV1 texture and the MV0 texture are usable to interpolate a frame between the current frame and the previous frame.
17. The system of claim 15, wherein each MV0 is determined based on a respective camera MV0 and a respective object MV0, where a camera MV0 for a selected vertex is determined based on a world space position of the selected vertex in the previous frame determined based on the cached depth buffer and inversed view matrix, where an object MV0 for the selected vertex is determined based on an eye space position of the selected vertex in the previous frame and an eye space position of the selected vertex in the current frame.
18. The system of claim 15, where each MV1 and each MV0 is assigned a respective pixel based on a location of a corresponding vertex.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
November 17, 2023
November 19, 2024
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.