A computer-implemented method of processing video data comprising a first sequences of image frames containing a first instance of an object. The method includes isolating said first instance of the object within the first sequence of image frames, determining, using the isolated first instance of the object, first parameter values for a synthetic model of the object, modifying the first parameter values for the synthetic model of the object, rendering a modified first instance of the object using a trained machine learning model and the modified first parameter values for the synthetic model of the object, and replacing at least part of the first instance of the object within the first sequence of image frames with a corresponding at least part of the modified first instance of the object.
Legal claims defining the scope of protection, as filed with the USPTO.
4. The computer-implemented method of claim 3, wherein determining the subsequence of the first sequence of image frames is such that the subsequence of image frames ends before the event takes place.
5. The computer-implemented method of claim 4, wherein the object is a human face, and the event is the human face uttering a plosive consonant or a bilabial nasal consonant.
15. The computer-implemented method of claim 14, wherein the second object is the first object.
16. The computer-implemented claim 1, wherein the object is a face of a specific human.
17. The computer-implemented method of claim 16, wherein said at least part of the first instance of the object is a part of the face including a mouth and excluding eyes.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
December 23, 2021
July 26, 2022
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.