A method of processing a sequence of frames of multimedia data is presented. The method provides for progressively refreshing the image data. The method includes dynamically selecting portions of frames of the sequence with progressively increasing area to refresh, and excluding non-refreshed areas as potential reference data for other frames.
Legal claims defining the scope of protection, as filed with the USPTO.
1. A method of processing a sequence of frames of multimedia data, the method comprising: selecting a first portion of a first frame of the sequence; refreshing the first portion by intra-coding the first portion; selecting at least one second portion of a second frame of the sequence, wherein the at least one second portion entirely covers and extends beyond an area of the second frame that is co-located with the first portion; refreshing the at least one second portion by coding the at least one second portion based on data associated with the refreshed first portion; dynamically selecting at least one third portion of a third frame; and refreshing the at least one third portion by coding the at least one third portion based on data associated with the refreshed first portion or the refreshed second portion, wherein the at least one second portion and the at least one third portion are optionally used as reference data for subsequent frames.
2. The method of claim 1 , wherein coding of the second or third portion comprises inter-coding the second or third portion.
3. The method of claim 1 , wherein coding of the second or third portion comprises intra-coding the second or third portion.
4. The method of claim 1 , wherein the multimedia data is processed in a single pass.
5. The method of claim 1 , wherein the multimedia data is processed in more than one pass.
6. The method of claim 1 , further comprising encoding at least one of the first, second and third portions based at least in part on the selecting of at least one of the first, second, and third portions.
7. The method of claim 1 , wherein the at least one second portion comprises a plurality of second portions, and further wherein one of the second portions is selected as reference data to refresh at least one portion of another frame in the sequence.
8. The method of claim 7 , further comprising reducing the area of the second portion, wherein the reduction is based on which of the second portions have been selected as reference data to refresh at least one portion of another frame in the sequence.
9. The method of claim 1 , wherein the first refresh frame is the first frame in a superframe.
10. The method of claim 1 , wherein the third portion covers substantially all of the third frame.
11. The method of claim 1 , further comprising selectively determining a total number of frames in the sequence for refreshing substantially an entire frame.
12. The method of claim 1 , wherein the first refresh portion comprises a substantially central portion of the first refresh frame.
13. The method of claim 1 , wherein the first refresh portion comprises at least a predetermined substantially rectangular area.
14. The method of claim 1 , wherein portions of the at least one second frame outside the second portion is excluded from being used as reference data for subsequent frames.
15. The method of claim 10 , further comprising refreshing a bi-directional frame, the bi-directional frame occurring after a last anchor frame not completely refreshed and prior to a first completely refreshed frame.
16. The method of claim 1 , further comprising refreshing at least one portion of a frame in reference to a plurality of weighted portions of previous frames, wherein one or more of the weighted portions having non-dominant weights are unrefreshed.
17. An apparatus configured to process a sequence of frames of multimedia data, the apparatus comprising: means for selecting a first portion of a first frame of the sequence; means for refreshing the first portion by intra-coding the first portion; means for selecting at least one second portion of a second frame of the sequence, wherein the at least one second portion entirely covers and extends beyond an area of the second frame that is co-located with the first portion; means for refreshing the at least one second portion by coding the at least one second portion based on data associated with the refreshed first portion; means for dynamically selecting at least one third portion of a third frame; and means for refreshing the at least one third portion by coding the at least one third portion based on data associated with the refreshed first portion or the refreshed second portion, wherein the at least one second portion and the at least one third portion are optionally used as reference data for subsequent frames.
18. The apparatus of claim 17 , wherein the means for refreshing the second or third portion comprises means for inter-coding the second or third portion.
19. The apparatus of claim 17 , wherein the means for refreshing the second or third portion comprises means for intra-coding the second or third portion.
20. The apparatus of claim 17 , wherein the apparatus is configured to process the multimedia data in a single pass.
21. The apparatus of claim 17 , wherein the apparatus is configured to process the multimedia data in more than one pass.
22. The apparatus of claim 17 , further comprising means for encoding at least one of the first, second and third portions based at least in part on the selecting of at least one of the first, second, and third portions.
23. The apparatus of claim 17 , further comprising means for selecting portions of the second portion as reference data to refresh at least one portion of another frame in the sequence.
24. The apparatus of claim 23 , further comprising means for reducing the area of the second portion, wherein the reduction is based on which of the second portions have been selected as reference data to refresh at least one portion of another frame in the sequence.
25. The apparatus of claim 17 , wherein the third portion covers substantially all of the third frame.
26. The apparatus of claim 17 , wherein portions of the at least one second frame outside the second portion is excluded from being used as reference data for subsequent frames.
27. The apparatus of claim 17 , further comprising means for selectively determining a total number of frames in the sequence for refreshing substantially an entire frame.
28. The apparatus of claim 17 , wherein the first refresh portion comprises a substantially central portion of the first refresh frame.
29. The apparatus of claim 17 , wherein the first refresh portion comprises at least a predetermined substantially rectangular area.
30. The apparatus of claim 26 , further comprising means for refreshing a bidirectional frame, the bi-directional frame occurring after a last anchor frame not completely refreshed and prior to a first completely refreshed frame.
31. The apparatus of claim 17 , further comprising means for refreshing at least one portion of a frame in reference to a plurality of weighted portions of previous frames, wherein one or more of the weighted portions having non-dominant weights are unrefreshed.
32. An apparatus configured to process a sequence of frames of multimedia data, comprising: a first selection module, configured to select a first portion of a first frame of the sequence; a first encoding module, configured to refresh the first portion by intra-coding the first portion; a second selection module, configured to select at least one second portion of a second frame of the sequence, wherein the at least one second portion entirely covers and extends beyond an area of the second frame that is co-located with the first portion; a second encoding module, configured to refresh the at least one second portion by coding the at least one second portion based on data associated with the refreshed first portion; a third selection module, configured to dynamically select at least one third portion of a third frame; a third encoding module, configured to refresh the at least one third portion by coding the at least one third portion based on data associated with the refreshed first portion or the refreshed second portion, wherein the at least one second portion and the at least one third portion are optionally used as reference data for subsequent frames.
33. The apparatus of claim 32 , wherein the second and third encoding modules are configured to inter-code the second and third portions.
34. The apparatus of claim 32 , wherein the device is configured to process the multimedia data in more than one pass.
35. The apparatus of claim 32 , further configured to reduce the area of the second portion, wherein the reduction is based on which of the second portions have been selected as reference data to refresh at least one portion of another frame in the sequence.
36. The apparatus of claim 32 , further comprising one or more additional encoding modules, configured to encode the subsequent frames and to exclude portions of the at least one second frame outside the second portion from being used as reference data for encoding the subsequent frames.
37. A non-transitory machine readable medium comprising instructions for processing a sequence of frames of multimedia data, wherein the instructions upon execution cause a machine to: select a first portion of a first frame of the sequence; refresh the first portion by intra-coding the first portion; select at least one second portion of a second frame of the sequence, wherein the at least one second portion entirely covers and extends beyond an area of the second frame that is collocated with the first portion; refresh the at least one second portion by coding the at least one second portion based on data associated with the refreshed first portion; dynamically select at least one third portion of a third frame; refresh the at least one third portion by coding the at least one third portion based on data associated with the refreshed first portion or the refreshed second portion, wherein the at least one second portion and the at least one third portion are optionally used as reference data for subsequent frames.
38. The non-transitory machine readable medium of claim 37 , wherein coding of the second or third portion comprises intra-coding the second or third portion.
39. The non-transitory machine readable medium of claim 37 , wherein the instructions when executed further cause the machine to reduce the area of the second portion, wherein the reduction is based on which of the second portions have been selected as reference data to refresh at least one portion of another frame in the sequence.
40. The non-transitory machine readable medium of claim 37 , wherein the instructions when executed further cause the machine to exclude portions of the at least one second frame outside the second portion from being used as reference data for subsequent frames.
41. A processor for processing a sequence of frames of multimedia data, said processor being configured to: select a first portion of a first frame of the sequence; refresh the first portion by intra-coding the first portion; select at least one second portion of a second frame of the sequence, wherein the at least one second portion entirely covers and extends beyond an area of the second frame that is collocated with the first portion; refresh the at least one second portion by coding the at least one second portion based on data associated with the refreshed first portion; dynamically select at least one third portion of a third frame; and refresh the at least one third portion by coding the at least one third portion based on data associated with the refreshed first portion or the refreshed second portion, wherein the at least one second portion and the at least one third portion are optionally used as reference data for subsequent frames.
42. The processor of claim 41 , wherein the area of the second portion is reduced based on which of the second portions have been selected as reference data to refresh at least one portion of another frame in the sequence.
43. The processor of claim 41 , wherein portions of the at least one second frame outside the second portion is excluded from being used as reference data for subsequent frames.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
September 25, 2006
October 11, 2016
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.