Patentable/Patents/US-8111300
US-8111300

System and method to selectively combine video frame image data

PublishedFebruary 7, 2012
Assigneenot available in USPTO data we have
Inventorsnot available in USPTO data we have
Technical Abstract

Systems and methods to selectively combine video frame image data are disclosed. First image data corresponding to a first video frame and second image data corresponding to a second video frame are received from an image sensor. The second image data is adjusted by at least partially compensating for offsets between portions of the first image data with respect to corresponding portions of the second image data to produce adjusted second image data. Combined image data corresponding to a combined video frame is generated by performing a hierarchical combining operation on the first image data and the adjusted second image data.

Patent Claims
25 claims

Legal claims defining the scope of protection, as filed with the USPTO.

1

1. A method of storing combined image data to a storage device, comprising: receiving first image data corresponding to a first video frame and second image data corresponding to a second video frame, the first video frame and the second video frame received from an image sensor; adjusting the second image data by at least partially compensating for offsets between portions of the first image data with respect to corresponding portions of the second image data to produce adjusted second image data; generating combined image data corresponding to a combined video frame by filtering the first image data and the adjusted second image data to compare filtered image characteristics, and wherein first values of the first image data and corresponding second values of the second image data are selectively combined based on the filtered image characteristics; and storing the combined image data to a storage device.

2

2. The method of claim 1 , wherein the combined image data has at least one of a greater resolution than the first image data, a higher dynamic range than the first image data, a larger depth of field than the first image data, less noise than the first image data, or less blurring due to motion than the first image data.

3

3. The method of claim 1 , further comprising compressing the combined image data prior to storing the data to the storage device.

4

4. The method of claim 1 , wherein the hierarchical combining operation includes a coarse combining operation and a fine combining operation.

5

5. The method of claim 4 , wherein the coarse combining operation includes selectively discarding one or more macroblocks of the adjusted second image data when a difference between the one or more macroblocks of the adjusted second image data and corresponding macroblocks of the first image data exceeds a selectable threshold value.

6

6. The method of claim 1 , wherein adjusting the second image data includes applying a set of motion vector data corresponding to the offsets between the portions of the first image data with respect to the corresponding portions of the second image.

7

7. The method of claim 6 , wherein the set of motion vector data is determined via a hierarchical registration process.

8

8. The method of claim 7 , wherein the hierarchical registration process includes: determining a first alignment offset between a first portion of the first image data and a first portion of-the second image data; and determining a second alignment offset between a second portion of the first image data and a second portion of the second image data based on the first alignment offset, wherein the second portion of the first image data is within the first portion of the first image data.

9

9. The method of claim 1 , wherein the image storage device includes one or more display buffers, registers, caches, flash memory elements, or hard disks.

10

10. The method of claim 1 , wherein generating the combined image data includes receiving a weight to be applied to a pixel value of the first image data and receiving a second weight to be applied to a pixel value of the second image data.

11

11. An apparatus comprising: a registration circuit configured to generate a set of motion vector data based on first image data corresponding to a first video frame and second image data corresponding to a second video frame, the first video frame and the second video frame received from an image sensor; a combination circuit coupled to selectively combine the first image data and adjusted second image data by filtering the first image data and the adjusted second image data to compare filtered image characteristics, and wherein first values of the first image data and corresponding second values of the second image data are selectively combined based on the filtered image characteristics; wherein the adjusted second image data corresponds to the second image data after being adjusted according to the motion vector data; and a control circuit to control the combination circuit to generate combined image data that corresponds to a combined video frame.

12

12. The apparatus of claim 11 , wherein the combined image data has at least one of a greater resolution than the first image data, a higher dynamic range than the first image data, a larger depth of field than the first image data, less noise than the first image data, or less blurring due to motion than the first image data.

13

13. The apparatus of claim 11 , wherein the combination circuit includes a coarse combination circuit and a fine combination circuit.

14

14. The apparatus of claim 11 , further comprising a compress and store module configured to compress the combined image data and to store the compressed combined image data at a memory device.

15

15. The apparatus of claim 11 , further comprising: a camera lens; and video capture circuitry coupled to the camera lens to generate the first image data and to generate the second image data.

16

16. The apparatus of claim 15 , further comprising a processor coupled to a wireless transceiver to send and receive data via an antenna.

17

17. An apparatus comprising: a registration circuit configured to generate a set of motion vector data based on first image data corresponding to a first video frame and second image data corresponding to a second video frame, the first video frame and the second video frame received from an image sensor; a combination circuit configured to combine the first image data and adjusted second image data, wherein the adjusted second image data corresponds to the second image data after being adjusted according to the motion vector data; the combination circuit also including: a macro block image alignment circuit having a first input coupled to receive the first image data and a second input coupled to receive the second image data, a third input coupled to receive a macro block motion vector signal, an aligned first image output and an aligned second image output; a block difference discriminator circuit having a first input coupled to receive the aligned first image output, a second input coupled to receive the aligned second image output, a third input coupled to receive a macro block difference signal, and having a first image difference output and a second image difference output; a mean pixel difference circuit having a first input coupled to the block difference discriminator circuit and configured to provide a pixel difference output signal to indicate a mean pixel difference result; and a control circuit to control the combination circuit to generate combined image data that corresponds to a combined video frame.

18

18. The apparatus of claim 17 , further comprising: a first filter coupled between the block difference discriminator circuit and the mean pixel difference circuit having a first input coupled to receive the first image difference output and an output providing a filtered first image difference output; and a second filter coupled between the block difference discriminator circuit and the mean pixel difference circuit having a first input coupled to receive the second image difference output and having an output to provide a filtered second image difference output.

19

19. An apparatus comprising: a registration means for generating a set of motion vector data based on first image data corresponding to a first video frame and second image data corresponding to a second video frame, the first video frame and the second video frame received from an image sensor; a combination means for selectively combining the first image data and adjusted second image data by filtering the first image data and the adjusted second image data to compare filtered image characteristics, and wherein first values of the first image data and corresponding second values of the second image data are selectively combined based on the filtered image characteristics; wherein the adjusted second image data corresponds to the second image data after being adjusted according to the motion vector data; and a control means for controlling the combination circuit to generate combined image data corresponding to a combined video frame.

20

20. The apparatus of claim 19 , further comprising: a camera lens; and video capture means coupled to the camera lens for generating the first image data and the second image data.

21

21. The apparatus of claim 19 , further comprising means for encoding the combined image data to generate encoded video data.

22

22. A non-transitory computer readable medium storing computer executable code comprising: code for receiving first image data corresponding to a first video frame and second image data corresponding to a second video frame, the first video frame and the second video frame received from an image sensor; code for adjusting the second image data by at least partially compensating for offsets between portions of the first image data with respect to corresponding portions of the second image data to produce adjusted second image data; and code for generating combined image data corresponding to a combined video frame by filtering the first image data and the adjusted second image data to compare filtered image characteristics, and wherein first values of the first image data and corresponding second values of the second image data are selectively combined based on the filtered image characteristics.

23

23. The computer readable medium of claim 22 , wherein the combined image data has at least one of a greater resolution than the first image data, a higher dynamic range than the first image data, a larger depth of field than the first image data, less noise than the first image data, or less blurring due to motion than the first image data.

24

24. The computer readable medium of claim 22 , further comprising code for providing the combined image data to a video encoder to generate encoded video data.

25

25. The computer readable medium of claim 22 , wherein the code for generating combined image data includes a coarse combining operation and a fine combining operation.

Classification Codes (CPC)

Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.

Patent Metadata

Filing Date

April 22, 2009

Publication Date

February 7, 2012

Want to explore more patents?

Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.

Citation & reuse

Analysis on this page is generated by Patentable — an AI-powered patent intelligence platform. AI-generated summaries, explanations, and analysis may be reused with attribution and a visible link back to the canonical URL below. Patent abstracts and claims are USPTO public domain.

Cite as: Patentable. “System and method to selectively combine video frame image data” (US-8111300). https://patentable.app/patents/US-8111300

© 2026 Patentable. All rights reserved.

Patentable is a research and drafting-assistant tool, not a law firm, and does not provide legal advice. Documents we generate are drafts for review by a licensed patent attorney.