Patentable/Patents/US-7536031
US-7536031

Temporal interpolation of a pixel on basis of occlusion detection

PublishedMay 19, 2009
Assigneenot available in USPTO data we have
Inventorsnot available in USPTO data we have
Technical Abstract

A method of determining a value for a particular pixel of a particular image being temporarily located intermediate a first image and a second image is disclosed. The method comprises: computing a first motion vector difference on basis of a first (Dp) and second (Dpp) motion vector of a first motion vector field (D3(x, n−1)) corresponding to the first image; computing a second motion vector difference on basis of a third (Dn) and fourth (Dnn) motion vector of a second motion vector field (D3(x, n)) corresponding to the second image; and establishing the value of the particular pixel on basis of a first value of a first pixel of the first image if the first motion vector difference is smaller than the second motion vector difference and establishing the value of the particular pixel on basis of a second value of a second pixel of the second image if the second motion vector difference is smaller than the first motion vector difference.

Patent Claims
10 claims

Legal claims defining the scope of protection, as filed with the USPTO.

1

1. A method of determining a value for a particular pixel of a particular image being temporarily located intermediate a first image and a second image, the method comprising an image apparatus that perform the following steps: computing a first motion vector difference on basis of a first ({right arrow over (D)} p ) and second ({right arrow over (D)} pp ) motion vector of a first motion vector field ({right arrow over (D)} 3 ({right arrow over (x)},n−1)) corresponding to the first image, the first motion vector ({right arrow over (D)} p ) being selected from the first motion vector field ({right arrow over (D)} 3 ({right arrow over (x)},n−1)) on basis of a particular spatial position ({right arrow over (x)}) of the particular pixel and a particular motion vector ({right arrow over (D)} c ) being estimated for the particular pixel and the second motion vector ({right arrow over (D)} pp ) being selected from the first motion vector field ({right arrow over (D)} 3 ({right arrow over (x)},n−1)) using the first motion vector ({right arrow over (D)} p ); computing a second motion vector difference on basis of a third ({right arrow over (D)} n ) and fourth ({right arrow over (D)} nn ) motion vector of a second motion vector field ({right arrow over (D)} 3 ({right arrow over (x)},n)) corresponding to the second image, the third motion vector ({right arrow over (D)} n ) being selected from the second motion vector field ({right arrow over (D)} 3 ({right arrow over (x)},n)) on basis of the particular spatial position ({right arrow over (x)}) of the particular pixel and the particular motion vector ({right arrow over (D)} c ) being estimated for the particular pixel and the fourth motion vector ({right arrow over (D)} nn ) being selected from the second motion vector field ({right arrow over (D)} 3 ({right arrow over (x)},n)) using the third motion vector ({right arrow over (D)} n ); and establishing the value of the particular pixel on basis of a first value of a first pixel of the first image if the first motion vector difference is smaller than the second motion vector difference and establishing the value of the particular pixel on basis of a second value of a second pixel of the second image if the second motion vector difference is smaller than the first motion vector difference.

2

2. A method of determining a value for a particular pixel as claimed in claim 1 , wherein the second motion vector ({right arrow over (D)} pp ) is selected from the first motion vector field ({right arrow over (D)} 3 ({right arrow over (x)},n−1)) on basis of the particular spatial position ({right arrow over (x)}) of the particular pixel and the first motion vector ({right arrow over (D)} p ).

3

3. A method of determining a value for a particular pixel as claimed in claim 2 , wherein the fourth motion vector ({right arrow over (D)} nn ) is selected from the second motion vector field ({right arrow over (D)} 3 ({right arrow over (x)},n)) on basis of the particular spatial position ({right arrow over (x)}) of the particular pixel and the third motion vector ({right arrow over (D)} n ).

4

4. A method of determining a value for a particular pixel as claimed in claim 1 , comprising establishing the value of the particular pixel on basis of the first value of the first pixel and of the second value of the second pixel if the first motion vector difference and the second motion vector difference are smaller than a predetermined threshold.

5

5. A method of determining a value for a particular pixel as claimed in claim 1 , comprising establishing the value of the particular pixel by means of interpolation of the first value of the first pixel and a further value of a further pixel in a spatial neighborhood of the first pixel.

6

6. A pixel value determining unit for determining a value for a particular pixel of a particular image being temporarily located intermediate a first image and a second image, the pixel value determining unit comprising: first computing means for computing a first motion vector difference on basis of a first ({right arrow over (D)} p ) and second ({right arrow over (D)} pp ) motion vector of a first motion vector field ({right arrow over (D)} 3 ({right arrow over (x)},n−1))corresponding to the first image, the first motion vector ({right arrow over (D)} p ) being selected from the first motion vector field ({right arrow over (D)} 3 ({right arrow over (x)},n−1)) on basis of a particular spatial position ({right arrow over (x)}) of the particular pixel and a particular motion vector ({right arrow over (D)} c ) being estimated for the particular pixel and the second motion vector ({right arrow over (D)} pp ) being selected from the first motion vector field ({right arrow over (D)} 3 ({right arrow over (x)}n−1)) using the first motion vector ({right arrow over (D)} p ); second computing means for computing a second motion vector difference on basis of a third ({right arrow over (D)} n )) and fourth ({right arrow over (D)} nn ) motion vector of a second motion vector field ({right arrow over (D)} 3 ({right arrow over (x)},n)) corresponding to the second image, the third motion vector ({right arrow over (D)} n ) being selected from the second motion vector field ({right arrow over (D)} 3 ({right arrow over (x)},n)) on basis of the particular spatial position ({right arrow over (x)}) of the particular pixel and the particular motion vector ({right arrow over (D)} c ) being estimated for the particular pixel and the fourth motion vector ({right arrow over (D)} nn ) being selected from the second motion vector field ({right arrow over (D)} 3 ({right arrow over (x)},n)) using the third motion vector ({right arrow over (D)} n ); and establishing means for establishing the value of the particular pixel on basis of a first value of a first pixel of the first image if the first motion vector difference is smaller than the second motion vector difference and establishing the value of the particular pixel on basis of a second value of a second pixel of the second image if the second motion vector difference is smaller than the first motion vector difference.

7

7. An image processing apparatus comprising: receiving means for receiving a signal corresponding to a sequence of video images; motion estimation means for estimating a first motion vector field for a first one of the video images and a second motion vector field for a second one of the video images; and a pixel value determining unit for determining a value for a particular pixel of a particular image being temporarily located intermediate the first one of the video images and the second one of the video images, the pixel value determining unit comprising: first computing means for computing a first motion vector difference on basis of a first ({right arrow over (D)} p ) and second ({right arrow over (D)} pp ) motion vector of a first motion vector field ({right arrow over (D)} 3 ({right arrow over (x)},n−1)) corresponding to the first image, the first motion vector ({right arrow over (D)} p ) being selected from the first motion vector field ({right arrow over (D)} 3 ({right arrow over (x)},n−1)) on basis of a particular spatial position ({right arrow over (x)}) of the particular pixel and a particular motion vector ({right arrow over (D)} c ) being estimated for the particular pixel and the second motion vector ({right arrow over (D)} pp ) being selected from the first motion vector field ({right arrow over (D)} 3 ({right arrow over (x)},n−1)) using the first motion vector ({right arrow over (D)} p ); second computing means for computing a second motion vector difference on basis of a third ({right arrow over (D)} n ) and fourth ({right arrow over (D)} nn ) motion vector of a second motion vector field ({right arrow over (D)} 3 ({right arrow over (x)},n)) corresponding to the second image, the third motion vector ({right arrow over (D)} n ) being selected from the second motion vector field ({right arrow over (D)} 3 ({right arrow over (x)},n)) on basis of the particular spatial position ({right arrow over (x)}) of the particular pixel and the particular motion vector ({right arrow over (D)} c ) being estimated for the particular pixel and the fourth motion vector ({right arrow over (D)} nn ) being selected from the second motion vector field ({right arrow over (D)} 3 ({right arrow over (x)},n)) using the third motion vector ({right arrow over (D)} n ); establishing means for establishing the value of the particular pixel on basis of a first value of a first pixel of the first one of the video images if the first motion vector difference is smaller than the second motion vector difference and establishing the value of the particular pixel on basis of a second value of a second pixel of the second one of the video images if the second motion vector difference is smaller than the first motion vector difference.

8

8. An image processing apparatus as claimed in claim 7 , further comprising a display device for displaying the output images.

9

9. An image processing apparatus as claimed in claim 8 , being a TV.

10

10. A computer program product embodied on a computer-readable medium to be loaded by a computer arrangement, comprising instructions to determine a value for a particular pixel of a particular image being temporarily located intermediate a first image and a second image, the computer program product, after being loaded providing said processing means with the capability to carry out: computing a first motion vector difference on basis of a first ({right arrow over (D)} p ) and second ({right arrow over (D)} pp ) motion vector of a first motion vector field ({right arrow over (D)} 3 ({right arrow over (x)},n−1)) corresponding to the first image, the first motion vector ({right arrow over (D)} p ) being selected from the first motion vector field ({right arrow over (D)} 3 ({right arrow over (x)},n−1)) on basis of a particular spatial position ({right arrow over (x)}) of the particular pixel and a particular motion vector ({right arrow over (D)} c ) being estimated for the particular pixel and the second motion vector ({right arrow over (D)} pp ) being selected from the first motion vector field ({right arrow over (D)} 3 ({right arrow over (x)},n−1)) using the first motion vector ({right arrow over (D)} p ); computing a second motion vector difference on basis of a third ({right arrow over (D)} n ) and fourth ({right arrow over (D)} nn ) motion vector of a second motion vector field ({right arrow over (D)} 3 ({right arrow over (x)},n)) corresponding to the second image, the third motion vector ({right arrow over (D)} n ) being selected from the second motion vector field ({right arrow over (D)} 3 ({right arrow over (x)},n)) on basis of the particular spatial position ({right arrow over (x)}) of the particular pixel and the particular motion vector ({right arrow over (D)} c ) being estimated for the particular pixel and the fourth motion vector ({right arrow over (D)} nn ) being selected from the second motion vector field ({right arrow over (D)} 3 ({right arrow over (x)},n)) using the third motion vector ({right arrow over (D)} n ); and establishing the value of the particular pixel on basis of a first value of a first pixel of the first image if the first motion vector difference is smaller than the second motion vector difference and establishing the value of the particular pixel on basis of a second value of a second pixel of the second image if the second motion vector difference is smaller than the first motion vector difference.

Classification Codes (CPC)

Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.

Patent Metadata

Filing Date

August 23, 2004

Publication Date

May 19, 2009

Want to explore more patents?

Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.

Citation & reuse

Analysis on this page is generated by Patentable — an AI-powered patent intelligence platform. AI-generated summaries, explanations, and analysis may be reused with attribution and a visible link back to the canonical URL below. Patent abstracts and claims are USPTO public domain.

Cite as: Patentable. “Temporal interpolation of a pixel on basis of occlusion detection” (US-7536031). https://patentable.app/patents/US-7536031

© 2026 Patentable. All rights reserved.

Patentable is a research and drafting-assistant tool, not a law firm, and does not provide legal advice. Documents we generate are drafts for review by a licensed patent attorney.

Temporal interpolation of a pixel on basis of occlusion detection — Rimmert Bart Wittebrood | Patentable