9177381

Depth Estimate Determination, Systems and Methods

PublishedNovember 3, 2015
Assigneenot available in USPTO data we have
Technical Abstract

Patent Claims
31 claims

Legal claims defining the scope of protection, as filed with the USPTO.

1

1. A method for determining a depth estimate for at least one pixel in a reference image, the reference image being one of a plurality of images of a three dimensional scene, the method including: a) providing access to a depth analysis engine comprising a device interface; b) obtaining, by the depth analysis engine, a plurality of images including a reference image representative of a scene via the device interface, wherein each of the plurality of images comprises a different perspective of the scene; c) determining first depth estimates for first pixels in a first resolution of the reference image using a parallax method, the first resolution being a lowest resolution; d) determining, by the depth analysis engine, current depth estimates for current pixels in a current resolution of the reference image by using previous depth estimates for equivalent previous pixels in a previous resolution of the reference image, the previous resolution being lower than the current resolution; and e) deriving, by the depth analysis engine, a refined depth estimate by refining the current depth estimate for at least one current pixel via: i) determining a plurality of candidate depths at least in part using the current depth estimates of the neighboring pixels and not that of the current pixel; ii) determining consistency scores for at least some of the candidate depths, the consistency score being indicative of the similarity of the current pixel with at least one candidate pixel in a first image and a second, different image from the plurality of images; iii) updating the current depth estimate of the current pixel using the consistency scores; and f) configuring a device to initiate an action as a function of the refined current depth estimate.

2

2. A method according to claim 1 , wherein the method includes, refining the current depth estimate by: a) selecting a candidate depth having an optimum consistency score; and b) refining the current depth estimate using the selected candidate depth.

3

3. A method according to claim 2 , wherein the method includes, refining the current depth estimate by replacing the current depth estimate with: a) the selected candidate depth; and b) a depth interpolated from the selected candidate depth and two or more neighboring candidate depths using the respective consistency scores.

4

4. A method according to claim 1 , wherein the method includes, determining the plurality of candidate depths by: a) comparing the current pixel to a plurality of neighboring current pixels; b) selecting at least one neighboring current pixel referenced on a similarity to the current pixel; and c) determining the candidate depths to include the current depth estimates of the current pixel and the at least one selected neighboring current pixel.

5

5. A method according to claim 4 , wherein the method includes, determining the plurality of candidate depths to include the current depth estimates and adjacent depth estimates of the current pixel and the at least one selected neighboring current pixel.

6

6. A method according to claim 1 , wherein the previous and current depth estimates are assigned to previous and current depth planes respectively, said previous and current depth planes defining a number of previous depth planes and a number of current depth planes wherein the number of current depth planes being greater than the number of previous depth planes.

7

7. A method according to claim 1 , wherein the candidate depths are at least one of: a) a plurality of discrete depths; and b) a depth range.

8

8. A method according to claim 1 , wherein the method includes iteratively refining the current depth estimates of current pixels in the current resolution of the reference image.

9

9. A method according to claim 8 , wherein the method includes iteratively refining the current depth estimates by: a) refining the current depth estimate of a plurality of current pixels; and b) further refining the current depth estimate of at least one of the plurality of current pixels.

10

10. A method according to claim 1 , wherein a current pixel is equivalent to a previous pixel if the current and previous pixels are at the same location in the reference image.

11

11. A method according to claim 1 , wherein the method includes, determining the first depth estimates using a global parallax method.

12

12. A method according to claim 1 , wherein the method includes, refining the current depth estimates for current resolutions of the image using a parallax local method, wherein the local method is performed for limited candidate depths determined from previous depth estimates of equivalent previous pixels from a previous lower resolution of the reference image.

13

13. A method according to claim 1 , wherein the method includes: a) in an electronic processing device operating as the depth analysis engine, determining the current depth estimates; and b) in the electronic processing device operating as the depth analysis engine, refining the current depth estimate for at least one current pixel by: i) selecting the plurality of candidate depths; ii) calculating the consistency scores; and iii) updating the current depth estimate of the current pixel.

14

14. A method according to claim 13 , wherein the method includes, storing in a store, at least one of: a) image data; and b) depth estimate data.

15

15. A method according to claim 14 , wherein the method includes updating a current depth estimate by updating depth estimate data stored in a store.

16

16. The method of claim 1 , wherein the at least one candidate pixel in the first image and the second image each corresponds to a neighboring current pixel from the at least one current pixel associated with a candidate depth from the at least some of the candidate depths.

17

17. A method for determining a depth estimate for at least one pixel in a reference image, the reference image being one of a plurality of images of a three dimensional scene, the method including: a) providing access to a depth analysis engine comprising a device interface; b) obtaining, by the depth analysis engine, a plurality of images including a reference image representative of a scene via the device interface, wherein each of the plurality of images comprises a different perspective of the scene; c) determining, by the depth analysis engine, current depth estimates for current pixels in a current resolution of the reference image by successively increasing current resolutions of the reference image using previous depth estimates of equivalent previous pixels from a previous lower resolution of the reference image; and d) deriving, by the depth analysis engine, a refined depth estimate by refining the current depth estimate for at least one current pixel via: i) determining a plurality of candidate depths at least in part using the current depth estimates of the neighboring pixels and not that of the current pixel; ii) determining consistency scores for at least some of the candidate depths, the consistency score being indicative of the similarity of the current pixel with at least one candidate pixel in a first image and a second, different image from the plurality of images; iii) updating the current depth estimate of the current pixel using the consistency scores; and e) configuring a device to initiate an action as a function of the refined current depth estimate.

18

18. A method according to claim 17 , wherein the method includes, refining the current depth estimate by: a) selecting a candidate depth having an optimum consistency score; and b) refining the current depth estimate using the selected candidate depth.

19

19. A method according to claim 18 , wherein the method includes, refining the current depth estimate by replacing the current depth estimate with: a) the selected candidate depth; and b) a depth interpolated from the selected candidate depth and two or more neighboring candidate depths using the respective consistency scores.

20

20. A method according to claim 17 , wherein the method includes, determining the plurality of candidate depths by: a) comparing the current pixel to a plurality of neighboring current pixels; b) selecting at least one neighboring current pixel referenced on a similarity to the current pixel; and c) determining the candidate depths to include the current depth estimates of the current pixel and the at least one selected neighboring current pixel.

21

21. A method according to claim 20 , wherein the method includes, determining the plurality of candidate depths to include the current depth estimates and adjacent depth estimates of the current pixel and the at least one selected neighboring current pixel.

22

22. A method according to claim 17 , wherein the previous and current depth estimates are assigned to previous and current depth planes respectively, said previous and current depth planes defining a number of previous depth planes and a number of current depth planes wherein the number of current depth planes being greater than the number of previous depth planes.

23

23. A method according to claim 17 , wherein the candidate depths are at least one of: a) a plurality of discrete depths; and b) a depth range.

24

24. A method according to claim 17 , wherein the method includes iteratively refining the current depth estimates of current pixels in the current resolution of the reference image.

25

25. A method according to claim 24 , wherein the method includes iteratively refining the current depth estimates by: a) refining the current depth estimate of a plurality of current pixels; and b) further refining the current depth estimate of at least one of the plurality of current pixels.

26

26. A method according to claim 17 , wherein a current pixel is equivalent to a previous pixel if the current and previous pixels are at the same location in the reference image.

27

27. A method according to claim 17 , wherein the method includes, refining the current depth estimates for current resolutions of the image using a parallax local method, wherein the local method is performed for limited candidate depths determined from previous depth estimates of equivalent previous pixels from a previous lower resolution of the reference image.

28

28. A method according to claim 17 , wherein the method includes: a) in an electronic processing device operating as the depth analysis engine, determining the current depth estimates; and b) in the electronic processing device operating as the depth analysis engine, refining the current depth estimate for at least one current pixel by: i) selecting the plurality of candidate depths; ii) calculating the consistency scores; and iii) updating the current depth estimate of the current pixel.

29

29. A method according to claim 28 , wherein the method includes, storing in a store, at least one of: a) image data; and b) depth estimate data.

30

30. A method according to claim 29 , wherein the method includes updating a current depth estimate by updating depth estimate data stored in a store.

31

31. A method according to claim 17 , wherein the at least one candidate pixel in the first image and the second image each corresponds to a neighboring current pixel from the at least one current pixel associated with a candidate depth from the at least some of the candidate depths.

Patent Metadata

Filing Date

Unknown

Publication Date

November 3, 2015

Inventors

David McKinnon

Want to explore more patents?

Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.

Citation & reuse

Analysis on this page is generated by Patentable — an AI-powered patent intelligence platform. AI-generated summaries, explanations, and analysis may be reused with attribution and a visible link back to the canonical URL below. Patent abstracts and claims are USPTO public domain.

Cite as: Patentable. “Depth Estimate Determination, Systems and Methods” (9177381). https://patentable.app/patents/9177381

© 2026 Patentable. All rights reserved.

Patentable is a research and drafting-assistant tool, not a law firm, and does not provide legal advice. Documents we generate are drafts for review by a licensed patent attorney.