Target-Less Auto-Alignment of Image Sensors in a Multi-Camera System

1. A computer-implemented method for determining a pixel shift between an image pair captured by image sensors, the method comprising: accessing a first image and a second image of the image pair, the first and second images comprising image data representative of an overlapping field of view between the image sensors; performing a smoothing operation on the first image and the second image to produce smoothed image data; determining edge magnitude data and edge phase data from the smoothed image data; identifying, by one or more processors, one or more edges in the image data based at least in part on the edge magnitude data and the edge phase data of the smoothed image data; and determining a pixel shift between the image pair by matching a first edge in the first image with a second edge in the second image using determined edge lengths for the identified one or more edges.

2. The method of claim 1 , wherein identifying the one or more edges in the image data comprises: identifying a first set of smoothed image data having determined edge magnitude greater than an edge magnitude threshold; identifying a second set of smoothed image data having determined edge phase within a threshold of a target edge phase value; and identifying the one or more edges from image data in both the first set of smoothed image data and the second set of smoothed image data.

3. The method of claim 2 , wherein the identified one or more edges are substantially perpendicular to a rolling shutter direction of the image sensors, and the target edge phase value corresponds to the rolling shutter direction.

4. The method of claim 1 , wherein the image sensors have a rolling shutter direction, the method further comprising: before determining the edge magnitude data and edge phase data, compressing the first and second images perpendicular to the rolling shutter direction without compressing the first and second images along the rolling shutter direction.

5. The method of claim 1 , wherein the first image and the second image are downsampled before the smoothing operation is performed.

6. The method of claim 1 , further comprising cropping the first and second images by removing image data corresponding to outer borders of the first and second images prior to determining the edge magnitude data and the edge phase data.

7. The method of claim 1 , further comprising calibrating the image sensors using the determined pixel shift.

8. A non-transitory computer readable medium comprising instructions for determining a pixel shift between an image pair captured by image sensors, the instructions executable by a processor, the instructions comprising instructions for: accessing a first image and a second image of the image pair, the first and second images comprising image data representative of an overlapping field of view between the image sensors; performing a smoothing operation on the first image and the second image to produce smoothed image data; determining edge magnitude data and edge phase data from the smoothed image data; identifying, by one or more processors, one or more edges in the image data based at least in part on the edge magnitude data and the edge phase data of the smoothed image data; and determining a pixel shift between the image pair by matching a first edge in the first image with a second edge in the second image using determined edge lengths for the identified one or more edges.

9. The computer-readable medium of claim 8 , wherein identifying the one or more edges in the image data comprises: identifying a first set of smoothed image data having determined edge magnitude greater than an edge magnitude threshold; identifying a second set of smoothed image data having determined edge phase within a threshold of a target edge phase value; and identifying the one or more edges from image data in both the first set of smoothed image data and the second set of smoothed image data.

10. The computer-readable medium of claim 9 , wherein the identified one or more edges are substantially perpendicular to a rolling shutter direction of the image sensors, and the target edge phase value corresponds to the rolling shutter direction.

11. The computer-readable medium of claim 8 , wherein the image sensors have a rolling shutter direction, wherein the instructions further comprise instructions for: before determining the edge magnitude data and the edge phase data, compressing the first and second images perpendicular to the rolling shutter direction without compressing the first and second images along the rolling shutter direction.

12. The computer-readable medium of claim 8 , wherein the instructions further comprise instructions for calibrating the image sensors using the determined pixel shift.

13. A camera system comprising at least one processor, an image sensor, and a non-transitory computer readable medium comprising instructions for determining a pixel shift between an image pair captured by image sensors including the image sensor, the instructions executable by the at least one processor, the instructions comprising instructions for: accessing a first image and a second image of the image pair, the first and second images comprising image data representative of an overlapping field of view between the image sensors; performing a smoothing operation on the first image and the second image to produce smoothed image data; determining edge magnitude data and edge phase data from the smoothed image data; identifying, by one or more processors, one or more edges in the image data based at least in part on the edge magnitude data and the edge phase data of the smoothed image data; determining a pixel shift between the image pair by matching a first edge in the first image with a second edge in the second image using determined edge lengths for the identified one or more edges.

14. The camera system of claim 13 , wherein identifying the one or more edges in the image data comprises: identifying a first set of smoothed image data having determined edge magnitude greater than an edge magnitude threshold; identifying a second set of smoothed image data having determined edge phase within a threshold of a target edge phase value; and identifying the one or more edges from image data in both the first set of smoothed image data and the second set of smoothed image data.

15. The camera system of claim 14 , wherein the identified one or more edges are substantially perpendicular to a rolling shutter direction of the image sensors, and the target edge phase value corresponds to the rolling shutter direction.

16. The camera system of claim 13 , wherein the image sensors have a rolling shutter direction, wherein the instructions further comprise instructions for: before determining the edge magnitude data and the edge phase data, compressing the first and second images perpendicular to the rolling shutter direction without compressing the first and second images along the rolling shutter direction.

17. The camera system of claim 13 , wherein the instructions further comprise instructions for calibrating the image sensors using the determined pixel shift.