Legal claims defining the scope of protection, as filed with the USPTO.
1. An image processing method, comprising: performing brightness adjustment on each frame of image in a video; performing offset compensation on each frame of the image after the brightness adjustment; and performing time domain filtering on pixels of each frame of the image after the offset compensation; wherein the method further comprises: zooming out each whole frame of image after the brightness adjustment automatically; obtaining zoomed out image of each frame after multiple processing by matching, second time domain filtering, moving object determining, image fusion, spatial each whole frame of zoomed out image; obtaining a difference diagram according to the zoomed out image of each frame after multiple processing and the zoomed out image of each frame after the brightness adjustment automatically; obtaining an enlarged difference diagram by zooming in the difference diagram to the same size as the zoomed out image of each frame after the brightness adjustment automatically; obtaining a final result by superimposing the enlarged difference diagram on each frame image after the brightness adjustment automatically.
2. The image processing method as claimed in claim 1 , wherein performing the brightness adjustment on each frame of the image in the video comprising: performing the following steps on each frame of the image: calculating a color average value of each of three color channels respectively, the three color channels referring to a red R channel, a green G channel and a blue B channel; and performing first time domain filtering on each of three color channels according to the color average value corresponding to each of three color channels by using a preset first filtering scheme.
3. The image processing method as claimed in claim 1 , wherein performing the offset compensation on each frame of the image after the brightness adjustment comprising: acquiring an offset between any two adjacent frames of images in the video after the brightness adjustment, and compensating the offset by using a preset offset compensation algorithm to make image contents of any two adjacent frames of images in the video at the same image coordinate be consistent with each other.
4. The image processing method as claimed in claim 1 , wherein performing the time domain filtering on the pixels of each frame of the image after the offset compensation comprising: performing second time domain filtering on each pixel in each frame of the image by a preset second filtering scheme to linearly superimpose a current frame of image and a previous frame of image preceding the current frame of image.
5. The image processing method as claimed in claim 3 , wherein the method further comprises: determining whether at least one moving object is contained in each frame of the image after performing the offset compensation on each frame of the image after the brightness adjustment.
6. The image processing method as claimed in claim 5 , wherein determining whether the at least one moving object is contained in each frame of the image comprising: dividing a current frame of image and a previous frame of image into blocks separately to obtain a plurality of first block images; calculating a difference between a first block image corresponding to the current frame of the image and a first block image corresponding to the previous frame of the image separately according to a preset difference calculation algorithm; comparing the difference between the two first block images with a preset difference threshold value; determining, when the difference between the two first block images is greater than or equal to the preset difference threshold value, that the two first block images are non-similar, and determining that image regions in the two first block images corresponding to the current frame of the image and the previous frame of the image contain at least one moving object; and determining, when the difference between the two first block images is less than the preset difference threshold value, that the two first block images are similar, and determining that the image regions in the two first block images corresponding the current frame of the image and the previous frame of the image do not contain any moving object.
7. The image processing method as claimed in claim 3 , wherein acquiring the offset between any two adjacent frames of images in the video after the brightness adjustment comprising: dividing a current frame of image after the brightness adjustment and a previous frame of image after the brightness adjustment separately into a plurality of second block images; calculating an offset between a second block image corresponding to the current frame of the image and a second block image corresponding to the previous frame of the image; and eliminating at least one second block image comprising the at least one moving object from the plurality of second block images, and taking an average value of offsets of the remaining second block images as an offset between the current frame of the image and the previous frame of the image.
8. The image processing method as claimed in claim 6 , wherein the method further comprises: after determining that any frame of image contains at least one moving object, generating a mask image of this frame of the image, wherein a pixel value of each pixel of an image region comprising the at least one moving object in the mask image is 1, and the pixel value of each pixel of another image region not comprising the at least one moving object is 0; and fusing, according to a preset fusion algorithm, at least one frame of image of which pixels are processed by time domain filtering and at least one frame of image of which pixels are not processed by the time domain filtering by using the mask image to preserve the image region comprising the at least one moving object.
9. The image processing method as claimed in claim 8 , wherein the method further comprises: performing spatial filtering on each frame of fused image.
10. An image processing device comprising a processor and a computer readable storage medium, the computer readable storage medium storing instructions, wherein instructions are executed by the processor to implement the image processing method as claimed in claim 1 .
11. The image processing method as claimed in claim 2 , wherein the preset first filtering scheme comprises one of the followings: a finite impulse response filter or an infinite impulse response filter.
12. The image processing method as claimed in claim 3 , wherein an expression of making the image contents of any two adjacent frames of images in the video at the same image coordinate be consistent with each other refers to that positions of regions having the same content in any two adjacent frames of images are the same, or an offset between the positions of regions having the same content in any two adjacent frames of images is less than or equal to a preset offset threshold, at the same image coordinate between any two adjacent frames of images.
13. The image processing method as claimed in claim 3 , wherein the preset offset compensation algorithm comprises at least one of a template matching algorithm and a feature point based matching algorithm.
14. The image processing method as claimed in claim 13 , wherein the template matching algorithm comprises the following steps: intercepting a region of the same size as a template image from a reference image to take this region as an interception image; and comparing the template image with the interception image to calculate an image difference between the template image and the interception image.
15. The image processing method as claimed in claim 14 , wherein a range of a starting position of the interception image in the reference image is manually set to calculate the image difference between each interception image and the template image, and the starting position of the interception image corresponding to the smallest difference is taken as the offset of the template image with respect to the reference image.
16. The image processing method as claimed in claim 13 , wherein the feature point based matching algorithm comprises the following steps: extracting feature points in the two frames of images to be matched separately; obtaining the feature point matching pairs by the feature point matching algorithm; and calculating the offset between two frames of images according to the feature point matching pairs.
17. The image processing method as claimed in claim 16 , wherein the method further comprises: obtaining optical flows of the feature points according to the these feature point pairs; and eliminating at least one abnormal optical flow of the feature points and averaging the remaining optical flows of the feature points as an offset of an entire image.
18. The image processing method as claimed in claim 4 , wherein the preset second filtering scheme comprises one of the followings: a finite impulse response filter or an infinite impulse response filter.
19. The image processing method as claimed in claim 8 , wherein the mask image is a binary image.
20. The image processing method as claimed in claim 8 , wherein the preset fusion algorithm comprises: a Laplace Pyramid Fusion Algorithm.
Unknown
June 28, 2022
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.