Legal claims defining the scope of protection, as filed with the USPTO.
1. A computer-implemented method for reconstructing a video frame, the method comprising: accessing a modified reference frame from a video, the modified reference frame temporally proximate to a degraded frame in the video, the modified reference frame including a watermark representative of a low-resolution version of the degraded frame; generating a transformed image frame by converting the modified reference frame into a set of image coefficients in a frequency domain; extracting a set of watermark coefficients representative of the watermark; converting the set of watermark coefficients into a first approximation of the degraded frame; generating a second approximation of the degraded frame using a motion vector between the modified reference frame and the first approximation of the degraded frame; and storing the second approximation of the degraded frame in place of the degraded frame, the storing the second approximation of the degraded frame comprising: generating a third approximation of the degraded frame by modifying the second approximation of the degraded frame using a set of low-frequency coefficients determined from the set of watermark coefficients, the generating of the third approximation of the degraded frame comprising: generating a set of reconstructed frame coefficients by converting the second approximation of the degraded image into the frequency domain; identifying a subset of reconstructed frame coefficients corresponding to low-frequency coefficients; modifying the set of reconstructed frame coefficients by replacing the subset of reconstructed frame coefficients with the set of low-frequency coefficients determined from the watermark coefficients; and generating the third approximation of the degraded frame by converting the modified set of reconstructed frame coefficients into the spatial domain; and storing the third approximation of the degraded frame in place of the degraded frame.
2. The method of claim 1 , wherein the extracting of the set of watermark coefficients comprises: obtaining a watermark position indicator specifying locations of the set of watermark coefficients among the set of image coefficients; and extracting the set of watermark coefficients from coefficients at the locations among the set of image coefficients.
3. The method of claim 1 , wherein the extracting of the set of watermark coefficients comprises: extracting a plurality of versions of the watermark coefficients from the transformed image frame; and determining the set of watermark coefficients from a measure of central tendency across the plurality of versions of the watermark coefficients.
4. The method of claim 1 , wherein the generating of the second approximation of the degraded frame comprises: determining the motion vector based on a comparison between the modified reference frame and the first approximation of the degraded frame; and generating the second approximation of the degraded frame by applying the motion vector to the modified reference frame.
5. The method of claim 1 , wherein: the generating of the set of reconstructed frame coefficients comprises applying a linear transform to one or more properties of an array of pixels representing the second approximation of the degraded image; and the generating of the third approximation of the degraded frame comprises applying an inverse of the linear transform to the modified set of reconstructed frame coefficients.
6. The method of claim 1 , further comprising determining the motion vector based on a comparison between the modified reference frame and the first approximation of the degraded frame; wherein the generating of the second approximation of the degraded frame using the motion vector comprises applying the determined motion vector to the modified reference frame.
7. A non-transitory computer-readable medium comprising a computer program having a plurality of instructions for reconstructing a video frame, the plurality of instructions being executable by at least one processor apparatus to perform steps comprising: accessing a modified reference frame from a video, the modified reference frame temporally proximate to a degraded frame in the video, the modified reference frame including a watermark representative of a low-resolution version of the degraded frame; generating a transformed image frame by converting the modified reference frame into a set of image coefficients in a frequency domain; extracting a set of watermark coefficients representative of the watermark; converting the set of watermark coefficients into a first approximation of the degraded frame; generating a second approximation of the degraded frame using a motion vector between the modified reference frame and the first approximation of the degraded frame; and storing the second approximation of the degraded frame in place of the degraded frame in the computer-readable medium; wherein the storing of the second approximation of the degraded frame comprises: generating a third approximation of the degraded frame by modifying the second approximation of the degraded frame using a set of low-frequency coefficients determined from the set of watermark coefficients; and storing the third approximation of the degraded frame in place of the degraded frame; and wherein the generating of the third approximation of the degraded frame comprises: generating a set of reconstructed frame coefficients by converting the second approximation of the degraded image into the frequency domain; identifying a subset of reconstructed frame coefficients corresponding to low-frequency coefficients; modifying the set of reconstructed frame coefficients by replacing the subset of reconstructed frame coefficients with the set of low-frequency coefficients determined from the watermark coefficients; and generating the third approximation of the degraded frame by converting the modified set of reconstructed frame coefficients into the spatial domain.
8. The computer-readable medium of claim 7 , wherein the extracting of the set of watermark coefficients comprises: obtaining a watermark position indicator specifying locations of the set of watermark coefficients among the set of image coefficients; and extracting the set of watermark coefficients from coefficients at the locations among the set of image coefficients.
9. The computer-readable medium of claim 7 , wherein the extracting of the set of watermark coefficients comprises: extracting a plurality of versions of the watermark coefficients from the transformed image frame; and determining the set of watermark coefficients from a measure of central tendency across the plurality of versions of the watermark coefficients.
10. The computer-readable medium of claim 7 , wherein the generating of the second approximation of the degraded frame comprises: determining the motion vector based on a comparison between the modified reference frame and the first approximation of the degraded frame; and generating the second approximation of the degraded frame by applying the motion vector to the modified reference frame.
11. The computer-readable medium of claim 7 , wherein: the generating of the set of reconstructed frame coefficients comprises applying a linear transform to one or more properties of an array of pixels representing the second approximation of the degraded image; and the generating of the third approximation of the degraded frame comprises applying an inverse of the linear transform to the modified set of reconstructed frame coefficients.
12. The computer-readable medium of claim 7 , wherein the plurality of instructions are further executable by the at least one processor apparatus to perform steps comprising determining the motion vector based on a comparison between the modified reference frame and the first approximation of the degraded frame; wherein the generating of the second approximation of the degraded frame using the motion vector comprises applying the determined motion vector to the modified reference frame.
13. A camera apparatus configured to reconstruct a video frame, the camera apparatus comprising: an image sensor configured to capture a video, the video comprising a plurality of frames captured by the image sensor; a processor apparatus; a non-transitory computer-readable storage medium having a computer program thereon, the computer program comprising a plurality of instructions configured to, when executed by the processor apparatus, cause the processor apparatus to: access a modified reference frame from the video, the modified reference frame being temporally proximate to a degraded frame in the video, the modified reference frame comprising a watermark representative of a low-resolution version of the degraded frame; generate a transformed image frame, the generation of the transformed image frame comprising a conversion of the modified reference frame into a set of image coefficients in a frequency domain; extract a set of watermark coefficients representative of the watermark; convert the set of watermark coefficients into a first approximation of the degraded frame; generate a second approximation of the degraded frame via a motion vector between the modified reference frame and the first approximation of the degraded frame; and store the second approximation of the degraded frame in place of the degraded frame; wherein the storage of the second approximation of the degraded frame comprises: generation of a third approximation of the degraded frame by modifying the second approximation of the degraded frame using a set of low-frequency coefficients determined from the set of watermark coefficients; and storage of the third approximation of the degraded frame in place of the degraded frame, wherein the generation of the third approximation of the degraded frame comprises: generation of a set of reconstructed frame coefficients via conversion of the second approximation of the degraded image into the frequency domain; identification of a subset of reconstructed frame coefficients corresponding to low-frequency coefficients; modification of the set of reconstructed frame coefficients via replacement of the subset of reconstructed frame coefficients with the set of low-frequency coefficients determined from the watermark coefficients; and generation of the third approximation of the degraded frame via conversion the modified set of reconstructed frame coefficients into the spatial domain.
14. The camera apparatus of claim 13 , wherein the extraction of the set of watermark coefficients comprises: obtaining of a watermark position indicator specifying locations of the set of watermark coefficients among the set of image coefficients; and extraction of the set of watermark coefficients from coefficients at the locations among the set of image coefficients.
15. The camera apparatus of claim 13 , wherein the extraction of the set of watermark coefficients comprises: extraction of a plurality of versions of the watermark coefficients from the transformed image frame; and determination of the set of watermark coefficients from a measure of central tendency across the plurality of versions of the watermark coefficients.
16. The camera apparatus of claim 13 , wherein the generation of the second approximation of the degraded frame comprises: determination of the motion vector based on a comparison between the modified reference frame and the first approximation of the degraded frame; and generation of the second approximation of the degraded frame by application of the motion vector to the modified reference frame.
17. The camera apparatus of claim 13 , wherein: the generation of the set of reconstructed frame coefficients comprises an application of a linear transform to one or more properties of an array of pixels representing the second approximation of the degraded image; and the generation of the third approximation of the degraded frame comprises an application of an inverse of the linear transform to the modified set of reconstructed frame coefficients.
18. The camera apparatus of claim 13 , wherein the plurality of instructions are further configured to, when executed by the processor apparatus, cause the processor apparatus to determine the motion vector based on a comparison between the modified reference frame and the first approximation of the degraded frame; wherein the generation of the second approximation of the degraded frame via the motion vector comprises an application of the determined motion vector to the modified reference frame.
19. The camera apparatus of claim 13 , further comprising a lens and a focus controller, the focus controller being configured to control operations of the lens.
20. The camera apparatus of claim 13 , further comprising an interface configured to perform data communication with an external computerized device via a wired or wireless network.
21. A computerized apparatus configured to reconstruct a video frame, the apparatus comprising: means for accessing a modified reference frame from a video, the modified reference frame temporally proximate to a degraded frame in the video, the modified reference frame including a watermark representative of a low-resolution version of the degraded frame; means for generating a transformed image frame via conversion of the modified reference frame into a set of image coefficients in a frequency domain; means for extracting a set of watermark coefficients representative of the watermark; means for converting the set of watermark coefficients into a first approximation of the degraded frame; means for generating a second approximation of the degraded frame via a motion vector between the modified reference frame and the first approximation of the degraded frame; and means for storing the second approximation of the degraded frame in place of the degraded frame; wherein the means for storing of the second approximation of the degraded frame comprises: means for generating a third approximation of the degraded frame by modifying the second approximation of the degraded frame via a set of low-frequency coefficients determined from the set of watermark coefficients; and means for storing the third approximation of the degraded frame in place of the degraded frame; and wherein the means for generating of the third approximation of the degraded frame comprises: means for generating a set of reconstructed frame coefficients via conversion of the second approximation of the degraded image into the frequency domain; means for identifying a subset of reconstructed frame coefficients corresponding to low-frequency coefficients; means for modifying the set of reconstructed frame coefficients via replacement of the subset of reconstructed frame coefficients with the set of low-frequency coefficients determined from the watermark coefficients; and means for generating the third approximation of the degraded frame via conversion of the modified set of reconstructed frame coefficients into the spatial domain.
22. The computerized apparatus of claim 21 , wherein the means for extracting the set of watermark coefficients comprises: means for obtaining a watermark position indicator configured to specify locations of the set of watermark coefficients among the set of image coefficients; and means for extracting the set of watermark coefficients from coefficients at the locations among the set of image coefficients.
23. The computerized apparatus of claim 21 , wherein the means for extracting the set of watermark coefficients comprises: means for extracting a plurality of versions of the watermark coefficients from the transformed image frame; and means for determining the set of watermark coefficients from a measure of central tendency across the plurality of versions of the watermark coefficients.
24. The computerized apparatus of claim 21 , wherein the means for generating the second approximation of the degraded frame comprises: means for determining the motion vector based on a comparison between the modified reference frame and the first approximation of the degraded frame; and means for generating the second approximation of the degraded frame via application of the motion vector to the modified reference frame.
25. The computerized apparatus of claim 21 , wherein: the means for generating the set of reconstructed frame coefficients comprises an application of a linear transform to one or more properties of an array of pixels representing the second approximation of the degraded image; and the means for generating the third approximation of the degraded frame comprises an application of an inverse of the linear transform to the modified set of reconstructed frame coefficients.
26. The computerized apparatus of claim 19 , wherein the apparatus further comprises means for determining the motion vector based on a comparison between the modified reference frame and the first approximation of the degraded frame; wherein the means for generating of the second approximation of the degraded frame using the motion vector comprises means for applying the determined motion vector to the modified reference frame.
Unknown
January 23, 2018
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.