Methods and apparatus, including computer program products, for processing a stream of image frames captured by a camera system. When an image frame from the stream of image frames is dropped, a current camera movement is determined. A substitute image frame for the dropped image frame is generated. The substitute image frame comprises a reference to a previous image frame and includes one or more motion vectors estimated solely based on the determined current camera movement. Remaining image frames in the stream of image frames are encoded and the substitute image frame is inserted at the place of the dropped image frame in the stream of encoded image frames.
Legal claims defining the scope of protection, as filed with the USPTO.
2. The method of claim 1, wherein the current camera movement is determined based on readings from one or more of: a gyroscope and a motor in the camera system.
3. The method of claim 2, wherein the current camera movement is determined by comparing current gyroscope and motor readings with corresponding gyroscope and motor readings for a previous image frame.
4. The method of claim 3, wherein the previous image frame is the most recent previous image frame.
5. The method of claim 1, wherein the one or more motion vectors comprise a single global motion vector for the entire substitute image frame.
6. The method of claim 1, wherein the motion vectors comprise a plurality of motion vectors, each of which represents the motion of a block of pixels in the substitute image frame.
7. The method of claim 6, wherein the plurality of motion vectors represent the motion of one or more interesting portions in the substitute image frame.
8. The method of claim 1, wherein the substitute image frame is a one of: a forward predicted image frame, P-image frame, and bidirectionally predicted image frame, B-image frame.
9. The method of claim 1, wherein the camera system is one of: a Pan Tilt Zoom, PTZ, camera and a Body Worn Camera, BWC.
10. The method of claim 1, wherein the stream of image frames is a live view stream of image frames and wherein the method further comprises: simultaneously capturing a recording stream of image frames, wherein the recording stream of image frames does not include any substitute image frames.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
October 11, 2021
July 23, 2024
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.