Methods and systems for reconstructing a high frame rate high resolution video

1. A controlling method of an image device, comprising: capturing a plurality of parity fields in a Bayer domain from an image sensor of the image device; and generating a video by reconstructing the plurality of parity fields by using one of a pre-Image Signal Processor (ISP) Flexible Sub-sampled Readout (FSR) reconstruction and a post-ISP FSR reconstruction based on bandwidth capacity of an ISP of the image device, wherein the generating further comprises: reconstructing the plurality of parity fields by using the pre-ISP FSR reconstruction in response to bandwidth of the ISP of the image device being unable to process the plurality of parity fields which have a frame rate that is scaled up by a scaling factor, detecting a user event for recording full frame Bayer data corresponding to a video captured by the image sensor, fetching, from a circular memory, a first parity field set corresponding to a plurality of parity fields stored in a time unit which is predetermined before the user event and a second parity field set corresponding to a plurality of parity fields stored in a time unit which is predetermined after the user event, reconstructing full frame Bayer data by using the first parity field set and the second parity field set, resizing the full frame Bayer data reconstructed in ISP bandwidth, and generating full frame YUV data by processing the resized full frame Bayer data.

2. The method of claim 1 , wherein the generating of the video comprises generating the plurality of parity fields which respectively have parity numbers by using a zig-zag sampling pattern, wherein a frame rate of each of the plurality of parity fields is scaled up in accordance with a scaling factor, and a frame size of each of the plurality of parity fields is scaled down in accordance with the scaling factor, and wherein the scaling factor corresponds to a number of the plurality of parity fields.

3. The method of claim 1 , further comprising: storing the plurality of parity fields based on a First-in-First-out (FIFO) mechanism.

4. The method of claim 1 , further comprising: generating a preview video by processing the first parity field set and the second parity field set, wherein the preview video is generated by processing a first parity field included in the first parity field set and a second parity field included in the second parity field set and the first parity field and the second parity field have an identical parity number.

5. The method of claim 1 , wherein the generating, further comprises: reconstructing the plurality of parity fields by using the pre-ISP FSR reconstruction in response to bandwidth of the ISP of the image device not being able to process the plurality of parity fields which have a frame rate that is scaled up by a scaling factor, detecting a user event for recording full frame Bayer data corresponding to a video captured by the image sensor, fetching, from a circular memory, a first parity field set corresponding to a plurality of parity fields stored in a time unit which is predetermined before the user event and a second parity field set corresponding to a plurality of parity fields stored in a time unit which is predetermined after the user event, demosaicing the first parity field set and the second parity field set to generate demosaiced data, generating YUV data of which a frame rate and a frame size are identical to a frame rate and a frame size of the plurality of parity fields from the demosaiced data, and generating full frame YUV data by reconstructing the YUV data.

6. The method of claim 5 , further comprising: generating a preview video by processing the demosaiced data.

7. The method of claim 1 , wherein the capturing comprises capturing a plurality of parity fields by sampling a part of full frame Bayer data which corresponds to a Region of Interest (ROI) from among full frame Bayer data acquired from the image sensor of the image device.

8. An image device, comprising: an image sensor configured to capture a plurality of parity fields in a Bayer domain; and an FRS reconstruction unit configured to generate a video by reconstructing the plurality of parity fields by using one of a pre-TSP FSR reconstruction and a post-SP FSR reconstruction based on bandwidth capacity of an ISP of the image device, wherein the FRS reconstruction unit, in response to detecting a user event for recording full frame Bayer data corresponding to a video captured by the image sensor: reconstructs the plurality of parity fields by using the pre-ISP FSR reconstruction, in response to bandwidth of the ISP of the image device being unable to process the plurality of parity fields which have a frame rate that is scaled up by a scaling factor, fetches, from the circular memory, a first parity field set corresponding to a plurality of parity fields stored in a time unit which is predetermined before the user event and a second parity field set corresponding to a plurality of parity fields stored in a time unit which is predetermined after the user event, reconstructs full frame Bayer data by using the first parity field set and the second parity field set, resizes the full frame Bayer data reconstructed in ISP bandwidth, and generates full frame YUV data by processing the resized full frame Bayer data.

9. The device of claim 8 , wherein the FRS reconstruction unit generates the plurality of parity fields which respectively have parity numbers by using a zig-zag sampling pattern, wherein a frame rate of each of the plurality of parity fields is scaled up in accordance with a scaling factor, and a frame size of each of the plurality of parity fields is scaled down in accordance with the scaling factor, and wherein the scaling factor corresponds to a number of the plurality of parity fields.

10. The device of claim 8 , further comprising: a circular memory configured to store the plurality parity fields based on a FIFO mechanism.

11. The device of claim 10 , wherein the FRS reconstruction unit, in response to detecting a user event for recording full frame Bayer data corresponding to a video captured by the image sensor: reconstructs the plurality of parity fields by using the pre-ISP FSR reconstruction in response to bandwidth of the ISP of the image device not being able to process the plurality of parity fields which have a frame rate that is scaled up by a scaling factor, fetches, from the circular memory, a first parity field set corresponding to a plurality of parity fields stored in a time unit which is predetermined before the user event and a second parity field set corresponding to a plurality of parity fields stored in a time unit which is predetermined after the user event, demosaics the first parity field set and the second parity field set to generate demosaiced data, generates YUV data of which a frame rate and a frame size are identical to a frame rate and a frame size of the plurality of parity fields from the demosaiced data, and generates full frame YUV data by reconstructing the YUV data.

12. The device of claim 11 , wherein the FRS reconstruction unit generates a preview video by processing the demosaiced data.

13. The device of claim 8 , wherein the FRS reconstruction unit generates a preview video by processing the first parity field set and the second parity field set, and wherein the preview video is generated by processing a first parity field included in the first parity field set and a second parity field included in the second parity field set and the first parity field and the second parity field have an identical parity number.