A moving image encoding and decoding system reduces compressed moving picture data amounts by producing a prediction signal suitable for moving pictures including dynamic textures. The system includes a moving picture encoding device 1 that includes a block divider 102 receiving a target pixel signal, a prediction signal generator 103 producing a prediction signal, a subtractor 105 producing a differential signal, and a transformer 106 and quantizer 107 producing an encoded differential signal. The encoding device 1 also includes an inverse quantizer 108 and inverse transformer 109 producing a decoded differential signal, an adder 110 producing a reproduction signal, a frame memory 104 storing the reproduction signal as a reference image, and a reference image generator 113. The reference image generator 113 may obtain an observation matrix C by using a pre-existing reference image. The encoding system 1 produces a new reference image y″t+5 based on the observation matrix C and a state vector xt+5, and stores the new reference image in the frame memory 104. The prediction signal generator 103 produces the prediction signal by using at least the new reference image y″t+5.
Legal claims defining the scope of protection, as filed with the USPTO.
1. A moving picture decoding device comprising: a processor; an input section executed by the processor to receive compressed data including an encoded differential signal obtained by prediction encoding a moving picture; a decoding section executed by the processor to decode the encoded differential signal so as to produce a decoded differential signal; a prediction signal generation section executed by the processor to produce a first prediction signal with respect to the decoded differential signal; an adding section executed by the processor to add the first prediction signal to the decoded differential signal so as to produce a reproduction signal; a storage section operable to store the reproduction signal as a reference image referred to in producing a second prediction signal; and a reference image generation section executed by the processor to generate an observation matrix from a matrix composed of a plurality of pixel vectors, each of the pixel vectors in the matrix representing respective different pre-existing reference images stored in the storage section, to produce, based on the observation matrix, a new reference image, and to store the new reference image in the storage section, wherein the prediction signal generation section is executed by the processor to produce the second prediction signal using at least the new reference image.
2. The moving picture decoding device according to claim 1 , wherein the reference image generation section is executed by the processor to generate the observation matrix and a state vector based on the matrix composed of the plurality of pixel vectors and to produce the new reference image based on the observation matrix and the state vector.
3. The moving picture decoding device according to claim 1 , wherein the compressed data further includes vector compressed data corresponding to a state vector; the decoding section is further executed by the processor to restore the vector compressed data so as to produce a decoded state vector; and the reference image generation section is further executed by the processor to produce the new reference image based on the observation matrix and the decoded state vector.
4. The moving picture decoding device according to claim 1 , wherein the reference image generation section is executed by the processor to generate the observation matrix by carrying out singular value decomposition on the matrix composed of the plurality of pixel vectors.
5. A moving picture decoding device comprising: a processor; an input section executed by the processor to receive compressed data including an encoded differential signal obtained by prediction encoding a moving picture; a decoding section executed by the processor to decode the encoded differential signal so as to produce a decoded differential signal; a prediction signal generation section executed by the processor to produce a first prediction signal with respect to the decoded differential signal; an adding section executed by the processor to add the first prediction signal to the decoded differential signal so as to produce a reproduction signal; and the processor configured to store the reproduction signal as a reference image in a storage section, the reference image referred to in producing a second prediction signal, wherein the prediction signal generation section is further executed by the processor to obtain at least one of an observation matrix or a state vector by using a matrix composed of a plurality of pixel vectors, each of the pixel vectors representing different respective pre-existing reference images stored in the storage section, and the prediction signal generation section is further executed by the processor to produce the second prediction signal based on the observation matrix or the state vector.
6. A moving picture decoding method comprising: receiving compressed data with an input section of a decoder device, the compressed data including an encoded differential signal obtained by prediction encoding a moving picture; decoding the encoded differential signal with a decoding section included in the decoder device so as to produce a decoded differential signal; producing a first prediction signal with a prediction signal generation section included in the decoder device, the first prediction signal produced with respect to the decoded differential signal; adding the first prediction signal to the decoded differential signal with an adding section included in the decoder device, the first prediction signal added to the decoded differential signal to produce a reproduction signal; storing the reproduction signal in a storage section included in the decoder device, the reproduction signal stored as a reference image referred to in producing a second prediction signal; and generating an observation matrix using a matrix composed of a plurality of pixel vectors, each of the pixel vectors included in the matrix representing different respective pre-existing reference images stored in the storage section, the observation matrix generated with a reference image generation section included in the decoder device; producing with the reference image generation section, based on the observation matrix, a new reference image; storing the new reference image in the storage section by the reference image generation section; and producing the second prediction signal with the prediction signal generation section, the second prediction signal produced using at least the new reference image.
7. A moving picture decoding method comprising: receiving compressed data with an input section of a decoder device, the compressed data including an encoded differential signal obtained by prediction encoding a moving picture; decoding the encoded differential signal with a decoding section included in the decoder device so as to produce a decoded differential signal; producing a first prediction signal with respect to the decoded differential signal by a prediction signal generation section included in the decoder device; adding the first prediction signal to the decoded differential signal with an adding section included in the decoder device so as to produce a reproduction signal; storing the reproduction signal in a storage section as a reference image that is referred to in producing a second prediction signal; and the prediction signal generation section generating at least one of an observation matrix or a state vector using a matrix composed of a plurality of pixel vectors, each of the pixel vectors representing different respective pre-existing reference images stored in the storage section to produce the second prediction signal based on the observation matrix or the state vector.
8. A non-transitory computer readable storage medium for a moving picture encoding and decoding system, the computer readable storage medium comprising instructions for moving picture decoding that cause a computer to execute: an input section to receive compressed data including an encoded differential signal obtained by prediction encoding a moving picture; a decoding section to decode the encoded differential signal so as to produce a decoded differential signal; a prediction signal generation section to produce a first prediction signal with respect to the decoded differential signal; an adding section to add the first prediction signal to the decoded differential signal so as to produce a reproduction signal; a storage section to store the reproduction signal as a reference image referred to in producing a second prediction signal; and a reference image generation section to generate an observation matrix using a matrix composed of a plurality of pixel vectors, each of the pixel vectors representing different respective pre-existing reference images stored in the storage section, to produce, based on the observation matrix, a new reference image, and to store the new reference image in the storage section, wherein the prediction signal generation section produces the second prediction signal by using at least the new reference image.
9. A non-transitory computer readable storage medium for a moving picture encoding and decoding system, the computer readable storage medium comprising instructions for moving picture decoding that cause a computer to execute: an input section to receive compressed data including an encoded differential signal obtained by prediction encoding a moving picture; a decoding section to decode the encoded differential signal so as to produce a decoded differential signal; a prediction signal generation section to produce a first prediction signal with respect to the decoded differential signal; an adding section to add the first prediction signal to the decoded differential signal so as to produce a reproduction signal; and a storage section to store the reproduction signal as a reference image referred to in producing a second prediction signal, wherein the prediction signal generation section to generate at least one of an observation matrix or a state vector by using a matrix composed of a plurality of pixel vectors, each of the pixel vectors representing different respective pre-existing reference images stored in the storage section, and to produce the second prediction signal based on the observation matrix or the state vector.
10. A moving picture decoding device comprising: a processor; an input section executed by the processor to receive compressed data including an encoded differential signal obtained by prediction encoding a moving picture; an entropy decoding section executed by the processor to restore from the compressed data at least the encoded differential signal of a target region serving as a decoding target; a decoding section executed by the processor to decode the encoded differential signal of the target region so as to produce a decoded differential signal; a prediction signal generation section executed by the processor to produce a first prediction signal of the target region with respect to the decoded differential signal; an adding section executed by the processor to add the first prediction signal to the decoded differential signal so as to produce a reproduction signal of the target region; a storage section operable to store the reproduction signal of the target region as a reference image referred to in producing a second prediction signal; and a reference image generation section executed by the processor to obtain an observation matrix using a matrix comprising a plurality of pixel vectors, each of the pixel vectors representing a respective pre-existing reference image stored in the storage section, the reference image generation section further executed by the processor to produce, based on the observation matrix, a new reference image, and to store the new reference image in the storage section, wherein, the entropy decoding section is further executed by the processor to decode from the compressed data positional information specifying an insertion position of the new reference image in a reference image list controlling a plurality of reference images; the prediction signal generation section is further executed by the processor to update the reference image list based on the positional information specifying the insertion position of the new reference image; the entropy decoding section is further executed by the processor to decode from the compressed data a reference image number specifying the reference image used in producing the second prediction signal of the target region based on the updated reference image list; and the prediction signal generation section is further executed by the processor to produce the second prediction signal of the target region by using the reference image specified by the decoded reference image number.
11. A moving picture decoding device comprising: a processor; an input section executed by the processor to receive compressed data including an encoded differential signal obtained by prediction encoding a moving picture; an entropy decoding section executed by the processor to restore from the compressed data at least the encoded differential signal of a target region serving as a decoding target; a decoding section executed by the processor to decode the encoded differential signal of the target region so as to produce a decoded differential signal; a prediction signal generation section executed by the processor to produce a first prediction signal of the target region with respect to the decoded differential signal; an adding section executed by the processor to add the first prediction signal to the decoded differential signal so as to produce a reproduction signal of the target region; a storage section operable to store the reproduction signal of the target region as a reference image referred to in producing a second prediction signal; and a reference image generation section executed by the processor to obtain an observation matrix by using a matrix comprising a plurality of pixel vectors, each of the pixel vectors representing a respective pre-existing reference image stored in the storage section, the reference image generation section further executed by the processor to produce, based on the observation matrix, a new reference image, and to store the new reference image in the storage section, wherein the entropy decoding section is further executed by the processor to decode from the compressed data positional information specifying an insertion position of the new reference image in a reference image list controlling a plurality of reference images relating to a large region composed of at least two target regions; the prediction signal generation section is further executed by the processor to update the reference image list relating to the large region based on the positional information specifying the insertion position of the new reference image; the entropy decoding section is further executed by the processor to decode from the compressed data a reference image number specifying the reference image used in producing the second prediction signal of the target region based on the updated reference image list; and the prediction signal generation section is further executed by the processor to produce the second prediction signal of the target region by using the reference image specified by the decoded reference image number.
12. The moving picture decoding device according to claim 10 , wherein the entropy decoding section is further executed by the processor to decode the positional information showing that the new reference image is not included in the reference image list, and the prediction signal generation section is further executed by the processor to update the reference image list in such a manner that the reference image list does not include the new reference image.
13. The moving picture decoding device according to claim 10 , wherein the reference image generation section is further executed by the processor to obtain the observation matrix and a state vector based on the matrix comprising the plurality of pixel vectors, and to produce the new reference image based on the observation matrix and the state vector.
14. The moving picture decoding device according claim 10 , wherein the compressed data further includes vector compressed data corresponding to a state vector; the decoding section is further executed by the processor to restore the vector compressed data so as to produce a decoded state vector within the decoded differential signal; and the reference image generation section is further executed by the processor to produce the new reference image based on the observation matrix and the decoded state vector.
15. The moving picture decoding device according to claim 13 , wherein the reference image generation section is further executed by the processor to obtain at least one of the observation matrix and the state vector by carrying out singular value decomposition on the matrix comprising the plurality of pixel vectors so as to produce the new reference image.
16. A moving picture decoding device comprising: a processor; an input section executed by the processor to receive compressed data including an encoded differential signal obtained by prediction encoding a moving picture; an entropy decoding section executed by the processor to restore from the compressed data at least the encoded differential signal of a target region serving as a decoding target; a decoding section executed by the processor to decode the encoded differential signal of the target region so as to produce a decoded differential signal; a prediction signal generation section executed by the processor to produce a first prediction signal of the target region with respect to the decoded differential signal; an adding section executed by the processor to add the first prediction signal to the decoded differential signal so as to produce a reproduction signal of the target region; and a storage section operable to store the reproduction signal of the target region as a reference image referred to in producing a second prediction signal, wherein the entropy decoding section is further executed by the processor to decode from the compressed data positional information specifying an insertion position of the new reference image in a reference image list controlling a plurality of reference images; the prediction signal generation section is further executed by the processor to update the reference image list based on the positional information specifying the insertion position of the new reference image, and to obtain an observation matrix by using a matrix comprising a plurality of pixel vectors, each of the pixel vectors representing a respective pre-existing reference image stored in the storage section; the prediction signal generation section is further executed by the processor to produce a new reference image based on the observation matrix, and to store the new reference image in the storage section; the entropy decoding section is further executed by the processor to decode from the compressed data a reference image number specifying the reference image used in producing the second prediction signal of the target region based on the updated reference image list; and the prediction signal generation section is further executed by the processor to produce the second prediction signal of the target region by using the reference image specified by the decoded reference image number.
17. A moving picture decoding method comprising: receiving compressed data with an input section included in a decoder device, the compressed data including an encoded differential signal obtained by prediction encoding a moving picture; restoring at least the encoded differential signal of a target region serving as a decoding target from the compressed data with an entropy decoding section included in the decoder device; decoding the encoded differential signal of the target region with a decoding section of the decoder device so as to produce a decoded differential signal; producing a first prediction signal of the target region with respect to the decoded differential signal with a prediction signal generation section included in the decoder device; adding the first prediction signal to the decoded differential signal with an adding section included in the decoder device so as to produce a reproduction signal of the target region; storing the reproduction signal of the target region with a storage section included in the decoder device, the reproduction signal of the target region stored as a reference image referred to in producing a second prediction signal; obtaining an observation matrix with a reference image generation section included in the decoder device using a matrix comprising a plurality of pixel vectors, each of the pixel vectors representing a respective pre-existing reference image stored in the storage section, producing with the reference image generation section, based on the observation matrix, a new reference image, and storing the new reference image in the storage section; decoding from the compressed data with the entropy decoding section positional information specifying an insertion position of the new reference image in a reference image list controlling a plurality of reference images; updating the reference image list with the prediction signal generation section based on the positional information specifying the insertion position of the new reference image; decoding from the compressed data with the entropy decoding section a reference image number specifying the reference image used in producing the second prediction signal of the target region based on the updated reference image list; and producing the second prediction signal of the target region with the prediction signal generation section using the reference image specified by the decoded reference image number.
18. A moving picture decoding method comprising: receiving compressed data with an input section included in a decoder device, the compressed data including an encoded differential signal obtained by prediction encoding a moving picture; restoring at least the encoded differential signal of a target region serving as a decoding target from the compressed data with an entropy decoding section included in the decoder device; decoding the encoded differential signal of the target region with a decoding section included in the decoder device so as to produce a decoded differential signal; producing a first prediction signal of the target region with respect to the decoded differential signal with a prediction signal generation section included in the decoder device; adding the first prediction signal to the decoded differential signal with an adding section included in the decoder device so as to produce a reproduction signal of the target region; storing the reproduction signal of the target region with a storage section included in the decoder device as a reference image referred to in producing a second prediction signal; obtaining an observation matrix with a reference image generation section included in the decoder device by using a matrix comprising a plurality of pixel vectors, each of the pixel vectors representing a respective pre-existing reference image stored in the storage section; producing with the reference image generation section, based on the observation matrix, a new reference image, and storing the new reference image in the storing section; decoding from the compressed data with the entropy decoding section positional information specifying an insertion position of the new reference image in a reference image list controlling a plurality of reference images relating to a large region composed of at least two target regions; updating with the prediction signal generation section the reference image list relating to the large region based on the positional information specifying the insertion position of the new reference image; decoding from the compressed data with entropy decoding section a reference image number specifying the reference image used in producing the second prediction signal of the target region based on the updated reference image; and producing the second prediction signal of the target region with the prediction signal generation section using the reference image specified by the decoded reference image number.
19. The moving picture decoding method according to claim 17 , wherein restoring at least the encoded differential signal of the target region serving as the decoding target from the compressed data further comprises decoding the positional information showing that the new reference image is not included in the reference image list; and producing the second prediction signal further comprises updating the reference image list in such a manner that the reference image list does not include the new reference image.
20. A moving picture decoding method comprising: receiving compressed data including an encoded differential signal obtained by prediction encoding a moving picture with an input section included in a decoding device; restoring at least the encoded differential signal of a target region serving as a decoding target from the compressed data with an entropy decoding section included in the decoding device; decoding the encoded differential signal of the target region with a decoding section included in the decoding device so as to produce a decoded differential signal; producing a first prediction signal of the target region with respect to the decoded differential signal with a prediction signal generation section included in the decoding device; adding the first prediction signal to the decoded differential signal with an adding section included in the decoding device so as to produce a reproduction signal of the target region; storing the reproduction signal of the target region with a storage section included in the decoder device, the reproduction signal stored as a reference image referred to in producing a second prediction signal; decoding from the compressed data with the entropy decoding section positional information specifying an insertion position of a new reference image in a reference image list controlling a plurality of reference images; updating the reference image list with the prediction signal generation section based on the positional information specifying the insertion position of the new reference image; obtaining an observation matrix with the prediction signal generation section using a matrix comprising a plurality of pixel vectors, each of the pixel vectors representing a respective pre-existing reference image stored in the storage section; producing a new reference image with the prediction signal generation section based on the observation matrix; storing the new reference image in the storage section with the prediction signal generation section; decoding from the compressed data with the entropy decoding section a reference image number specifying the new reference image used in producing the second prediction signal of the target region based on the updated reference image list; and producing the second prediction signal of the target region with the prediction signal generation section using the new reference image specified by the decoded reference image number.
21. The moving picture decoding device according to claim 11 , wherein the entropy decoding section is further executed by the processor to decode the positional information showing that the new reference image is not included in the reference image list, and the prediction signal generation section is further executed by the processor to update the reference image list in such a manner that the reference image list does not include the new reference image.
22. The moving picture decoding device according to claim 11 , wherein the reference image generation section is further executed by the processor to obtain the observation matrix and a state vector based on the matrix comprising the plurality of pixel vectors and to produce the new reference image based on the observation matrix and the state vector.
23. The moving picture decoding device according claim 11 , wherein the compressed data further includes vector compressed data corresponding to a state vector; the decoding section is further executed by the processor to restore the vector compressed data so as to produce a decoded state vector within the decoded differential signal; and the reference image generation section is further executed by the processor to produce the new reference image based on the observation matrix and the decoded state vector.
24. The moving picture decoding device according to claim 22 , wherein the reference image generation section is further executed by the processor to obtain at least one of the observation matrix and the state vector by carrying out singular value decomposition on the matrix comprising the plurality of pixel vectors so as to produce the new reference image.
25. The moving picture decoding method according to claim 18 , wherein restoring at least the encoded differential signal of the target region serving as the decoding target from the compressed data further comprises decoding the positional information showing that the new reference image is not included in the reference image list; and producing the second prediction signal further comprises updating the reference image list in such a manner that the reference image list does not include the new reference image.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
March 18, 2011
March 1, 2016
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.