In one example, a device for decoding video data includes a processor configured to decapsulate a slice of a random access point (RAP) picture of a bitstream from a network abstraction layer (NAL) unit, wherein the NAL unit includes a NAL unit type value that indicates whether the RAP picture is of a type that can have associated leading pictures and whether the RAP picture is an instantaneous decoder refresh (IDR) picture or a clean random access (CRA) picture, determine whether the RAP picture can have associated leading pictures based on the NAL unit type value, and decode video data of the bitstream following the RAP picture based on the determination of whether the RAP picture can have associated leading pictures.
Legal claims defining the scope of protection, as filed with the USPTO.
1. A method of decoding, by a decoding device including a processor, video data, the method comprising: decapsulating a slice of a random access point (RAP) picture of a bitstream from a network abstraction layer (NAL) unit, wherein the NAL unit includes a NAL unit type value that indicates whether the RAP picture is an instantaneous decoder refresh (IDR) picture or a clean random access (CRA) picture, and also indicates, when the RAP picture is an IDR picture, whether the IDR picture is a type of IDR picture that may have associated leading pictures that are decodable leading pictures (DLPs), wherein each leading picture follows a random access picture in decoding order and precedes the random access picture in output order, wherein: the NAL unit type value being a first NAL unit type value indicates that the RAP picture is an IDR picture that may have associated DLPs; the NAL unit type value being a second NAL unit type value indicates that the RAP picture is an IDR picture that does not have associated DLPs; and the NAL unit type value being a third NAL unit type value indicates that the RAP picture is a CRA picture; determining that the RAP picture is not the CRA picture and that the RAP picture is: an IDR picture that may have associated DLPs based on the NAL unit type value being the first NAL unit type value, or an IDR picture that does not have associated DLPs based on the NAL unit type value being the second NAL unit type value; and decoding the RAP picture and video data of the bitstream following the RAP picture based on the NAL unit type value.
2. The method of claim 1 , further comprising: determining, for a subsequent NAL unit, that a NAL unit type value indicates that the subsequent NAL unit comprises a suffix supplemental enhancement information (SEI) NAL unit including a suffix SEI message, wherein the suffix SEI message indicates that the subsequent NAL unit may succeed, in decoding order, the last video coding layer, VCL, NAL unit in an access unit (AU); and decoding video data of the bitstream following the suffix SEI NAL unit based on data of the suffix SEI message.
3. The method of claim 2 , further comprising extracting the suffix SEI NAL unit from the AU that includes at least a first video coding layer (VCL) NAL unit in the AU prior to the suffix SEI NAL unit in decoding order.
4. The method of claim 3 , wherein the suffix SEI NAL unit follows, in decoding order, all VCL NAL units in the AU.
5. A decoding device for decoding video data, the decoding device comprising: memory configured to store the video data; and a processor configured to: decapsulate a slice of a random access point (RAP) picture of a bitstream from a network abstraction layer (NAL) unit, wherein the NAL unit includes a NAL unit type value that indicates whether the RAP picture is an instantaneous decoder refresh (IDR) picture or a clean random access (CRA) picture, and also indicates, when the RAP picture is an IDR picture, whether the IDR picture is a type of IDR picture that may have associated leading pictures that are decodable leading pictures (DLPs), wherein each leading picture follows a random access picture in decoding order and precedes the random access picture in output order, wherein; the NAL unit type value being a first NAL unit type value indicates that the RAP picture is an IDR picture that may have associated DLPs; the NAL unit type value being a second NAL unit type value indicates that the RAP picture is an IDR picture that does not have associated DLPs; and the NAL unit type value being a third NAL unit type value indicates that the RAP picture is a CRA picture; determine that the RAP picture is not the CRA picture and that the RAP picture is: an IDR picture that may have associated DLPs based on the NAL unit type value being the first NAL unit type value, an IDR picture that does not have associated DLPs based on the NAL unit type value being the second NAL unit type value; and decode the RAP picture and video data of the bitstream following the RAP picture based on the NAL unit type value.
6. The decoding device of claim 5 , wherein the processor is further configured to determine, for a subsequent NAL unit, that a NAL unit type value indicates that the subsequent NAL unit comprises a suffix supplemental enhancement information (SEI) NAL unit including a suffix SEI message, wherein the suffix SEI message indicates that the subsequent NAL unit may succeed, in decoding order, the last video coding layer, VCL, NAL unit in an access unit (AU), and decode video data of the bitstream following the suffix SEI NAL unit based on data of the suffix SEI message.
7. The decoding device of claim 6 , wherein the processor is configured to extract the suffix SEI NAL unit from the AU that includes at least a first video coding layer (VCL) NAL unit in the AU prior to the suffix SEI NAL unit in decoding order.
8. The decoding device of claim 7 , wherein the suffix SEI NAL unit follows, in decoding order, all VCL NAL units in the AU.
9. A decoding device for decoding video data, the decoding device comprising: means for storing the video data; and means for decapsulating a slice of a random access point (RAP) picture of a bitstream from a network abstraction layer (NAL) unit, wherein the NAL unit includes a NAL unit type value that indicates whether the RAP picture is an instantaneous decoder refresh (IDR) picture or a clean random access (CRA) picture, and also indicates, when the RAP picture is an IDR picture, whether the RAP picture is a type of RAP picture that may have associated leading pictures that are decodable leading pictures (DLPs), wherein each leading picture follows a random access picture in decoding order and precedes the random access picture in output order, wherein: the NAL unit type value being a first NAL unit type value indicates that the RAP picture is an IDR picture that may have associated DLPs; the NAL unit type value being a second NAL unit type value indicates that the RAP picture is an IDR picture that does not have associated DLPs; and the NAL unit type value being a third NAL unit type value indicates that the RAP picture is a CRA picture; means for determining that the RAP picture is not the CRA picture and that the RAP picture is: an DR picture that may have associated DLPs based on the NAL unit type value being the first NAL unit type value, or an DR picture that does not have associated DLPs based on the NAL unit type value being the second NAL unit type value; and means for decoding the RAP picture and video data of the bitstream following the RAP picture based on the NAL unit type value.
10. The decoding device of claim 9 , further comprising: means for determining, for a subsequent NAL unit, that a NAL unit type value indicates that the subsequent NAL unit comprises a suffix supplemental enhancement information (SEI) NAL unit including a suffix SEI message, wherein the suffix SEI message indicates that the subsequent NAL unit may succeed, in decoding order, the last video coding layer, VCL, NAL unit in an access unit (AU); and means for decoding video data of the bitstream following the suffix SEI NAL unit based on data of the suffix SEI message.
11. The decoding device of claim 10 , further comprising means for extracting the suffix SEI NAL unit from the AU that includes at least a first video coding layer (VCL) NAL unit in the AU prior to the suffix SEI NAL unit in decoding order.
12. The decoding device of claim 11 , wherein the suffix SEI NAL unit follows, in decoding order, all VCL NAL units in the AU.
13. A non-transitory computer-readable storage medium having stored thereon instructions that, when executed by a processor of a decoding device, cause the processor to: decapsulate a slice of a random access point (RAP) picture of a bitstream from a network abstraction layer (NAL) unit, wherein the NAL unit includes a NAL unit type value that indicates whether the RAP picture is an instantaneous decoder refresh (IDR) picture or a clean random access (CRA) picture, and also indicates, when the RAP picture is an IDR picture, whether the IDR picture is a type of DR picture that may have associated leading pictures that are decodable leading pictures (DLPs) wherein each leading picture follows a random access picture in decoding order and precedes the random access picture in output order, wherein: the NAL unit type value being a first NAL unit type value indicates that the RAP picture is an IDR picture that may have associated DLPs; the NAL unit type value being a second NAL unit type value indicates that the RAP picture is an IDR picture that does not have associated DLPs; and the NAL unit type value being a third NAL unit type value indicates that the RAP picture is a CRA picture; determine that the RAP picture is not the CRA picture and that the RAP picture is: an IDR picture that may have associated DLPs based on the NAL unit type value being the first NAL unit type value, or an IDR picture that does not have associated DLPs based on the NAL unit type value being the second NAL unit type value; and decode the RAP picture and video data of the bitstream following the RAP picture based on the NAL unit type value.
14. The computer-readable storage medium of claim 13 , further comprising instructions that cause the processor to: determine, for a subsequent NAL unit, that a NAL unit type value indicates that the subsequent NAL unit comprises a suffix supplemental enhancement information (SEI) NAL unit including a suffix SEI message, wherein the suffix SEI message indicates that the subsequent NAL unit may succeed, in decoding order, the last video coding layer, VCL, NAL unit in an access unit (AU); and decode video data of the bitstream following the suffix SEI NAL unit based on data of the suffix SEI message.
15. The computer-readable storage medium of claim 14 , further comprising instructions that cause the processor to extract the suffix SEI NAL unit from the AU that includes at least a first video coding layer (VCL) NAL unit in the AU prior to the suffix SEI NAL unit in decoding order.
16. The computer-readable storage medium of claim 15 , wherein the suffix SEI NAL unit follows, in decoding order, all VCL NAL units in the AU.
17. A method of generating, by an encoding device including a processor, a bitstream including video data, the method comprising: determining whether a random access point (RAP) picture is an instantaneous decoder refresh (IDR) picture that may have associated decodable leading pictures or an IDR picture that does not have associated decodable leading pictures (DLPs) wherein each leading picture follows a random access picture in decoding order and precedes the random access picture in output order, and that the RAP picture is not a clean random access (CRA) picture; encapsulating a slice of the RAP picture in a network abstraction layer (NAL) unit, wherein encapsulating comprises generating a NAL unit type value for the NAL unit, wherein generating the NAL unit type value comprises setting the NAL unit type value: to a first NAL unit type value based on the RAP picture being an IDR picture that may have associated DLPs, or to a second NAL unit type value based on the RAP picture being an IDR picture that does not have associated DLPs, and not to a third NAL unit type value based on the RAP picture not being a CRA picture; and generating a bitstream including the NAL unit.
18. The method of claim 17 , further comprising: determining whether a supplemental enhancement information (SEI) message is a prefix SEI message or a suffix SEI message, wherein the SEI message includes data related to the encoded slice of video data; and encapsulating the SEI message in an SEI NAL unit, wherein the SEI NAL unit includes a NAL unit type value that indicates whether the SEI NAL unit is a prefix SEI NAL unit or a suffix SEI NAL unit and whether the SEI message is a prefix SEI message or a suffix SEI message, wherein generating the bitstream further comprises generating the bitstream to include the SEI NAL unit.
19. The method of claim 18 , wherein generating the bitstream comprises encapsulating the SEI NAL unit in an access unit (AU) such that the SEI NAL unit follows a first video coding layer (VCL) NAL unit in the AU in decoding order when the NAL unit type value indicates that the SEI NAL unit is a suffix SEI NAL unit.
20. The method of claim 19 , wherein generating the bitstream further comprises encapsulating the SEI NAL unit in the AU such that the SEI NAL unit further succeeds a last VCL NAL unit in the AU in decoding order when the NAL unit type value indicates that the SEI NAL unit is the suffix SEI NAL unit.
21. An encoding device for generating a bitstream including video data, the encoding device comprising: memory configured to store the video data; and a processor configured to: determine whether a random access point (RAP) picture is an instantaneous decoder refresh (IDR) picture that may have associated decodable leading pictures or an IDR picture that does not have associated decodable leading pictures (DLPs wherein each leading picture follows a random access picture in decoding order and precedes the random access picture in output order, and that the RAP picture is not a clean random access (CRA) picture; encapsulate a slice of the RAP picture in a network abstraction layer (NAL) unit, wherein the processor is configured to generate a NAL unit type value for the NAL unit, wherein to generate the NAL unit type value, the processor is configured to set the NAL unit type value: to a first NAL unit type value based on the RAP picture being an IDR picture that may have associated DLPs, or to a second NAL unit type value based on the RAP picture being an IDR picture that does not have associated DLPs; and not to a third NAL unit type value based on the RAP picture not being a CRA picture; and generate a bitstream including the NAL unit.
22. The encoding device of claim 21 , wherein the processor is further configured to determine whether a supplemental enhancement information (SEI) message is a prefix SEI message or a suffix SEI message, wherein the SEI message includes data related to the encoded slice of video data, encapsulate the SEI message in an SEI NAL unit, wherein the SEI NAL unit includes a NAL unit type value that indicates whether the SEI NAL unit is a prefix SEI NAL unit or a suffix SEI NAL unit and whether the SEI message is a prefix SEI message or a suffix SEI message, and generate the bitstream to include the SEI NAL unit.
23. The encoding device of claim 22 , wherein the processor is configured to encapsulate the SEI NAL unit in an access unit (AU) such that the SEI NAL unit follows a first video coding layer (VCL) NAL unit in the AU in decoding order when the NAL unit type value indicates that the SEI NAL unit is a suffix SEI NAL unit.
24. The encoding device of claim 23 , wherein the processor is configured to encapsulate the SEI NAL unit in the AU such that the SEI NAL unit further succeeds a last VCL NAL unit in the AU in decoding order when the NAL unit type value indicates that the SEI NAL unit is the suffix SEI NAL unit.
25. An encoding device for generating a bitstream including video data, the encoding device comprising: means for storing the video data; means for determining whether a random access point (RAP) picture is an instantaneous decoder refresh (IDR) picture that may have associated decodable leading pictures or an DR picture that does not have associated decodable leading pictures (DLPs) wherein each leading picture follows a random access picture in decoding order and precedes the random access picture in output order, and that the RAP picture is not a clean random access (CRA) picture; means for encapsulating a slice of the RAP picture in a network abstraction layer (NAL) unit, wherein the means for encapsulating comprises means for generating a NAL unit type value for the NAL unit, wherein the means for generating the NAL unit type value comprises means for setting the NAL unit type value: to a first NAL unit type value based on the RAP picture being an DR picture that may have associated DLPs, or to a second NAL unit type value based on the RAP picture being an IDR picture that does not have associated DLPs; and not to a third NAL unit type value based on the RAP picture not being a CRA picture; and means for generating a bitstream including the NAL unit.
26. The encoding device of claim 25 , further comprising: means for determining whether a supplemental enhancement information (SEI) message is a prefix SEI message or a suffix SEI message, wherein the SEI message includes data related to the encoded slice of video data; and means for encapsulating the SEI message in an SEI NAL unit, wherein the SEI NAL unit includes a NAL unit type value that indicates whether the SEI NAL unit is a prefix SEI NAL unit or a suffix SEI NAL unit and whether the SEI message is a prefix SEI message or a suffix SEI message, wherein the means for generating the bitstream further comprises means for generating the bitstream to include the SEI NAL unit.
27. The encoding device of claim 26 , wherein the means for generating the bitstream comprises means for encapsulating the SEI NAL unit in an access unit (AU) such that the SEI NAL unit follows a first video coding layer (VCL) NAL unit in the AU in decoding order when the NAL unit type value indicates that the SEI NAL unit is a suffix SEI NAL unit.
28. The encoding device of claim 27 , wherein the means for generating the bitstream further comprises means for encapsulating the SEI NAL unit in the AU such that the SEI NAL unit further succeeds a last VCL NAL unit in the AU in decoding order when the NAL unit type value indicates that the SEI NAL unit is the suffix SEI NAL unit.
29. A non-transitory computer-readable storage medium having stored thereon instructions that, when executed by a processor of an encoding device, cause the processor to: determine whether a random access point (RAP) picture is an instantaneous decoder refresh (IDR) picture that may have associated decodable leading pictures or an IDR picture that does not have associated decodable leading pictures (DLPs) wherein each leading picture follows a random access picture in decoding order and precedes the random access picture in output order, and that the RAP picture is not a clean random access (CRA) picture; encapsulate a slice of the RAP picture in a network abstraction layer (NAL) unit, wherein the instructions that cause the processor to encapsulate the slice comprise instructions that cause the processor to generate a NAL unit type value for the NAL unit, wherein the instructions that cause the processor to generate the NAL unit type value comprise instructions that cause the processor to set the NAL unit type value: to a first NAL unit type value based on the RAP picture being an IDR picture that may have associated DLPs, or to a second NAL unit type value based on the RAP picture being an IDR picture that does not have associated DLPs; and not to a third NAL unit type value based on the RAP picture not being a CRA picture; and generate a bitstream including the NAL unit.
30. The computer-readable storage medium of claim 29 , further comprising instructions that cause the processor to: determine whether a supplemental enhancement information (SEI) message is a prefix SEI message or a suffix SEI message, wherein the SEI message includes data related to the encoded slice of video data; and encapsulate the SEI message in an SEI NAL unit, wherein the SEI NAL unit includes a NAL unit type value that indicates whether the SEI NAL unit is a prefix SEI NAL unit or a suffix SEI NAL unit and whether the SEI message is a prefix SEI message or a suffix SEI message, wherein the instructions that cause the processor to generate the bitstream further comprise instructions that cause the processor to generate the bitstream to include the SEI NAL unit.
31. The computer-readable storage medium of claim 30 , wherein the instructions that cause the processor to generate the bitstream comprise instructions that cause the processor to encapsulate the SEI NAL unit in an access unit (AU) such that the SEI NAL unit follows a first video coding layer (VCL) NAL unit in the AU in decoding order when the NAL unit type value indicates that the SEI NAL unit is a suffix SEI NAL unit.
32. The computer-readable storage medium of claim 31 , wherein the instructions that cause the processor to generate the bitstream further comprise instructions that cause the processor to encapsulate the SEI NAL unit in the AU such that the SEI NAL unit further succeeds a last VCL NAL unit in the AU in decoding order when the NAL unit type value indicates that the SEI NAL unit is the suffix SEI NAL unit.
33. The decoding device of claim 5 , wherein the decoding device comprises at least one of: a microprocessor, an integrated circuit, a digital signal processor (DSP), a field programmable gate array (FPGA), a desktop computer, a laptop computer, a tablet computer, a wireless communication device, a phone, a television, a camera, a display device, a digital media player, a video game console, a video game device, or a video streaming device.
34. The decoding device of claim 5 , further comprising: a display configured to display at least one picture associated with the video data.
35. The decoding device of claim 9 , wherein the decoding device comprises at least one of: a microprocessor, an integrated circuit, a digital signal processor (DSP), a field programmable gate array (FPGA), a desktop computer, a laptop computer, a tablet computer, a wireless communication device, a phone, a television, a camera, a display device, a digital media player, a video game console, a video game device, or a video streaming device.
36. The decoding device of claim 9 , further comprising: display means for displaying at least one picture associated with the video data.
37. The encoding device of claim 21 , further comprising: a camera configured to capture at least one picture associated with the video data.
38. The encoding device of claim 25 , further comprising: means for capturing at least one picture associated with the video data.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
March 13, 2013
May 9, 2017
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.