Patentable/Patents/US-9270991
US-9270991

Inter-layer reference picture generation for HLS-only scalable video coding

PublishedFebruary 23, 2016
Assigneenot available in USPTO data we have
Inventorsnot available in USPTO data we have
Technical Abstract

An apparatus for coding video information may include a memory unit configured to store video information associated with a picture and a processor in communication with the memory unit configured to resample video information of a reference picture to obtain a resampled picture having a plurality of slices and a different picture size than a picture to be encoded. Further, the processor may determine slice definitions for slices in the resampled picture. The slices of the resampled picture may correspond to slices of the reference picture. The processor may determine, based on the slice definitions, whether a slice of the resampled picture satisfies one or more slice definition rules. In response to determining that the slice of the resampled picture does not satisfy at least one slice definition rule, the processor can modify the slice definition for the slice so as to satisfy the slice definition rule.

Patent Claims
50 claims

Legal claims defining the scope of protection, as filed with the USPTO.

1

1. An apparatus for coding video information, the apparatus comprising: a memory unit configured to store video information associated with a picture; a processor in communication with the memory unit, wherein the processor is configured to: resample video information of a reference picture to obtain a resampled picture, the reference picture having a plurality of slices and having a different picture size than a picture to be encoded; determine slice definitions for a plurality of slices in the resampled picture, the plurality of slices of the resampled picture corresponding to a plurality of slices of the reference picture; determine, based at least partially on the slice definitions, whether each of the plurality of slices of the resampled picture satisfies one or more slice definition rules; and in response to determining that at least one of the plurality of slices of the resampled picture does not satisfy at least one slice definition rule, modify the slice definition for at least some of the plurality of slices in the resampled picture that do not satisfy the at least one slice definition rule so as to satisfy the slice definition rule.

2

2. The apparatus of claim 1 , wherein the processor is further configured to determine whether each of the plurality of slices of the resampled picture satisfies the one or more slice definition rules by determining whether a slice from the plurality of slices in the resampled picture includes a disparity between a height of the slice in a first column and a height of the slice in a previous column that is greater than one largest coding unit (LCU).

3

3. The apparatus of claim 1 , wherein the processor is further configured to determine whether each of the plurality of slices of the resampled picture satisfies the one or more slice definition rules by determining whether a slice from the plurality of slices in the resampled picture includes more than one incomplete scan line.

4

4. The apparatus of claim 1 , wherein the processor is further configured to determine whether each of the plurality of slices in the resampled picture satisfies the one or more slice definition rules by determining whether a slice from the plurality of slices in the resampled picture includes a partial LCU.

5

5. The apparatus of claim 4 , wherein the processor is further configured to modify the slice definition for at least some of the plurality of slices in the resampled picture that do not satisfy at least one slice definition rule by rounding the partial LCU.

6

6. The apparatus of claim 5 , wherein rounding the partial LCU comprises modifying the slice definition for at least one slice of the plurality of slices in the resampled picture that includes the partial LCU to remove the partial LCU from the slice definition.

7

7. The apparatus of claim 5 , wherein rounding the partial LCU comprises modifying the slice definition for at least one slice of the plurality of slices in the resampled picture that includes the partial LCU to include the entire LCU corresponding to the partial LCU in the slice definition.

8

8. The apparatus of claim 1 , wherein the processor is further configured to modify the slice definition for at least some of the plurality of slices in the resampled picture that do not satisfy at least one slice definition rule by dividing at least one slice of the plurality of resampled slices into multiple sub-slices.

9

9. The apparatus of claim 8 , wherein, for at least some sub-slices of the multiple sub-slices, the processor is further configured to associate at least some of the information included in a slice header of the at least one slice of the plurality of slices in the resampled picture with a slice header of the sub-slice.

10

10. The apparatus of claim 1 , wherein the reference picture is a reference picture for a single layer video codec.

11

11. The apparatus of claim 10 , wherein the processor is further configured to add the resampled picture to a reference picture list for the current picture to be encoded.

12

12. The apparatus of claim 10 , wherein the processor is further configured to use the resampled reference picture as a collocated picture for temporal motion vector derivation.

13

13. The apparatus of claim 1 , wherein the reference picture is a reference picture from a lower layer than the picture to be encoded in a multi-layer video codec.

14

14. The apparatus of claim 13 , wherein the processor is further configured to use the resampled picture to perform inter layer prediction.

15

15. The apparatus of claim 13 , wherein the processor is further configured to add the resampled picture to a reference picture list for the picture to be encoded.

16

16. The apparatus of claim 13 , wherein the processor is further configured to use the reference picture as a collocated picture for temporal motion vector derivation.

17

17. The apparatus of claim 1 , wherein the processor is further configured to encode the picture to be encoded using the resampled picture.

18

18. The apparatus of claim 1 , wherein the processor is further configured to decode the picture using the resampled picture.

19

19. The apparatus of claim 1 , wherein the processor is further configured to associate each block in the resampled picture with a slice header of the slice which includes the collocated block in the reference picture.

20

20. The apparatus of claim 19 , wherein the block size is 16×16.

21

21. The apparatus of claim 1 , further comprising one or more of a desktop computer, a notebook computers, a laptop computer, a tablet computer, a set-top box, a telephone handset, a smart phone, a smart pad, a television, a camera, a display device, a digital media player, a video gaming console, or a video streaming device.

22

22. A method of coding video information, the method comprising: resampling video information of a reference picture of a picture to be encoded to obtain a resampled picture, the reference picture having a plurality of slices and having a different picture size than the picture to be encoded; determining slice definitions for a plurality of resampled slices in the resampled picture, the plurality of slices of the resampled picture corresponding to a plurality of slices of the reference picture; determining, based at least partially on the slice definitions, whether each of the plurality of slices of the resampled picture satisfies one or more slice definition rules; and in response to determining that at least one of the plurality of slices of the resampled picture does not satisfy at least one slice definition rule, modifying the slice definition for at least some of the plurality of slices in the resampled picture that do not satisfy the at least one slice definition scan rule to satisfy the at least one slice definition rule.

23

23. The method of claim 22 , wherein said determining comprises determining whether each of the plurality of slices of the resampled picture satisfies the one or more slice definition rules by determining whether a slice from the plurality of slices in the resampled picture includes a disparity between a height of the slice in a first column and a height of the slice in a previous column that is greater than one largest coding unit (LCU).

24

24. The method of claim 22 , wherein said determining comprises determining whether each of the plurality of slices of the resampled picture satisfies the one or more slice definition rules by determining whether a slice from the plurality of slices in the resampled picture includes more than one incomplete scan line.

25

25. The method of claim 22 , wherein said determining comprises determining whether each of the plurality of slices of the resampled picture satisfies the one or more slice definition rules by determining whether a slice from the plurality of slices in the resampled picture includes a partial LCU.

26

26. The method of claim 25 , wherein said modifying comprises rounding the partial LCU.

27

27. The method of claim 26 , wherein rounding the partial LCU comprises modifying the slice definition for at least one slice of the plurality of slices in the resampled picture that includes the partial LCU to remove the partial LCU from the slice definition.

28

28. The method of claim 26 , wherein rounding the partial LCU comprises modifying the slice definition for at least one slice of the plurality of slices in the resampled picture that includes the partial LCU to include the entire LCU corresponding to the partial LCU in the slice definition.

29

29. The method of claim 22 , wherein said modifying comprises dividing at least one slice of the plurality of slices into multiple sub-slices.

30

30. The method of claim 29 , wherein, for at least some sub-slices of the multiple sub-slices, the method further comprises associating at least some of the information included in a slice header of the at least one slice of the plurality of slices in the resampled picture with a slice header of the sub-slice.

31

31. The method of claim 22 , wherein the reference picture is a reference picture for a single layer video codec.

32

32. The method of claim 31 , further comprising adding the resampled picture to a reference picture list for the picture to be encoded.

33

33. The method of claim 31 , further comprising using the resampled reference picture as a collocated picture for temporal motion vector derivation.

34

34. The method of claim 22 , wherein the reference picture is a reference picture from a lower layer than the picture to be encoded in a multi-layer video codec.

35

35. The method of claim 34 , further comprising using the resampled picture to perform inter layer prediction.

36

36. The method of claim 34 , further comprising adding the resampled picture to a reference picture list for the picture to be encoded.

37

37. The method of claim 34 , further comprising using the resampled reference picture as a collocated picture for temporal motion vector derivation.

38

38. The method of claim 22 , further comprising encoding the picture to be encoded using the resampled picture.

39

39. The method of claim 22 , further comprising decoding an encoded copy of the picture using the resampled layer.

40

40. The method of claim 22 , further comprising associating each block in the resampled picture with a slice header of the slice which includes the collocated block in the reference picture.

41

41. The method of claim 40 , wherein the block size is 16×16.

42

42. Non-transitory computer-readable storage media having instructions stored thereon that when executed cause an apparatus comprising at least one processor to: resample video information of a reference picture to obtain a resampled picture, the reference picture having a plurality of slices and having a different picture size than a picture to be encoded; determine slice definitions for a plurality of slices in the resampled picture, the plurality of slices of the resampled picture corresponding to a plurality of slices of the reference picture; determine, based at least partially on the slice definitions, whether each of the plurality of slices of the resampled picture satisfies one or more slice definition rules; and in response to determining that at least one of the plurality of slices of the resampled picture does not satisfy at least one slice definition rule, modify the slice definition for at least some of the plurality of slices in the resampled picture that do not satisfy the at least one slice definition rule to satisfy the slice definition rule.

43

43. The non-transitory computer readable storage medium of claim 42 , wherein the apparatus is further configured to determine whether each of the plurality of slices of the resampled picture satisfies the one or more slice definition rules by determining whether a slice from the plurality of slices of the resampled picture includes a partial LCU.

44

44. The non-transitory computer readable storage medium of claim 43 , wherein the apparatus is further configured to modify the slice definition for at least some of the plurality of slices of the resampled picture that do not satisfy at least one slice definition rule by modifying the slice definition for at least one slice of the plurality of slices that includes the partial block to either (1) remove the partial LCU from the slice definition; or (2) include the entire LCU corresponding to the partial LCU in the slice definition.

45

45. The non-transitory computer readable storage medium of claim 42 , wherein the apparatus is further configured to modify the slice definition for at least some of the plurality of slices of the resampled picture that do not satisfy at least one slice definition rule by dividing at least one slice of the plurality of slices into multiple sub-slices.

46

46. An apparatus configured to code video information, the apparatus comprising: means for storing video information associated with a picture; means for resampling video information of the picture to obtain a resampled picture, the picture having a plurality of slices; means for determining slice definitions for a plurality of slices of the resampled picture, the plurality of slices of the resampled picture corresponding to the plurality of slices of the picture; means for determining, based at least partially on the slice definitions, whether each of the plurality of slices of the resampled picture satisfies one or more slice definition rules; and means for modifying the slice definition for at least some of the plurality of slices of the resampled picture in response to determining that at least one of the plurality of slices of the resampled picture does not satisfy at least one of the one or more slice definition rules.

47

47. The apparatus of claim 46 , wherein at least two of the said means for storing video information, means for resampling, means for determining slice definitions, means for determining, and means for modifying comprise the same means.

48

48. The apparatus of claim 46 , wherein said means for determining is further configured to determine whether each of the plurality of slices of the resampled picture satisfies the one or more slice definition scan rules by determining whether a slice from the plurality of slices of the resampled picture includes a partial LCU.

49

49. The apparatus of claim 48 , wherein said means for modifying is further configured to modify the slice definition for at least some of the plurality of slices of the resampled picture by modifying the slice definition for at least one slice of the plurality of slices that includes the partial LCU to either (1) remove the partial LCU from the slice definition; or (2) include the entire LCU corresponding to the partial LCU in the slice definition.

50

50. The apparatus of claim 46 , wherein said means for modifying is further configured to modify the slice definition for at least some of the plurality of slices of the resampled layer by dividing at least one slice of the plurality of slices into multiple sub-slices.

Classification Codes (CPC)

Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.

Patent Metadata

Filing Date

December 20, 2013

Publication Date

February 23, 2016

Want to explore more patents?

Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.

Citation & reuse

Analysis on this page is generated by Patentable — an AI-powered patent intelligence platform. AI-generated summaries, explanations, and analysis may be reused with attribution and a visible link back to the canonical URL below. Patent abstracts and claims are USPTO public domain.

Cite as: Patentable. “Inter-layer reference picture generation for HLS-only scalable video coding” (US-9270991). https://patentable.app/patents/US-9270991

© 2026 Patentable. All rights reserved.

Patentable is a research and drafting-assistant tool, not a law firm, and does not provide legal advice. Documents we generate are drafts for review by a licensed patent attorney.