Patentable/Patents/US-10602110
US-10602110

Chroma reshaping based on just noticeable differences

PublishedMarch 24, 2020
Assigneenot available in USPTO data we have
Inventorsnot available in USPTO data we have
Technical Abstract

Methods and systems for chroma reshaping are applied to images or video frames. The method comprises receiving at least one image or video frame. The color space of the at least one image or video frame is partitioned in M1×M2×M3 non-overlapping bins. For each bin it is determined whether it is a valid bin, for which the at least one image or video frame has at least one pixel with a color value falling within said bin. For each chroma channel, a required number of codewords is calculated for representing two color values in said valid bin that have consecutive codewords for the respective chroma channel without a noticeable difference. At least one content-aware chroma forward reshaping function is generated based on the calculated required numbers of codewords and applied to the at least one image or video frame.

Patent Claims
16 claims

Legal claims defining the scope of protection, as filed with the USPTO.

1

1. A method comprising: receiving, by a computer, at least one image or video frame; for a color space of the at least one image or video frame, partitioning, by the computer, the color space in M1×M2×M3 non-overlapping bins; determining for each bin whether it is a valid bin, a valid bin being a bin for which the at least one image or video frame has at least one pixel with a color value falling within said bin; for each chroma channel of the color space: calculating, by the computer and for each valid bin, a required number of codewords necessary for the respective chroma channel to represent, without a noticeable difference, two color values in said valid bin that have consecutive codewords for the respective chroma channel; generating, by the computer, at least one content-aware chroma forward reshaping function, based on the calculated required numbers of codewords; applying, by the computer, the at least one content-aware chroma forward reshaping function to the at least one image or video frame.

2

2. The method of claim 1 , wherein the at least one content-aware chroma forward reshaping function comprises a single channel chroma forward reshaping function for each chroma channel.

3

3. The method of claim 2 , wherein the M1×M2×M3 non-overlapping bins of the partitioning of the color space comprise M1 arrays of M2×M3 bins in a luma direction, M2 arrays of M1×M3 bins in a first chroma direction and M3 arrays of M1×M2 bins in a second chroma direction, the method further comprising: calculating, by the computer, for each of the M2 arrays in the first chroma direction, a first maximum value among the calculated required numbers of codewords of the valid bins in the respective array; and calculating, by the computer, for each of the M3 arrays in the second chroma direction, a second maximum value among the calculated required numbers of codewords of the valid bins in the respective array.

4

4. The method of claim 1 , wherein generating, by the computer, the at least one content-aware chroma forward reshaping function comprises building a codeword look-up table.

5

5. The method of claim 1 , wherein the at least one content-aware chroma forward reshaping function comprises a multi channel chroma forward reshaping function.

6

6. The method of claim 5 , wherein generating, by the computer, the at least one content-aware chroma forward reshaping function comprises calculating a cumulative sum of the calculated required numbers of codewords over the M1×M2×M3 non-overlapping bins to obtain a three dimensional look-up table.

7

7. The method of claim 6 , wherein generating, by the computer, the at least one content-aware chroma forward reshaping function further comprises calculating a multi-channel forward reshaping matrix by minimizing a cost function between chroma values of the at least one image or video frame predicted by the multi-channel forward reshaping matrix and chroma values obtained by mapping the at least one image or video frame using the three dimensional look-up table.

8

8. The method of claim 5 , further comprising generating, by the computer, at least one backward reshaping function based on the at least one content-aware chroma forward reshaping function.

9

9. The method of claim 8 , further comprising approximating, by the computer, the at least one backward reshaping function by a polynomial function.

10

10. The method of claim 9 , wherein the polynomial function is a multi-piece 2nd order polynomial function.

11

11. The method of claim 8 , wherein generating, by the computer, the at least one backward reshaping function comprises generating a look-up table via inverse scanning of the at least one content-aware chroma forward reshaping function.

12

12. The method of claim 8 , wherein generating, by the computer, the at least one backward reshaping function comprises calculating a multi-channel backward reshaping matrix by minimizing a cost function between chroma values of the at least one image or video frame predicted by the multi-channel backward reshaping matrix and chroma values resulting from applying the multi channel chroma forward reshaping function to the at least one image or video frame.

13

13. The method of claim 1 , wherein the color space is the ICtCp color space.

14

14. The method of claim 1 , wherein the step of calculating, by the computer, for the respective chroma channel the required number of codewords for each valid bin comprises: accessing a content independent partitioning of the color space for said respective chroma channel, that has M1×M2×M3 non-overlapping bins, with M1 rows of M2×M3 bins in the luma direction, M2 rows of M1×M3 bins in the first chroma direction and M3 rows of M1×M2 bins in the second chroma direction, wherein each bin is linked to a required number of codewords.

15

15. A data-processing system configured to perform with one or more processors the method according to claim 1 .

16

16. A tangible, non-transitory, computer program product having instructions which, when executed by a computing device or system, cause said computing device or system to perform the method according to claim 1 .

Classification Codes (CPC)

Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.

Patent Metadata

Filing Date

August 28, 2017

Publication Date

March 24, 2020

Want to explore more patents?

Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.

Citation & reuse

Analysis on this page is generated by Patentable — an AI-powered patent intelligence platform. AI-generated summaries, explanations, and analysis may be reused with attribution and a visible link back to the canonical URL below. Patent abstracts and claims are USPTO public domain.

Cite as: Patentable. “Chroma reshaping based on just noticeable differences” (US-10602110). https://patentable.app/patents/US-10602110

© 2026 Patentable. All rights reserved.

Patentable is a research and drafting-assistant tool, not a law firm, and does not provide legal advice. Documents we generate are drafts for review by a licensed patent attorney.