11295528

Image Rendering Method and Apparatus, Image Processing Device, and Storage Medium

PublishedApril 5, 2022
Assigneenot available in USPTO data we have
Technical Abstract

Patent Claims
19 claims

Legal claims defining the scope of protection, as filed with the USPTO.

1

1. An image rendering method, performed by an image processing device, the method comprising: obtaining an initial image of a current scene, and determining a first area and a second area on the initial image; rendering first image data of the first area based on a first rendering rule, to obtain a first sub-image; rendering second image data of the second area based on a second rendering rule, to obtain a second sub-image; and generating a target display image based on the first sub-image and the second sub-image, the first rendering rule being different from the second rendering rule, wherein the rendering the first image data of the first area comprises: obtaining color image data of the first area from the initial image, and obtaining depth image data of the first area, the depth image data indicating information about a distance between a scene object in the initial image and an eye of a user; and performing visual depth-of-field rendering on the color image data such that a color value of a target pixel in non-gaze point pixels is adjusted based on a difference between a reference focal length of the target pixel in the non-gaze point pixels and a target focal length of a gaze point pixel.

2

2. The method according to claim 1 , wherein the determining the first area and the second area comprises: performing tracking of the eye of the user, to determine a gaze point on the initial image; determining the first area based on the gaze point and a target field of view (FOV); and determining the second area based on the initial image and the first area.

3

3. The method according to claim 1 , wherein the performing the visual depth-of-field rendering comprises: determining the gaze point pixel from the color image data; determining depth information corresponding to the gaze point pixel based on the depth image data, and determining the target focal length of the user based on the determined depth information; and determining the reference focal length of the target pixel in the non-gaze point pixels in the color image data based on the target focal length and the depth image data.

4

4. The method according to claim 3 , wherein the performing the visual depth-of-field rendering further comprises: determining differential information between a reference focal length of each target pixel in the non-gaze point pixels and the target focal length; determining a mapping value of each target pixel according to the differential information, and selecting, from a reference layer set, a target layer based on the mapping value of each target pixel; and determining a color value of each target pixel according to a color value of a pixel that has a same image position as each target pixel on the target layer.

5

5. The method according to claim 4 , wherein the reference layer set comprises a plurality of reference layers, the plurality of reference layers have a same image size, and resolutions of the plurality of reference layers are different and less than an image resolution corresponding to the color image data.

6

6. The method according to claim 4 , wherein the target layer is a single target layer, and the determining the color value of each target pixel comprises: determining, as the color value of each target pixel, the color value of the pixel that has the same image position as each target pixel on the single target layer.

7

7. The method according to claim 4 , wherein the target layer comprises at least two target layers, and the determining the color value of each target pixel comprises: obtaining color values of pixels that have a same image position as each target pixel on the at least two target layers; to obtain at least two color values; and calculating the at least two color values according to a preset computation rule, and determining the color value of each target pixel based on a result of the calculating.

8

8. The method according to claim 1 , wherein the rendering the second image data of the second area comprises: rendering the second image data of the second area based on a resolution and an image quality parameter indicated by the second rendering rule, to obtain the second sub-image.

9

9. The method according to claim 1 , wherein the generating the target display image comprises: generating a mask layer; and performing layer superimposition on the first sub-image, the second sub-image, and the mask layer according to a position of the first sub-image on the initial image, to generate the target display image, the target display image comprising a gaze area and a non-gaze area, a color value of a pixel in the gaze area being based on color values of pixels in areas overlapping between the first sub-image, the second sub-image, and the mask layer, and a color value of a pixel in the non-gaze area being based on color values of pixels on the second sub-image.

10

10. The method according to claim 9 , wherein the performing the layer superimposition comprises: determining a superimposition area of the first sub-image on the second sub-image; superimposing the first sub-image and the mask layer on the superimposition area on the second sub-image, to generate an overlapping area; and rendering the gaze area based on a color value of each pixel in the overlapping area and rendering the non-gaze area based on a color value of each pixel in a remaining area other than the overlapping area on the second sub-image, to obtain the target display image.

11

11. The method according to claim 9 , further comprising, during the layer superimposition: obtaining a color value of each pixel in the gaze area by using a formula: B=I×M+O×(1−M), B representing a color value of a target pixel in the gaze area, I representing a color value of a pixel that has a same image position as the target pixel in the gaze area on the first sub-image, O representing a color value of a pixel that has the same image position as the target pixel in the gaze area on the second sub-image, M representing a mask value of a pixel that has the same image position as the target pixel in the gaze area on the mask layer.

12

12. The method according to claim 1 , wherein the generating the target display image comprises: determining a mixed area based on the first sub-image and the second sub-image; determining a color value of each pixel in the mixed area based on a distance between each pixel in the mixed area and a center of the initial image; and generating the target display image based on the color value of each pixel in the mixed area, a color value of each pixel in the second area, and a color value of each pixel in the first area.

13

13. The method according to claim 12 , wherein the first sub-image comprises an edge area and a core area, the core area being determined according to a gaze point and a target field of view (FOV), and wherein the determining the mixed area comprises: determining a reference area on the second sub-image, the reference area covering a corresponding area of the first sub-image on the second sub-image; and determining a part other than the core area in the reference area as the mixed area.

14

14. The method according to claim 12 , wherein the determining the color value of each pixel in the mixed area comprises: determining a reference color value of each target pixel in the mixed area based on a radius of a reference area and a distance between each target pixel in the mixed area and the center of the initial image; obtaining a first color value of a pixel that has a same image position as each target pixel in the mixed area on the first sub-image, and obtaining a second color value of a pixel that has the same image position as each target pixel in the mixed area on the second sub-image; and obtaining a final color value of each target pixel in the mixed area based on the first color value and the second color value.

15

15. The method according to claim 12 , wherein the generating the target display image comprises: rendering the mixed area based on the color value of each pixel in the mixed area; rendering a core area based on a color value of each pixel in the core area on the first sub-image, the core area being determined according to a gaze point and a target field of view (FOV); and rendering a remaining part other than the core area and the mixed area on the second sub-image according to a color value of each pixel in the remaining part on the second sub-image, to obtain the target display image.

16

16. A non-transitory computer-readable storage medium, storing a computer program, which, when executed by a processor, causes the processor to perform the method of claim 1 .

17

17. An image rendering method, performed by an image processing device, the method comprising: obtaining an initial image of a current scene, and determining a first area and a second area on the initial image; rendering first image data of the first area based on a first rendering rule, to obtain a first sub-image; rendering second image data of the second area based on a second rendering rule, to obtain a second sub-image; generating a mask layer, a size of the mask layer corresponding to a remaining area other than the first area in the second area; and generating a target display image based on the first sub-image, the second sub-image, and the mask layer, the first rendering rule being different from the second rendering rule, wherein the rendering the first image data of the first area comprises: obtaining color image data of the first area from the initial image, and obtaining depth image data of the first area, the depth image data indicating information about a distance between a scene object in the initial image and an eye of a user; and performing visual depth-of-field rendering on the color image data such that a color value of a target pixel in non-gaze point pixels is adjusted based on a difference between a reference focal length of the target pixel in the non-gaze point pixels and a target focal length of a gaze point pixel.

18

18. An image processing device, comprising a processor and a memory, the memory being configured to store a computer program, which, when executed by the processor, causes the processor to perform the method of claim 17 .

19

19. An image rendering apparatus, comprising: at least one memory configured to store program code; and at least one processor configured to read the program code and operate as instructed by the program code, the program code comprising: obtaining code configured to cause the at least one processor to obtain an initial image of a current scene; determination code configured to cause the at least one processor to determine a first area and a second area on the initial image; rendering code configured to cause the at least one processor to render first image data of the first area on the initial image based on a first rendering rule, to obtain a first sub-image, and render second image data of the second area on the initial image based on a second rendering rule, to obtain a second sub-image; and generation code configured to cause the at least one processor to generate a target display image according to the first sub-image and the second sub-image, the first rendering rule being different from the second rendering rule, wherein the rendering the first image data of the first area comprises: obtaining color image data of the first area from the initial image, and obtaining depth image data of the first area, the depth image data indicating information about a distance between a scene object in the initial image and an eye of a user; and performing visual depth-of-field rendering on the color image data such that a color value of a target pixel in non-gaze point pixels is adjusted based on a difference between a reference focal length of the target pixel in the non-gaze point pixels and a target focal length of a gaze point pixel.

Patent Metadata

Filing Date

Unknown

Publication Date

April 5, 2022

Inventors

Jui Hsiang CHAO
Huai-Che LEE

Want to explore more patents?

Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.

Citation & reuse

Analysis on this page is generated by Patentable — an AI-powered patent intelligence platform. AI-generated summaries, explanations, and analysis may be reused with attribution and a visible link back to the canonical URL below. Patent abstracts and claims are USPTO public domain.

Cite as: Patentable. “IMAGE RENDERING METHOD AND APPARATUS, IMAGE PROCESSING DEVICE, AND STORAGE MEDIUM” (11295528). https://patentable.app/patents/11295528

© 2026 Patentable. All rights reserved.

Patentable is a research and drafting-assistant tool, not a law firm, and does not provide legal advice. Documents we generate are drafts for review by a licensed patent attorney.