11651470

Scheduling Jobs on Graphical Processing Units

PublishedMay 16, 2023
Assigneenot available in USPTO data we have
Technical Abstract

Patent Claims
13 claims

Legal claims defining the scope of protection, as filed with the USPTO.

2

2. The method of claim 1, wherein the GPU operational cost component is indicative of an expected cost of operating the one or more GPUs according to the set of allocations and the job migration cost component is indicative of expected costs of job migrations resulting from the set of allocations.

3

3. The method of claim 1, wherein updating allocations of the existing jobs according to the determined set of allocations comprises migrating an existing job from one GPU of the one or more GPUs to another GPU of the one or more GPUs.

5

5. The method of claim 1, comprising receiving weights for the GPU operational cost component and job migration cost component.

7

7. The method of claim 1, wherein determining the set of allocations that minimizes the cost function comprises determining, by a GPU scheduler, decisions for allocating new and existing jobs, a number of job migrations and migration cost, decisions on migrating existing jobs, and decisions on powering off/on GPUs.

9

9. The non-transitory machine-readable storage medium of claim 8, wherein the GPU operational cost component is indicative of an expected cost of operating the one or more GPUs according to the set of allocations and the job migration cost component is indicative of expected costs of job migrations resulting from the set of allocations.

10

10. The non-transitory machine-readable storage medium of claim 8, wherein instructions to cause the processing resource to update allocations of the existing jobs according to the determined set of allocations comprise instructions to cause the processing resource to migrate an existing job from one GPU of the one or more GPUs to another GPU of the one or more GPUs.

11

11. The non-transitory machine-readable storage medium of claim 8, further comprising instructions to cause the processing resource to, in response to one of the existing jobs completing, determining a second set of job allocations for a second set of jobs that minimizes the cost function, the second set of jobs comprising the existing jobs excluding the completed one of the existing jobs.

12

12. The non-transitory machine-readable storage medium of claim 8, comprising instructions that, when executed, cause the processing resource to receive weights for the operational cost and migration cost.

14

14. The computing system of claim 13, wherein the GPU operational cost component is indicative of an expected cost of operating the one or more GPUs according to the set of allocations and the job migration cost component is indicative of expected costs of job migrations resulting from the set of allocations.

15

15. The computing system of claim 13, wherein the GPU scheduler updating allocations of the existing jobs comprises the GPU scheduler migrating an existing job from one GPU of the one or more GPUs to another GPU of the one or more GPUs.

16

16. The computing system of claim 13, wherein the GPU scheduler is to, in response to one of the existing jobs completing, determine a second set of job allocations for a second set of jobs that minimizes the cost function, the second set of jobs comprising the existing jobs excluding the completed one of the existing jobs.

17

17. The computing system of claim 13, wherein the GPU scheduler is to receive weights for the GPU operational cost component and job migration cost component.

19

19. The computing system of claim 13, wherein the GPU scheduler determining the set of allocations that minimizes the cost function comprises determining, by the GPU scheduler, decisions for allocating new and existing jobs, a number of job migrations and migration cost, decisions on migrating existing jobs, and decisions on powering off/on GPUs.

Patent Metadata

Filing Date

Unknown

Publication Date

May 16, 2023

Inventors

Diman Zad Tootaghaj
Junguk Cho
Puneet Sharma

Want to explore more patents?

Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.

Citation & reuse

Analysis on this page is generated by Patentable — an AI-powered patent intelligence platform. AI-generated summaries, explanations, and analysis may be reused with attribution and a visible link back to the canonical URL below. Patent abstracts and claims are USPTO public domain.

Cite as: Patentable. “SCHEDULING JOBS ON GRAPHICAL PROCESSING UNITS” (11651470). https://patentable.app/patents/11651470

© 2026 Patentable. All rights reserved.

Patentable is a research and drafting-assistant tool, not a law firm, and does not provide legal advice. Documents we generate are drafts for review by a licensed patent attorney.