Legal claims defining the scope of protection, as filed with the USPTO.
2. The method of claim 1, wherein the GPU operational cost component is indicative of an expected cost of operating the one or more GPUs according to the set of allocations and the job migration cost component is indicative of expected costs of job migrations resulting from the set of allocations.
3. The method of claim 1, wherein updating allocations of the existing jobs according to the determined set of allocations comprises migrating an existing job from one GPU of the one or more GPUs to another GPU of the one or more GPUs.
5. The method of claim 1, comprising receiving weights for the GPU operational cost component and job migration cost component.
7. The method of claim 1, wherein determining the set of allocations that minimizes the cost function comprises determining, by a GPU scheduler, decisions for allocating new and existing jobs, a number of job migrations and migration cost, decisions on migrating existing jobs, and decisions on powering off/on GPUs.
9. The non-transitory machine-readable storage medium of claim 8, wherein the GPU operational cost component is indicative of an expected cost of operating the one or more GPUs according to the set of allocations and the job migration cost component is indicative of expected costs of job migrations resulting from the set of allocations.
10. The non-transitory machine-readable storage medium of claim 8, wherein instructions to cause the processing resource to update allocations of the existing jobs according to the determined set of allocations comprise instructions to cause the processing resource to migrate an existing job from one GPU of the one or more GPUs to another GPU of the one or more GPUs.
11. The non-transitory machine-readable storage medium of claim 8, further comprising instructions to cause the processing resource to, in response to one of the existing jobs completing, determining a second set of job allocations for a second set of jobs that minimizes the cost function, the second set of jobs comprising the existing jobs excluding the completed one of the existing jobs.
12. The non-transitory machine-readable storage medium of claim 8, comprising instructions that, when executed, cause the processing resource to receive weights for the operational cost and migration cost.
14. The computing system of claim 13, wherein the GPU operational cost component is indicative of an expected cost of operating the one or more GPUs according to the set of allocations and the job migration cost component is indicative of expected costs of job migrations resulting from the set of allocations.
15. The computing system of claim 13, wherein the GPU scheduler updating allocations of the existing jobs comprises the GPU scheduler migrating an existing job from one GPU of the one or more GPUs to another GPU of the one or more GPUs.
16. The computing system of claim 13, wherein the GPU scheduler is to, in response to one of the existing jobs completing, determine a second set of job allocations for a second set of jobs that minimizes the cost function, the second set of jobs comprising the existing jobs excluding the completed one of the existing jobs.
17. The computing system of claim 13, wherein the GPU scheduler is to receive weights for the GPU operational cost component and job migration cost component.
19. The computing system of claim 13, wherein the GPU scheduler determining the set of allocations that minimizes the cost function comprises determining, by the GPU scheduler, decisions for allocating new and existing jobs, a number of job migrations and migration cost, decisions on migrating existing jobs, and decisions on powering off/on GPUs.
Unknown
May 16, 2023
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.