Memory Efficient Policy-Based File Deletion System

1. A system comprising: a batch server comprising one or more hardware processors and a memory storing instructions, the one or more hardware processors configurable to: instruct a master computing system, in communication with a plurality of slave computing systems, to distribute a plurality of policies among the plurality of slave computing systems such that each one of the plurality of policies is assigned to a corresponding one of the slave computing systems, each of the plurality of policies being configurable to, when executed by a corresponding one of the plurality of slave computing systems, cause the corresponding one of the slave computing systems that has been assigned the policy to: identify a set of files that satisfies the policy, and cause the set of files to be deleted by instructing a second master computing system to delete the set of files, the second master computing system configurable to: monitor central processing unit (CPU) usage of a second plurality of slave computing systems; and distribute responsibility for deletion of the set of files among at least a portion of the second plurality of slave computing systems according to a result of monitoring CPU usage of the second plurality of slave computing systems.

2. The system as recited in claim 1 , the database system further configurable to cause the corresponding one of the plurality of slave computing systems to cause the set of files to be deleted by instructing a file storage system to delete the set of files.

3. The system as recited in claim 1 , the database system further configurable to cause a name of each of the plurality of policies to be provided as a key parameter of a map task executed by a corresponding one of the second plurality of slave computing systems.

4. The system as recited in claim 1 , the one or more hardware processors further configurable to: cause instructions to be sent to the master computing system for execution by each of the plurality of slave computing systems.

5. The system as recited in claim 1 , the one or more hardware processors further configurable to transmit identifiers of the policies to the master computing system.

6. The system as recited in claim 5 , each of the identifiers corresponding to one of a plurality of policy files.

7. The system as recited in claim 1 , at least one of the policies corresponding to a particular group, customer, or tenant.

8. A computer program product comprising computer-readable program code capable of being executed by one or more processors when retrieved from a non-transitory computer-readable medium, the program code comprising computer-readable instructions configurable to cause: instructing a master computing system in communication with a plurality of slave computing systems, to distribute a plurality of policies among the plurality of slave computing systems such that each one of the plurality of policies is assigned to a corresponding one of the slave computing systems, each of the plurality of policies being configurable to cause a corresponding one of the plurality of slave computing systems that has been assigned the policy to: identify a set of files that satisfies the policy, and cause the set of files to be deleted by instructing a second master computing system to delete the set of files, the second master computing system configurable to: monitor central processing unit (CPU) usage of a second plurality of slave computing systems; and distribute responsibility for deletion of the set of files among at least a portion of the second plurality of slave computing systems according to a result of monitoring CPU usage of the second plurality of slave computing systems.

9. The computer program product as recited in claim 8 , the program code comprising instructions further configured to cause: the corresponding one of the plurality of slave computing systems to cause the set of files to be deleted by instructing a file storage system to delete the set of files.

10. The computer program product as recited in claim 8 , the program code comprising instructions further configured to cause: providing a name of each of the plurality of policies as a key parameter of a map task executed by a corresponding one of the second plurality of slave computing systems.

11. The computer program product as recited in claim 8 , the program code comprising instructions further configured to cause: sending instructions to the master computing system for execution by each of the plurality of slave computing systems.

12. The computer program product as recited in claim 8 , the program code comprising computer-readable instructions further configurable to cause: transmitting identifiers of the plurality of policies to the master computing system.

13. The computer program product as recited in claim 12 , each of the identifiers corresponding to one of a plurality of policy files.

14. The computer program product as recited in claim 8 , at least one of the policies corresponding to a particular group, customer, or tenant.

15. A method, comprising: instructing a master computing system, in communication with a plurality of slave computing systems, to distribute a plurality of policies among the plurality of slave computing systems such that each one of the plurality of policies is assigned to a corresponding one of the slave computing systems, each of the plurality of policies being configurable to cause a corresponding one of the plurality of slave computing systems that has been assigned the policy to: identify a set of files that satisfies the policy, and cause the set of files to be deleted by instructing a second master computing system to delete the set of files, the second master computing system configurable to: monitor central processing unit (CPU) usage of a second plurality of slave computing systems; and distribute responsibility for deletion of the set of files among at least a portion of the second plurality of slave computing systems according to a result of monitoring CPU usage of the second plurality of slave computing systems.

16. The method as recited in claim 15 , further comprising: causing the corresponding one of the plurality of slave computing systems to cause the set of files to be deleted by instructing a file storage system to delete the set of files.

17. The method as recited in claim 15 , further comprising: sending instructions to the master computing system for execution by each of the plurality of slave computing systems.

18. The method as recited in claim 15 , the instructions further configurable to instruct the master computing system to distribute the plurality of policies among the plurality of slave computing systems by distributing a plurality of policy files corresponding to the plurality of policies among the slave computing systems.

19. The method as recited in claim 15 , further comprising: transmitting identifiers of the plurality of policies to the master computing system.

20. The method as recited in claim 19 , each of the identifiers corresponding to one of a plurality of policy files.

21. The method as recited in claim 15 , at least one of the policies corresponding to a particular group, customer, or tenant.