Systems and Methods for Processing Data in Security Systems Using Parallelism, Stateless Queries, Data Slicing, or Asynchronous Pull Mechanisms

1. A method for processing data in a security system, the method comprising: each of a plurality of data pull devices of a central server pulling data from a respective one of a plurality of regional server databases, wherein a number of the plurality of data pull devices equals a number of the plurality of regional server databases, wherein the plurality of data pull devices function asynchronously, wherein each of the plurality of data pull devices is programmed to pull the respective data from the respective one of the plurality of regional server databases at a respective predetermined time interval, wherein the respective predetermined time interval for a first of the plurality of data pull devices is different than the respective predetermined time interval for a second of the plurality of data pull devices, and wherein a central server database has a first schema, and wherein one of the plurality of regional server databases has a second, different schema, and the central server executing a template matching process to identify portions of the central server database matching portions of the one of the plurality of regional server databases.

2. The method of claim 1 further comprising: configuring a starting point of each of the plurality of regional server databases; and pulling the data from the plurality of regional server databases associated with time after the starting point.

3. The method of claim 2 further comprising configuring the starting point based on received user input.

4. The method of claim 1 wherein changes within each of the plurality of regional server databases are maintained within each of the plurality of regional server databases, and wherein the central server captures the changes within each of the plurality of regional server databases as needed.

5. The method of claim 1 wherein the central server includes microservice architecture.

6. The method of claim 1 wherein each of the plurality of data pull devices exits a low power sleep state at the respective predetermined time interval to pull the data from the respective one of the plurality of regional server databases.

7. The method of claim 1 further comprising each of the plurality of data pull devices placing the data from the respective one of the plurality of regional server databases in a respective one a plurality of data queues, wherein the respective one of the plurality of data queues is determined based on a state of the data.

8. A method for processing data in a security system, the method comprising: each of a plurality of threads of a central server retrieving a predetermined size of data from a plurality of regional server databases, wherein each of the plurality of threads are not assigned to any specific regional server database of the plurality of regional server databases, such that any of the plurality of threads can retrieve the data from any of the plurality of regional server databases, and wherein the central server identifies a load for the plurality of threads and assigns each of the plurality of threads to a respective portion of the load.

9. The method of claim 8 further comprising: configuring a starting point of each of the plurality of regional server databases; and retrieving the data from the plurality of regional server databases associated with time after the starting point.

10. The method of claim 9 further comprising configuring the starting point based on received user input.

11. The method of claim 8 wherein changes within each of the plurality of regional server databases are maintained within each of the plurality of regional server databases, and wherein the central server captures the changes within each of the plurality of regional server databases as needed.

12. The method of claim 8 wherein a central server database has a first schema, and wherein one of the plurality of regional server databases has a second, different schema.

13. The method of claim 12 further comprising the central server executing a template matching process to identify portions of the central server database matching portions of the one of the plurality of regional server databases.

14. The method of claim 8 wherein the central server includes microservice architecture.

15. The method of claim 8 further comprising each of the plurality of threads placing the data from the respective one of the plurality of regional server databases in a respective one of a plurality of data queues, wherein the respective one of the plurality of data queues is determined based on a state of the data.

16. The method of claim 15 further comprising: the central server processing the data; and the central server moving the data as processed from the respective one of the plurality of data queues to a processed one of the plurality of data queues.

17. A method for processing data in a security system, the method comprising: each of a plurality of data pull devices of a central server retrieving data from a respective one of a plurality of regional server databases, wherein a number of the plurality of data pull devices equals a number of the plurality of regional server databases and the plurality of data pull devices function asynchronously; and each of the plurality of data pull devices placing the data from the respective one of the plurality of regional server databases in a respective one a plurality of data queues, wherein the respective one of the plurality of data queues is determined based on a state of the data.

18. The method of claim 17 further comprising: the central server processing the data; and the central server moving the data as processed from the respective one of the plurality of data queues to a processed one of the plurality of data queues.