Determining Desired Job Plan Based on Previous Inquiries in a Stream Processing Framework

1. A method for processing inquiries over continuous streams of data, the method, including logic when executed by a processor, comprising: identifying a new inquiry to be processed over a continuous dynamic stream of data, the new inquiry newly submitted and not derived from any previous inquiry; identifying a new job plan for execution of the new inquiry, the new job plan comprising an identification of a plurality of best currently available processing elements for processing the continuous dynamic stream of data in accordance with the new inquiry; identifying a previous inquiry determined to be similar to the new inquiry using keyword searches to identify matching keywords in the previous inquiry and the new inquiry according to a predetermined threshold for similarity; and obtaining a previously executed job plan that is associated with the identified previous inquiry, wherein the previously executed job plan includes processing elements that executed the previous inquiry; comparing the previously executed job plan with the new job plan based on pre-defined parameters; wherein the pre-defined parameter comprises determining whether input and output formatting of processing elements in the previously executed job plan and the identified currently available processing elements for the new job plan are the same; and automatically executing, if the input-output formatting is not the same, the previously executed job plan; automatically determining, if the input-output formatting is the same, a number of processing elements that are different between the new and previously executed job plan; and automatically executing, if there is no difference in the number of processing elements between the new and previously executed job plans, the new job plan or the previously executed job plan or both the new job plan and the previously executed job plan.

2. The method of claim 1 , wherein the plurality of best currently available processing elements are capable of satisfying user-defined performance criteria for processing the new inquiry over the continuous dynamic stream of data.

3. The method of claim 2 , wherein the user-defined performance criteria comprises speed, accuracy, efficiency, cost or combinations thereof.

4. The method of claim 1 , further comprising maintaining a log of previous inquiries and the previously executed job plans associated with each previous inquiry in the log.

5. The method of claim 1 , further comprising: comparing the new inquiry to a log of previous inquiries; and identifying the previous inquiry from the log of previous using predefined relevance matching metrics.

6. The method of claim 5 , wherein the relevance matching metrics comprises the key word searches.

7. The method of claim 5 , further comprising obtaining the previously executed job plan associated with the identified previous inquiry that satisfies the relevance metrics.

8. The method of claim 1 , further comprising identifying differences between the previously executed job plan and the new job plan; and using the identified differences to select at least one of the previously executed job plan and the new job plan for execution.

9. The method of claim 1 , wherein: the step of executing further comprises executing both the previously executed job plan and the new job plan; and the method further comprises: comparing results from the execution of the previously executed job plan and the new job plan; and selecting the previously executed job plan or the new job plan based on the results comparison.

10. The method of claim 9 , wherein the step of selecting further comprises selecting the new job plan, and the method further comprises using the new job plan to process the previous inquiry associated with the previously executed job plan.

11. The method of claim 9 , further comprising using the selected job plan to process subsequent inquiries.

12. The method of claim 1 , wherein the step of comparing the new job plan to the previously executed job plan further comprises comparing the new job plan to a plurality of previous inquiries that are determined to be sufficiently similar to the new inquiry using the keyword searches; and the step of executing the job plan further comprises executing at least one of the new job plan and one or more the previously executed job plans.

13. A non-transitory computer-readable medium containing a computer-readable code that when read by a computer causes the computer to perform a method for processing inquiries over continuous streams of data, the method comprising: identifying a new inquiry to be processed over a continuous dynamic stream of data, the new inquiry newly submitted and not derived from any previous inquiry; identifying a new job plan for execution of the new inquiry, the new job plan comprising an identification of a plurality of best currently available processing elements for processing the continuous dynamic stream of data in accordance with the new inquiry; identifying a previous inquiry determined to be sufficiently similar to the new inquiry using keyword searches to identify matching keywords in the previous inquiry and the new inquiry according to a predetermined threshold for similarity; and obtaining a previously executed job plan that is associated with the identified previous inquiry, wherein the previously executed job plan includes processing elements that executed the previous inquiry; comparing the previously executed job plan with the new job plan based on pre-defined parameters; wherein the pre-defined parameter comprises determining whether input and output formatting of processing elements in the previously executed job plan and the identified currently available processing elements for the new job plan are the same; and automatically executing, if the input-output formatting is not the same, the previously executed job plan; automatically determining, if the input-output formatting is the same, a number of processing elements that are different between the new and previously executed job plan; and automatically executing, if there is no difference in the number of processing elements between the new and previously executed job plans, the new job plan or the previously executed job plan or both the new job plan and the previously executed job plan.

14. The non-transitory computer-readable medium of claim 13 , wherein the plurality of best currently available processing elements are capable of satisfying user-defined performance criteria for processing the new inquiry over the continuous dynamic stream of data.

15. The non-transitory computer-readable medium of claim 14 , wherein the user-defined performance criteria comprises speed, accuracy, efficiency, cost or combinations thereof.

16. The non-transitory computer-readable medium of claim 13 , wherein the method further comprises: comparing the new inquiry to a log of previous inquiries; and identifying the previous inquiry from the log of previous inquiries that satisfies a predefined relevance metric.

17. The non-transitory computer-readable medium of claim 16 , wherein the method further comprises obtaining the previously executed job plan associated with the identified previous inquiry that satisfies the relevance metric.

18. The non-transitory computer-readable medium of claim 13 , wherein: the step of executing further comprises executing both the previously executed job plan and the new job plan; and the method further comprises: comparing results from the execution of the previously executed job plan and the new job plan; and selecting the previously executed job plan or the new job plan based on the results comparison.

19. The non-transitory computer-readable medium of claim 18 , wherein the step of selecting further comprises selecting the new job plan, and the method further comprises using the new job plan to process the previous inquiry associated with the previously executed job plan.

20. The non-transitory computer-readable medium of claim 18 , wherein the method further comprises using the selected job plan to process subsequent inquiries.