Disclosed are embodiments for providing batch performance using a stream processor. In one embodiment, a method is disclosed comprising receiving, at a stream processor, an event, the stream processor including a plurality of processing stages; generating, by the stream processor, an augmented event based on the event, the augmented event including at least one additional field not appearing in the event, the additional field generated by an operation selected from the group consisting of a join or dimensional annotation operation; and emitting, by the stream processor, the augmented event to downstream consumer.
Legal claims defining the scope of protection, as filed with the USPTO.
2. The method of claim 1, further comprising querying the join table to determine if the event is in the join table prior to querying the join table to identify the secondary event and writing the event to the join table if the event is not in the join table.
3. The method of claim 2, wherein querying the join table to determine if the event is in the join table comprises extracting a join key from the event and querying the join table using the join key.
4. The method of claim 2, wherein querying the join table to identify the secondary event and querying the join table to determine if the event is in the join table comprise a single query.
5. The method of claim 1, further comprising labeling the secondary event if the secondary event is present in the join table.
6. The method of claim 5, wherein labeling the secondary event comprises setting a join status header field of the secondary event in the join table.
7. The method of claim 1, further comprising augmenting the secondary event if the secondary event is present in the join table to form the augmented event, the augmented event including one or more fields from the event.
9. The non-transitory computer-readable storage medium of claim 8, further comprising querying the join table to determine if the event is in the join table prior to querying the join table to identify the secondary event and writing the event to the join table if the event is not in the join table.
10. The non-transitory computer-readable storage medium of claim 9, wherein querying the join table to determine if the event is in the join table comprises extracting a join key from the event and querying the join table using the join key.
11. The non-transitory computer-readable storage medium of claim 9, wherein querying the join table to identify the secondary event and querying the join table to determine if the event is in the join table comprise a single query.
12. The non-transitory computer-readable storage medium of claim 8, further comprising labeling the secondary event if the secondary event is present in the join table.
13. The non-transitory computer-readable storage medium of claim 12, wherein labeling the secondary event comprises setting a join status header field of the secondary event in the join table.
14. The non-transitory computer-readable storage medium of claim 8, further comprising augmenting the secondary event if the secondary event is present in the join table to form the augmented event, the augmented event including one or more fields from the event.
16. The device of claim 15, the instructions further comprising querying the join table to determine if the event is in the join table prior to querying the join table to identify the secondary event and writing the event to the join table if the event is not in the join table.
17. The device of claim 16, wherein querying the join table to determine if the event is in the join table comprises extracting a join key from the event and querying the join table using the join key.
18. The device of claim 16, wherein querying the join table to identify the secondary event and querying the join table to determine if the event is in the join table comprise a single query.
19. The device of claim 15, the instructions further comprising labeling the secondary event if the secondary event is present in the join table.
20. The device of claim 15, further comprising augmenting the secondary event if the secondary event is present in the join table to form the augmented event, the augmented event including one or more fields from the event.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
January 16, 2023
April 9, 2024
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.