Please enable JavaScript.
Coggle requires JavaScript to display documents.
(Streaming Challenges (Processing out-of-order data, Maintaining large…
Streaming Challenges
Processing out-of-order data
Maintaining large amounts of state
Supporting high-data throughput
Processing each event exactly once despit machine failures
Handling load imbalance and stragglers
Responding to events at low latency
Joing with external data in other storrage systems
Determing how to update output sinks as new events arrive
Writting data transcationally to output systems
Updating your applications business logic at runtime
Streaming Usecase
Notification and Alerting
Realtime Reporting
Incremental ETL
Realtime Decision Making
Update Data to Serve in Real Time
Online Machine Learning
Design Points
Declaritive API
Event Time
Processing Time
Continuous V.S Micro-Batch Execution
an-record-at-a-time