Please enable JavaScript.
Coggle requires JavaScript to display documents.
Kinesis (Kinesis Streams (Shards are persistence layer (7h up to 24 hours)…
Kinesis
-
-
-
Types
Kinesis Streams
input --> processing tools (lambda, custom code on ec2, Data Analytics) --> output
Kinesis Firehose
Input --> Firehose Stream (continously load data) --> S3, Redshift, Elasticsearch, Splunk
-
-
-
-
- default 500 Shards (can be more on request)
- 1000 writes/s
- data processed in Shards (async)
- Data has PartitionKey and Sequence
KCL --> Kinesis Client Library (best for reading)
KPL --> Kinesis Producer Library (writing)
Kinesis Data Stream API (could be used but should use one of the others)