Please enable JavaScript.
Coggle requires JavaScript to display documents.
17.194: Kinesis Data Firehose - Coggle Diagram
17.194: Kinesis Data Firehose
Features
Fully managed service, no administration, auto scale, serverless
AWS: RedShift/S3/OpenSearch
3rd part partner: Splunk/MongoDB/DataDog/NewRelic
Custom: send to any HTTP endpoint
Pay for data going through Firehose
Near Real time
60s latency min for non full batches
Min 1 MB of data at a time
Support many data format, convert, transform, compress
Support custom data transform using AWS Lambda
Can send failed or all data to a backup S3 bucket
Kinesis Data Stream vs Firehose
Stream
Streaming service for ingest at scale
Write custom code
Real time
Manage scaling
Data storage 1-365 days
Support replay capability
Firehose
Load stream data into S3/Redshift/OpenSearch/3rd party/Custom HTTP
Fully managed
Near real-time
Auto scale
No data storage
Not support replay capability