Please enable JavaScript.
Coggle requires JavaScript to display documents.
22.252: Managed Streaming for apache Kafka - Coggle Diagram
22.252: Managed Streaming for apache Kafka
AMZ MSK
Alternative to AMZ Kinesis
Fully managed Apache Kafka on AWS
Allow to create, update, delete clusters
MSK create, manages Kafka brokers nodes & Zookeeper nodes for you
Deploy MSK cluster in your VPC, multi AZ (up to 3 for HA)
Auto recovery from common Apache Kafka failures
Data stored on EBS volumes
for as long as you want
MSK Serverless
Run Apache Kafka on MSK without managing the capacity
MSK auto provision resource and scale compute and storage
KDS vs MSK
Kinesis Data stream
1 MB message size limit
Data Stream with Shards
Shard Split & Merge
TLS In flight Encryption
KMS at rest encryption
MSK
1MB default, up to 10MB
Kafka topics with partitions
Can only add partitions to a topic
PLAINTEXT or TLS in flight encryption
KMS at rest encryption
MSK Consumer
KDA for Apache Flink
AWS Glue
Lambda
Application Run on: EC2, ECS, EKS