Please enable JavaScript.
Coggle requires JavaScript to display documents.
Kafka - Coggle Diagram
Kafka
-
Producer
Producer ACK
ACK=1, producer needs to accept Leader's ack( at most once), data can be lost when leader down, but data not sync to follower
ACK=all, producer needs to accept ack from leader and followers(at least once/ exactly)
ACK=0, no ack, it can cause data lost (at most once)
Prodcuer Key
when key == null, message is dispatched to partitions by round-robin
when key != null, message will be dispatched by hash key to corresponding partition
consumer
consumer group
-
each consumer group can see all data, but if multiple consumers and partitions, each consumer can only pull data from assigned partition(s)
each partition can only be consumed by one consumer
consumer and partition can be 1-1 or 1-many, so numbers of consumers more than partitions means some consumers can't pull any data,
-
-
-