Please enable JavaScript.
Coggle requires JavaScript to display documents.
Kafka Reliability - Coggle Diagram
Kafka Reliability
broker.rack
Broker-level
Availability Zones as separate racks
rack name for each broker
Unclean Leader Election
Broker and Cluster-wide levels
unclean.leader.election.enable
default value is True (Should be False, giving the consequences)
it is better to set to False to avoid data loss!
When no in-sync replica exists...
min.insync.replicas
Topic and Broker-level configurations
Ensures that data is written into minimum amount of replicas
NotEnoughReplicasException
Validation Steps
Validate Configuration
Validate Application
Monitor App in Production
Keeping replicas in Sync
zookeeper.session.timeout.ms
18s from version 2.5.0
replica.lag.time.max.ms
30s from versiojn 2.50
default.replication.factor
Broker-level for automatically created topics
replication.factor
Topic-level
Producer-Broker communications
enable.idempotence=true
Broker is expected to reject duplicates