Path 6 of 10
Reliability and Error Handling
What fails, how it shows up, and how retries, dead letter topics and idempotency contain it.
0 / 5 lessons completed ยท about 148 min in total
After this path you can
Outcomes
- Classify a failure as transient or permanent
- Build a retry and dead letter flow that does not block a partition
- Shut down and recover without losing or repeating work
Lessons
- 1What can fail, and what each failure looks likeA map of producer, broker, network, consumer and dependency failures: the symptom your application sees, what Kafka does by itself, and what your code still has to do.Intermediate25 min
- 2Poison messages and error handlingWhy one record that can never be processed blocks a partition under at-least-once delivery, and how to classify, skip, dead-letter or stop in Spring for Apache Kafka.Intermediate28 min
- 3Retries, back-off and retry topicsBlocking retries keep order and stall the partition; retry topics keep the partition moving and give up order. How each works, how they meet max.poll.interval.ms, and how to retry safely.Advanced30 min
- 4Dead letter topics: park, inspect, replayWhat belongs in a dead letter topic, what Spring records with each failed record, how to size and alert on it, and how to replay it without creating new damage.Intermediate30 min
- 5Out-of-order events, graceful shutdown and recoveryWhy events arrive out of order and how a consumer stays correct anyway, how to stop a consumer without causing duplicates or stalls, and how to recover after an incident.Advanced35 min
Related labs
Simulations, not a real cluster.
- Lab 2Partition key and orderingFoundation20 min
- Lab 4Adding and removing consumersIntermediate25 min
- Lab 5Duplicate message processingIntermediate25 min
- Lab 6Consumer crash before offset commitIntermediate25 min
- Lab 7Poison message and dead-letter queueIntermediate25 min
- Lab 8Retry and backoff strategyIntermediate30 min
- Lab 9Broker failure and leader electionAdvanced30 min
- Lab 13Database unavailable while consuming Kafka messagesAdvanced35 min
- Lab 15Schema evolutionAdvanced35 min