Skip to content

Path 6 of 10

Reliability and Error Handling

What fails, how it shows up, and how retries, dead letter topics and idempotency contain it.

0 / 5 lessons completed ยท about 148 min in total

After this path you can

Outcomes

  • Classify a failure as transient or permanent
  • Build a retry and dead letter flow that does not block a partition
  • Shut down and recover without losing or repeating work

Lessons

  1. 1What can fail, and what each failure looks likeA map of producer, broker, network, consumer and dependency failures: the symptom your application sees, what Kafka does by itself, and what your code still has to do.Intermediate25 min
  2. 2Poison messages and error handlingWhy one record that can never be processed blocks a partition under at-least-once delivery, and how to classify, skip, dead-letter or stop in Spring for Apache Kafka.Intermediate28 min
  3. 3Retries, back-off and retry topicsBlocking retries keep order and stall the partition; retry topics keep the partition moving and give up order. How each works, how they meet max.poll.interval.ms, and how to retry safely.Advanced30 min
  4. 4Dead letter topics: park, inspect, replayWhat belongs in a dead letter topic, what Spring records with each failed record, how to size and alert on it, and how to replay it without creating new damage.Intermediate30 min
  5. 5Out-of-order events, graceful shutdown and recoveryWhy events arrive out of order and how a consumer stays correct anyway, how to stop a consumer without causing duplicates or stalls, and how to recover after an incident.Advanced35 min

Related labs

Simulations, not a real cluster.

  1. Lab 2Partition key and orderingFoundation20 min
  2. Lab 4Adding and removing consumersIntermediate25 min
  3. Lab 5Duplicate message processingIntermediate25 min
  4. Lab 6Consumer crash before offset commitIntermediate25 min
  5. Lab 7Poison message and dead-letter queueIntermediate25 min
  6. Lab 8Retry and backoff strategyIntermediate30 min
  7. Lab 9Broker failure and leader electionAdvanced30 min
  8. Lab 13Database unavailable while consuming Kafka messagesAdvanced35 min
  9. Lab 15Schema evolutionAdvanced35 min