Path 1 of 10
Kafka Foundations
What Kafka is, why it exists, how event streaming differs from messaging, and when not to reach for it.
0 / 6 lessons completed ยท about 113 min in total
After this path you can
Outcomes
- Explain what problem a distributed log solves
- Tell event streaming apart from queue-based messaging
- Decide whether Kafka fits a given problem
Lessons
- 1What Kafka is and why it existsKafka is a distributed commit log: services append records to it, and any number of readers consume them at their own pace. See the problem it was built for and the smallest working picture.Foundation20 min
- 2Messaging vs event streaming: queues and logsA queue hands each message to one worker and removes it once acknowledged. A log keeps records and lets each reader track its own position. Compare Kafka and RabbitMQ on that basis.Foundation22 min
- 3Event-driven architecture: sync calls vs async eventsEvents, commands and queries are different messages with different coupling. See what moving an order flow from synchronous calls to events buys, and what it costs.Foundation22 min
- 4The Kafka ecosystem: what is Apache and what is notThe pieces around a Kafka cluster, which of them ship with Apache Kafka, which come from vendors or other projects, and where each sits in the order system.Foundation16 min
- 5What Kafka is used for: seven families of useThe seven uses named in the Kafka documentation, each turned into topics, keys, retention and consumers for a concrete online shop.Foundation16 min
- 6When not to use KafkaThe limits of a partitioned log: seven situations where Kafka is the wrong tool or needs an adaptation, and what to use or do instead.Foundation17 min
Related labs
Simulations, not a real cluster.
- Lab 1Producer publishing messagesFoundation20 min
- Lab 2Partition key and orderingFoundation20 min
- Lab 3Consumer group assignmentFoundation20 min
- Lab 4Adding and removing consumersIntermediate25 min
- Lab 5Duplicate message processingIntermediate25 min
- Lab 6Consumer crash before offset commitIntermediate25 min
- Lab 7Poison message and dead-letter queueIntermediate25 min
- Lab 9Broker failure and leader electionAdvanced30 min
- Lab 12Transactional outboxAdvanced30 min
- Lab 15Schema evolutionAdvanced35 min