Skip to content
Chaos Lab

Challenge 12 · intermediate · Chat

The busy channel

People read about 1,000 channels a second, spread over the message store's partitions. At 20 seconds something big happens in one huge channel: for 10 seconds, 3,000 extra reads a second all ask for that channel's latest messages. A channel lives on one partition, and each partition answers about 400 queries a second.

From 18 to 45 seconds, keep at least 99.5% of channel reads answering, with a p99 of 300 ms or less.

ready00:00 / 01:00Success · 10 s–p99 · 10 s–Delivery delaynone

Goal · measured 00:18–00:45

0 changes · par 1
  • Channel reads answer ≥ 99.5%not measured yet
  • Read p99 ≤ 300 msnot measured yet

This is a simulation. Its numbers come from a model of a typical system, not from measuring real servers. The same link and seed always give the same run. How the Chaos Lab works.