Skip to content
Chaos Lab

Challenge 13 · intermediate · Chat

The announcement

Every message is copied into each member's inbox by fan-out workers, in batches of 50 members; ordinary messages need a couple of batches each. At 20 and 40 seconds, an admin posts an announcement to a channel of 400,000 members: 8,000 batches each. The workers copy 1,000 batches a second, and every message shares their queue.

From 18 to 60 seconds, keep at least 99% of ordinary messages delivered within one second, with a delivery p99 of one second or less.

ready00:00 / 01:10Success · 10 s–p99 · 10 s–Delivery delaynone

Goal · measured 00:18–01:00

0 changes · par 1
  • Messages delivered within 1 s ≥ 99.0%not measured yet
  • Delivery p99 ≤ 1.0 snot measured yet

This is a simulation. Its numbers come from a model of a typical system, not from measuring real servers. The same link and seed always give the same run. How the Chaos Lab works.