Skip to content
Chaos Lab

Challenge 55 · intermediate · Multi-region app

The region goes dark

The app runs in region A; region B is a full standby with eight servers and a database that is promoted automatically when traffic arrives. At 15 seconds region A loses power and nothing in it answers.

Failover is manual: the on-call engineer is paged and switches traffic by hand. Users' devices cache the DNS answer for 30 seconds (time is compressed: that stands for five minutes). From 15 to 90 seconds, at least 80% of requests must succeed, with no more than 10 seconds in which most of them fail.

ready00:00 / 01:30Success · 10 s–p99 · 10 s–Servingregion AOn B0%

Goal · measured 00:15–01:30

0 changes · par 2
  • Requests succeed ≥ 80.0%not measured yet
  • Seconds mostly down ≤ 10 snot measured yet

This is a simulation. Its numbers come from a model of a typical system, not from measuring real servers. The same link and seed always give the same run. How the Chaos Lab works.