Skip to content
All outages

Incident · Easy · DNS/HTTP · Infra

One customer, whole internet

  • SEV1
  • GLOBAL
  • ~85% ERRORS
90s

The situation

Your CDN starts returning errors from about 85% of its network. Major news and shopping sites go dark. The last software release went out on 12 May. Seconds before the errors, one customer saved a change to their own service settings.

The evidence

Error rate, all locationsillustrative
  • errors %
Logs and signalsReconstructed
12 Mayedge software release deployed (no issues)
8 Juncustomer config change saved · config validator: accepted
+0s edge: errors on ~85% of network
+1m deploys today: 0

Your call

What is the root cause?

Charts and logs are reconstructions. Aim for 90 seconds; going over costs nothing.

Last updated: Official postmortem