Skip to content
Practice

SEV-1 simulationAPIs and dependencies · Real outage · Reconstructed data · 15–20 minutes

Incident #022 — Zero usage, zero quota

Customer impact

Sign-ins and credential checks are failing for every user account, so every app that needs authentication is down.

SignalCurrent value
Sign-ins and tokensfailing, all accounts
Apps needing sign-indown
Account database leadercannot write
Account database quotajust reduced
Reported usage0
Service-account workloadsmostly working

Your task

You have just been paged for the identity service. Work out why every account lookup fails, using the service map, metrics, logs, traces and recent changes. Stop the impact first, then name the cause and the permanent fix.

03:50Impact continuing · +0 minabout 0 thousand failed sign-ins lost since you joined

Investigate · each first look costs 2 simulated minutes

What do you want to look at?

Nothing open yet. Pick a view above. You do not have to open them all before you act.

Step 1 · mitigate · you can act at any time

Every user account is failing to sign in. What do you do first?