Concept
Dead man's switch
A dead man's switch is an alert that fires all the time on purpose, sent to a system outside the monitoring stack. That outside system pages someone when the signal stops arriving. It covers the one failure ordinary alerts cannot report: the alerting pipeline itself being down.
- Alert that always fires
- Heartbeat to an outside service (succeeds)
- Monitoring breaks (fails)
- Heartbeat stops (fails)
- Outside service pages (succeeds)
Where you'll see it
Nothing on the site names this term yet.
Related concepts
Sources: kube-prometheus runbooks: the Watchdog alert ↗ · Report a problem
The definition is in our own words.