incident archive
chronological
2026-05-15
INC-0001 Crash
Interview exercise for μ-text troubleshooting candidates.
2026-05-16
INC-0002 The Lockup
Andy's first real incident — three processes deadlocked in a dependency cycle.
2026-05-17
INC-0003 Race Condition
Two workers overwrote the same customer state — Andy's first overnight incident.
2026-05-18
INC-0004 Cache Poisoning
Edge caches return tenant data to the wrong clients — isolation failure or something worse.
2026-05-19
INC-0005 Starvation
A retry consumer that never crashes, never blocks, and never runs.
2026-05-20
INC-0006 Livelock
Two recovery workers, both running flat out, neither finishing anything.
2026-05-21
INC-0007 Priority Inversion
The release gate waits on the garbage collector, and the garbage collector never gets to run.
2026-05-22
INC-0008 Split Brain
A partition left two halves of the control plane each certain they were in charge.
2026-05-23
INC-0009 Infinite Recursion
The repair service found a defect in its own repair, and then found a defect in that.
2026-05-24
INC-0010 Byzantine Fault
Five attestation replicas, five different histories, every one of them correctly signed.
2026-05-25
INC-0011 Man in the Middle
Four sessions, three pinned fingerprints, and a conversation that was never direct.
2026-05-26
INC-0012 Replay
Four authorisations, four good signatures, and one of them was ten minutes old.
2026-05-27
INC-0013 Covert Channel
The verified channel went quiet, so the message came through the retry delays instead.
2026-05-28
INC-0014 Backdoor
A hook that runs after the harness has finished deciding it is sound.
2026-05-29
INC-0015 Sandbox Escape
Four attempts to leave a container in one night, and one of them was not an attempt.
2026-05-30
INC-0016 Dead Man Switch
Four armed switches, one unrenewed deadline, and only one order that works.