Datacenter failure waves

  • Survive
  • Metal 14
  • Datacenter

Difficulty 4 of 5

Lookups run on database replicas of 60,000/s each. Wave 1: a rack switch fails. Wave 2: power feed A fails. Wave 3: the load grows to 1.5 times and feed B fails. You can afford three replicas now and 16 USD/mo more before wave 3.

Play level

Data centerZone RackZone RackZone RackZone RackHTTP/2HTTP/2Users80,000 req/sLoad balanc…1 vCPU · 1 GBKey-value s…2 vCPU · 2 GBKey-value s…2 vCPU · 2 GB
Data centerZone RackZone RackZone RackZone RackHTTP/2HTTP/2UsersLoad b…Key-va…Key-va…
The board at the start of the level
Failure domains on the floorTap for the next fault. Arrow keys move the replicas.

Two rows · 3 of 3 replicas up · load served

Goals and limits

Time within SLO
at least 95%
p99 latency
under 50 ms
Monthly cost
under 30 USD/mo
Waves
3
Time within SLO
at least 95%
Parts you can add
Key-value store
Part limit
6
Traffic
80,000 req/s

Concepts

How players did

Player results load from the server.