Multi-cause incident

  • Fix
  • Level 26 of 41
  • Guard

Difficulty 5 of 5

The order screen stalls twice. Calls pile up after the remote service recovers. Restore response time and availability with at most three edits.

02:17 UTC. Orders stall. The graph shows two queue peaks and a long recovery after the second peak.

Play level

HTTP/2HTTP/2Users200 req/sWorker1 vCPU · 1 GBExternal API1 vCPU · 1 GB
HTTP/2HTTP/2Users200 req/sWorker1 vCPU · 1 GBExternal API1 vCPU · 1 GB
The board at the start of the level
A backup and its restoreArrow keys change the backup interval. Tap to change the restore rate.

Backup every 60 minutes · RPO 60 minutes · RTO 11 hours at 100 Mbps

Goals and limits

p99 latency
under 350 ms
Availability
at least 85%
Monthly cost
under 80 USD/mo
Edit limit
3
Traffic
200 req/s

Concepts

How players did

Player results load from the server.

All levels