Kill switch delivery

  • Choose
  • Guard 16

Difficulty 4 of 5

A risky feature sits behind a flag. 3 API instances check the flag on each of 3,000 requests/s. The flag store restarts for 20 s at 0:20. At 0:50 you turn the flag off. Fewer than 3,000 replies may still run the feature. Keep errors under 1 percent.

Play level

Options

  • Read the flag store on every request
  • Keep the flag in each instance for 5 minutes
  • Keep the flag in each instance and push every change to it
A canary before the whole fleetTap to change the deployment method

Goals and limits

Error rate
under 1%
Data mismatches
under 3,000
p99 latency
under 100 ms
Monthly cost
under 60 USD/mo
Traffic
3,000 req/s

Concepts

How players did

Player results load from the server.