Kill switch delivery
Difficulty 4 of 5
A risky feature sits behind a flag. 3 API instances check the flag on each of 3,000 requests/s. The flag store restarts for 20 s at 0:20. At 0:50 you turn the flag off. Fewer than 3,000 replies may still run the feature. Keep errors under 1 percent.
Options
- Read the flag store on every request
- Keep the flag in each instance for 5 minutes
- Keep the flag in each instance and push every change to it
Goals and limits
- Error rate
- under 1%
- Data mismatches
- under 3,000
- p99 latency
- under 100 ms
- Monthly cost
- under 60 USD/mo
- Traffic
- 3,000 req/s
Concepts
How players did
Player results load from the server.