Uneven work
Difficulty 2 of 5
A balancer sends 300 requests/s to two backends with 2 vCPU each. Measured CPU per request is 1 ms on one backend and 50 ms on the other. Choose the routing plan. Keep p99 below 350 ms and errors below 0.1 percent.
Options
- Send requests in round-robin order
- Round robin with a 300 ms backend timeout
- Send requests to the less busy backend
Goals and limits
- p99 latency
- under 350 ms
- Error rate
- under 0.1%
- Monthly cost
- under 100 USD/mo
- Traffic
- 300 req/s
Concepts
How players did
Player results load from the server.