The threshold

Model 06
HTTP/2gRPCgRPCPartner apps2,000 req/sAPI server4 vCPU · 4 GBModel (CPU)8 vCPU · 4 GBFeature sto…4 vCPU · 4 GB
HTTP/2gRPCgRPCPartner ap…2,000 req/sAPI server4 vCPU · 4 GBModel (CPU)8 vCPU · 4 GBFeature st…4 vCPU · 4 GB

Tune the parts. Turn every goal green.

Traffic
2,000 req/s · reads only
Limit
API server answers about 13,000 req/s
Bill
  • API server16 USD/mo
  • Model (CPU)32 USD/mo
  • Feature store16 USD/mo
64 of 200 USD/mo

Goals

Not tested yet

The share of requests that fail or get no answer.What the servers and services cost each month.

A fraud model scores 2,000 card payments/s. 1 payment in 200 is fraud. A missed fraud costs 120 USD; each flagged payment costs 2 USD of review. Keep the loss under 6,000 USD for the run and false alarms under 2 percent. You can change only the threshold.

One change feed keeps serving in stepTap or press Space to change the write paths

Two write paths · 4 of 16 served features differ from training