Recall vs speed

  • Tune
  • Model 13

Difficulty 3 of 5

A vector index holds 10 million items with 768 dimensions on 8 fixed vCPU. It must answer 3,000 searches/s. At least 95 percent of searches must find the right item, at p99 under 20 ms. You can change only the search width.

Play level

HTTP/2gRPCUsers3,000 req/sAPI server4 vCPU · 4 GBVector DB8 vCPU · 64 GB
HTTP/2gRPCUsers3,000 req/sAPI server4 vCPU · 4 GBVector DB8 vCPU · 64 GB
The board at the start of the level
An index against a full scanTap to add or remove the index

Index · 4 pages read per query · disk writes per insert: 2

Goals and limits

Recall
at least 95%
p99 latency
under 20 ms
Error rate
under 0.1%
Monthly cost
under 400 USD/mo
Traffic
3,000 req/s

Concepts

How players did

Player results load from the server.

All levels