Query the lake

  • Build
  • Flow 06

Difficulty 3 of 5

Streams land 50 TB of events in object storage as 128 MB files. Analysts run 20 dashboard queries/min, each about one day of data. Keep dashboard p99 under 15 s with under 1 percent errors, and stay under 1,000 USD/mo with storage and requests.

Play level

S3Users5 req/sUsers0.33 req/sObject stor…1 vCPU · 1 GB
S3Users5 req/sUsers0.33 req/sObject st…1 vCPU · 1 GB
The board at the start of the level
A disk that fillsArrow keys change the write rate. Tap to ship the logs.

5 MB/s · logs kept on the host · disk full in 33 minutes

Goals and limits

p99 latency (Dash)
under 15 s
Error rate (Dash)
under 1%
Error rate (Events)
under 0.1%
Monthly cost
under 1,000 USD/mo
Parts you can add
Analytics DB
Part limit
2
Traffic
0 req/s

Concepts

How players did

Player results load from the server.