Query the lake
Difficulty 3 of 5
Streams land 50 TB of events in object storage as 128 MB files. Analysts run 20 dashboard queries/min, each about one day of data. Keep dashboard p99 under 15 s with under 1 percent errors, and stay under 1,000 USD/mo with storage and requests.
5 MB/s · logs kept on the host · disk full in 33 minutes
Goals and limits
- p99 latency (Dash)
- under 15 s
- Error rate (Dash)
- under 1%
- Error rate (Events)
- under 0.1%
- Monthly cost
- under 1,000 USD/mo
- Parts you can add
- Analytics DB
- Part limit
- 2
- Traffic
- 0 req/s
Concepts
How players did
Player results load from the server.