Compact small files

Flow 09
HTTP/2SQLUsers2,000 req/sUsers0.05 req/sAnalytics DB8 vCPU · 16 GB
HTTP/2SQLUsers2,000 req/sUsers0.05 req/sAnalytics…8 vCPU · 16 GB

Fix the board. Turn every goal green.

Traffic
Daily0 req/s · reads onlyIngest2,000 req/s · writes only
Bill
  • Analytics DB64 USD/mo
64 of 100 USD/mo

Goals

Not tested yet

99 of 100 requests finish faster than this.The share of requests that fail or get no answer.The share of requests that fail or get no answer.What the servers and services cost each month.

Streams write 2,000 batches/s of 64 KB into the events store. The daily report reads 20 GB and now times out. Bring the report p99 under 20 s with under 1 percent errors, and keep ingest errors under 0.1 percent. Use at most 3 edits.

09:05 The daily report times out after 60 s. Each run opens 312,500 files. Ingest writes queue behind it.

A disk that fillsArrow keys change the write rate. Tap to ship the logs.

5 MB/s · logs kept on the host · disk full in 33 minutes