Lagging consumer

  • Fix
  • Queue 07

Difficulty 2 of 5

Consumer lag grows through the day. Keep lag below 30 seconds and lose no event. A consumer group cannot use more active consumers than the log has partitions.

3:00. Consumer lag keeps growing. Graph: lag rises every hour, and each consumer is at full CPU.

Play level

KafkaTCPUsers4,000 req/sKafka log2 vCPU · 8 GBWorker1 vCPU · 2 GB
KafkaTCPUsers4,000 req/sKafka log2 vCPU · 8 GBWorker1 vCPU · 2 GB
The board at the start of the level
A queue between two speedsDrag or use arrow keys to change the workers

4 workers · 3 jobs waiting · wait 33 ms

Goals and limits

Queue lag
under 30 s
Lost writes
none
Monthly cost
under 300 USD/mo
Parts you can add
Worker
Part limit
16
Edit limit
3
Traffic
4,000 req/s

Concepts

How players did

Player results load from the server.