Lagging consumer

Queue 07
KafkaTCPUsers4,000 req/sKafka log2 vCPU · 8 GBWorker1 vCPU · 2 GB
KafkaTCPUsers4,000 req/sKafka log2 vCPU · 8 GBWorker1 vCPU · 2 GB

Fix the board. Turn every goal green.

Traffic
4,000 req/s · writes only
Limit
Worker answers about 3,300 req/s
Bill
  • Kafka log32 USD/mo
  • Worker8 USD/mo
40 of 300 USD/mo

Goals

Not tested yet

How long a message waits before a worker takes it.Saved data that was lost later.What the servers and services cost each month.

Consumer lag grows through the day. Keep lag below 30 seconds and lose no event. A consumer group cannot use more active consumers than the log has partitions.

3:00. Consumer lag keeps growing. Graph: lag rises every hour, and each consumer is at full CPU.

Parts you can add: Worker. At most 16 parts. Budget: 300 USD/mo.

Tap a part to add it, or drag it onto a trace.Click a part to add it, or drag it onto a trace.