Hi, Lee,
Would you be able to see which Kafka API is generating the traffic?
This is provided by the MBean
kafka.network:type=RequestMetrics,name=RequestsPerSec,request=*,version=([0-9]+)
[1].
Thanks,
Alexandre
[1] https://kafka.apache.org/documentation/#monitoring
Le dim. 16 avr. 2023 à 18:22,
Hi Kirk,
Points 1 and 2: yes we have both logging and metrics. I'll collate
Point 3 concurrency refers to the spring boot kafka concurrent container. 2
threads will be made available to the consumer group to consume 30
partitions making up a single topic.
point 4: consumer- Kafka Consumer Configur
Hi Lee,
Some questions:
1. Can you enable metrics for your consumer(s)? See [1] and [2] for links on
consumer-level and fetch-level metrics, respectively.
2. Can you enable more detailed logging?
3. What do you mean specifically by “concurrency of 2?”
4. Can you verify the name of the fetch.wait
Hi All,
I've a spring boot kafka consumer group, consuming a topic with 30
partitions with a concurrency of 2 (staging set up).
The network traffic in and out was very high >200k per second even when
consuming no messages.
I've adjusted fetch.wait.max.ms to be significantly higher (15,000) than
