Hi all!
I have a cluster of about 20 brokers and one of them is transmitting about 4
times as much data as the others (80mB/sec vs 20mB/sec). It has the roughly
the same number of topics & partitions and it's the leader for the same number
as all the other brokers. The kafka-manager web tool
Hi,
Do you track these metrics with JMX and can you see if there are any
differences between your brokers?
- Number of client requests (fetch, consume, and follower) per second per
broker
- Message in rate per second per broker
Is your 80mB/sec rate the outgoing traffic for the entire server and
That's a very intriguing question, Dylan.
Even if the partitions for each of the topics are distributed evenly across
the brokers, it's not guaranteed that the *data* will be distributed
evenly. By default, the producer will send all the messages in a topic with
the same key to the same partition.
need to figure out what that means.
Thanks!
-Dylan
From: Alex Woolford
Sent: Saturday, February 8, 2020 10:09 PM
To: users@kafka.apache.org
Cc: Dylan Martin
Subject: Re: Confusingly unbalanced broker
[EXTERNAL E-MAIL]
That's a very intriguing quest
