Hi Abhishek, For Zookeeper's mode, there's no workaround, unfortunately. But you can upgrade your cluster to the latest kafka version (v3.7.0) to migrate to KRaft mode. For your information, in KRaft mode, we use `StripedReplicaPlacer`, which will fix your problem. ref: https://github.com/apache/kafka/blob/trunk/metadata/src/main/java/org/apache/kafka/metadata/placement/StripedReplicaPlacer.java#L94
Thank you. Luke On Thu, Mar 28, 2024 at 12:55 AM Abhishek Singla < abhisheksingla...@gmail.com> wrote: > Yes, it’s similar. > > Replicas are evenly distribute among racks but not among brokers within > rack even if no. of brokers are same in all racks. > > Is there a workaround for this? > > On Wed, 27 Mar 2024 at 5:36 PM, Chia-Ping Tsai <chia7...@apache.org> > wrote: > > > hi Abhishek > > > > Is this issue similar to the unbalance you had met? > > > > https://issues.apache.org/jira/browse/KAFKA-10368 > > > > best, > > chia-ping > > > > On 2024/03/23 21:06:59 Abhishek Singla wrote: > > > Hi Team, > > > > > > Kafka version: 2_2.12-2.6.0 > > > Zookeeper version: 3.8.x > > > > > > We have a Kafka Cluster of 12 brokers spread equally across 3 racks. > > Topic > > > gets auto created with default num.partitions=6 and > replication_factor=3. > > > It is observed that replicas are equally distributed over racks but > > within > > > the rack the replicas are randomly distributed like sometimes 3,3,0,0 > or > > > sometimes 3:2:1 or sometime 2,2,1,1 > > > > > > Is there a configuration to evenly distribute replicas across brokers > > > within a rack, maybe some sort of round robin strategy 2,2,1,1? > > > > > > And also it is observed that over time 1 broker ends up having way more > > > replicas across topics than the other broker in the same rack. Is > there a > > > config for even distribution of replicas across topics also? > > > > > > Regards, > > > Abhishek Singla > > > > > >
