Re: Replicas not equally distributed within rack

Hi, Also you could potentially check tools like Cruise Control , which can help with performing both manual and automated rebalances to help with more even distributions based on plenty of different options. On Thu, Mar 28, 2024 at 8:39 AM Luke Chen

Re: Replicas not equally distributed within rack

Hi Abhishek, For Zookeeper's mode, there's no workaround, unfortunately. But you can upgrade your cluster to the latest kafka version (v3.7.0) to migrate to KRaft mode. For your information, in KRaft mode, we use `StripedReplicaPlacer`, which will fix your problem. ref:

Re: Replicas not equally distributed within rack

Yes, it’s similar. Replicas are evenly distribute among racks but not among brokers within rack even if no. of brokers are same in all racks. Is there a workaround for this? On Wed, 27 Mar 2024 at 5:36 PM, Chia-Ping Tsai wrote: > hi Abhishek > > Is this issue similar to the unbalance you had

Re: Replicas not equally distributed within rack

hi Abhishek Is this issue similar to the unbalance you had met? https://issues.apache.org/jira/browse/KAFKA-10368 best, chia-ping On 2024/03/23 21:06:59 Abhishek Singla wrote: > Hi Team, > > Kafka version: 2_2.12-2.6.0 > Zookeeper version: 3.8.x > > We have a Kafka Cluster of 12 brokers

Re: Replicas not equally distributed within rack

Hi Team, Could someone help me with how to distribute kafka topic replicas evenly across brokers to avoid data skew (disk utilisation). Regards, Abhishek Singla On Sun, Mar 24, 2024 at 2:36 AM Abhishek Singla wrote: > Hi Team, > > Kafka version: 2_2.12-2.6.0 > Zookeeper version: 3.8.x > > We

Replicas not equally distributed within rack

Hi Team, Kafka version: 2_2.12-2.6.0 Zookeeper version: 3.8.x We have a Kafka Cluster of 12 brokers spread equally across 3 racks. Topic gets auto created with default num.partitions=6 and replication_factor=3. It is observed that replicas are equally distributed over racks but within the rack