Re: Replicas not equally distributed within rack

2024-03-27 Thread Abhishek Singla
Yes, it’s similar. Replicas are evenly distribute among racks but not among brokers within rack even if no. of brokers are same in all racks. Is there a workaround for this? On Wed, 27 Mar 2024 at 5:36 PM, Chia-Ping Tsai wrote: > hi Abhishek > > Is this issue similar to the unbalance you had

Re: Replicas not equally distributed within rack

2024-03-27 Thread Chia-Ping Tsai
hi Abhishek Is this issue similar to the unbalance you had met? https://issues.apache.org/jira/browse/KAFKA-10368 best, chia-ping On 2024/03/23 21:06:59 Abhishek Singla wrote: > Hi Team, > > Kafka version: 2_2.12-2.6.0 > Zookeeper version: 3.8.x > > We have a Kafka Cluster of 12 brokers

Re: Messages disappearing from Kafka Streams topology

2024-03-27 Thread mangat rai
Hey Karsten, You don't need to do any other configuration to enable EOS. See here - https://docs.confluent.io/platform/current/streams/concepts.html#processing-guarantees It mentions that the producer will be idempotent. That also mans ack=all will be considered. Not that if you have any other

Re: Messages disappearing from Kafka Streams topology

2024-03-27 Thread Karsten Stöckmann
Hi Mangat, thanks for clarification. So to my knowledge exactly-once is configured using the 'processing.guarantee=exactly_once_v2' setting? Is the configuration setting 'acks=all' somehow related and would you advise setting that as well? Best wishes Karsten mangat rai schrieb am Di., 26.

Community Over Code NA 2024 Travel Assistance Applications now open!

2024-03-27 Thread Gavin McDonald
Hello to all users, contributors and Committers! [ You are receiving this email as a subscriber to one or more ASF project dev or user mailing lists and is not being sent to you directly. It is important that we reach all of our users and contributors/committers so that they may get a chance

Re: Replicas not equally distributed within rack

2024-03-27 Thread Abhishek Singla
Hi Team, Could someone help me with how to distribute kafka topic replicas evenly across brokers to avoid data skew (disk utilisation). Regards, Abhishek Singla On Sun, Mar 24, 2024 at 2:36 AM Abhishek Singla wrote: > Hi Team, > > Kafka version: 2_2.12-2.6.0 > Zookeeper version: 3.8.x > > We

Re: [ANNOUNCE] New committer: Christo Lolov

2024-03-27 Thread Matthias J. Sax
Congrats! On 3/26/24 9:39 PM, Christo Lolov wrote: Thank you everyone! It wouldn't have been possible without quite a lot of reviews and extremely helpful inputs from you and the rest of the community! I am looking forward to working more closely with you going forward :) On Tue, 26 Mar 2024