Hello Community, Can you please give input?
Rgds, Kamal From: Kamal Mittal via user <[email protected]> Sent: 23 July 2025 16:37 To: Hongshun Wang <[email protected]>; [email protected] Subject: RE: Kafka cluster rebalancing I am using Flink 1.20.x so please in that context share views. From: Kamal Mittal <[email protected]<mailto:[email protected]>> Sent: 23 July 2025 08:27 To: Kamal Mittal <[email protected]<mailto:[email protected]>>; Hongshun Wang <[email protected]<mailto:[email protected]>>; [email protected]<mailto:[email protected]> Subject: RE: Kafka cluster rebalancing Need inputs for below query. Please share views. From: Kamal Mittal via user <[email protected]<mailto:[email protected]>> Sent: 22 July 2025 07:44 To: Hongshun Wang <[email protected]<mailto:[email protected]>>; [email protected]<mailto:[email protected]> Subject: RE: Kafka cluster rebalancing Added community as well for below query. From: Kamal Mittal Sent: 22 July 2025 07:40 To: Hongshun Wang <[email protected]<mailto:[email protected]>> Subject: RE: Kafka cluster rebalancing So in Apache Flink based kafka source/sink, autoscaling followed by rebalancing can’t be supported? From: Hongshun Wang <[email protected]<mailto:[email protected]>> Sent: 22 July 2025 07:38 To: Kamal Mittal <[email protected]<mailto:[email protected]>> Subject: Re: Kafka cluster rebalancing NO, if rebalancing, the offset of kafka split is not right, which will causing data incorrect. On Mon, Jul 21, 2025 at 6:00 PM Kamal Mittal via user <[email protected]<mailto:[email protected]>> wrote: Hello, Planning to use Cruise control for kafka cluster rebalancing due to scaling etc. and using Flink kakfa source/sink. Query is that if there are pauses during rebalancing w.r.t producer/consumer using topic partitions for data read/write then will the flink connectors for kafka brokers may fail or disconnect? Rgds, Kamal
