Hello Community, Can you please give input?
Rgds, Kamal From: Kamal Mittal via user <user@flink.apache.org> Sent: 23 July 2025 16:37 To: Hongshun Wang <loserwang1...@gmail.com>; user@flink.apache.org Subject: RE: Kafka cluster rebalancing I am using Flink 1.20.x so please in that context share views. From: Kamal Mittal <kamal.mit...@ericsson.com<mailto:kamal.mit...@ericsson.com>> Sent: 23 July 2025 08:27 To: Kamal Mittal <kamal.mit...@ericsson.com<mailto:kamal.mit...@ericsson.com>>; Hongshun Wang <loserwang1...@gmail.com<mailto:loserwang1...@gmail.com>>; user@flink.apache.org<mailto:user@flink.apache.org> Subject: RE: Kafka cluster rebalancing Need inputs for below query. Please share views. From: Kamal Mittal via user <user@flink.apache.org<mailto:user@flink.apache.org>> Sent: 22 July 2025 07:44 To: Hongshun Wang <loserwang1...@gmail.com<mailto:loserwang1...@gmail.com>>; user@flink.apache.org<mailto:user@flink.apache.org> Subject: RE: Kafka cluster rebalancing Added community as well for below query. From: Kamal Mittal Sent: 22 July 2025 07:40 To: Hongshun Wang <loserwang1...@gmail.com<mailto:loserwang1...@gmail.com>> Subject: RE: Kafka cluster rebalancing So in Apache Flink based kafka source/sink, autoscaling followed by rebalancing can’t be supported? From: Hongshun Wang <loserwang1...@gmail.com<mailto:loserwang1...@gmail.com>> Sent: 22 July 2025 07:38 To: Kamal Mittal <kamal.mit...@ericsson.com<mailto:kamal.mit...@ericsson.com>> Subject: Re: Kafka cluster rebalancing NO, if rebalancing, the offset of kafka split is not right, which will causing data incorrect. On Mon, Jul 21, 2025 at 6:00 PM Kamal Mittal via user <user@flink.apache.org<mailto:user@flink.apache.org>> wrote: Hello, Planning to use Cruise control for kafka cluster rebalancing due to scaling etc. and using Flink kakfa source/sink. Query is that if there are pauses during rebalancing w.r.t producer/consumer using topic partitions for data read/write then will the flink connectors for kafka brokers may fail or disconnect? Rgds, Kamal
