Re: Flink Kafka Connector behaviour on leader change and broker upgrade

2016-11-06 Thread Robert Metzger
Hi, yes, the Flink Kafka connector for Kafka 0.8 handles broker leader changes without failing. The SimpleConsumer provided by Kafka 0.8 doesn't handle that. The 0.9 Flink Kafka consumer also supports broker leader changes transparently. If you keep using the Flink Kafka 0.8 connector with a 0.9 b

Flink Kafka Connector behaviour on leader change and broker upgrade

2016-11-04 Thread Janardhan Reddy
HI, Does the flink kafka connector 0.8.2 handle broker's leader change gracefully since simple kafka consumer should be handling leader changes for a partition. How would the consumer behave when upgrading the brokers from 0.8 to 0.9. Thanks