Re: How would Flink job react to change of partitions in Kafka topic?

2021-06-23 Thread Thomas Wang
Sounds good. Thanks. Thomas On Wed, Jun 23, 2021 at 11:59 AM Seth Wiesman wrote: > It will just work as long as you enable partition discovery. > > > https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/connectors/datastream/kafka/#partition-discovery > > On Tue, Jun 22, 2021 at 1:

Re: How would Flink job react to change of partitions in Kafka topic?

2021-06-23 Thread Seth Wiesman
It will just work as long as you enable partition discovery. https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/connectors/datastream/kafka/#partition-discovery On Tue, Jun 22, 2021 at 1:32 PM Thomas Wang wrote: > Hi, > > I'm wondering if anyone has changed the number of partitio

How would Flink job react to change of partitions in Kafka topic?

2021-06-22 Thread Thomas Wang
Hi, I'm wondering if anyone has changed the number of partitions of a source Kafka topic. Let's say I have a Flink job read from a Kafka topic which used to have 32 partitions. If I change the number of partitions of that topic to 64, can the Flink job still guarantee the exactly-once semantics?