AW: Kafka SQL Connector: dropping events if more partitions then source tasks

/browse/FLINK-20041 Best, Jan Von: Shengkai Fang Gesendet: Samstag, 27. Februar 2021 05:03 An: Jan Oelschlegel Cc: Benchao Li ; Arvid Heise ; user ; Timo Walther Betreff: Re: Kafka SQL Connector: dropping events if more partitions then source tasks Hi Jan. Thanks for your reply. Do you set

Re: Kafka SQL Connector: dropping events if more partitions then source tasks

*Cc:* Benchao Li ; Arvid Heise ; > user ; Timo Walther > *Betreff:* Re: Kafka SQL Connector: dropping events if more partitions > then source tasks > > > > Hi, Jan. > > > > Could you tell us which Flink version you use? As far as I know, the kafka > sql connector has

AW: Kafka SQL Connector: dropping events if more partitions then source tasks

apache.org>>; user mailto:user@flink.apache.org>>; Timo Walther mailto:twal...@apache.org>> Betreff: Re: Kafka SQL Connector: dropping events if more partitions then source tasks Hi Jan, What you are observing is correct for the current implementation. Current watermark ge

Re: Kafka SQL Connector: dropping events if more partitions then source tasks

. > > > > The problem is only on the SQL site. > > > > > > Best, > > Jan > > > > *Von:* Benchao Li > *Gesendet:* Donnerstag, 25. Februar 2021 00:04 > *An:* Jan Oelschlegel > *Cc:* Arvid Heise ; user ; Timo > Walther > *Betreff:* Re: Ka

AW: Kafka SQL Connector: dropping events if more partitions then source tasks

. Februar 2021 00:04 An: Jan Oelschlegel Cc: Arvid Heise ; user ; Timo Walther Betreff: Re: Kafka SQL Connector: dropping events if more partitions then source tasks Hi Jan, What you are observing is correct for the current implementation. Current watermark generation is based on subtask

Re: Kafka SQL Connector: dropping events if more partitions then source tasks

> > > *Von:* Arvid Heise > *Gesendet:* Mittwoch, 24. Februar 2021 14:10 > *An:* Jan Oelschlegel > *Cc:* user ; Timo Walther > *Betreff:* Re: Kafka SQL Connector: dropping events if more partitions > then source tasks > > > > Hi Jan, > > > > Are you runnin

AW: Kafka SQL Connector: dropping events if more partitions then source tasks

://issues.apache.org/jira/browse/FLINK-20041 Best, Jan Von: Arvid Heise Gesendet: Mittwoch, 24. Februar 2021 14:10 An: Jan Oelschlegel Cc: user ; Timo Walther Betreff: Re: Kafka SQL Connector: dropping events if more partitions then source tasks Hi Jan, Are you running on historic data

Re: Kafka SQL Connector: dropping events if more partitions then source tasks

> > > > Best, > > Jan > > > > *Von:* Jan Oelschlegel > *Gesendet:* Donnerstag, 18. Februar 2021 09:51 > *An:* Jan Oelschlegel ; user < > user@flink.apache.org> > *Betreff:* AW: Kafka SQL Connector: dropping events if more partitions > then source tas

AW: Kafka SQL Connector: dropping events if more partitions then source tasks

. Februar 2021 09:51 An: Jan Oelschlegel ; user Betreff: AW: Kafka SQL Connector: dropping events if more partitions then source tasks By using the DataStream API with the same business logic I'm getting no dropped events. Von: Jan Oelschlegel mailto:oelschle...@integration-factory.de>> Ge

AW: Kafka SQL Connector: dropping events if more partitions then source tasks

By using the DataStream API with the same business logic I'm getting no dropped events. Von: Jan Oelschlegel Gesendet: Mittwoch, 17. Februar 2021 19:18 An: user Betreff: Kafka SQL Connector: dropping events if more partitions then source tasks Hi, i have a question regarding FlinkSQL

Kafka SQL Connector: dropping events if more partitions then source tasks

Hi, i have a question regarding FlinkSQL connector for Kafka. I have 3 Kafka partitions and 1 Kafka SQL source connector (Parallelism 1). The data within the Kafka parttitons are sorted based on a event-time field, which is also my event-time in Flink. My Watermark is generated with a delay of