I think you’re hitting this issue:
https://issues.apache.org/jira/browse/FLINK-31632
<https://issues.apache.org/jira/browse/FLINK-31632>
Fixed in 1.16.2, 1.171.
— Ken
> On Jun 15, 2023, at 1:39 PM, Piotr Domagalski <pi...@domagalski.com> wrote:
>
> Hi all!
>
> We've been experimenting with watermark alignment in Flink 1.15 and observed
> an odd behaviour that I couldn't find any mention of in the documentation.
>
> With the following strategy:
>
> WatermarkStrategy.<Event>forBoundedOutOfOrderness(Duration.ofSeconds(60))
> .withTimestampAssigner((e, t) -> e.timestamp)
> .withIdleness(Duration.ofSeconds(3600))
> .withWatermarkAlignment("group-1", Duration.ofSeconds(15));
>
> Kafka sources stop consuming completely after 3600s (even when the data is
> flowing into all the partitions). Is this an expected behaviour? Where could
> I find more information on this?
>
> --
> Piotr Domagalski
--------------------------
Ken Krugler
http://www.scaleunlimited.com
Custom big data solutions
Flink, Pinot, Solr, Elasticsearch
