Thanks Hequn for the pointer.
From what I read, I may also need to emit the timestamp regularly for all idle
partitions to ensure watermark progression.
—
Fritz
> On Nov 8, 2018, at 6:02 PM, Hequn Cheng wrote:
>
> Hi Fritz,
>
> Watermarks are merged on stream shuffles. If one of the input's
Hi Fritz,
Watermarks are merged on stream shuffles. If one of the input's watermark
not progressing, they will not advance the event time at the operators. I
think you should decrease the parallelism of source and make sure there are
data in each of your source partition.
Note that the Kafka sourc
Hi All,
I noticed if one of the slot's watermark not progressing, its impacting all
slots processFunction timer and no timer are not firing.
In my example, I have Source parallelism set to 8 and Kafka partition is 4. The
next operator is processFunction with parallelism of 8 + event timer. I
