Re: My batch source doesn't emit MAX_WATERMARK when it finishes - why?

2021-07-08 Thread Dawid Wysakowicz
Hi, Your example does not show what watermarks are flowing through the program. It prints the watermark at the point a record is being emitted. As the cited text states, the final watermark is emitted after all records are emitted. You can test it e.g. with the newly added writeWatermark method in

My batch source doesn't emit MAX_WATERMARK when it finishes - why?

2021-07-08 Thread Yik San Chan
Hi, According to the docs [1] When a source reaches the end of the input, it emits a final watermark with timestamp Long.MAX_VALUE, indicating the "end of time". However, in my small experiment [2], the Flink job reads from a local csv file, and prints a watermark for each record in the SinkFun