Hi Averell, Can you describe your settings in a bit more detail?
For example, are you reading in PROCESS_CONTINUOUSLY mode or PROCESS_ONCE? What is your checkpoint interval? The above are to understand why checkpoints are not processed within these 15 min. Kostas > On Sep 25, 2018, at 8:08 AM, Averell <lvhu...@gmail.com> wrote: > > Hi Kostas, > > Yes, applying the filter on the 100K files takes time, and the delay of 15 > minutes I observed definitely caused by that big number of files and the > cost of each individual file status check. However, the delay is much > smaller when checkpointing is off. > Within that 15 minutes, checkpointing process is not triggered though. > > Thanks and regards, > Averell > > > > -- > Sent from: > http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
