Re: Sliding window buffering on restart without save point

2019-02-11 Thread Konstantin Knauf
Hi William, first of all, I would like to give you two pointers regarding state migration: * If you set UUIDs for all operators you can change the topology of your job without breaking the compatibility with the savepoint [1]. State will be matched to the operator with the same UUID. * In Flink

Sliding window buffering on restart without save point

2019-02-08 Thread shater93
Hello, I am having a Flink pipeline processing data in several overlapping(sliding) windows such that they span [t_i, t_i + T], where t_i is the window starting time and T is the window size. The overlap is such that t_(I+1) - t_i = T/6 (i.e on every window size there is 6 overlapping windows).