Re: Minimum time between checkpoints in Flink runner

2018-09-17 Thread Maximilian Michels
:) If you want to try this out, you can use the 2.7.0-RC1 release candidate. Here is the Maven repository. https://repository.apache.org/content/repositories/orgapachebeam-1046/ You'll have to enable the snapshot setting if you add this to Maven. On 17.09.18 18:13, Jozef Vilcek wrote: I can

Re: Minimum time between checkpoints in Flink runner

2018-09-17 Thread Jozef Vilcek
I can see it was very recently added... https://issues.apache.org/jira/browse/BEAM-5372 On Wed, Sep 12, 2018 at 12:54 PM Encho Mishinev wrote: > Hello, > > I am using Flink runner with Apache Beam 2.6.0. An important configuration > of Flink is the 'minimum time between checkpoints' parameter

Minimum time between checkpoints in Flink runner

2018-09-12 Thread Encho Mishinev
Hello, I am using Flink runner with Apache Beam 2.6.0. An important configuration of Flink is the 'minimum time between checkpoints' parameter in addition to just the checkpointing interval. This is important since if checkpoints are heavy, the job might end up doing mostly checkpointing and not