Programmatically abort checkpoint

2016-11-11 Thread Lorenzo Affetti
Hi everybody, I am using Flink v1.1.2 is it possible to programmatically abort a snapshot from the method public StreamTaskState snapshotOperatorState(long checkpointId, long timestamp) In an operator? Thank you! Lorenzo

Re: Programmatically abort checkpoint

2016-11-11 Thread Stephan Ewen
What do you mean exactly with aborting a checkpoint? Continuing the processing despite failed checkpoints? You can have a look at these recent changes, they cleanly abort checkpoint alignment in certain conditions: https://issues.apache.org/jira/browse/FLINK-4976 https://github.com/apache/flink/p

Re: Programmatically abort checkpoint

2016-11-11 Thread Lorenzo Affetti
Yes, I mean aborting the checkpoint alignment directly from an operator. This is because I am introducing an operator that performs some asynchronous stuff that also involves side effects on its internal state. I wanted to abort a checkpoint directly from that operator if a barrier comes in while

Re: Programmatically abort checkpoint

2016-11-14 Thread Ufuk Celebi
Hey Lorenzo, internally Flink is able to abort checkpoints, but this is not possible from the user code. There is currently no way to be explicitly notified about an incoming barrier. You can check out this PR (https://github.com/apache/flink/pull/2629) and see whether it addresses your questi

Re: Programmatically abort checkpoint

2016-11-14 Thread Lorenzo Affetti
Thank you for the pointers and the clarification! One question, when you say: "There is currently no way to be explicitly notified about an incoming barrier”, isn’t `snapshotOperatorState` invoked when a barrier approaches the operator? Lorenzo Affetti --- MD in computer engineering PhD St

Re: Programmatically abort checkpoint

2016-11-14 Thread Ufuk Celebi
On 14 November 2016 at 11:30:13, Lorenzo Affetti (lorenzo.affe...@polimi.it) wrote: > Thank you for the pointers and the clarification! > > One question, when you say: "There is currently no way to be explicitly > notified about > an incoming barrier”, isn’t `snapshotOperatorState` invoked w