Re: Checkpoint / Two Phase Commit

2019-06-02 Thread Piotr Nowojski
Hi, Sorry for late answer. > As I understand how it operates, the pre-phase state is when the checkpoint > is initiated and the checkpoint barrier advances from source to sink. Once > the pre-phase is complete (and successful), then the next step in the > process is where the "Sink" operator is e

Re: Checkpoint / Two Phase Commit

2019-05-24 Thread vijikarthi
Pinging again on this thread to see if anyone has any recommendations? Particularly, I am interested to understand whether this scenario is also applicable for Kafka Connector? -- Sent from: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/

Checkpoint / Two Phase Commit

2019-05-21 Thread vijikarthi
Question regarding end-to-end exactly once guarantee implementation using 2PC? As I understand how it operates, the pre-phase state is when the checkpoint is initiated and the checkpoint barrier advances from source to sink. Once the pre-phase is complete (and successful), then the next step in t