Re: Checkpoint recovery and state external to flink

2019-03-05 Thread Aggarwal, Ajay
t; , "user@flink.apache.org" Subject: Re: Checkpoint recovery and state external to flink Hi Ajay I think two phase commit protocol could solve your concern for the exactly-once external system, Flink already support this feature in some sinks [1], e.g. you could refer to [2] to know whi

Re: Checkpoint recovery and state external to flink

2019-03-05 Thread Yun Tang
and state external to flink What happens when the flink job interacts with a user managed database and hence has some state outside of flink? In these situations when a flink job is recovered from last successful checkpoint, this external state will not be in sync with the recovered flink

Checkpoint recovery and state external to flink

2019-03-04 Thread Aggarwal, Ajay
What happens when the flink job interacts with a user managed database and hence has some state outside of flink? In these situations when a flink job is recovered from last successful checkpoint, this external state will not be in sync with the recovered flink state. In most cases it will be