Re: Question about checkpointing with stateful operators and state recovery

2017-10-11 Thread Aljoscha Krettek
Hi Frederico, I'll try and give some answers: 1. Generally speaking, no. If you use keyed state, for example via RuntimeContext you don't need to implement CheckpointedFunction. 2. You don't have to set setCommitOffsetsOnCheckpoints(true), this only affects how offsets are committed to Kafka i

Question about checkpointing with stateful operators and state recovery

2017-09-28 Thread Federico D'Ambrosio
Hi, I've got a couple of questions concerning the topics in the subject: 1. If an operator is getting applied on a keyed stream, do I still have to implement the CheckpointedFunction trait and define the snapshotState and initializeState methods, in order to successfully recover the state from