Checkpointing not happening in Standalone HA mode

2018-07-25 Thread Vinay Patil
Hi, I am starting the cluster using bootstrap application where in I am calling Job Manager and Task Manager main class to form the cluster. The HA cluster is formed correctly and I am able to submit jobs to this cluster using RemoteExecutionEnvironment but when I enable checkpointing in code I do

Re: Checkpointing not happening in Standalone HA mode

2018-07-25 Thread Chesnay Schepler
Please check the job- and taskmanager logs for anything suspicious. On 25.07.2018 12:33, Vinay Patil wrote: Hi, I am starting the cluster using bootstrap application where in I am calling Job Manager and Task Manager main class to form the cluster. The HA cluster is formed correctly and I am

Re: Checkpointing not happening in Standalone HA mode

2018-07-25 Thread Vinay Patil
No error in the logs. That is why I am not able to understand why checkpoints are not getting triggered. Regards, Vinay Patil On Wed, Jul 25, 2018 at 4:44 PM Vinay Patil wrote: > Hi Chesnay, > > No error in the logs. That is why I am not able to understand why > checkpoints are getting trigger

Re: Checkpointing not happening in Standalone HA mode

2018-07-25 Thread Chesnay Schepler
Can you provide us with the job code? I assume that checkpointing runs properly if you submit the same job to a normal cluster? On 25.07.2018 13:15, Vinay Patil wrote: No error in the logs. That is why I am not able to understand why checkpoints are not getting triggered. Regards, Vinay Pat

Re: Checkpointing not happening in Standalone HA mode

2018-07-25 Thread Vinay Patil
Hi Chesnay, No error in the logs. That is why I am not able to understand why checkpoints are getting triggered. Regards, Vinay Patil On Wed, Jul 25, 2018 at 4:36 PM Chesnay Schepler wrote: > Please check the job- and taskmanager logs for anything suspicious. > > On 25.07.2018 12:33, Vinay Pa

Re: Checkpointing not happening in Standalone HA mode

2018-07-25 Thread vino yang
Hi Vinay: Did you call specific config API refer to this documentation[1]; Can you share your job program and JM Log? Or the JM log contains the log message like this pattern "Triggering checkpoint {} @ {} for job {}."? [1]: https://ci.apache.org/projects/flink/flink-docs-release-1.5/dev/stream/

Re: Checkpointing not happening in Standalone HA mode

2018-07-27 Thread Vinay Patil
Hi Vino, Yes I am enabling checkpoint in the code as follows : StreamExecutionEnvironment env = StreamExecutionEnvironment.createRemoteEnvironment(",,getJobConfiguration(),jarPath"); env.enableCheckpointing(1000); env.setSateBackend(new FsStateBackend("file:///")); env.getCheckpointConfig().s

Re: Checkpointing not happening in Standalone HA mode

2018-07-27 Thread vino yang
Hi Vinay, Oh! You use a collection source? That's the problem. Please use a general source like Kafka or others. Maybe your checkpoint has not be triggered, your job has stopped. Thanks, vino. 2018-07-27 16:07 GMT+08:00 Vinay Patil : > Hi Vino, > > Yes I am enabling checkpoint in the code as f

Re: Checkpointing not happening in Standalone HA mode

2018-07-27 Thread Vinay Patil
Hi Vino, Yes, Job runs successfully, however, no checkpoints are successful. I will update the source Regards, Vinay Patil On Fri, Jul 27, 2018 at 2:00 PM vino yang wrote: > Hi Vinay, > > Oh! You use a collection source? That's the problem. Please use a general > source like Kafka or others.