Re: expected behavior when Flink job cluster exhausted all restarts

2020-10-23 Thread Eleanore Jin
Hi Till, thanks a lot for the explanation. Im using Flink 1.10.2 with java 11. Thanks! Eleanore On Fri, Oct 23, 2020 at 4:31 AM Till Rohrmann wrote: > Hi Eleanore, > > if you want to tolerate JM restarts, then you have to enable HA. W/o HA, a > JM restart is effectively a submission of a new j

Re: expected behavior when Flink job cluster exhausted all restarts

2020-10-23 Thread Till Rohrmann
Hi Eleanore, if you want to tolerate JM restarts, then you have to enable HA. W/o HA, a JM restart is effectively a submission of a new job. In order to tell you more about the Task submission rejection by the TaskExecutor, I would need to take a look at the logs of the JM and the rejecting TaskE

expected behavior when Flink job cluster exhausted all restarts

2020-10-21 Thread Eleanore Jin
Hi experts, I am running a flink job cluster, the application jar is packaged together with flink in a docker image. The flink job cluster is running in kubernetes, the restart strategy is below restart-strategy: failure-rate restart-strategy.failure-rate.max-failures-per-interval: 20 restart-stra