[
https://issues.apache.org/jira/browse/FLINK-2929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14987374#comment-14987374
]
Till Rohrmann commented on FLINK-2929:
--------------------------------------
We could auto generate a random ZNode path for each cluster start. In case of a
clean shutdown this path could be removed if not explicitly set to be kept.
When starting a new cluster we then could add an option to start with a
specific znode path in order to recover from or in case of an upgrade. However,
this has the disadvantage that the user would be responsible for cleaning up
the state data when it's no longer needed.
> Recovery of jobs on cluster restarts
> ------------------------------------
>
> Key: FLINK-2929
> URL: https://issues.apache.org/jira/browse/FLINK-2929
> Project: Flink
> Issue Type: Improvement
> Affects Versions: 0.10
> Reporter: Ufuk Celebi
>
> Recovery information is stored in ZooKeeper under a static root like
> {{/flink}}. In case of a cluster restart without canceling running jobs old
> jobs will be recovered from ZooKeeper.
> This can be confusing or helpful depending on the use case.
> I suspect that the confusing case will be more common.
> We can change the default cluster start up (e.g. new YARN session or new
> ./start-cluster call) to purge all existing data in ZooKeeper and add a flag
> to not do this if needed.
> [~trohrm...@apache.org], [~aljoscha], [~StephanEwen] what's your opinion?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
