[
https://issues.apache.org/jira/browse/FLINK-20695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17253197#comment-17253197
]
lidesheng commented on FLINK-20695:
-----------------------------------
Could you clarify which 1.11 version you are using? (1.11.0; 1.11.1; 1.11.2;
1.11.3) --> 1.11.2
Did the jobs finish successfully, or did they fail / were canceled? --> Job
executed successfully.
Finally, which Zookeeper version are you using? -->
zookeeper-3.4.5-cdh6.2.0.jar
The version of zk is too old?
> Zookeeper node under leader and leaderlatch is not deleted after job finished
> -----------------------------------------------------------------------------
>
> Key: FLINK-20695
> URL: https://issues.apache.org/jira/browse/FLINK-20695
> Project: Flink
> Issue Type: Improvement
> Components: Runtime / Task
> Reporter: lidesheng
> Priority: Critical
>
> I used flink 1.11 in standalone cluster mode for batch job. The enviornment
> was configured as zookeeper HA mode.
> After job was commited, flink runtime created nodes under
> /flink/default/leader and /flink/default/leaderlatch with job id. Though
> jobs were finished, these nodes were remaining in zookeeper path forever.
> After a period of running, more and more jobs had been executed and there
> were a greate number of nodes under /flink/default/leader and slowed down the
> performance of zookeeper. Why not delete the nodes after job finished? Flink
> runtime could get job status by listeners and delete the leader nodes for job
> immidiately.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
