Session cluster configmap removal

2021-06-29 Thread Sweta Kalakuntla
Hi,

We have flink session clusters in kubernetes and several long running flink
jobs deployed in them with HA enabled. After we have enabled HA, we are
seeing configmaps created for every new job. Whenever we stop/cancel any
existing jobs, these configmaps do not get deleted. Is that right, these
configmaps will not be removed unless we shutdown the cluster?

Thanks,
Sweta


Re: Session cluster configmap removal

2021-06-30 Thread Yang Wang
Hi Sweta,

After FLINK-20695[1] is resolved, once the job in session cluster reached
to the globally terminal state(FAILED, CENCELED),
the HA related ConfigMap will be deleted.

So could you please have a try with Flink version 1.13.1, 1.12.5?

However, we still have some residual ConfigMaps(e.g. rest-server,
resourcemanager, dispatcher) for shared components in the session cluster.
They will be retained even though the session cluster is shutdown. This
will be fixed in FLINK-20219[2].

[1]. https://issues.apache.org/jira/browse/FLINK-20695
[2]. https://issues.apache.org/jira/browse/FLINK-20219

Best,
Yang



Sweta Kalakuntla  于2021年6月30日周三 上午3:14写道:

> Hi,
>
> We have flink session clusters in kubernetes and several long running
> flink jobs deployed in them with HA enabled. After we have enabled HA, we
> are seeing configmaps created for every new job. Whenever we stop/cancel
> any existing jobs, these configmaps do not get deleted. Is that right,
> these configmaps will not be removed unless we shutdown the cluster?
>
> Thanks,
> Sweta
>
>
>