Till Rohrmann created FLINK-17372: ------------------------------------- Summary: SlotManager should expose total required resources Key: FLINK-17372 URL: https://issues.apache.org/jira/browse/FLINK-17372 Project: Flink Issue Type: Improvement Components: Runtime / Coordination Affects Versions: 1.10.1, 1.11.0 Reporter: Till Rohrmann Fix For: 1.11.0
Currently, the {{SlotManager}} exposes the set of required resources which have not been fulfilled via {{SlotManager.getRequiredResources}}. The idea of this function is to allow the {{ResourceManager}} to decide whether new pods/containers need to be started or not. The problem is that once a resource has been registered at the {{SlotManager}} it will decrease the set of required resources. If now a pod/container fails, then the {{ResourceManager}} won't know whether it needs to restart the container or not. In order to simplify the interaction, I propose to let the {{SlotManager}} announce all of its required resources (pending + registered resources). That way the {{ResourceManager}} only needs to compare the set of required resources with the set of pending and allocated containers/pods. -- This message was sent by Atlassian Jira (v8.3.4#803005)