Zhanghao Chen created FLINK-29615:
-------------------------------------
Summary: MetricStore does not remove metrics of nonexistent
subtasks when adaptive scheduler lowers job parallelism
Key: FLINK-29615
URL: https://issues.apache.org/jira/browse/FLINK-29615
Project: Flink
Issue Type: Bug
Components: Runtime / Metrics, Runtime / REST
Affects Versions: 1.15.0, 1.16.0
Reporter: Zhanghao Chen
Fix For: 1.17.0
*Problem*
MetricStore does not remove metrics of nonexistent subtasks when adaptive
scheduler lowers job parallelism and users will see metrics of nonexistent
subtasks on Web UI (e.g. the task backpressure page) or REST API response.
*Proposed Solution*
Thanks to [FLINK-29132] SubtaskMetricStore causes memory leak. - ASF JIRA
(apache.org) & [FLINK-28588] Enhance REST API for Speculative Execution - ASF
JIRA (apache.org), Flink will now update current execution attempts when
updating metrics. Since the active subtask info is included in the current
execution attempt info, we are able to retain active subtasks using the current
execution attempt info.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)