xingbe created FLINK-30707:
------------------------------
Summary: Let speculative execution takes input number bytes into
account when detecting slow tasks
Key: FLINK-30707
URL: https://issues.apache.org/jira/browse/FLINK-30707
Project: Flink
Issue Type: Improvement
Components: Runtime / Coordination
Affects Versions: 1.17.0
Reporter: xingbe
The default slowTaskDetector in speculative execution is based on execution
time now, if the data amount allocated to each subtask is uneven, time-based
slow task detection may not reflect the actual performance of the subtask.
Therefore, it is necessary to take the input information into account when
detecting slow tasks.
The major changes are:
* Need to know the amount of data processed by each execution vertex.
* ExecutionTimeBasedSlowTaskDetector needs to introduce the amount of input
data to weight it with execution time.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
