Jingsong Lee created FLINK-14860:
------------------------------------
Summary: Provide a new InputSplitAssigner that consider page cache
utilization ratio
Key: FLINK-14860
URL: https://issues.apache.org/jira/browse/FLINK-14860
Project: Flink
Issue Type: New Feature
Components: Table SQL / Runtime
Reporter: Jingsong Lee
At present, only the need of localization is considered in
LocatableInputSplitAssigner, but there is a problem of random floating among
three copies of split (HDFS has three copies for files), which leads to
excessive use of cache. Therefore, we also need to make it possible to schedule
three copies in a clear order on the basis of localization.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)