Zhilong Hong created FLINK-22773:
------------------------------------
Summary: Optimize the construction of pipelined regions
Key: FLINK-22773
URL: https://issues.apache.org/jira/browse/FLINK-22773
Project: Flink
Issue Type: Sub-task
Components: Runtime / Coordination
Affects Versions: 1.13.0
Reporter: Zhilong Hong
During the initialization of DefaultExecutionTopology, pipelined regions will
be computed for scheduling. Currently the complexity of this procedure is
O(N^2):
{code:java}
for all vertices in the topology:
for all consumed results of the vertex:
if the consumed result is reconnectable:
merge the current region with its producer region
{code}
One possible solution is mentioned in FLINK-17330.
If we can optimize this procedure from O(N^2) to O(N), it will speed up the
initialization of SchedulerNG, and accelerate the submission of a new job,
especially for OLAP jobs.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
