shuai.xu created FLINK-11298:
--------------------------------
Summary: Scheduling job in the unit of concurrent groups
Key: FLINK-11298
URL: https://issues.apache.org/jira/browse/FLINK-11298
Project: Flink
Issue Type: Improvement
Components: JobManager
Reporter: shuai.xu
Now flink only support two scheduling modes, that's scheduling all tasks Eager
for streaming jobs and scheduling all task Lazy_from_source for batch jobs.
This is not flexible enough for the various requirements of different job such
as FLINK-10240. We proposal a new ConcurrentSchedulingGroup based scheduling
strategy which first split a job into serval concurrent groups and then
schedule it in the unit of concurrent groups. This strategy will support not
only the existing EAGER and LAZY_FROM_SOURCE mode but also other situation such
as the Build/Probe in FLINK-10240.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)