Hi all, As you might have seen already, we are currently reworking Flink's scheduling. At the moment, scheduling is a concern that is scattered across different components, such as ExecutionGraph, Execution and SlotPool. Scheduling also happens only on the granularity of individual tasks, which make holistic scheduling strategies hard to implement. For more details on our motivation see [1]. To track the progress, we have created the umbrella issue FLINK-10429 [2] (bear in mind that the current sub-tasks are still subject to change).
We are currently in the process of finalizing the scheduler interfaces. Our current state can be found in [3]. Feel free to review and comment on our design proposal. Best, Gary [1] https://docs.google.com/document/d/1q7NOqt05HIN-PlKEEPB36JiuU1Iu9fnxxVGJzylhsxU/edit [2] https://issues.apache.org/jira/browse/FLINK-10429 [3] https://docs.google.com/document/d/1fstkML72YBO1tGD_dmG2rwvd9bklhRVauh4FSsDDwXU/edit?usp=sharing
