Xintong Song created FLINK-14106:
------------------------------------

             Summary: Make SlotManager pluggable
                 Key: FLINK-14106
                 URL: https://issues.apache.org/jira/browse/FLINK-14106
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Coordination
    Affects Versions: 1.9.0
            Reporter: Xintong Song
             Fix For: 1.10.0


As we are enabling fine grained resource management in 1.10, we can have 
various resource scheduling strategies. Such strategies generally should make 
the following three decisions.
 * When to launch new / release existing TMs? (How many TMs)
 * What and how many resources should TMs be started with?
 * How to allocate between slot requests and TM resources?

We may want to make above decisions differently in different scenarios 
(active/reactive mode, perjob/session mode, etc.). Therefore, we propose to 
make the scheduling strategies pluggable.

We propose to make the following changes:
 * Make SlotManager an interface, and implements it differently for different 
strategies strategies.
 * Modify ResourceManager-SlotManager interfaces to cover all the three 
decisions mentioned above in SlotManager. In particular, SlotManager needs to 
allocate TM resources instead of slot resources from ResourceActions.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

Reply via email to