Benjamin Teke created YARN-10505:
------------------------------------

             Summary: Extend the maximum-capacity property to react to weight 
mode changes
                 Key: YARN-10505
                 URL: https://issues.apache.org/jira/browse/YARN-10505
             Project: Hadoop YARN
          Issue Type: Sub-task
            Reporter: Benjamin Teke


The property root.users.maximum-capacity could mean the following things:
 * Relative Percentage: maximum capacity relative to its parent. If it’s set to 
50, then it means that the capacity is capped with respect to the parent.
 * Absolute Percentage: maximum capacity expressed as a percentage of the 
overall cluster capacity.
 * Percentages of different resource types: this would refer to vCores, memory, 
GPU, etc... Similarly to the single percentage value, this could either mean 
percentage of the parent or percentage of the overall cluster resource.
 * Absolute limit: explicit definition of vCores and memory like vcores=20, 
memory-mb=16384. 

 

Note that Fair Scheduler supports the following settings:
 * Single percentage (absolute)
 * Two percentages (absolute)
 * Absolute resources

 

It is recommended that all three formats are supported for maximum-capacity 
after introducing weight mode. The final form of the configuration for example 
could look like this:

root.users.maximum-capacity = 100% - single percentage

root.users.maximum-capacity = (vcores=100%, memory-mb=100%) - two percentages

root.users.maximum-capacity = (vcores=10, memory-mb=10000mb) - absolute



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

Reply via email to