[
https://issues.apache.org/jira/browse/YARN-9509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18047322#comment-18047322
]
ASF GitHub Bot commented on YARN-9509:
--------------------------------------
github-actions[bot] closed pull request #766: YARN-9509: Added a configuration
for admins to be able to capped per-container cpu usage based on a multiplier
URL: https://github.com/apache/hadoop/pull/766
> Capped cpu usage with cgroup strict-resource-usage based on a mulitplier
> ------------------------------------------------------------------------
>
> Key: YARN-9509
> URL: https://issues.apache.org/jira/browse/YARN-9509
> Project: Hadoop YARN
> Issue Type: New Feature
> Components: nodemanager
> Reporter: Nicolas Fraison
> Priority: Minor
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Add a multiplier configuration on strict resource usage to authorize
> container to use spare cpu up to a limit.
> Currently with strict resource usage you can't get more than what you request
> which is sometime not good for jobs that doesn't have a constant usage of cpu
> (for ex. spark jobs with multiple stages).
> But without strict resource usage we have seen some bad behaviour from our
> users that don't tune at all their needs and it leads to some containers
> requesting 2 vcore but constantly using 20.
> The idea here is to still authorize containers to get more cpu than what they
> request if some are free but also to avoid too big differencies so SLA on
> jobs is not breached if the cluster is full (at least increase of runtime is
> contain)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
