[
https://issues.apache.org/jira/browse/YARN-9509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18047161#comment-18047161
]
ASF GitHub Bot commented on YARN-9509:
--------------------------------------
github-actions[bot] commented on PR #766:
URL: https://github.com/apache/hadoop/pull/766#issuecomment-3684629248
We're closing this stale PR because it has been open for 100 days with no
activity. This isn't a judgement on the merit of the PR in any way. It's just a
way of keeping the PR queue manageable.
If you feel like this was a mistake, or you would like to continue working
on it, please feel free to re-open it and ask for a committer to remove the
stale tag and review again.
Thanks all for your contribution.
> Capped cpu usage with cgroup strict-resource-usage based on a mulitplier
> ------------------------------------------------------------------------
>
> Key: YARN-9509
> URL: https://issues.apache.org/jira/browse/YARN-9509
> Project: Hadoop YARN
> Issue Type: New Feature
> Components: nodemanager
> Reporter: Nicolas Fraison
> Priority: Minor
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Add a multiplier configuration on strict resource usage to authorize
> container to use spare cpu up to a limit.
> Currently with strict resource usage you can't get more than what you request
> which is sometime not good for jobs that doesn't have a constant usage of cpu
> (for ex. spark jobs with multiple stages).
> But without strict resource usage we have seen some bad behaviour from our
> users that don't tune at all their needs and it leads to some containers
> requesting 2 vcore but constantly using 20.
> The idea here is to still authorize containers to get more cpu than what they
> request if some are free but also to avoid too big differencies so SLA on
> jobs is not breached if the cluster is full (at least increase of runtime is
> contain)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
