[ https://issues.apache.org/jira/browse/YARN-9326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779296#comment-16779296 ]
Wilfred Spiegelenburg commented on YARN-9326: --------------------------------------------- Thanks [~adam.antal] for following up on YARN-8662 * I looked at the documentation and am missing the changes to the {{minResources}}. As I stated in YARN-8662 the {{minResources}} tag also handles % signs in its definition. That is not mentioned in any style example. We need to add it for new and old style definitions. * New style resources for all settings can use % which is not shown. I am thus still missing the example for new style resources that use the percentage in all settings: {code} vcores=X%, memory-mb=Y% {code} * The other thing that is still not clear in the update is that the only case in which we default the resource types not specified to either 0 or the maximum is when we use the new style resources. That should be combined with making it even clearer that resource types should *not* be used in combination with old style definitions. > Fair Scheduler configuration defaults are not documented in case of min and > maxResources > ---------------------------------------------------------------------------------------- > > Key: YARN-9326 > URL: https://issues.apache.org/jira/browse/YARN-9326 > Project: Hadoop YARN > Issue Type: Improvement > Components: docs, documentation, fairscheduler, yarn > Affects Versions: 3.2.0 > Reporter: Adam Antal > Assignee: Adam Antal > Priority: Major > Attachments: YARN-9326.001.patch, YARN-9326.002.patch > > > The FairScheduler's configuration has the following defaults (from the code: > javadoc): > {noformat} > In new style resources, any resource that is not specified will be set to > missing or 0%, as appropriate. Also, in the new style resources, units are > not allowed. Units are assumed from the resource manager's settings for the > resources when the value isn't a percentage. The missing parameter is only > used in the case of new style resources without percentages. With new style > resources with percentages, any missing resources will be assumed to be 100% > because percentages are only used with maximum resource limits. > {noformat} > This is not documented in the hadoop yarn site FairScheduler.html. It is > quite intuitive, but still need to be documented though. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org