[ https://issues.apache.org/jira/browse/YARN-10257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17099767#comment-17099767 ]
Peter Bacsko commented on YARN-10257: ------------------------------------- [~adam.antal] 1. "Do you plan to do something with regards to the first item from the description? (I mean the increment-allocation properties)." Well, those properties are not needed during the conversion - so I simply removed all references to them (the original FS-CS document made me believe that those are necessary to convert, but in fact, they're not). 2. system-rules artifact --> thanks, it looks like a better solution, I switched to this. > FS-CS converter: skip increment properties for mem/vcores and fix DRF check > --------------------------------------------------------------------------- > > Key: YARN-10257 > URL: https://issues.apache.org/jira/browse/YARN-10257 > Project: Hadoop YARN > Issue Type: Sub-task > Reporter: Peter Bacsko > Assignee: Peter Bacsko > Priority: Major > Attachments: YARN-10257-001.patch, YARN-10257-002.patch > > > Two issues have been discovered during fs2cs testing: > 1. The conversion of allocation increment properties are not needed: > {{yarn.scheduler.increment-allocation-mb}} > {{yarn.scheduler.increment-allocation-vcores}} > {{yarn.resource-types.memory-mb.increment-allocation}} > {{yarn.resource-types.vcores.increment-allocation}} > 2. The following piece of code is incorrect - the default scheduling policy > can be different from DRF, which is a problem if DRF is used everywhere else: > {code} > private boolean isDrfUsed(FairScheduler fs) { > FSQueue rootQueue = fs.getQueueManager().getRootQueue(); > AllocationConfiguration allocConf = fs.getAllocationConfiguration(); > String defaultPolicy = allocConf.getDefaultSchedulingPolicy().getName(); > if (DominantResourceFairnessPolicy.NAME.equals(defaultPolicy)) { > return true; > } else { > return isDrfUsedOnQueueLevel(rootQueue); > } > } > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org