[jira] [Commented] (YARN-2669) FairScheduler: queue names shouldn't allow periods
[ https://issues.apache.org/jira/browse/YARN-2669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16305336#comment-16305336 ] Carlos Martinez Moller commented on YARN-2669: -- Doing this kind of replacement (james.smith to james_dot_smith) adds some limitations to automating queue placement. I don't know if they were possible before... if they weren't it would be also good to consider this enhancement. The Fair Scheduler allows for Subpool management which is very useful in certain scenarios, where two or more levels are used. Scenario: Let's imagine that due to budgets I want to split the cluster in two main queues: DepartmentA (30% of the cluster) and DepartmentB (70% of the cluster) And then split the queue DeparmentA in two: ProjectA(40%) and ProjectB (60%) Using secondary groups we could have created a Unix Group "DeparmentA.ProjectA" and assign it to the user executing Batches for this department. This allows for an easy/centralized management of Queues when SubQueues are used: - Single database of which users work on which pools (/etc/group/LDAP) - Easy to reallocate/redesign the solution by changing the secondary groups of users But this Jira seems to think on a flat Queue solution, I believe Subpools are not considered (other than the group.username kind) With the solution adopted on this Jira we are forced to specify the Queue for each Job and do Queue management for each job. In the case of redesigning the Pool distribution have many things to change in mind. Not everything comes from Linux shell and uses the same technology, sometimes is JDBC executions on Hive, etc so the workaround is not as easy as modifying the .profile of an user to specify a queue. I could not think for a Workaround to this. > FairScheduler: queue names shouldn't allow periods > -- > > Key: YARN-2669 > URL: https://issues.apache.org/jira/browse/YARN-2669 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: Wei Yan >Assignee: Wei Yan > Fix For: 2.7.0 > > Attachments: YARN-2669-1.patch, YARN-2669-2.patch, YARN-2669-3.patch, > YARN-2669-4.patch, YARN-2669-5.patch > > > For an allocation file like: > {noformat} > > > 4096mb,4vcores > > > {noformat} > Users may wish to config minResources for a queue with full path "root.q1". > However, right now, fair scheduler will treat this configureation for the > queue with full name "root.root.q1". We need to print out a warning msg to > notify users about this. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-2669) FairScheduler: queue names shouldn't allow periods
[ https://issues.apache.org/jira/browse/YARN-2669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14222007#comment-14222007 ] Hudson commented on YARN-2669: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1965 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1965/]) YARN-2669. FairScheduler: queue names shouldn't allow periods (Wei Yan via Sandy Ryza) (sandy: rev a128cca305cecb215a2eef2ef543d1bf9b23a41b) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/PeriodGroupsMapping.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestFairScheduler.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/AllocationFileLoaderService.java * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/FairScheduler.apt.vm * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestQueuePlacementPolicy.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/QueuePlacementRule.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/FairScheduler.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestAllocationFileLoaderService.java > FairScheduler: queue names shouldn't allow periods > -- > > Key: YARN-2669 > URL: https://issues.apache.org/jira/browse/YARN-2669 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: Wei Yan >Assignee: Wei Yan > Fix For: 2.7.0 > > Attachments: YARN-2669-1.patch, YARN-2669-2.patch, YARN-2669-3.patch, > YARN-2669-4.patch, YARN-2669-5.patch > > > For an allocation file like: > {noformat} > > > 4096mb,4vcores > > > {noformat} > Users may wish to config minResources for a queue with full path "root.q1". > However, right now, fair scheduler will treat this configureation for the > queue with full name "root.root.q1". We need to print out a warning msg to > notify users about this. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2669) FairScheduler: queue names shouldn't allow periods
[ https://issues.apache.org/jira/browse/YARN-2669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14222000#comment-14222000 ] Hudson commented on YARN-2669: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #13 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/13/]) YARN-2669. FairScheduler: queue names shouldn't allow periods (Wei Yan via Sandy Ryza) (sandy: rev a128cca305cecb215a2eef2ef543d1bf9b23a41b) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/AllocationFileLoaderService.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/FairScheduler.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestFairScheduler.java * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestAllocationFileLoaderService.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestQueuePlacementPolicy.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/FairScheduler.apt.vm * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/PeriodGroupsMapping.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/QueuePlacementRule.java > FairScheduler: queue names shouldn't allow periods > -- > > Key: YARN-2669 > URL: https://issues.apache.org/jira/browse/YARN-2669 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: Wei Yan >Assignee: Wei Yan > Fix For: 2.7.0 > > Attachments: YARN-2669-1.patch, YARN-2669-2.patch, YARN-2669-3.patch, > YARN-2669-4.patch, YARN-2669-5.patch > > > For an allocation file like: > {noformat} > > > 4096mb,4vcores > > > {noformat} > Users may wish to config minResources for a queue with full path "root.q1". > However, right now, fair scheduler will treat this configureation for the > queue with full name "root.root.q1". We need to print out a warning msg to > notify users about this. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2669) FairScheduler: queue names shouldn't allow periods
[ https://issues.apache.org/jira/browse/YARN-2669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14221970#comment-14221970 ] Hudson commented on YARN-2669: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk-Java8 #13 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/13/]) YARN-2669. FairScheduler: queue names shouldn't allow periods (Wei Yan via Sandy Ryza) (sandy: rev a128cca305cecb215a2eef2ef543d1bf9b23a41b) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/FairScheduler.apt.vm * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/FairScheduler.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/QueuePlacementRule.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/AllocationFileLoaderService.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestFairScheduler.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestQueuePlacementPolicy.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/PeriodGroupsMapping.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestAllocationFileLoaderService.java > FairScheduler: queue names shouldn't allow periods > -- > > Key: YARN-2669 > URL: https://issues.apache.org/jira/browse/YARN-2669 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: Wei Yan >Assignee: Wei Yan > Fix For: 2.7.0 > > Attachments: YARN-2669-1.patch, YARN-2669-2.patch, YARN-2669-3.patch, > YARN-2669-4.patch, YARN-2669-5.patch > > > For an allocation file like: > {noformat} > > > 4096mb,4vcores > > > {noformat} > Users may wish to config minResources for a queue with full path "root.q1". > However, right now, fair scheduler will treat this configureation for the > queue with full name "root.root.q1". We need to print out a warning msg to > notify users about this. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2669) FairScheduler: queue names shouldn't allow periods
[ https://issues.apache.org/jira/browse/YARN-2669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14221963#comment-14221963 ] Hudson commented on YARN-2669: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1941 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1941/]) YARN-2669. FairScheduler: queue names shouldn't allow periods (Wei Yan via Sandy Ryza) (sandy: rev a128cca305cecb215a2eef2ef543d1bf9b23a41b) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/AllocationFileLoaderService.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/FairScheduler.apt.vm * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestQueuePlacementPolicy.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/QueuePlacementRule.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestAllocationFileLoaderService.java * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestFairScheduler.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/FairScheduler.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/PeriodGroupsMapping.java > FairScheduler: queue names shouldn't allow periods > -- > > Key: YARN-2669 > URL: https://issues.apache.org/jira/browse/YARN-2669 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: Wei Yan >Assignee: Wei Yan > Fix For: 2.7.0 > > Attachments: YARN-2669-1.patch, YARN-2669-2.patch, YARN-2669-3.patch, > YARN-2669-4.patch, YARN-2669-5.patch > > > For an allocation file like: > {noformat} > > > 4096mb,4vcores > > > {noformat} > Users may wish to config minResources for a queue with full path "root.q1". > However, right now, fair scheduler will treat this configureation for the > queue with full name "root.root.q1". We need to print out a warning msg to > notify users about this. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2669) FairScheduler: queue names shouldn't allow periods
[ https://issues.apache.org/jira/browse/YARN-2669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14221931#comment-14221931 ] Hudson commented on YARN-2669: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #13 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/13/]) YARN-2669. FairScheduler: queue names shouldn't allow periods (Wei Yan via Sandy Ryza) (sandy: rev a128cca305cecb215a2eef2ef543d1bf9b23a41b) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestFairScheduler.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/AllocationFileLoaderService.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/FairScheduler.apt.vm * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestAllocationFileLoaderService.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/PeriodGroupsMapping.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestQueuePlacementPolicy.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/FairScheduler.java * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/QueuePlacementRule.java > FairScheduler: queue names shouldn't allow periods > -- > > Key: YARN-2669 > URL: https://issues.apache.org/jira/browse/YARN-2669 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: Wei Yan >Assignee: Wei Yan > Fix For: 2.7.0 > > Attachments: YARN-2669-1.patch, YARN-2669-2.patch, YARN-2669-3.patch, > YARN-2669-4.patch, YARN-2669-5.patch > > > For an allocation file like: > {noformat} > > > 4096mb,4vcores > > > {noformat} > Users may wish to config minResources for a queue with full path "root.q1". > However, right now, fair scheduler will treat this configureation for the > queue with full name "root.root.q1". We need to print out a warning msg to > notify users about this. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2669) FairScheduler: queue names shouldn't allow periods
[ https://issues.apache.org/jira/browse/YARN-2669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14221938#comment-14221938 ] Hudson commented on YARN-2669: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #751 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/751/]) YARN-2669. FairScheduler: queue names shouldn't allow periods (Wei Yan via Sandy Ryza) (sandy: rev a128cca305cecb215a2eef2ef543d1bf9b23a41b) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestFairScheduler.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/FairScheduler.apt.vm * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestQueuePlacementPolicy.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/FairScheduler.java * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestAllocationFileLoaderService.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/QueuePlacementRule.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/PeriodGroupsMapping.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/AllocationFileLoaderService.java > FairScheduler: queue names shouldn't allow periods > -- > > Key: YARN-2669 > URL: https://issues.apache.org/jira/browse/YARN-2669 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: Wei Yan >Assignee: Wei Yan > Fix For: 2.7.0 > > Attachments: YARN-2669-1.patch, YARN-2669-2.patch, YARN-2669-3.patch, > YARN-2669-4.patch, YARN-2669-5.patch > > > For an allocation file like: > {noformat} > > > 4096mb,4vcores > > > {noformat} > Users may wish to config minResources for a queue with full path "root.q1". > However, right now, fair scheduler will treat this configureation for the > queue with full name "root.root.q1". We need to print out a warning msg to > notify users about this. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2669) FairScheduler: queue names shouldn't allow periods
[ https://issues.apache.org/jira/browse/YARN-2669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14221671#comment-14221671 ] Hadoop QA commented on YARN-2669: - {color:green}+1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12682990/YARN-2669-5.patch against trunk revision 1e9a3f4. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 4 new or modified test files. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. There were no new javadoc warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 2.0.3) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-YARN-Build/5904//testReport/ Console output: https://builds.apache.org/job/PreCommit-YARN-Build/5904//console This message is automatically generated. > FairScheduler: queue names shouldn't allow periods > -- > > Key: YARN-2669 > URL: https://issues.apache.org/jira/browse/YARN-2669 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: Wei Yan >Assignee: Wei Yan > Fix For: 2.7.0 > > Attachments: YARN-2669-1.patch, YARN-2669-2.patch, YARN-2669-3.patch, > YARN-2669-4.patch, YARN-2669-5.patch > > > For an allocation file like: > {noformat} > > > 4096mb,4vcores > > > {noformat} > Users may wish to config minResources for a queue with full path "root.q1". > However, right now, fair scheduler will treat this configureation for the > queue with full name "root.root.q1". We need to print out a warning msg to > notify users about this. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2669) FairScheduler: queue names shouldn't allow periods
[ https://issues.apache.org/jira/browse/YARN-2669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14221627#comment-14221627 ] Hudson commented on YARN-2669: -- FAILURE: Integrated in Hadoop-trunk-Commit #6589 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/6589/]) YARN-2669. FairScheduler: queue names shouldn't allow periods (Wei Yan via Sandy Ryza) (sandy: rev a128cca305cecb215a2eef2ef543d1bf9b23a41b) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/AllocationFileLoaderService.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestQueuePlacementPolicy.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestAllocationFileLoaderService.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/PeriodGroupsMapping.java * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/FairScheduler.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/FairScheduler.apt.vm * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/QueuePlacementRule.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestFairScheduler.java > FairScheduler: queue names shouldn't allow periods > -- > > Key: YARN-2669 > URL: https://issues.apache.org/jira/browse/YARN-2669 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: Wei Yan >Assignee: Wei Yan > Fix For: 2.7.0 > > Attachments: YARN-2669-1.patch, YARN-2669-2.patch, YARN-2669-3.patch, > YARN-2669-4.patch, YARN-2669-5.patch > > > For an allocation file like: > {noformat} > > > 4096mb,4vcores > > > {noformat} > Users may wish to config minResources for a queue with full path "root.q1". > However, right now, fair scheduler will treat this configureation for the > queue with full name "root.root.q1". We need to print out a warning msg to > notify users about this. -- This message was sent by Atlassian JIRA (v6.3.4#6332)