[jira] [Commented] (YARN-343) Capacity Scheduler maximum-capacity value -1 is invalid
[ https://issues.apache.org/jira/browse/YARN-343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13567649#comment-13567649 ] Hudson commented on YARN-343: - Integrated in Hadoop-Mapreduce-trunk #1330 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1330/]) YARN-343. Capacity Scheduler maximum-capacity value -1 is invalid (Xuan Gong via tgraves) (Revision 1440457) Result = SUCCESS tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1440457 Files : * /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacitySchedulerConfiguration.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestCapacityScheduler.java > Capacity Scheduler maximum-capacity value -1 is invalid > --- > > Key: YARN-343 > URL: https://issues.apache.org/jira/browse/YARN-343 > Project: Hadoop YARN > Issue Type: Bug > Components: capacityscheduler >Affects Versions: 0.23.6 >Reporter: Thomas Graves >Assignee: Xuan Gong > Fix For: 3.0.0, 2.0.3-alpha, 0.23.7 > > Attachments: YARN-343.1.patch, Yarn-343.2.patch, YARN-343.3.patch > > > I tried to start the resource manager using the capacity scheduler with a > particular queues maximum-capacity set to -1 which is supposed to disable it > according to the docs but I got the following exception: > java.lang.IllegalArgumentException: Illegal value of maximumCapacity -0.01 > used in call to setMaxCapacity for queue foo > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CSQueueUtils.checkMaxCapacity(CSQueueUtils.java:31) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.setupQueueConfigs(LeafQueue.java:220) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.(LeafQueue.java:191) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:310) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:325) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initializeQueues(CapacityScheduler.java:232) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.reinitialize(CapacityScheduler.java:202) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-343) Capacity Scheduler maximum-capacity value -1 is invalid
[ https://issues.apache.org/jira/browse/YARN-343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13567600#comment-13567600 ] Hudson commented on YARN-343: - Integrated in Hadoop-Hdfs-trunk #1302 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1302/]) YARN-343. Capacity Scheduler maximum-capacity value -1 is invalid (Xuan Gong via tgraves) (Revision 1440457) Result = SUCCESS tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1440457 Files : * /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacitySchedulerConfiguration.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestCapacityScheduler.java > Capacity Scheduler maximum-capacity value -1 is invalid > --- > > Key: YARN-343 > URL: https://issues.apache.org/jira/browse/YARN-343 > Project: Hadoop YARN > Issue Type: Bug > Components: capacityscheduler >Affects Versions: 0.23.6 >Reporter: Thomas Graves >Assignee: Xuan Gong > Fix For: 3.0.0, 2.0.3-alpha, 0.23.7 > > Attachments: YARN-343.1.patch, Yarn-343.2.patch, YARN-343.3.patch > > > I tried to start the resource manager using the capacity scheduler with a > particular queues maximum-capacity set to -1 which is supposed to disable it > according to the docs but I got the following exception: > java.lang.IllegalArgumentException: Illegal value of maximumCapacity -0.01 > used in call to setMaxCapacity for queue foo > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CSQueueUtils.checkMaxCapacity(CSQueueUtils.java:31) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.setupQueueConfigs(LeafQueue.java:220) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.(LeafQueue.java:191) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:310) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:325) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initializeQueues(CapacityScheduler.java:232) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.reinitialize(CapacityScheduler.java:202) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-343) Capacity Scheduler maximum-capacity value -1 is invalid
[ https://issues.apache.org/jira/browse/YARN-343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13567591#comment-13567591 ] Hudson commented on YARN-343: - Integrated in Hadoop-Hdfs-0.23-Build #511 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/511/]) YARN-343. Capacity Scheduler maximum-capacity value -1 is invalid (Xuan Gong via tgraves) (Revision 1440459) Result = SUCCESS tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1440459 Files : * /hadoop/common/branches/branch-0.23/hadoop-yarn-project/CHANGES.txt * /hadoop/common/branches/branch-0.23/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacitySchedulerConfiguration.java * /hadoop/common/branches/branch-0.23/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestCapacityScheduler.java > Capacity Scheduler maximum-capacity value -1 is invalid > --- > > Key: YARN-343 > URL: https://issues.apache.org/jira/browse/YARN-343 > Project: Hadoop YARN > Issue Type: Bug > Components: capacityscheduler >Affects Versions: 0.23.6 >Reporter: Thomas Graves >Assignee: Xuan Gong > Fix For: 3.0.0, 2.0.3-alpha, 0.23.7 > > Attachments: YARN-343.1.patch, Yarn-343.2.patch, YARN-343.3.patch > > > I tried to start the resource manager using the capacity scheduler with a > particular queues maximum-capacity set to -1 which is supposed to disable it > according to the docs but I got the following exception: > java.lang.IllegalArgumentException: Illegal value of maximumCapacity -0.01 > used in call to setMaxCapacity for queue foo > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CSQueueUtils.checkMaxCapacity(CSQueueUtils.java:31) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.setupQueueConfigs(LeafQueue.java:220) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.(LeafQueue.java:191) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:310) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:325) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initializeQueues(CapacityScheduler.java:232) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.reinitialize(CapacityScheduler.java:202) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-343) Capacity Scheduler maximum-capacity value -1 is invalid
[ https://issues.apache.org/jira/browse/YARN-343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13567526#comment-13567526 ] Hudson commented on YARN-343: - Integrated in Hadoop-Yarn-trunk #113 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/113/]) YARN-343. Capacity Scheduler maximum-capacity value -1 is invalid (Xuan Gong via tgraves) (Revision 1440457) Result = SUCCESS tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1440457 Files : * /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacitySchedulerConfiguration.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestCapacityScheduler.java > Capacity Scheduler maximum-capacity value -1 is invalid > --- > > Key: YARN-343 > URL: https://issues.apache.org/jira/browse/YARN-343 > Project: Hadoop YARN > Issue Type: Bug > Components: capacityscheduler >Affects Versions: 0.23.6 >Reporter: Thomas Graves >Assignee: Xuan Gong > Fix For: 3.0.0, 2.0.3-alpha, 0.23.7 > > Attachments: YARN-343.1.patch, Yarn-343.2.patch, YARN-343.3.patch > > > I tried to start the resource manager using the capacity scheduler with a > particular queues maximum-capacity set to -1 which is supposed to disable it > according to the docs but I got the following exception: > java.lang.IllegalArgumentException: Illegal value of maximumCapacity -0.01 > used in call to setMaxCapacity for queue foo > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CSQueueUtils.checkMaxCapacity(CSQueueUtils.java:31) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.setupQueueConfigs(LeafQueue.java:220) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.(LeafQueue.java:191) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:310) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:325) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initializeQueues(CapacityScheduler.java:232) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.reinitialize(CapacityScheduler.java:202) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-343) Capacity Scheduler maximum-capacity value -1 is invalid
[ https://issues.apache.org/jira/browse/YARN-343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566756#comment-13566756 ] Thomas Graves commented on YARN-343: Note I think we discussed this under MAPREDUCE-3683. > Capacity Scheduler maximum-capacity value -1 is invalid > --- > > Key: YARN-343 > URL: https://issues.apache.org/jira/browse/YARN-343 > Project: Hadoop YARN > Issue Type: Bug > Components: capacityscheduler >Affects Versions: 0.23.6 >Reporter: Thomas Graves >Assignee: Xuan Gong > Fix For: 3.0.0, 2.0.3-alpha, 0.23.7 > > Attachments: YARN-343.1.patch, Yarn-343.2.patch, YARN-343.3.patch > > > I tried to start the resource manager using the capacity scheduler with a > particular queues maximum-capacity set to -1 which is supposed to disable it > according to the docs but I got the following exception: > java.lang.IllegalArgumentException: Illegal value of maximumCapacity -0.01 > used in call to setMaxCapacity for queue foo > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CSQueueUtils.checkMaxCapacity(CSQueueUtils.java:31) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.setupQueueConfigs(LeafQueue.java:220) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.(LeafQueue.java:191) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:310) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:325) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initializeQueues(CapacityScheduler.java:232) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.reinitialize(CapacityScheduler.java:202) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-343) Capacity Scheduler maximum-capacity value -1 is invalid
[ https://issues.apache.org/jira/browse/YARN-343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566753#comment-13566753 ] Thomas Graves commented on YARN-343: I expect the parents max capacity to apply to its children so no child can get over the max capacity of the parent. Otherwise the parent max capacity has no meaning. > Capacity Scheduler maximum-capacity value -1 is invalid > --- > > Key: YARN-343 > URL: https://issues.apache.org/jira/browse/YARN-343 > Project: Hadoop YARN > Issue Type: Bug > Components: capacityscheduler >Affects Versions: 0.23.6 >Reporter: Thomas Graves >Assignee: Xuan Gong > Fix For: 3.0.0, 2.0.3-alpha, 0.23.7 > > Attachments: YARN-343.1.patch, Yarn-343.2.patch, YARN-343.3.patch > > > I tried to start the resource manager using the capacity scheduler with a > particular queues maximum-capacity set to -1 which is supposed to disable it > according to the docs but I got the following exception: > java.lang.IllegalArgumentException: Illegal value of maximumCapacity -0.01 > used in call to setMaxCapacity for queue foo > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CSQueueUtils.checkMaxCapacity(CSQueueUtils.java:31) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.setupQueueConfigs(LeafQueue.java:220) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.(LeafQueue.java:191) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:310) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:325) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initializeQueues(CapacityScheduler.java:232) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.reinitialize(CapacityScheduler.java:202) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-343) Capacity Scheduler maximum-capacity value -1 is invalid
[ https://issues.apache.org/jira/browse/YARN-343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566721#comment-13566721 ] Arun C Murthy commented on YARN-343: Sorry, one thing I failed to notice... We really should return Float.MAX_VALUE rather than 100.0 since 100.0 will limit it to parent's max-cap, where-as Float.MAX_VALUE will let it go beyond. Does that make sense? > Capacity Scheduler maximum-capacity value -1 is invalid > --- > > Key: YARN-343 > URL: https://issues.apache.org/jira/browse/YARN-343 > Project: Hadoop YARN > Issue Type: Bug > Components: capacityscheduler >Affects Versions: 0.23.6 >Reporter: Thomas Graves >Assignee: Xuan Gong > Fix For: 3.0.0, 2.0.3-alpha, 0.23.7 > > Attachments: YARN-343.1.patch, Yarn-343.2.patch, YARN-343.3.patch > > > I tried to start the resource manager using the capacity scheduler with a > particular queues maximum-capacity set to -1 which is supposed to disable it > according to the docs but I got the following exception: > java.lang.IllegalArgumentException: Illegal value of maximumCapacity -0.01 > used in call to setMaxCapacity for queue foo > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CSQueueUtils.checkMaxCapacity(CSQueueUtils.java:31) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.setupQueueConfigs(LeafQueue.java:220) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.(LeafQueue.java:191) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:310) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:325) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initializeQueues(CapacityScheduler.java:232) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.reinitialize(CapacityScheduler.java:202) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-343) Capacity Scheduler maximum-capacity value -1 is invalid
[ https://issues.apache.org/jira/browse/YARN-343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566540#comment-13566540 ] Hudson commented on YARN-343: - Integrated in Hadoop-trunk-Commit #3300 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/3300/]) YARN-343. Capacity Scheduler maximum-capacity value -1 is invalid (Xuan Gong via tgraves) (Revision 1440457) Result = SUCCESS tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1440457 Files : * /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacitySchedulerConfiguration.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestCapacityScheduler.java > Capacity Scheduler maximum-capacity value -1 is invalid > --- > > Key: YARN-343 > URL: https://issues.apache.org/jira/browse/YARN-343 > Project: Hadoop YARN > Issue Type: Bug > Components: capacityscheduler >Affects Versions: 0.23.6 >Reporter: Thomas Graves >Assignee: Xuan Gong > Fix For: 3.0.0, 2.0.3-alpha, 0.23.7 > > Attachments: YARN-343.1.patch, Yarn-343.2.patch, YARN-343.3.patch > > > I tried to start the resource manager using the capacity scheduler with a > particular queues maximum-capacity set to -1 which is supposed to disable it > according to the docs but I got the following exception: > java.lang.IllegalArgumentException: Illegal value of maximumCapacity -0.01 > used in call to setMaxCapacity for queue foo > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CSQueueUtils.checkMaxCapacity(CSQueueUtils.java:31) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.setupQueueConfigs(LeafQueue.java:220) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.(LeafQueue.java:191) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:310) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:325) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initializeQueues(CapacityScheduler.java:232) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.reinitialize(CapacityScheduler.java:202) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-343) Capacity Scheduler maximum-capacity value -1 is invalid
[ https://issues.apache.org/jira/browse/YARN-343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566533#comment-13566533 ] Thomas Graves commented on YARN-343: +1 looks good. Thanks Xuan. > Capacity Scheduler maximum-capacity value -1 is invalid > --- > > Key: YARN-343 > URL: https://issues.apache.org/jira/browse/YARN-343 > Project: Hadoop YARN > Issue Type: Bug > Components: capacityscheduler >Affects Versions: 0.23.6 >Reporter: Thomas Graves >Assignee: Xuan Gong > Attachments: YARN-343.1.patch, Yarn-343.2.patch, YARN-343.3.patch > > > I tried to start the resource manager using the capacity scheduler with a > particular queues maximum-capacity set to -1 which is supposed to disable it > according to the docs but I got the following exception: > java.lang.IllegalArgumentException: Illegal value of maximumCapacity -0.01 > used in call to setMaxCapacity for queue foo > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CSQueueUtils.checkMaxCapacity(CSQueueUtils.java:31) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.setupQueueConfigs(LeafQueue.java:220) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.(LeafQueue.java:191) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:310) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:325) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initializeQueues(CapacityScheduler.java:232) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.reinitialize(CapacityScheduler.java:202) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-343) Capacity Scheduler maximum-capacity value -1 is invalid
[
https://issues.apache.org/jira/browse/YARN-343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13564516#comment-13564516
]
Hadoop QA commented on YARN-343:
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12566796/YARN-343.3.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:red}-1 core tests{color}. The patch failed these unit tests in
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager:
org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebServices
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-YARN-Build/372//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/372//console
This message is automatically generated.
> Capacity Scheduler maximum-capacity value -1 is invalid
> ---
>
> Key: YARN-343
> URL: https://issues.apache.org/jira/browse/YARN-343
> Project: Hadoop YARN
> Issue Type: Bug
> Components: capacityscheduler
>Affects Versions: 0.23.6
>Reporter: Thomas Graves
>Assignee: Xuan Gong
> Attachments: YARN-343.1.patch, Yarn-343.2.patch, YARN-343.3.patch
>
>
> I tried to start the resource manager using the capacity scheduler with a
> particular queues maximum-capacity set to -1 which is supposed to disable it
> according to the docs but I got the following exception:
> java.lang.IllegalArgumentException: Illegal value of maximumCapacity -0.01
> used in call to setMaxCapacity for queue foo
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CSQueueUtils.checkMaxCapacity(CSQueueUtils.java:31)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.setupQueueConfigs(LeafQueue.java:220)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.(LeafQueue.java:191)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:310)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:325)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initializeQueues(CapacityScheduler.java:232)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.reinitialize(CapacityScheduler.java:202)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-343) Capacity Scheduler maximum-capacity value -1 is invalid
[
https://issues.apache.org/jira/browse/YARN-343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13563105#comment-13563105
]
Hadoop QA commented on YARN-343:
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12566567/Yarn-343.2.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:red}-1 core tests{color}. The patch failed these unit tests in
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager:
org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebServices
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-YARN-Build/370//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/370//console
This message is automatically generated.
> Capacity Scheduler maximum-capacity value -1 is invalid
> ---
>
> Key: YARN-343
> URL: https://issues.apache.org/jira/browse/YARN-343
> Project: Hadoop YARN
> Issue Type: Bug
> Components: capacityscheduler
>Affects Versions: 0.23.6
>Reporter: Thomas Graves
>Assignee: Xuan Gong
> Attachments: YARN-343.1.patch, Yarn-343.2.patch
>
>
> I tried to start the resource manager using the capacity scheduler with a
> particular queues maximum-capacity set to -1 which is supposed to disable it
> according to the docs but I got the following exception:
> java.lang.IllegalArgumentException: Illegal value of maximumCapacity -0.01
> used in call to setMaxCapacity for queue foo
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CSQueueUtils.checkMaxCapacity(CSQueueUtils.java:31)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.setupQueueConfigs(LeafQueue.java:220)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.(LeafQueue.java:191)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:310)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:325)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initializeQueues(CapacityScheduler.java:232)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.reinitialize(CapacityScheduler.java:202)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-343) Capacity Scheduler maximum-capacity value -1 is invalid
[
https://issues.apache.org/jira/browse/YARN-343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13562996#comment-13562996
]
Hadoop QA commented on YARN-343:
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12565659/YARN-343.1.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:red}-1 findbugs{color}. The patch appears to introduce 1 new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:red}-1 core tests{color}. The patch failed these unit tests in
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager:
org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebServices
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-YARN-Build/368//testReport/
Findbugs warnings:
https://builds.apache.org/job/PreCommit-YARN-Build/368//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-resourcemanager.html
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/368//console
This message is automatically generated.
> Capacity Scheduler maximum-capacity value -1 is invalid
> ---
>
> Key: YARN-343
> URL: https://issues.apache.org/jira/browse/YARN-343
> Project: Hadoop YARN
> Issue Type: Bug
> Components: capacityscheduler
>Affects Versions: 0.23.6
>Reporter: Thomas Graves
>Assignee: Xuan Gong
> Attachments: YARN-343.1.patch
>
>
> I tried to start the resource manager using the capacity scheduler with a
> particular queues maximum-capacity set to -1 which is supposed to disable it
> according to the docs but I got the following exception:
> java.lang.IllegalArgumentException: Illegal value of maximumCapacity -0.01
> used in call to setMaxCapacity for queue foo
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CSQueueUtils.checkMaxCapacity(CSQueueUtils.java:31)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.setupQueueConfigs(LeafQueue.java:220)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.(LeafQueue.java:191)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:310)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:325)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initializeQueues(CapacityScheduler.java:232)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.reinitialize(CapacityScheduler.java:202)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-343) Capacity Scheduler maximum-capacity value -1 is invalid
[ https://issues.apache.org/jira/browse/YARN-343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13557718#comment-13557718 ] Arun C Murthy commented on YARN-343: Agreed, looks like a bug. > Capacity Scheduler maximum-capacity value -1 is invalid > --- > > Key: YARN-343 > URL: https://issues.apache.org/jira/browse/YARN-343 > Project: Hadoop YARN > Issue Type: Bug > Components: capacityscheduler >Affects Versions: 0.23.6 >Reporter: Thomas Graves > > I tried to start the resource manager using the capacity scheduler with a > particular queues maximum-capacity set to -1 which is supposed to disable it > according to the docs but I got the following exception: > java.lang.IllegalArgumentException: Illegal value of maximumCapacity -0.01 > used in call to setMaxCapacity for queue foo > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CSQueueUtils.checkMaxCapacity(CSQueueUtils.java:31) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.setupQueueConfigs(LeafQueue.java:220) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.(LeafQueue.java:191) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:310) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:325) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initializeQueues(CapacityScheduler.java:232) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.reinitialize(CapacityScheduler.java:202) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-343) Capacity Scheduler maximum-capacity value -1 is invalid
[ https://issues.apache.org/jira/browse/YARN-343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13556957#comment-13556957 ] Thomas Graves commented on YARN-343: -1 was the value used in 1.X to also mean its disabled so we should support for backwards compatibility. Its also documented in the 0.23/2.0 capacity scheduler doc: http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html > Capacity Scheduler maximum-capacity value -1 is invalid > --- > > Key: YARN-343 > URL: https://issues.apache.org/jira/browse/YARN-343 > Project: Hadoop YARN > Issue Type: Bug > Components: capacityscheduler >Affects Versions: 0.23.6 >Reporter: Thomas Graves > > I tried to start the resource manager using the capacity scheduler with a > particular queues maximum-capacity set to -1 which is supposed to disable it > according to the docs but I got the following exception: > java.lang.IllegalArgumentException: Illegal value of maximumCapacity -0.01 > used in call to setMaxCapacity for queue foo > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CSQueueUtils.checkMaxCapacity(CSQueueUtils.java:31) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.setupQueueConfigs(LeafQueue.java:220) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.(LeafQueue.java:191) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:310) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:325) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initializeQueues(CapacityScheduler.java:232) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.reinitialize(CapacityScheduler.java:202) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-343) Capacity Scheduler maximum-capacity value -1 is invalid
[ https://issues.apache.org/jira/browse/YARN-343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13556681#comment-13556681 ] Xuan Gong commented on YARN-343: The number we set up for the queue at CapacityScheduler.xml is configured as %. So here, you set -1, after read to the code, it will become -0.01. If you do not set any value at this property, it will use 100 as default, that means this queue will be fully used. And I do not think we can use negative number, it will check the value, and will pop up the exception if we set any negative number. > Capacity Scheduler maximum-capacity value -1 is invalid > --- > > Key: YARN-343 > URL: https://issues.apache.org/jira/browse/YARN-343 > Project: Hadoop YARN > Issue Type: Bug > Components: capacityscheduler >Affects Versions: 0.23.6 >Reporter: Thomas Graves > > I tried to start the resource manager using the capacity scheduler with a > particular queues maximum-capacity set to -1 which is supposed to disable it > according to the docs but I got the following exception: > java.lang.IllegalArgumentException: Illegal value of maximumCapacity -0.01 > used in call to setMaxCapacity for queue foo > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CSQueueUtils.checkMaxCapacity(CSQueueUtils.java:31) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.setupQueueConfigs(LeafQueue.java:220) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.(LeafQueue.java:191) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:310) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:325) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initializeQueues(CapacityScheduler.java:232) > at > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.reinitialize(CapacityScheduler.java:202) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
