[jira] [Commented] (YARN-2913) Fair scheduler should have ability to set MaxResourceDefault for each queue
[ https://issues.apache.org/jira/browse/YARN-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971492#comment-14971492 ] Hudson commented on YARN-2913: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1310 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/1310/]) YARN-2913. Fair scheduler should have ability to set MaxResourceDefault (mingma: rev 934d96a334598fcf0e5aba2043ff539469025f69) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/FairScheduler.md * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/AllocationConfiguration.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestAllocationFileLoaderService.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/AllocationFileLoaderService.java * hadoop-yarn-project/CHANGES.txt > Fair scheduler should have ability to set MaxResourceDefault for each queue > --- > > Key: YARN-2913 > URL: https://issues.apache.org/jira/browse/YARN-2913 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: Siqi Li >Assignee: Siqi Li > Fix For: 2.8.0 > > Attachments: YARN-2913.v1.patch, YARN-2913.v2.patch, > YARN-2913.v3.patch, YARN-2913.v4.patch, YARN-2913.v5.patch > > > Queues that are created on the fly have the max resource of the entire > cluster. Fair Scheduler should have a default maxResource to control the > maxResource of those queues -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2913) Fair scheduler should have ability to set MaxResourceDefault for each queue
[ https://issues.apache.org/jira/browse/YARN-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971202#comment-14971202 ] Hudson commented on YARN-2913: -- FAILURE: Integrated in Hadoop-trunk-Commit #8695 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/8695/]) YARN-2913. Fair scheduler should have ability to set MaxResourceDefault (mingma: rev 934d96a334598fcf0e5aba2043ff539469025f69) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/AllocationFileLoaderService.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/AllocationConfiguration.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/FairScheduler.md * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestAllocationFileLoaderService.java * hadoop-yarn-project/CHANGES.txt > Fair scheduler should have ability to set MaxResourceDefault for each queue > --- > > Key: YARN-2913 > URL: https://issues.apache.org/jira/browse/YARN-2913 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: Siqi Li >Assignee: Siqi Li > Fix For: 2.8.0 > > Attachments: YARN-2913.v1.patch, YARN-2913.v2.patch, > YARN-2913.v3.patch, YARN-2913.v4.patch, YARN-2913.v5.patch > > > Queues that are created on the fly have the max resource of the entire > cluster. Fair Scheduler should have a default maxResource to control the > maxResource of those queues -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2913) Fair scheduler should have ability to set MaxResourceDefault for each queue
[ https://issues.apache.org/jira/browse/YARN-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971335#comment-14971335 ] Hudson commented on YARN-2913: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #574 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/574/]) YARN-2913. Fair scheduler should have ability to set MaxResourceDefault (mingma: rev 934d96a334598fcf0e5aba2043ff539469025f69) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestAllocationFileLoaderService.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/FairScheduler.md * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/AllocationConfiguration.java * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/AllocationFileLoaderService.java > Fair scheduler should have ability to set MaxResourceDefault for each queue > --- > > Key: YARN-2913 > URL: https://issues.apache.org/jira/browse/YARN-2913 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: Siqi Li >Assignee: Siqi Li > Fix For: 2.8.0 > > Attachments: YARN-2913.v1.patch, YARN-2913.v2.patch, > YARN-2913.v3.patch, YARN-2913.v4.patch, YARN-2913.v5.patch > > > Queues that are created on the fly have the max resource of the entire > cluster. Fair Scheduler should have a default maxResource to control the > maxResource of those queues -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2913) Fair scheduler should have ability to set MaxResourceDefault for each queue
[ https://issues.apache.org/jira/browse/YARN-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971666#comment-14971666 ] Hudson commented on YARN-2913: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2520 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2520/]) YARN-2913. Fair scheduler should have ability to set MaxResourceDefault (mingma: rev 934d96a334598fcf0e5aba2043ff539469025f69) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/FairScheduler.md * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/AllocationConfiguration.java * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestAllocationFileLoaderService.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/AllocationFileLoaderService.java > Fair scheduler should have ability to set MaxResourceDefault for each queue > --- > > Key: YARN-2913 > URL: https://issues.apache.org/jira/browse/YARN-2913 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: Siqi Li >Assignee: Siqi Li > Fix For: 2.8.0 > > Attachments: YARN-2913.v1.patch, YARN-2913.v2.patch, > YARN-2913.v3.patch, YARN-2913.v4.patch, YARN-2913.v5.patch > > > Queues that are created on the fly have the max resource of the entire > cluster. Fair Scheduler should have a default maxResource to control the > maxResource of those queues -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2913) Fair scheduler should have ability to set MaxResourceDefault for each queue
[ https://issues.apache.org/jira/browse/YARN-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971701#comment-14971701 ] Hudson commented on YARN-2913: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #530 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/530/]) YARN-2913. Fair scheduler should have ability to set MaxResourceDefault (mingma: rev 934d96a334598fcf0e5aba2043ff539469025f69) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/FairScheduler.md * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/AllocationConfiguration.java * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/AllocationFileLoaderService.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestAllocationFileLoaderService.java > Fair scheduler should have ability to set MaxResourceDefault for each queue > --- > > Key: YARN-2913 > URL: https://issues.apache.org/jira/browse/YARN-2913 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: Siqi Li >Assignee: Siqi Li > Fix For: 2.8.0 > > Attachments: YARN-2913.v1.patch, YARN-2913.v2.patch, > YARN-2913.v3.patch, YARN-2913.v4.patch, YARN-2913.v5.patch > > > Queues that are created on the fly have the max resource of the entire > cluster. Fair Scheduler should have a default maxResource to control the > maxResource of those queues -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2913) Fair scheduler should have ability to set MaxResourceDefault for each queue
[ https://issues.apache.org/jira/browse/YARN-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971715#comment-14971715 ] Hudson commented on YARN-2913: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2466 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/2466/]) YARN-2913. Fair scheduler should have ability to set MaxResourceDefault (mingma: rev 934d96a334598fcf0e5aba2043ff539469025f69) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/FairScheduler.md * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/AllocationFileLoaderService.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/AllocationConfiguration.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestAllocationFileLoaderService.java > Fair scheduler should have ability to set MaxResourceDefault for each queue > --- > > Key: YARN-2913 > URL: https://issues.apache.org/jira/browse/YARN-2913 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: Siqi Li >Assignee: Siqi Li > Fix For: 2.8.0 > > Attachments: YARN-2913.v1.patch, YARN-2913.v2.patch, > YARN-2913.v3.patch, YARN-2913.v4.patch, YARN-2913.v5.patch > > > Queues that are created on the fly have the max resource of the entire > cluster. Fair Scheduler should have a default maxResource to control the > maxResource of those queues -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2913) Fair scheduler should have ability to set MaxResourceDefault for each queue
[ https://issues.apache.org/jira/browse/YARN-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971576#comment-14971576 ] Hudson commented on YARN-2913: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #588 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/588/]) YARN-2913. Fair scheduler should have ability to set MaxResourceDefault (mingma: rev 934d96a334598fcf0e5aba2043ff539469025f69) * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestAllocationFileLoaderService.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/AllocationFileLoaderService.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/AllocationConfiguration.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/FairScheduler.md > Fair scheduler should have ability to set MaxResourceDefault for each queue > --- > > Key: YARN-2913 > URL: https://issues.apache.org/jira/browse/YARN-2913 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: Siqi Li >Assignee: Siqi Li > Fix For: 2.8.0 > > Attachments: YARN-2913.v1.patch, YARN-2913.v2.patch, > YARN-2913.v3.patch, YARN-2913.v4.patch, YARN-2913.v5.patch > > > Queues that are created on the fly have the max resource of the entire > cluster. Fair Scheduler should have a default maxResource to control the > maxResource of those queues -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2913) Fair scheduler should have ability to set MaxResourceDefault for each queue
[
https://issues.apache.org/jira/browse/YARN-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14969950#comment-14969950
]
Hadoop QA commented on YARN-2913:
-
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch | 17m 29s | Pre-patch trunk compilation is
healthy. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:green}+1{color} | tests included | 0m 0s | The patch appears to
include 1 new or modified test files. |
| {color:green}+1{color} | javac | 8m 9s | There were no new javac warning
messages. |
| {color:green}+1{color} | javadoc | 10m 36s | There were no new javadoc
warning messages. |
| {color:green}+1{color} | release audit | 0m 26s | The applied patch does
not increase the total number of release audit warnings. |
| {color:red}-1{color} | checkstyle | 0m 50s | The applied patch generated 2
new checkstyle issues (total was 37, now 35). |
| {color:green}+1{color} | whitespace | 0m 0s | The patch has no lines that
end in whitespace. |
| {color:green}+1{color} | install | 1m 32s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse | 0m 34s | The patch built with
eclipse:eclipse. |
| {color:green}+1{color} | findbugs | 1m 31s | The patch does not introduce
any new Findbugs (version 3.0.0) warnings. |
| {color:red}-1{color} | yarn tests | 56m 4s | Tests failed in
hadoop-yarn-server-resourcemanager. |
| | | 97m 16s | |
\\
\\
|| Reason || Tests ||
| Failed unit tests |
hadoop.yarn.server.resourcemanager.scheduler.fifo.TestFifoScheduler |
| | hadoop.yarn.server.resourcemanager.applicationsmanager.TestAMRestart |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12768102/YARN-2913.v4.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / 960201b |
| checkstyle |
https://builds.apache.org/job/PreCommit-YARN-Build/9530/artifact/patchprocess/diffcheckstylehadoop-yarn-server-resourcemanager.txt
|
| hadoop-yarn-server-resourcemanager test log |
https://builds.apache.org/job/PreCommit-YARN-Build/9530/artifact/patchprocess/testrun_hadoop-yarn-server-resourcemanager.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-YARN-Build/9530/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf903.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output |
https://builds.apache.org/job/PreCommit-YARN-Build/9530/console |
This message was automatically generated.
> Fair scheduler should have ability to set MaxResourceDefault for each queue
> ---
>
> Key: YARN-2913
> URL: https://issues.apache.org/jira/browse/YARN-2913
> Project: Hadoop YARN
> Issue Type: Bug
>Reporter: Siqi Li
>Assignee: Siqi Li
> Attachments: YARN-2913.v1.patch, YARN-2913.v2.patch,
> YARN-2913.v3.patch, YARN-2913.v4.patch
>
>
> Queues that are created on the fly have the max resource of the entire
> cluster. Fair Scheduler should have a default maxResource to control the
> maxResource of those queues
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-2913) Fair scheduler should have ability to set MaxResourceDefault for each queue
[ https://issues.apache.org/jira/browse/YARN-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14970092#comment-14970092 ] Ming Ma commented on YARN-2913: --- Thanks [~l201514]. Can you please update FairScheduler.md? > Fair scheduler should have ability to set MaxResourceDefault for each queue > --- > > Key: YARN-2913 > URL: https://issues.apache.org/jira/browse/YARN-2913 > Project: Hadoop YARN > Issue Type: Bug >Reporter: Siqi Li >Assignee: Siqi Li > Attachments: YARN-2913.v1.patch, YARN-2913.v2.patch, > YARN-2913.v3.patch, YARN-2913.v4.patch > > > Queues that are created on the fly have the max resource of the entire > cluster. Fair Scheduler should have a default maxResource to control the > maxResource of those queues -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2913) Fair scheduler should have ability to set MaxResourceDefault for each queue
[
https://issues.apache.org/jira/browse/YARN-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14970359#comment-14970359
]
Hadoop QA commented on YARN-2913:
-
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch | 23m 43s | Pre-patch trunk compilation is
healthy. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:green}+1{color} | tests included | 0m 0s | The patch appears to
include 1 new or modified test files. |
| {color:green}+1{color} | javac | 9m 5s | There were no new javac warning
messages. |
| {color:green}+1{color} | javadoc | 11m 49s | There were no new javadoc
warning messages. |
| {color:green}+1{color} | release audit | 0m 25s | The applied patch does
not increase the total number of release audit warnings. |
| {color:green}+1{color} | site | 3m 44s | Site still builds. |
| {color:red}-1{color} | checkstyle | 0m 54s | The applied patch generated 2
new checkstyle issues (total was 37, now 35). |
| {color:green}+1{color} | whitespace | 0m 0s | The patch has no lines that
end in whitespace. |
| {color:green}+1{color} | install | 1m 37s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse | 0m 36s | The patch built with
eclipse:eclipse. |
| {color:green}+1{color} | findbugs | 1m 38s | The patch does not introduce
any new Findbugs (version 3.0.0) warnings. |
| {color:red}-1{color} | yarn tests | 60m 17s | Tests failed in
hadoop-yarn-server-resourcemanager. |
| | | 113m 52s | |
\\
\\
|| Reason || Tests ||
| Failed unit tests |
hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesNodeLabels |
| | hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesApps |
| | hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesCapacitySched |
| |
hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesDelegationTokens |
| | hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesNodes |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12768181/YARN-2913.v5.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle site |
| git revision | trunk / 124a412 |
| checkstyle |
https://builds.apache.org/job/PreCommit-YARN-Build/9535/artifact/patchprocess/diffcheckstylehadoop-yarn-server-resourcemanager.txt
|
| hadoop-yarn-server-resourcemanager test log |
https://builds.apache.org/job/PreCommit-YARN-Build/9535/artifact/patchprocess/testrun_hadoop-yarn-server-resourcemanager.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-YARN-Build/9535/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output |
https://builds.apache.org/job/PreCommit-YARN-Build/9535/console |
This message was automatically generated.
> Fair scheduler should have ability to set MaxResourceDefault for each queue
> ---
>
> Key: YARN-2913
> URL: https://issues.apache.org/jira/browse/YARN-2913
> Project: Hadoop YARN
> Issue Type: Bug
>Reporter: Siqi Li
>Assignee: Siqi Li
> Attachments: YARN-2913.v1.patch, YARN-2913.v2.patch,
> YARN-2913.v3.patch, YARN-2913.v4.patch, YARN-2913.v5.patch
>
>
> Queues that are created on the fly have the max resource of the entire
> cluster. Fair Scheduler should have a default maxResource to control the
> maxResource of those queues
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-2913) Fair scheduler should have ability to set MaxResourceDefault for each queue
[
https://issues.apache.org/jira/browse/YARN-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14967901#comment-14967901
]
Ming Ma commented on YARN-2913:
---
The patch looks good. Nit: maybe you want to rename {{queueMaxResourceDefault}}
to {{queueMaxResourcesDefault}}. [~sandyr] or others, any additional comments?
> Fair scheduler should have ability to set MaxResourceDefault for each queue
> ---
>
> Key: YARN-2913
> URL: https://issues.apache.org/jira/browse/YARN-2913
> Project: Hadoop YARN
> Issue Type: Bug
>Reporter: Siqi Li
>Assignee: Siqi Li
> Attachments: YARN-2913.v1.patch, YARN-2913.v2.patch
>
>
> Queues that are created on the fly have the max resource of the entire
> cluster. Fair Scheduler should have a default maxResource to control the
> maxResource of those queues
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-2913) Fair scheduler should have ability to set MaxResourceDefault for each queue
[
https://issues.apache.org/jira/browse/YARN-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14968295#comment-14968295
]
Hadoop QA commented on YARN-2913:
-
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch | 22m 24s | Pre-patch trunk compilation is
healthy. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:green}+1{color} | tests included | 0m 0s | The patch appears to
include 1 new or modified test files. |
| {color:green}+1{color} | javac | 10m 30s | There were no new javac warning
messages. |
| {color:green}+1{color} | javadoc | 13m 29s | There were no new javadoc
warning messages. |
| {color:green}+1{color} | release audit | 0m 29s | The applied patch does
not increase the total number of release audit warnings. |
| {color:red}-1{color} | checkstyle | 1m 4s | The applied patch generated 8
new checkstyle issues (total was 37, now 42). |
| {color:red}-1{color} | whitespace | 0m 0s | The patch has 1 line(s) that
end in whitespace. Use git apply --whitespace=fix. |
| {color:green}+1{color} | install | 1m 53s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse | 0m 42s | The patch built with
eclipse:eclipse. |
| {color:green}+1{color} | findbugs | 1m 56s | The patch does not introduce
any new Findbugs (version 3.0.0) warnings. |
| {color:red}-1{color} | yarn tests | 73m 5s | Tests failed in
hadoop-yarn-server-resourcemanager. |
| | | 125m 36s | |
\\
\\
|| Reason || Tests ||
| Failed unit tests |
hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerResizing |
| |
hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacityScheduler |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12767901/YARN-2913.v3.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / d1cdce7 |
| checkstyle |
https://builds.apache.org/job/PreCommit-YARN-Build/9515/artifact/patchprocess/diffcheckstylehadoop-yarn-server-resourcemanager.txt
|
| whitespace |
https://builds.apache.org/job/PreCommit-YARN-Build/9515/artifact/patchprocess/whitespace.txt
|
| hadoop-yarn-server-resourcemanager test log |
https://builds.apache.org/job/PreCommit-YARN-Build/9515/artifact/patchprocess/testrun_hadoop-yarn-server-resourcemanager.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-YARN-Build/9515/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output |
https://builds.apache.org/job/PreCommit-YARN-Build/9515/console |
This message was automatically generated.
> Fair scheduler should have ability to set MaxResourceDefault for each queue
> ---
>
> Key: YARN-2913
> URL: https://issues.apache.org/jira/browse/YARN-2913
> Project: Hadoop YARN
> Issue Type: Bug
>Reporter: Siqi Li
>Assignee: Siqi Li
> Attachments: YARN-2913.v1.patch, YARN-2913.v2.patch,
> YARN-2913.v3.patch
>
>
> Queues that are created on the fly have the max resource of the entire
> cluster. Fair Scheduler should have a default maxResource to control the
> maxResource of those queues
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-2913) Fair scheduler should have ability to set MaxResourceDefault for each queue
[ https://issues.apache.org/jira/browse/YARN-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965716#comment-14965716 ] Siqi Li commented on YARN-2913: --- Hi [~mingma], Can you take a look at this patch? > Fair scheduler should have ability to set MaxResourceDefault for each queue > --- > > Key: YARN-2913 > URL: https://issues.apache.org/jira/browse/YARN-2913 > Project: Hadoop YARN > Issue Type: Bug >Reporter: Siqi Li >Assignee: Siqi Li > Attachments: YARN-2913.v1.patch, YARN-2913.v2.patch > > > Queues that are created on the fly have the max resource of the entire > cluster. Fair Scheduler should have a default maxResource to control the > maxResource of those queues -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2913) Fair scheduler should have ability to set MaxResourceDefault for each queue
[
https://issues.apache.org/jira/browse/YARN-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965940#comment-14965940
]
Hadoop QA commented on YARN-2913:
-
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch | 17m 38s | Pre-patch trunk compilation is
healthy. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:green}+1{color} | tests included | 0m 0s | The patch appears to
include 1 new or modified test files. |
| {color:green}+1{color} | javac | 8m 9s | There were no new javac warning
messages. |
| {color:green}+1{color} | javadoc | 10m 33s | There were no new javadoc
warning messages. |
| {color:green}+1{color} | release audit | 0m 24s | The applied patch does
not increase the total number of release audit warnings. |
| {color:red}-1{color} | checkstyle | 0m 53s | The applied patch generated 8
new checkstyle issues (total was 37, now 42). |
| {color:red}-1{color} | whitespace | 0m 1s | The patch has 1 line(s) that
end in whitespace. Use git apply --whitespace=fix. |
| {color:green}+1{color} | install | 1m 34s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse | 0m 34s | The patch built with
eclipse:eclipse. |
| {color:green}+1{color} | findbugs | 1m 31s | The patch does not introduce
any new Findbugs (version 3.0.0) warnings. |
| {color:green}+1{color} | yarn tests | 57m 23s | Tests passed in
hadoop-yarn-server-resourcemanager. |
| | | 98m 44s | |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12767664/YARN-2913.v2.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / 6c8b6f3 |
| checkstyle |
https://builds.apache.org/job/PreCommit-YARN-Build/9496/artifact/patchprocess/diffcheckstylehadoop-yarn-server-resourcemanager.txt
|
| whitespace |
https://builds.apache.org/job/PreCommit-YARN-Build/9496/artifact/patchprocess/whitespace.txt
|
| hadoop-yarn-server-resourcemanager test log |
https://builds.apache.org/job/PreCommit-YARN-Build/9496/artifact/patchprocess/testrun_hadoop-yarn-server-resourcemanager.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-YARN-Build/9496/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf903.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output |
https://builds.apache.org/job/PreCommit-YARN-Build/9496/console |
This message was automatically generated.
> Fair scheduler should have ability to set MaxResourceDefault for each queue
> ---
>
> Key: YARN-2913
> URL: https://issues.apache.org/jira/browse/YARN-2913
> Project: Hadoop YARN
> Issue Type: Bug
>Reporter: Siqi Li
>Assignee: Siqi Li
> Attachments: YARN-2913.v1.patch, YARN-2913.v2.patch
>
>
> Queues that are created on the fly have the max resource of the entire
> cluster. Fair Scheduler should have a default maxResource to control the
> maxResource of those queues
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-2913) Fair scheduler should have ability to set MaxResourceDefault for each queue
[
https://issues.apache.org/jira/browse/YARN-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14524993#comment-14524993
]
Hadoop QA commented on YARN-2913:
-
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:red}-1{color} | patch | 0m 0s | The patch command could not apply
the patch during dryrun. |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12684708/YARN-2913.v1.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / f1a152c |
| Console output |
https://builds.apache.org/job/PreCommit-YARN-Build/7642/console |
This message was automatically generated.
Fair scheduler should have ability to set MaxResourceDefault for each queue
---
Key: YARN-2913
URL: https://issues.apache.org/jira/browse/YARN-2913
Project: Hadoop YARN
Issue Type: Bug
Reporter: Siqi Li
Assignee: Siqi Li
Attachments: YARN-2913.v1.patch
Queues that are created on the fly have the max resource of the entire
cluster. Fair Scheduler should have a default maxResource to control the
maxResource of those queues
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-2913) Fair scheduler should have ability to set MaxResourceDefault for each queue
[
https://issues.apache.org/jira/browse/YARN-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525037#comment-14525037
]
Hadoop QA commented on YARN-2913:
-
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:red}-1{color} | patch | 0m 0s | The patch command could not apply
the patch during dryrun. |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12684708/YARN-2913.v1.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / f1a152c |
| Console output |
https://builds.apache.org/job/PreCommit-YARN-Build/7652/console |
This message was automatically generated.
Fair scheduler should have ability to set MaxResourceDefault for each queue
---
Key: YARN-2913
URL: https://issues.apache.org/jira/browse/YARN-2913
Project: Hadoop YARN
Issue Type: Bug
Reporter: Siqi Li
Assignee: Siqi Li
Attachments: YARN-2913.v1.patch
Queues that are created on the fly have the max resource of the entire
cluster. Fair Scheduler should have a default maxResource to control the
maxResource of those queues
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-2913) Fair scheduler should have ability to set MaxResourceDefault for each queue
[ https://issues.apache.org/jira/browse/YARN-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14231972#comment-14231972 ] Siqi Li commented on YARN-2913: --- [~sandyr] can you take a look at this patch? The reason behind it is that for some clusters, we are allowing users to create their own queue on the fly. However, such queue doesn't have a maxResource limit, whenever those users submit a large job, the other users will be impacted. Fair scheduler should have ability to set MaxResourceDefault for each queue --- Key: YARN-2913 URL: https://issues.apache.org/jira/browse/YARN-2913 Project: Hadoop YARN Issue Type: Bug Reporter: Siqi Li Assignee: Siqi Li Attachments: YARN-2913.v1.patch Queues that are created on the fly have the max resource of the entire cluster. Fair Scheduler should have a default maxResource to control the maxResource of those queues -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2913) Fair scheduler should have ability to set MaxResourceDefault for each queue
[
https://issues.apache.org/jira/browse/YARN-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14232109#comment-14232109
]
Hadoop QA commented on YARN-2913:
-
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12684708/YARN-2913.v1.patch
against trunk revision 52bcefc.
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:red}-1 core tests{color}. The patch failed these unit tests in
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager:
org.apache.hadoop.yarn.server.resourcemanager.security.TestDelegationTokenRenewer
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-YARN-Build/5981//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/5981//console
This message is automatically generated.
Fair scheduler should have ability to set MaxResourceDefault for each queue
---
Key: YARN-2913
URL: https://issues.apache.org/jira/browse/YARN-2913
Project: Hadoop YARN
Issue Type: Bug
Reporter: Siqi Li
Assignee: Siqi Li
Attachments: YARN-2913.v1.patch
Queues that are created on the fly have the max resource of the entire
cluster. Fair Scheduler should have a default maxResource to control the
maxResource of those queues
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
