[jira] [Commented] (YARN-3633) With Fair Scheduler, cluster can logjam when there are too many queues

2015-06-30 Thread Rohit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14609248#comment-14609248 ] Rohit Agarwal commented on YARN-3633: - Yes, the {{clusterMaxAMShare}} is acting as an u

[jira] [Commented] (YARN-3633) With Fair Scheduler, cluster can logjam when there are too many queues

2015-06-30 Thread Rohit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14609163#comment-14609163 ] Rohit Agarwal commented on YARN-3633: - Yes, that is very much possible. But without thi

[jira] [Commented] (YARN-3633) With Fair Scheduler, cluster can logjam when there are too many queues

2015-05-19 Thread Rohit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14551213#comment-14551213 ] Rohit Agarwal commented on YARN-3633: - The remaining checkstyle and findbugs issues see

[jira] [Updated] (YARN-3633) With Fair Scheduler, cluster can logjam when there are too many queues

2015-05-19 Thread Rohit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohit Agarwal updated YARN-3633: Attachment: YARN-3633-1.patch > With Fair Scheduler, cluster can logjam when there are too many queue

[jira] [Commented] (YARN-3633) With Fair Scheduler, cluster can logjam when there are too many queues

2015-05-19 Thread Rohit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14550008#comment-14550008 ] Rohit Agarwal commented on YARN-3633: - Other non-AM containers can be scheduled in the

[jira] [Updated] (YARN-3633) With Fair Scheduler, cluster can logjam when there are too many queues

2015-05-18 Thread Rohit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohit Agarwal updated YARN-3633: Attachment: YARN-3633.patch > With Fair Scheduler, cluster can logjam when there are too many queues

[jira] [Commented] (YARN-3633) With Fair Scheduler, cluster can logjam when there are too many queues

2015-05-13 Thread Rohit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14542929#comment-14542929 ] Rohit Agarwal commented on YARN-3633: - Actually, I like the idea of not enforcing the q

[jira] [Commented] (YARN-3633) With Fair Scheduler, cluster can logjam when there are too many queues

2015-05-13 Thread Rohit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14542902#comment-14542902 ] Rohit Agarwal commented on YARN-3633: - [~sandyr] If we do that and have no cluster-wide

[jira] [Commented] (YARN-3633) With Fair Scheduler, cluster can logjam when there are too many queues

2015-05-13 Thread Rohit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14542895#comment-14542895 ] Rohit Agarwal commented on YARN-3633: - Can you elaborate the scenario where the AMs wou

[jira] [Commented] (YARN-3633) With Fair Scheduler, cluster can logjam when there are too many queues

2015-05-12 Thread Rohit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14540491#comment-14540491 ] Rohit Agarwal commented on YARN-3633: - So, in essence the problem is that when there ar

[jira] [Created] (YARN-3633) With Fair Scheduler, cluster can logjam when there are too many queues

2015-05-12 Thread Rohit Agarwal (JIRA)
Rohit Agarwal created YARN-3633: --- Summary: With Fair Scheduler, cluster can logjam when there are too many queues Key: YARN-3633 URL: https://issues.apache.org/jira/browse/YARN-3633 Project: Hadoop YARN

[jira] [Updated] (YARN-3382) Some of UserMetricsInfo metrics are incorrectly set to root queue metrics

2015-04-01 Thread Rohit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohit Agarwal updated YARN-3382: Target Version/s: 2.7.0 Affects Version/s: 2.2.0 2.3.0

[jira] [Commented] (YARN-3415) Non-AM containers can be counted towards amResourceUsage of a fairscheduler queue

2015-04-01 Thread Rohit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391738#comment-14391738 ] Rohit Agarwal commented on YARN-3415: - +1 > Non-AM containers can be counted towards a

[jira] [Commented] (YARN-3415) Non-AM containers can be counted towards amResourceUsage of a fairscheduler queue

2015-04-01 Thread Rohit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391674#comment-14391674 ] Rohit Agarwal commented on YARN-3415: - It looks good. I have one minor comment: {code}

[jira] [Commented] (YARN-3415) Non-AM containers can be counted towards amResourceUsage of a fairscheduler queue

2015-03-30 Thread Rohit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387763#comment-14387763 ] Rohit Agarwal commented on YARN-3415: - I don't understand the newly added tests: {code}

[jira] [Commented] (YARN-3382) Some of UserMetricsInfo metrics are incorrectly set to root queue metrics

2015-03-28 Thread Rohit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14385495#comment-14385495 ] Rohit Agarwal commented on YARN-3382: - Can someone review/merge this? > Some of UserMe

[jira] [Commented] (YARN-3415) Non-AM containers can be counted towards amResourceUsage of a fairscheduler queue

2015-03-28 Thread Rohit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14385202#comment-14385202 ] Rohit Agarwal commented on YARN-3415: - > if (!isAmRunning() && getLiveContainers().size

[jira] [Created] (YARN-3415) Non-AM containers can be counted towards amResourceUsage of a fairscheduler queue

2015-03-28 Thread Rohit Agarwal (JIRA)
Rohit Agarwal created YARN-3415: --- Summary: Non-AM containers can be counted towards amResourceUsage of a fairscheduler queue Key: YARN-3415 URL: https://issues.apache.org/jira/browse/YARN-3415 Project:

[jira] [Updated] (YARN-3382) Some of UserMetricsInfo metrics are incorrectly set to root queue metrics

2015-03-19 Thread Rohit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohit Agarwal updated YARN-3382: Attachment: YARN-3382.patch Patch attached. > Some of UserMetricsInfo metrics are incorrectly set to

[jira] [Created] (YARN-3382) Some of UserMetricsInfo metrics are incorrectly set to root queue metrics

2015-03-19 Thread Rohit Agarwal (JIRA)
Rohit Agarwal created YARN-3382: --- Summary: Some of UserMetricsInfo metrics are incorrectly set to root queue metrics Key: YARN-3382 URL: https://issues.apache.org/jira/browse/YARN-3382 Project: Hadoop Y

[jira] [Updated] (YARN-3199) Fair Scheduler documentation improvements

2015-02-27 Thread Rohit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohit Agarwal updated YARN-3199: Attachment: YARN-3199-1.patch [~aw] Updated the patch to markdown. > Fair Scheduler documentation im

[jira] [Commented] (YARN-3168) Convert site documentation from apt to markdown

2015-02-27 Thread Rohit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14341289#comment-14341289 ] Rohit Agarwal commented on YARN-3168: - Sure. I can update the patch on YARN-3199 to be

[jira] [Commented] (YARN-3168) Convert site documentation from apt to markdown

2015-02-27 Thread Rohit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340625#comment-14340625 ] Rohit Agarwal commented on YARN-3168: - [~gururaj] Please also incorporate YARN-3199. >

[jira] [Created] (YARN-3270) node label expression not getting set in ApplicationSubmissionContext

2015-02-26 Thread Rohit Agarwal (JIRA)
Rohit Agarwal created YARN-3270: --- Summary: node label expression not getting set in ApplicationSubmissionContext Key: YARN-3270 URL: https://issues.apache.org/jira/browse/YARN-3270 Project: Hadoop YARN

[jira] [Updated] (YARN-3270) node label expression not getting set in ApplicationSubmissionContext

2015-02-26 Thread Rohit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohit Agarwal updated YARN-3270: Attachment: YARN-3270.patch Attached the patch. > node label expression not getting set in Applicati

[jira] [Updated] (YARN-3199) Fair Scheduler documentation improvements

2015-02-15 Thread Rohit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohit Agarwal updated YARN-3199: Attachment: YARN-3199.patch > Fair Scheduler documentation improvements > ---

[jira] [Created] (YARN-3199) Fair Scheduler documentation improvements

2015-02-15 Thread Rohit Agarwal (JIRA)
Rohit Agarwal created YARN-3199: --- Summary: Fair Scheduler documentation improvements Key: YARN-3199 URL: https://issues.apache.org/jira/browse/YARN-3199 Project: Hadoop YARN Issue Type: Improve

[jira] [Commented] (YARN-3199) Fair Scheduler documentation improvements

2015-02-15 Thread Rohit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14321798#comment-14321798 ] Rohit Agarwal commented on YARN-3199: - [~aw], [~gururaj] Please also pick this up when