[jira] [Updated] (YARN-276) Capacity Scheduler can hang when submit many jobs concurrently

2012-12-19 Thread nemon lou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nemon lou updated YARN-276: --- Attachment: YARN-276.patch > Capacity Scheduler can hang when submit many jobs concurrently > -

[jira] [Commented] (YARN-276) Capacity Scheduler can hang when submit many jobs concurrently

2012-12-19 Thread nemon lou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13535809#comment-13535809 ] nemon lou commented on YARN-276: All YARN and MR 's tests passed on my own cluster.So Submit

[jira] [Commented] (YARN-276) Capacity Scheduler can hang when submit many jobs concurrently

2012-12-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13535813#comment-13535813 ] Hadoop QA commented on YARN-276: {color:red}-1 overall{color}. Here are the results of test

[jira] [Commented] (YARN-230) Make changes for RM restart phase 1

2012-12-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13535863#comment-13535863 ] Hudson commented on YARN-230: - Integrated in Hadoop-Yarn-trunk #70 (See [https://builds.apache.

[jira] [Commented] (YARN-3) Add support for CPU isolation/monitoring of containers

2012-12-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13535866#comment-13535866 ] Hudson commented on YARN-3: --- Integrated in Hadoop-Yarn-trunk #70 (See [https://builds.apache.org/jo

[jira] [Commented] (YARN-254) Update fair scheduler web UI for hierarchical queues

2012-12-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13535868#comment-13535868 ] Hudson commented on YARN-254: - Integrated in Hadoop-Yarn-trunk #70 (See [https://builds.apache.

[jira] [Commented] (YARN-230) Make changes for RM restart phase 1

2012-12-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13535937#comment-13535937 ] Hudson commented on YARN-230: - Integrated in Hadoop-Hdfs-trunk #1259 (See [https://builds.apach

[jira] [Commented] (YARN-3) Add support for CPU isolation/monitoring of containers

2012-12-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13535941#comment-13535941 ] Hudson commented on YARN-3: --- Integrated in Hadoop-Hdfs-trunk #1259 (See [https://builds.apache.org/

[jira] [Commented] (YARN-254) Update fair scheduler web UI for hierarchical queues

2012-12-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13535943#comment-13535943 ] Hudson commented on YARN-254: - Integrated in Hadoop-Hdfs-trunk #1259 (See [https://builds.apach

[jira] [Commented] (YARN-230) Make changes for RM restart phase 1

2012-12-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13535979#comment-13535979 ] Hudson commented on YARN-230: - Integrated in Hadoop-Mapreduce-trunk #1290 (See [https://builds.

[jira] [Commented] (YARN-3) Add support for CPU isolation/monitoring of containers

2012-12-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13535983#comment-13535983 ] Hudson commented on YARN-3: --- Integrated in Hadoop-Mapreduce-trunk #1290 (See [https://builds.apache

[jira] [Commented] (YARN-254) Update fair scheduler web UI for hierarchical queues

2012-12-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13535985#comment-13535985 ] Hudson commented on YARN-254: - Integrated in Hadoop-Mapreduce-trunk #1290 (See [https://builds.

[jira] [Commented] (YARN-103) Add a yarn AM - RM client module

2012-12-19 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13536147#comment-13536147 ] Bikas Saha commented on YARN-103: - I think the patch follows the example you mention about i

[jira] [Commented] (YARN-103) Add a yarn AM - RM client module

2012-12-19 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13536184#comment-13536184 ] Alejandro Abdelnur commented on YARN-103: - you would extend it to implement a concre

[jira] [Commented] (YARN-103) Add a yarn AM - RM client module

2012-12-19 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13536193#comment-13536193 ] Bikas Saha commented on YARN-103: - That would mean creating an empty concrete client that ex

[jira] [Created] (YARN-277) Use AMRMClient in DistributedShell to exemplify the approach

2012-12-19 Thread Bikas Saha (JIRA)
Bikas Saha created YARN-277: --- Summary: Use AMRMClient in DistributedShell to exemplify the approach Key: YARN-277 URL: https://issues.apache.org/jira/browse/YARN-277 Project: Hadoop YARN Issue Typ

[jira] [Commented] (YARN-103) Add a yarn AM - RM client module

2012-12-19 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13536217#comment-13536217 ] Alejandro Abdelnur commented on YARN-103: - My mistaken then, I've misunderstood how

[jira] [Commented] (YARN-223) Change processTree interface to work better with native code

2012-12-19 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13536228#comment-13536228 ] Luke Lu commented on YARN-223: -- # The changes to eliminate usage of ResourceCalculatorPlugin is

[jira] [Comment Edited] (YARN-103) Add a yarn AM - RM client module

2012-12-19 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13536217#comment-13536217 ] Alejandro Abdelnur edited comment on YARN-103 at 12/19/12 6:18 PM: ---

[jira] [Commented] (YARN-142) Change YARN APIs to throw IOException

2012-12-19 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13536231#comment-13536231 ] Xuan Gong commented on YARN-142: sudo find . -name '*.java' -print0 | xargs -0 grep -l 'Yarn

[jira] [Commented] (YARN-223) Change processTree interface to work better with native code

2012-12-19 Thread Radim Kolar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13536246#comment-13536246 ] Radim Kolar commented on YARN-223: -- process tree is standalone component for some time.

[jira] [Commented] (YARN-223) Change processTree interface to work better with native code

2012-12-19 Thread Radim Kolar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13536273#comment-13536273 ] Radim Kolar commented on YARN-223: -- currently every system (windows and linux) which have r

[jira] [Commented] (YARN-223) Change processTree interface to work better with native code

2012-12-19 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13536392#comment-13536392 ] Luke Lu commented on YARN-223: -- Upon second look, though the current ResourceCalculatorProcessT

[jira] [Commented] (YARN-103) Add a yarn AM - RM client module

2012-12-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13536432#comment-13536432 ] Siddharth Seth commented on YARN-103: - After discussing this offline with Vinod - couple

[jira] [Created] (YARN-278) Fair scheduler maxRunningApps config causes no apps to make progress

2012-12-19 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-278: --- Summary: Fair scheduler maxRunningApps config causes no apps to make progress Key: YARN-278 URL: https://issues.apache.org/jira/browse/YARN-278 Project: Hadoop YARN I

[jira] [Commented] (YARN-170) NodeManager stop() gets called twice on shutdown

2012-12-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13536616#comment-13536616 ] Hadoop QA commented on YARN-170: {color:green}+1 overall{color}. Here are the results of te

[jira] [Updated] (YARN-278) Fair scheduler maxRunningApps config causes no apps to make progress

2012-12-19 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-278: Description: This occurs because the scheduler erroneously chooses apps to offer resources to that are not ru

[jira] [Updated] (YARN-278) Fair scheduler maxRunningApps config causes no apps to make progress

2012-12-19 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-278: Attachment: YARN-278.patch > Fair scheduler maxRunningApps config causes no apps to make progress > -

[jira] [Commented] (YARN-278) Fair scheduler maxRunningApps config causes no apps to make progress

2012-12-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13536635#comment-13536635 ] Hadoop QA commented on YARN-278: {color:red}-1 overall{color}. Here are the results of test

[jira] [Commented] (YARN-223) Change processTree interface to work better with native code

2012-12-19 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13536636#comment-13536636 ] Luke Lu commented on YARN-223: -- Committed to trunk and branch-2. Thanks Radim for the patch and

[jira] [Commented] (YARN-223) Change processTree interface to work better with native code

2012-12-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13536638#comment-13536638 ] Hudson commented on YARN-223: - Integrated in Hadoop-trunk-Commit #3144 (See [https://builds.apa

[jira] [Updated] (YARN-276) Capacity Scheduler can hang when submit many jobs concurrently

2012-12-19 Thread nemon lou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nemon lou updated YARN-276: --- Attachment: YARN-276.patch > Capacity Scheduler can hang when submit many jobs concurrently > -

[jira] [Commented] (YARN-276) Capacity Scheduler can hang when submit many jobs concurrently

2012-12-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13536781#comment-13536781 ] Hadoop QA commented on YARN-276: {color:green}+1 overall{color}. Here are the results of te

[jira] [Updated] (YARN-275) Make NodeManagers to NOT blindly heartbeat irrespective of whether previous heartbeat is processed or not.

2012-12-19 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-275: --- Attachment: YARN-270.1.patch 1.In RMNode,store the NodeUpdatedDone in a field and make the scheduler set the s

[jira] [Commented] (YARN-276) Capacity Scheduler can hang when submit many jobs concurrently

2012-12-19 Thread nemon lou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13536818#comment-13536818 ] nemon lou commented on YARN-276: This patch is ready for review now.Thank you.