[jira] [Commented] (YARN-1315) TestQueueACLs should also test FairScheduler

2013-10-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801542#comment-13801542 ] Hudson commented on YARN-1315: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4642 (See [https:

[jira] [Commented] (YARN-1331) yarn.cmd exits with NoClassDefFoundError trying to run rmadmin or logs

2013-10-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801515#comment-13801515 ] Hudson commented on YARN-1331: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4641 (See [https:

[jira] [Commented] (YARN-1121) RMStateStore should flush all pending store events before closing

2013-10-21 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801504#comment-13801504 ] Bikas Saha commented on YARN-1121: -- The state store has its own dispatch queue. So basical

[jira] [Commented] (YARN-1315) TestQueueACLs should also test FairScheduler

2013-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801498#comment-13801498 ] Hadoop QA commented on YARN-1315: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1330) Fair Scheduler: defaultQueueSchedulingPolicy does not take effect

2013-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801492#comment-13801492 ] Hadoop QA commented on YARN-1330: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1315) TestQueueACLs should also test FairScheduler

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1315: - Attachment: YARN-1315.patch > TestQueueACLs should also test FairScheduler > -

[jira] [Commented] (YARN-1335) Move duplicate code from FSSchedulerApp and FiCaSchedulerApp into SchedulerApplication

2013-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801480#comment-13801480 ] Hadoop QA commented on YARN-1335: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-1330) Fair Scheduler: defaultQueueSchedulingPolicy does not take effect

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1330: - Attachment: YARN-1330-1.patch > Fair Scheduler: defaultQueueSchedulingPolicy does not take effect > --

[jira] [Commented] (YARN-1321) NMTokenCache is a a singleton, prevents multiple AMs running in a single JVM to work correctly

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801476#comment-13801476 ] Sandy Ryza commented on YARN-1321: -- +1 LGTM > NMTokenCache is a a singleton, prevents mul

[jira] [Commented] (YARN-947) Defining the history data classes for the implementation of the reading/writing interface

2013-10-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801470#comment-13801470 ] Zhijie Shen commented on YARN-947: -- I'm thinking that instead of putting rmappstate/rmappa

[jira] [Updated] (YARN-1335) Move duplicate code from FSSchedulerApp and FiCaSchedulerApp into SchedulerApplication

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1335: - Attachment: YARN-1335.patch > Move duplicate code from FSSchedulerApp and FiCaSchedulerApp into > Schedul

[jira] [Commented] (YARN-1305) RMHAProtocolService#serviceInit should handle HAUtil's IllegalArgumentException

2013-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801455#comment-13801455 ] Hadoop QA commented on YARN-1305: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-1305) RMHAProtocolService#serviceInit should handle HAUtil's IllegalArgumentException

2013-10-21 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1305: - Attachment: YARN-1305.8-2.patch > RMHAProtocolService#serviceInit should handle HAUtil's > Illega

[jira] [Updated] (YARN-963) JobHistoryEventHandler could not flush every 30 secondes

2013-10-21 Thread qus-jiawei (JIRA)
[ https://issues.apache.org/jira/browse/YARN-963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qus-jiawei updated YARN-963: Environment: (was: Cloudera CDH4.2.1) > JobHistoryEventHandler could not flush every 30 secondes > --

[jira] [Commented] (YARN-1305) RMHAProtocolService#serviceInit should handle HAUtil's IllegalArgumentException

2013-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801427#comment-13801427 ] Hadoop QA commented on YARN-1305: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-1121) RMStateStore should flush all pending store events before closing

2013-10-21 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801409#comment-13801409 ] Omkar Vinit Joshi commented on YARN-1121: - [~bikassaha] we have a single dispatcher

[jira] [Assigned] (YARN-1121) RMStateStore should flush all pending store events before closing

2013-10-21 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi reassigned YARN-1121: --- Assignee: Omkar Vinit Joshi > RMStateStore should flush all pending store events befor

[jira] [Commented] (YARN-1331) yarn.cmd exits with NoClassDefFoundError trying to run rmadmin or logs

2013-10-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801396#comment-13801396 ] Arpit Agarwal commented on YARN-1331: - +1 for the patch. Verified both commands manual

[jira] [Updated] (YARN-1305) RMHAProtocolService#serviceInit should handle HAUtil's IllegalArgumentException

2013-10-21 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1305: - Attachment: YARN-1305.8.patch Thank you too, Bikas. The code quality gets better and better :-) T

[jira] [Updated] (YARN-895) RM crashes if it restarts while NameNode is in safe mode

2013-10-21 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi updated YARN-895: --- Description: (was: Today if RM restarts while name node is in safe mode then RM crashes. Du

[jira] [Updated] (YARN-895) RM crashes if it restarts while NameNode is in safe mode

2013-10-21 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi updated YARN-895: --- Description: Today if RM restarts while name node is in safe mode then RM crashes. During safe

[jira] [Updated] (YARN-895) RM crashes if it restarts while NameNode is in safe mode

2013-10-21 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi updated YARN-895: --- Summary: RM crashes if it restarts while NameNode is in safe mode (was: If NameNode is in safe

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801369#comment-13801369 ] Sandy Ryza commented on YARN-415: - The scheduler can write to a tracking object that the RM

[jira] [Commented] (YARN-261) Ability to kill AM attempts

2013-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801340#comment-13801340 ] Hadoop QA commented on YARN-261: {color:red}-1 overall{color}. Here are the results of test

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

2013-10-21 Thread Andrey Klochkov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801332#comment-13801332 ] Andrey Klochkov commented on YARN-415: -- On a second thought, scheduler does not seem li

[jira] [Commented] (YARN-1334) YARN should give more info on errors when running failed distributed shell command

2013-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801325#comment-13801325 ] Hadoop QA commented on YARN-1334: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-1330) Fair Scheduler: defaultQueueSchedulingPolicy does not take effect

2013-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801323#comment-13801323 ] Hadoop QA commented on YARN-1330: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-1334) YARN should give more info on errors when running failed distributed shell command

2013-10-21 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801322#comment-13801322 ] Xuan Gong commented on YARN-1334: - bq. Does it dynamically retrieves NM address based on co

[jira] [Commented] (YARN-1334) YARN should give more info on errors when running failed distributed shell command

2013-10-21 Thread Tassapol Athiapinya (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801319#comment-13801319 ] Tassapol Athiapinya commented on YARN-1334: --- Can you please check if this part is

[jira] [Commented] (YARN-1321) NMTokenCache is a a singleton, prevents multiple AMs running in a single JVM to work correctly

2013-10-21 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801317#comment-13801317 ] Alejandro Abdelnur commented on YARN-1321: -- IMO, testing that a instance different

[jira] [Updated] (YARN-1330) Fair Scheduler: defaultQueueSchedulingPolicy does not take effect

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1330: - Attachment: YARN-1330-1.patch > Fair Scheduler: defaultQueueSchedulingPolicy does not take effect > --

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

2013-10-21 Thread Andrey Klochkov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801308#comment-13801308 ] Andrey Klochkov commented on YARN-415: -- Adding YARN-1335 as a dependency. > Capture me

[jira] [Updated] (YARN-1334) YARN should give more info on errors when running failed distributed shell command

2013-10-21 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1334: Attachment: YARN-1334.1.patch A simple patch which add more information (such as using which command to get

[jira] [Commented] (YARN-1123) [YARN-321] Adding ContainerReport and Protobuf implementation

2013-10-21 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801306#comment-13801306 ] Vinod Kumar Vavilapalli commented on YARN-1123: --- bq. I think we should keep

[jira] [Assigned] (YARN-1334) YARN should give more info on errors when running failed distributed shell command

2013-10-21 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong reassigned YARN-1334: --- Assignee: Xuan Gong > YARN should give more info on errors when running failed distributed shell > co

[jira] [Commented] (YARN-1334) YARN should give more info on errors when running failed distributed shell command

2013-10-21 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801304#comment-13801304 ] Xuan Gong commented on YARN-1334: - The reason why we can find any details about the contain

[jira] [Commented] (YARN-1335) Move duplicate code from FSSchedulerApp and FiCaSchedulerApp into SchedulerApplication

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801300#comment-13801300 ] Sandy Ryza commented on YARN-1335: -- Will try to get a patch out for this today. > Move du

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801297#comment-13801297 ] Sandy Ryza commented on YARN-415: - I don't think there's any strong reason not to move a lot

[jira] [Assigned] (YARN-1335) Move duplicate code from FSSchedulerApp and FiCaSchedulerApp into SchedulerApplication

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reassigned YARN-1335: Assignee: Sandy Ryza > Move duplicate code from FSSchedulerApp and FiCaSchedulerApp into > Schedule

[jira] [Created] (YARN-1335) Move duplicate code from FSSchedulerApp and FiCaSchedulerApp into SchedulerApplication

2013-10-21 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1335: Summary: Move duplicate code from FSSchedulerApp and FiCaSchedulerApp into SchedulerApplication Key: YARN-1335 URL: https://issues.apache.org/jira/browse/YARN-1335 Project: H

[jira] [Commented] (YARN-1321) NMTokenCache is a a singleton, prevents multiple AMs running in a single JVM to work correctly

2013-10-21 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801288#comment-13801288 ] Omkar Vinit Joshi commented on YARN-1321: - bq. On the testcases, I've modified the

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

2013-10-21 Thread Andrey Klochkov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801286#comment-13801286 ] Andrey Klochkov commented on YARN-415: -- IMO it makes sense to move this tracking into t

[jira] [Commented] (YARN-1321) NMTokenCache is a a singleton, prevents multiple AMs running in a single JVM to work correctly

2013-10-21 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801283#comment-13801283 ] Alejandro Abdelnur commented on YARN-1321: -- same as before, the extra javac warnin

[jira] [Created] (YARN-1334) YARN should give more info on errors when running failed distributed shell command

2013-10-21 Thread Tassapol Athiapinya (JIRA)
Tassapol Athiapinya created YARN-1334: - Summary: YARN should give more info on errors when running failed distributed shell command Key: YARN-1334 URL: https://issues.apache.org/jira/browse/YARN-1334

[jira] [Commented] (YARN-1321) NMTokenCache is a a singleton, prevents multiple AMs running in a single JVM to work correctly

2013-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801282#comment-13801282 ] Hadoop QA commented on YARN-1321: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-1321) NMTokenCache is a a singleton, prevents multiple AMs running in a single JVM to work correctly

2013-10-21 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated YARN-1321: - Attachment: YARN-1321.patch Sandy, Omkar, thanks for reviewing the patch. I've normalized

[jira] [Updated] (YARN-261) Ability to kill AM attempts

2013-10-21 Thread Andrey Klochkov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Klochkov updated YARN-261: - Attachment: YARN-261--n6.patch Jason, makes sense. See the updated patch. > Ability to kill AM att

[jira] [Resolved] (YARN-1230) Fair scheduler aclSubmitApps does not handle acls with only groups

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved YARN-1230. -- Resolution: Duplicate This was fixed in YARN-1288 > Fair scheduler aclSubmitApps does not handle acls w

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801112#comment-13801112 ] Sandy Ryza commented on YARN-415: - bq. However since RMAppAttemptImpl and the scheduler are

[jira] [Commented] (YARN-956) [YARN-321] Add a testable in-memory HistoryStorage

2013-10-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801094#comment-13801094 ] Zhijie Shen commented on YARN-956: -- Did some similar local tests for 1 application, 1 attem

[jira] [Commented] (YARN-947) Defining the history data classes for the implementation of the reading/writing interface

2013-10-21 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801092#comment-13801092 ] Mayank Bansal commented on YARN-947: Yes it will make it depends on YARN-978 , however i

[jira] [Commented] (YARN-1321) NMTokenCache is a a singleton, prevents multiple AMs running in a single JVM to work correctly

2013-10-21 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801095#comment-13801095 ] Omkar Vinit Joshi commented on YARN-1321: - bq. Change containsNMToken to containsTo

[jira] [Updated] (YARN-1333) Support blacklisting in the Fair Scheduler

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1333: - Assignee: (was: Sandy Ryza) > Support blacklisting in the Fair Scheduler > ---

[jira] [Updated] (YARN-1333) Support blacklisting in the Fair Scheduler

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1333: - Affects Version/s: 2.2.0 > Support blacklisting in the Fair Scheduler > --

[jira] [Created] (YARN-1333) Support blacklisting in the Fair Scheduler

2013-10-21 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1333: Summary: Support blacklisting in the Fair Scheduler Key: YARN-1333 URL: https://issues.apache.org/jira/browse/YARN-1333 Project: Hadoop YARN Issue Type: Improvement

[jira] [Commented] (YARN-947) Defining the history data classes for the implementation of the reading/writing interface

2013-10-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801067#comment-13801067 ] Zhijie Shen commented on YARN-947: -- ApplicationAttemptState will make this jira depend on Y

[jira] [Assigned] (YARN-1333) Support blacklisting in the Fair Scheduler

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reassigned YARN-1333: Assignee: Sandy Ryza > Support blacklisting in the Fair Scheduler >

[jira] [Commented] (YARN-975) Add a file-system implementation for history-storage

2013-10-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801062#comment-13801062 ] Zhijie Shen commented on YARN-975: -- As to the scalability of the implementation, it's obvio

[jira] [Commented] (YARN-1068) Add admin support for HA operations

2013-10-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801060#comment-13801060 ] Karthik Kambatla commented on YARN-1068: Merging the CLI now makes any subsequent c

[jira] [Commented] (YARN-947) Defining the history data classes for the implementation of the reading/writing interface

2013-10-21 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801056#comment-13801056 ] Mayank Bansal commented on YARN-947: [~zjshen] Some comments: ApplicationAttemptFinishD

[jira] [Created] (YARN-1332) In TestAMRMClient, replace assertTrue with assertEquals where possible

2013-10-21 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1332: Summary: In TestAMRMClient, replace assertTrue with assertEquals where possible Key: YARN-1332 URL: https://issues.apache.org/jira/browse/YARN-1332 Project: Hadoop YARN

[jira] [Commented] (YARN-947) Defining the history data classes for the implementation of the reading/writing interface

2013-10-21 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801038#comment-13801038 ] Mayank Bansal commented on YARN-947: [~zjshen] I think we still haven't decided on cont

[jira] [Commented] (YARN-1331) yarn.cmd exits with NoClassDefFoundError trying to run rmadmin or logs

2013-10-21 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801029#comment-13801029 ] Chris Nauroth commented on YARN-1331: - {quote} -1 tests included. The patch doesn't app

[jira] [Commented] (YARN-1068) Add admin support for HA operations

2013-10-21 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801027#comment-13801027 ] Bikas Saha commented on YARN-1068: -- Spoke to Vinod offline. His suggestion is to make sure

[jira] [Commented] (YARN-1321) NMTokenCache is a a singleton, prevents multiple AMs running in a single JVM to work correctly

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801022#comment-13801022 ] Sandy Ryza commented on YARN-1321: -- {code} public abstract void cleanupRunningContainer

[jira] [Commented] (YARN-1331) yarn.cmd exits with NoClassDefFoundError trying to run rmadmin or logs

2013-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801018#comment-13801018 ] Hadoop QA commented on YARN-1331: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-1330) Fair Scheduler: defaultQueueSchedulingPolicy does not take effect

2013-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801000#comment-13801000 ] Hadoop QA commented on YARN-1330: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1331) yarn.cmd exits with NoClassDefFoundError trying to run rmadmin or logs

2013-10-21 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated YARN-1331: Attachment: YARN-1331.1.patch Attaching patch. This also removes historyserver from the usage outpu

[jira] [Created] (YARN-1331) yarn.cmd exits with NoClassDefFoundError trying to run rmadmin or logs

2013-10-21 Thread Chris Nauroth (JIRA)
Chris Nauroth created YARN-1331: --- Summary: yarn.cmd exits with NoClassDefFoundError trying to run rmadmin or logs Key: YARN-1331 URL: https://issues.apache.org/jira/browse/YARN-1331 Project: Hadoop YARN

[jira] [Commented] (YARN-934) HistoryStorage writer interface for Application History Server

2013-10-21 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13800994#comment-13800994 ] Mayank Bansal commented on YARN-934: +1 Looks good. Thanks, Mayank > HistoryStorage wr

[jira] [Updated] (YARN-1330) Fair Scheduler: defaultQueueSchedulingPolicy does not take effect

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1330: - Attachment: YARN-1330.patch > Fair Scheduler: defaultQueueSchedulingPolicy does not take effect >

[jira] [Commented] (YARN-1288) Make Fair Scheduler ACLs more user friendly

2013-10-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13800953#comment-13800953 ] Hudson commented on YARN-1288: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4636 (See [https:

[jira] [Commented] (YARN-1258) Allow configuring the Fair Scheduler root queue

2013-10-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13800950#comment-13800950 ] Hudson commented on YARN-1258: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4635 (See [https:

[jira] [Updated] (YARN-1258) Allow configuring the Fair Scheduler root queue

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1258: - Fix Version/s: (was: 2.3.0) 2.2.1 > Allow configuring the Fair Scheduler root queue

[jira] [Commented] (YARN-925) HistoryStorage Reader Interface for Application History Server

2013-10-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13800935#comment-13800935 ] Zhijie Shen commented on YARN-925: -- It seems that we need state as well for the filter. App

[jira] [Commented] (YARN-925) HistoryStorage Reader Interface for Application History Server

2013-10-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13800928#comment-13800928 ] Zhijie Shen commented on YARN-925: -- bq. if you look at the filters more closely you will se

[jira] [Commented] (YARN-1328) ContainerId should expose a public static string of the ID's prefix

2013-10-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13800920#comment-13800920 ] Zhijie Shen commented on YARN-1328: --- bq. Why do you need this? Suppose we write differen

[jira] [Created] (YARN-1330) Fair Scheduler: defaultQueueSchedulingPolicy does not take effect

2013-10-21 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1330: Summary: Fair Scheduler: defaultQueueSchedulingPolicy does not take effect Key: YARN-1330 URL: https://issues.apache.org/jira/browse/YARN-1330 Project: Hadoop YARN

[jira] [Commented] (YARN-1068) Add admin support for HA operations

2013-10-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13800911#comment-13800911 ] Karthik Kambatla commented on YARN-1068: Thanks Bikas. I agree with your assessment

[jira] [Commented] (YARN-925) HistoryStorage Reader Interface for Application History Server

2013-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13800905#comment-13800905 ] Hadoop QA commented on YARN-925: {color:red}-1 overall{color}. Here are the results of test

[jira] [Updated] (YARN-925) HistoryStorage Reader Interface for Application History Server

2013-10-21 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated YARN-925: --- Attachment: YARN-925-6.patch Adding application type Thanks, Mayank > HistoryStorage Reader Interface

[jira] [Commented] (YARN-925) HistoryStorage Reader Interface for Application History Server

2013-10-21 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13800890#comment-13800890 ] Mayank Bansal commented on YARN-925: [~zjshen] if you look at the filters more closely y

[jira] [Commented] (YARN-1328) ContainerId should expose a public static string of the ID's prefix

2013-10-21 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13800872#comment-13800872 ] Vinod Kumar Vavilapalli commented on YARN-1328: --- Why do you need this? I can

[jira] [Created] (YARN-1329) yarn-config.sh overwrites YARN_CONF_DIR indiscriminately

2013-10-21 Thread Aaron Gottlieb (JIRA)
Aaron Gottlieb created YARN-1329: Summary: yarn-config.sh overwrites YARN_CONF_DIR indiscriminately Key: YARN-1329 URL: https://issues.apache.org/jira/browse/YARN-1329 Project: Hadoop YARN I

[jira] [Commented] (YARN-1321) NMTokenCache is a a singleton, prevents multiple AMs running in a single JVM to work correctly

2013-10-21 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13800772#comment-13800772 ] Alejandro Abdelnur commented on YARN-1321: -- The extra javac warning is expected as

[jira] [Commented] (YARN-1321) NMTokenCache is a a singleton, prevents multiple AMs running in a single JVM to work correctly

2013-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13800763#comment-13800763 ] Hadoop QA commented on YARN-1321: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-1328) ContainerId should expose a public static string of the ID's prefix

2013-10-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13800760#comment-13800760 ] Zhijie Shen commented on YARN-1328: --- Noticed it before, but is it better to refer to a un

[jira] [Updated] (YARN-1321) NMTokenCache is a a singleton, prevents multiple AMs running in a single JVM to work correctly

2013-10-21 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated YARN-1321: - Attachment: YARN-1321.patch uploading proper patch, the previous one was incomplete as I d

[jira] [Commented] (YARN-1328) ContainerId should expose a public static string of the ID's prefix

2013-10-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13800646#comment-13800646 ] Jason Lowe commented on YARN-1328: -- Note that ConverterUtils already has prefixes for appl

[jira] [Commented] (YARN-1328) ContainerId should expose a public static string of the ID's prefix

2013-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13800501#comment-13800501 ] Hadoop QA commented on YARN-1328: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-1328) ContainerId should expose a public static string of the ID's prefix

2013-10-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1328: -- Attachment: YARN-1328.2.patch Changed to the upper case. I'm wondering whether the constant is really p

[jira] [Commented] (YARN-1328) ContainerId should expose a public static string of the ID's prefix

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13800450#comment-13800450 ] Sandy Ryza commented on YARN-1328: -- The existing constants are marked as Private and Unsta

[jira] [Commented] (YARN-925) HistoryStorage Reader Interface for Application History Server

2013-10-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13800448#comment-13800448 ] Zhijie Shen commented on YARN-925: -- BTW, getAllApplications(...) might trouble the cache im

[jira] [Commented] (YARN-925) HistoryStorage Reader Interface for Application History Server

2013-10-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13800433#comment-13800433 ] Zhijie Shen commented on YARN-925: -- bq. I have two methods in the interface one with the fi

[jira] [Commented] (YARN-891) Store completed application information in RM state store

2013-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13800421#comment-13800421 ] Hadoop QA commented on YARN-891: {color:green}+1 overall{color}. Here are the results of te

[jira] [Commented] (YARN-967) [YARN-321] Command Line Interface(CLI) for Reading Application History Storage Data

2013-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13800417#comment-13800417 ] Hadoop QA commented on YARN-967: {color:red}-1 overall{color}. Here are the results of test

[jira] [Commented] (YARN-925) HistoryStorage Reader Interface for Application History Server

2013-10-21 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13800414#comment-13800414 ] Mayank Bansal commented on YARN-925: [~zjshen] I have two methods in the interface one w