[jira] [Commented] (YARN-1306) Clean up hadoop-sls sample-conf according to YARN-1228

2013-10-28 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13807551#comment-13807551 ] Sandy Ryza commented on YARN-1306: -- +1 Clean up hadoop-sls sample-conf according to

[jira] [Commented] (YARN-1333) Support blacklisting in the Fair Scheduler

2013-10-25 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13805465#comment-13805465 ] Sandy Ryza commented on YARN-1333: -- Thanks Tsuyoshi. Just a couple more things: {code} +

[jira] [Commented] (YARN-1351) Invalid string format in Fair Scheduler log warn message

2013-10-25 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13805599#comment-13805599 ] Sandy Ryza commented on YARN-1351: -- +1 Invalid string format in Fair Scheduler log warn

[jira] [Commented] (YARN-1333) Support blacklisting in the Fair Scheduler

2013-10-25 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13805649#comment-13805649 ] Sandy Ryza commented on YARN-1333: -- +1 pending jenkins Support blacklisting in the Fair

[jira] [Updated] (YARN-1335) Move duplicate code from FSSchedulerApp and FiCaSchedulerApp into SchedulerApplication

2013-10-24 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1335: - Attachment: YARN-1335-1.patch Move duplicate code from FSSchedulerApp and FiCaSchedulerApp into

[jira] [Commented] (YARN-1335) Move duplicate code from FSSchedulerApp and FiCaSchedulerApp into SchedulerApplication

2013-10-24 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13803891#comment-13803891 ] Sandy Ryza commented on YARN-1335: -- Thanks for the review Tsuyoshi. Uploading a patch

[jira] [Commented] (YARN-1321) NMTokenCache is a a singleton, prevents multiple AMs running in a single JVM to work correctly

2013-10-24 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13803936#comment-13803936 ] Sandy Ryza commented on YARN-1321: -- [~vinodkv], if I understand correctly, the difference

[jira] [Commented] (YARN-1335) Move duplicate code from FSSchedulerApp and FiCaSchedulerApp into SchedulerApplication

2013-10-24 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13804718#comment-13804718 ] Sandy Ryza commented on YARN-1335: -- Looked into this and I don't think synchronization

[jira] [Updated] (YARN-786) Expose application resource usage in RM REST API

2013-10-24 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-786: Attachment: YARN-786.patch Expose application resource usage in RM REST API

[jira] [Commented] (YARN-786) Expose application resource usage in RM REST API

2013-10-24 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13804844#comment-13804844 ] Sandy Ryza commented on YARN-786: - Attached patch adds allocatedMB, allocatedVCores, and

[jira] [Updated] (YARN-1351) Invalid string format in Fair Scheduler log warn message

2013-10-24 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1351: - Summary: Invalid string format in Fair Scheduler log warn message (was: Invalid Format String

[jira] [Commented] (YARN-1351) Invalid string format in Fair Scheduler log warn message

2013-10-24 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13804865#comment-13804865 ] Sandy Ryza commented on YARN-1351: -- Thanks for finding and working on this [~konnew88]!

[jira] [Commented] (YARN-1343) NodeManagers additions/restarts are not reported as node updates in AllocateResponse responses to AMs

2013-10-23 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13803442#comment-13803442 ] Sandy Ryza commented on YARN-1343: -- +1 NodeManagers additions/restarts are not reported

[jira] [Commented] (YARN-1343) NodeManagers additions/restarts are not reported as node updates in AllocateResponse responses to AMs

2013-10-23 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13803446#comment-13803446 ] Sandy Ryza commented on YARN-1343: -- pending jenkins NodeManagers additions/restarts are

[jira] [Commented] (YARN-1335) Move duplicate code from FSSchedulerApp and FiCaSchedulerApp into SchedulerApplication

2013-10-22 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13802136#comment-13802136 ] Sandy Ryza commented on YARN-1335: -- Tests not included because it's a simple refactoring

[jira] [Commented] (YARN-1328) ContainerId should expose a public static string of the ID's prefix

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13800450#comment-13800450 ] Sandy Ryza commented on YARN-1328: -- The existing constants are marked as Private and

[jira] [Created] (YARN-1330) Fair Scheduler: defaultQueueSchedulingPolicy does not take effect

2013-10-21 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1330: Summary: Fair Scheduler: defaultQueueSchedulingPolicy does not take effect Key: YARN-1330 URL: https://issues.apache.org/jira/browse/YARN-1330 Project: Hadoop YARN

[jira] [Updated] (YARN-1258) Allow configuring the Fair Scheduler root queue

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1258: - Fix Version/s: (was: 2.3.0) 2.2.1 Allow configuring the Fair Scheduler root queue

[jira] [Updated] (YARN-1330) Fair Scheduler: defaultQueueSchedulingPolicy does not take effect

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1330: - Attachment: YARN-1330.patch Fair Scheduler: defaultQueueSchedulingPolicy does not take effect

[jira] [Commented] (YARN-1321) NMTokenCache is a a singleton, prevents multiple AMs running in a single JVM to work correctly

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13801022#comment-13801022 ] Sandy Ryza commented on YARN-1321: -- {code} public abstract void

[jira] [Assigned] (YARN-1333) Support blacklisting in the Fair Scheduler

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reassigned YARN-1333: Assignee: Sandy Ryza Support blacklisting in the Fair Scheduler

[jira] [Created] (YARN-1333) Support blacklisting in the Fair Scheduler

2013-10-21 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1333: Summary: Support blacklisting in the Fair Scheduler Key: YARN-1333 URL: https://issues.apache.org/jira/browse/YARN-1333 Project: Hadoop YARN Issue Type: Improvement

[jira] [Updated] (YARN-1333) Support blacklisting in the Fair Scheduler

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1333: - Affects Version/s: 2.2.0 Support blacklisting in the Fair Scheduler

[jira] [Updated] (YARN-1333) Support blacklisting in the Fair Scheduler

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1333: - Assignee: (was: Sandy Ryza) Support blacklisting in the Fair Scheduler

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13801112#comment-13801112 ] Sandy Ryza commented on YARN-415: - bq. However since RMAppAttemptImpl and the scheduler are

[jira] [Created] (YARN-1335) Move duplicate code from FSSchedulerApp and FiCaSchedulerApp into SchedulerApplication

2013-10-21 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1335: Summary: Move duplicate code from FSSchedulerApp and FiCaSchedulerApp into SchedulerApplication Key: YARN-1335 URL: https://issues.apache.org/jira/browse/YARN-1335 Project:

[jira] [Assigned] (YARN-1335) Move duplicate code from FSSchedulerApp and FiCaSchedulerApp into SchedulerApplication

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reassigned YARN-1335: Assignee: Sandy Ryza Move duplicate code from FSSchedulerApp and FiCaSchedulerApp into

[jira] [Commented] (YARN-1335) Move duplicate code from FSSchedulerApp and FiCaSchedulerApp into SchedulerApplication

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13801300#comment-13801300 ] Sandy Ryza commented on YARN-1335: -- Will try to get a patch out for this today. Move

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13801297#comment-13801297 ] Sandy Ryza commented on YARN-415: - I don't think there's any strong reason not to move a lot

[jira] [Updated] (YARN-1330) Fair Scheduler: defaultQueueSchedulingPolicy does not take effect

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1330: - Attachment: YARN-1330-1.patch Fair Scheduler: defaultQueueSchedulingPolicy does not take effect

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13801369#comment-13801369 ] Sandy Ryza commented on YARN-415: - The scheduler can write to a tracking object that the RM

[jira] [Updated] (YARN-1335) Move duplicate code from FSSchedulerApp and FiCaSchedulerApp into SchedulerApplication

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1335: - Attachment: YARN-1335.patch Move duplicate code from FSSchedulerApp and FiCaSchedulerApp into

[jira] [Commented] (YARN-1321) NMTokenCache is a a singleton, prevents multiple AMs running in a single JVM to work correctly

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13801476#comment-13801476 ] Sandy Ryza commented on YARN-1321: -- +1 LGTM NMTokenCache is a a singleton, prevents

[jira] [Updated] (YARN-1330) Fair Scheduler: defaultQueueSchedulingPolicy does not take effect

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1330: - Attachment: YARN-1330-1.patch Fair Scheduler: defaultQueueSchedulingPolicy does not take effect

[jira] [Updated] (YARN-1315) TestQueueACLs should also test FairScheduler

2013-10-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1315: - Attachment: YARN-1315.patch TestQueueACLs should also test FairScheduler

[jira] [Commented] (YARN-1328) ContainerId should expose a public static string of the ID's prefix

2013-10-20 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13800214#comment-13800214 ] Sandy Ryza commented on YARN-1328: -- Agreed with Tsuyoshi that we should make these upper

[jira] [Commented] (YARN-1321) NMTokenCache is a a singleton, prevents multiple AMs running in a single JVM to work correctly

2013-10-19 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799987#comment-13799987 ] Sandy Ryza commented on YARN-1321: -- bq. Keep the statics around for single AM per JVM case

[jira] [Commented] (YARN-1222) Make improvements in ZKRMStateStore for fencing

2013-10-18 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799504#comment-13799504 ] Sandy Ryza commented on YARN-1222: -- {code} LOG.error(Error in storing master key

[jira] [Updated] (YARN-1121) RMStateStore should flush all pending store events before closing

2013-10-18 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1121: - Fix Version/s: (was: 2.2.0) 2.2.1 RMStateStore should flush all pending store

[jira] [Updated] (YARN-1053) Diagnostic message from ContainerExitEvent is ignored in ContainerImpl

2013-10-18 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1053: - Fix Version/s: (was: 2.2.0) 2.2.1 Diagnostic message from ContainerExitEvent is

[jira] [Updated] (YARN-1158) ResourceManager UI has application stdout missing if application stdout is not in the same directory as AppMaster stdout

2013-10-18 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1158: - Fix Version/s: (was: 2.2.0) 2.2.1 ResourceManager UI has application stdout

[jira] [Updated] (YARN-1022) Unnecessary INFO logs in AMRMClientAsync

2013-10-18 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1022: - Fix Version/s: (was: 2.2.0) 2.2.1 Unnecessary INFO logs in AMRMClientAsync

[jira] [Updated] (YARN-1142) MiniYARNCluster web ui does not work properly

2013-10-18 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1142: - Fix Version/s: (was: 2.2.0) 2.2.1 MiniYARNCluster web ui does not work properly

[jira] [Updated] (YARN-1234) Container localizer logs are not created in secured cluster

2013-10-18 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1234: - Fix Version/s: (was: 2.2.0) 2.2.1 Container localizer logs are not created in

[jira] [Updated] (YARN-1288) Make Fair Scheduler ACLs more user friendly

2013-10-18 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1288: - Attachment: YARN-1288-3.patch Make Fair Scheduler ACLs more user friendly

[jira] [Commented] (YARN-1317) Make Queue, QueueACLs and QueueMetrics first class citizens in YARN

2013-10-17 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798397#comment-13798397 ] Sandy Ryza commented on YARN-1317: -- To add, YARN-1052 covers handling queue ACLs

[jira] [Updated] (YARN-1288) Make Fair Scheduler ACLs more user friendly

2013-10-17 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1288: - Attachment: YARN-1288-2.patch Make Fair Scheduler ACLs more user friendly

[jira] [Commented] (YARN-1288) Make Fair Scheduler ACLs more user friendly

2013-10-17 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798586#comment-13798586 ] Sandy Ryza commented on YARN-1288: -- For the record, the old default behavior was that the

[jira] [Commented] (YARN-807) When querying apps by queue, iterating over all apps is inefficient and limiting

2013-10-16 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13797019#comment-13797019 ] Sandy Ryza commented on YARN-807: - [~acmurthy]'s +1 was to the idea. This hasn't been

[jira] [Assigned] (YARN-1315) TestQueueACLs should also test FairScheduler

2013-10-16 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reassigned YARN-1315: Assignee: Sandy Ryza TestQueueACLs should also test FairScheduler

[jira] [Created] (YARN-1315) TestQueueACLs should also test FairScheduler

2013-10-16 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1315: Summary: TestQueueACLs should also test FairScheduler Key: YARN-1315 URL: https://issues.apache.org/jira/browse/YARN-1315 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-1288) Make Fair Scheduler ACLs more user friendly

2013-10-16 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13797308#comment-13797308 ] Sandy Ryza commented on YARN-1288: -- Uploaded a new patch. Addressed false changes and

[jira] [Updated] (YARN-1288) Make Fair Scheduler ACLs more user friendly

2013-10-16 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1288: - Attachment: YARN-1288-1.patch Make Fair Scheduler ACLs more user friendly

[jira] [Updated] (YARN-1315) TestQueueACLs should also test FairScheduler

2013-10-16 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1315: - Attachment: YARN-1315.patch TestQueueACLs should also test FairScheduler

[jira] [Updated] (YARN-1241) In Fair Scheduler maxRunningApps does not work for non-leaf queues

2013-10-16 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1241: - Attachment: YARN-1241-6.patch In Fair Scheduler maxRunningApps does not work for non-leaf queues

[jira] [Commented] (YARN-1241) In Fair Scheduler maxRunningApps does not work for non-leaf queues

2013-10-16 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13797442#comment-13797442 ] Sandy Ryza commented on YARN-1241: -- Uploaded a new patch that * Removes the false change

[jira] [Created] (YARN-1316) Add continuous scheduling and allow-undeclared-pools to Fair Scheduler documentation

2013-10-16 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1316: Summary: Add continuous scheduling and allow-undeclared-pools to Fair Scheduler documentation Key: YARN-1316 URL: https://issues.apache.org/jira/browse/YARN-1316 Project:

[jira] [Commented] (YARN-1308) set default value for nodemanager aux service

2013-10-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13795428#comment-13795428 ] Sandy Ryza commented on YARN-1308: -- This looks like a duplicate of YARN-1289 set default

[jira] [Resolved] (YARN-1308) set default value for nodemanager aux service

2013-10-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved YARN-1308. -- Resolution: Duplicate set default value for nodemanager aux service

[jira] [Commented] (YARN-1259) In Fair Scheduler web UI, queue num pending and num active apps switched

2013-10-14 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13794374#comment-13794374 ] Sandy Ryza commented on YARN-1259: -- +1 In Fair Scheduler web UI, queue num pending and

[jira] [Commented] (YARN-1295) In UnixLocalWrapperScriptBuilder, using bash -c can cause Text file busy errors

2013-10-14 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13794449#comment-13794449 ] Sandy Ryza commented on YARN-1295: -- [~vinodkv], any concerns? I'll commit this tomorrow

[jira] [Commented] (YARN-1259) In Fair Scheduler web UI, queue num pending and num active apps switched

2013-10-14 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13794487#comment-13794487 ] Sandy Ryza commented on YARN-1259: -- I just committed this to trunk, branch-2, and

[jira] [Commented] (YARN-1290) Let continuous scheduling achieve more balanced task assignment

2013-10-14 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13794788#comment-13794788 ] Sandy Ryza commented on YARN-1290: -- I was concerned that the sort would have a performance

[jira] [Moved] (YARN-1297) Miscellaneous Fair Scheduler speedups

2013-10-11 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza moved MAPREDUCE-5578 to YARN-1297: - Component/s: (was: scheduler) scheduler

[jira] [Updated] (YARN-1300) SLS tests fail because conf puts yarn properties in fair-scheduler.xml

2013-10-11 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1300: - Summary: SLS tests fail because conf puts yarn properties in fair-scheduler.xml (was: FairScheduler

[jira] [Commented] (YARN-1300) SLS tests fail because conf puts yarn properties in fair-scheduler.xml

2013-10-11 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13792821#comment-13792821 ] Sandy Ryza commented on YARN-1300: -- This is occurring because of YARN-1228. It used to be

[jira] [Commented] (YARN-1300) SLS tests fail because conf puts yarn properties in fair-scheduler.xml

2013-10-11 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13792985#comment-13792985 ] Sandy Ryza commented on YARN-1300: -- Thanks for the patch. If we're going to be moving the

[jira] [Commented] (YARN-1044) used/min/max resources do not display info in the scheduler page

2013-10-11 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13792998#comment-13792998 ] Sandy Ryza commented on YARN-1044: -- +1, will commit this shortly used/min/max resources

[jira] [Commented] (YARN-1122) FairScheduler user-as-default-queue always defaults to 'default'

2013-10-11 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13793017#comment-13793017 ] Sandy Ryza commented on YARN-1122: -- This was fixed by YARN-1236, closing this as

[jira] [Commented] (YARN-305) Too many 'Node offerred to app:... messages in RM

2013-10-11 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13793048#comment-13793048 ] Sandy Ryza commented on YARN-305: - +1 Too many 'Node offerred to app:... messages in RM

[jira] [Updated] (YARN-305) Fair scheduler logs too many Node offered to app:... messages

2013-10-11 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-305: Summary: Fair scheduler logs too many Node offered to app:... messages (was: Too many 'Node offerred to

[jira] [Commented] (YARN-305) Fair scheduler logs too many Node offered to app:... messages

2013-10-11 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13793053#comment-13793053 ] Sandy Ryza commented on YARN-305: - Attaching rebased patch Fair scheduler logs too many

[jira] [Commented] (YARN-1300) SLS tests fail because conf puts yarn properties in fair-scheduler.xml

2013-10-11 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13793054#comment-13793054 ] Sandy Ryza commented on YARN-1300: -- +1 SLS tests fail because conf puts yarn properties

[jira] [Commented] (YARN-1044) used/min/max resources do not display info in the scheduler page

2013-10-11 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13793087#comment-13793087 ] Sandy Ryza commented on YARN-1044: -- Thanks Sangjin! I just committed this to trunk,

[jira] [Commented] (YARN-1182) MiniYARNCluster creates and inits the RM/NM only on start()

2013-10-10 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13791952#comment-13791952 ] Sandy Ryza commented on YARN-1182: -- Nit: {code} +

[jira] [Created] (YARN-1291) RM INFO logs limit scheduling speed

2013-10-10 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1291: Summary: RM INFO logs limit scheduling speed Key: YARN-1291 URL: https://issues.apache.org/jira/browse/YARN-1291 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-1291) RM INFO logs limit scheduling speed

2013-10-10 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13791999#comment-13791999 ] Sandy Ryza commented on YARN-1291: -- I would like to demote the RMContainerImpl state

[jira] [Created] (YARN-1295) In UnixLocalWrapperScriptBuilder, using bash -c can cause Text file busy errors

2013-10-10 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1295: Summary: In UnixLocalWrapperScriptBuilder, using bash -c can cause Text file busy errors Key: YARN-1295 URL: https://issues.apache.org/jira/browse/YARN-1295 Project: Hadoop

[jira] [Commented] (YARN-1271) Text file busy errors launching containers again

2013-10-10 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13792158#comment-13792158 ] Sandy Ryza commented on YARN-1271: -- These errors are still coming up for me after the

[jira] [Commented] (YARN-1295) In UnixLocalWrapperScriptBuilder, using bash -c can cause Text file busy errors

2013-10-10 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13792161#comment-13792161 ] Sandy Ryza commented on YARN-1295: -- Grepped through the code for -c and didn't find

[jira] [Updated] (YARN-1295) In UnixLocalWrapperScriptBuilder, using bash -c can cause Text file busy errors

2013-10-10 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1295: - Attachment: YARN-1295.patch In UnixLocalWrapperScriptBuilder, using bash -c can cause Text file busy

[jira] [Created] (YARN-1288) Fair Scheduler child queue ACLs shouldn't give everyone access by default

2013-10-09 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1288: Summary: Fair Scheduler child queue ACLs shouldn't give everyone access by default Key: YARN-1288 URL: https://issues.apache.org/jira/browse/YARN-1288 Project: Hadoop YARN

[jira] [Commented] (YARN-1241) In Fair Scheduler maxRunningApps does not work for non-leaf queues

2013-10-09 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13790879#comment-13790879 ] Sandy Ryza commented on YARN-1241: -- Thanks for the review Karthik. Will post a rebased

[jira] [Updated] (YARN-1241) In Fair Scheduler maxRunningApps does not work for non-leaf queues

2013-10-09 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1241: - Attachment: YARN-1241-4.patch In Fair Scheduler maxRunningApps does not work for non-leaf queues

[jira] [Updated] (YARN-1241) In Fair Scheduler maxRunningApps does not work for non-leaf queues

2013-10-09 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1241: - Attachment: YARN-1241-5.patch In Fair Scheduler maxRunningApps does not work for non-leaf queues

[jira] [Updated] (YARN-1288) Fair Scheduler child queue ACLs shouldn't give everyone access by default

2013-10-09 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1288: - Attachment: YARN-1288.patch Fair Scheduler child queue ACLs shouldn't give everyone access by default

[jira] [Updated] (YARN-1288) Make Fair Scheduler ACLs more use friendly

2013-10-09 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1288: - Description: The Fair Scheduler currently defaults the root queue's acl to empty and all other queues'

[jira] [Updated] (YARN-1288) Make Fair Scheduler ACLs more user friendly

2013-10-09 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1288: - Description: The Fair Scheduler currently defaults the root queue's acl to empty and all other queues'

[jira] [Updated] (YARN-1288) Make Fair Scheduler ACLs more user friendly

2013-10-09 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1288: - Summary: Make Fair Scheduler ACLs more user friendly (was: Make Fair Scheduler ACLs more use friendly)

[jira] [Commented] (YARN-1288) Make Fair Scheduler ACLs more user friendly

2013-10-09 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13791098#comment-13791098 ] Sandy Ryza commented on YARN-1288: -- Attached patch that makes the changes discussed above.

[jira] [Resolved] (YARN-250) Add a generic mechanism to the resource manager for client communication with the scheduler.

2013-10-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved YARN-250. - Resolution: Won't Fix Add a generic mechanism to the resource manager for client communication with the

[jira] [Commented] (YARN-250) Add a generic mechanism to the resource manager for client communication with the scheduler.

2013-10-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13789605#comment-13789605 ] Sandy Ryza commented on YARN-250: - My original thinking was that this would be useful for

[jira] [Commented] (YARN-250) Add a generic mechanism to the resource manager for client communication with the scheduler.

2013-10-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13789687#comment-13789687 ] Sandy Ryza commented on YARN-250: - The mechanism this JIRA proposed would make most sense

[jira] [Commented] (YARN-1284) LCE: Race condition leaves dangling cgroups entries for killed containers

2013-10-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13789861#comment-13789861 ] Sandy Ryza commented on YARN-1284: -- A few nits. Otherwise LGTM. {code} + //package

[jira] [Commented] (YARN-1284) LCE: Race condition leaves dangling cgroups entries for killed containers

2013-10-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13789864#comment-13789864 ] Sandy Ryza commented on YARN-1284: -- Oh, and also: {code{ +if (! new

[jira] [Commented] (YARN-321) Generic application history service

2013-10-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13789876#comment-13789876 ] Sandy Ryza commented on YARN-321: - Was a design doc ever written up for this? The

[jira] [Created] (YARN-1287) Consolidate MockClocks

2013-10-08 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1287: Summary: Consolidate MockClocks Key: YARN-1287 URL: https://issues.apache.org/jira/browse/YARN-1287 Project: Hadoop YARN Issue Type: Improvement

[jira] [Updated] (YARN-321) Generic application history service

2013-10-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-321: Attachment: ApplicationHistoryServiceHighLevel.pdf Generic application history service

[jira] [Commented] (YARN-321) Generic application history service

2013-10-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13790047#comment-13790047 ] Sandy Ryza commented on YARN-321: - Thanks Vinod and Zhijie. Didn't see the comment. I'm

[jira] [Updated] (YARN-1258) Allow configuring the Fair Scheduler root queue

2013-10-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1258: - Attachment: YARN-1258-1.patch Allow configuring the Fair Scheduler root queue

<    2   3   4   5   6   7   8   9   10   11   >