[jira] [Created] (YARN-1316) Add continuous scheduling and allow-undeclared-pools to Fair Scheduler documentation

2013-10-16 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1316: Summary: Add continuous scheduling and allow-undeclared-pools to Fair Scheduler documentation Key: YARN-1316 URL: https://issues.apache.org/jira/browse/YARN-1316 Project: Had

[jira] [Commented] (YARN-1241) In Fair Scheduler maxRunningApps does not work for non-leaf queues

2013-10-16 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13797442#comment-13797442 ] Sandy Ryza commented on YARN-1241: -- Uploaded a new patch that * Removes the false change l

[jira] [Updated] (YARN-1241) In Fair Scheduler maxRunningApps does not work for non-leaf queues

2013-10-16 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1241: - Attachment: YARN-1241-6.patch > In Fair Scheduler maxRunningApps does not work for non-leaf queues > -

[jira] [Updated] (YARN-1315) TestQueueACLs should also test FairScheduler

2013-10-16 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1315: - Attachment: YARN-1315.patch > TestQueueACLs should also test FairScheduler > -

[jira] [Updated] (YARN-1288) Make Fair Scheduler ACLs more user friendly

2013-10-16 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1288: - Attachment: YARN-1288-1.patch > Make Fair Scheduler ACLs more user friendly >

[jira] [Commented] (YARN-1288) Make Fair Scheduler ACLs more user friendly

2013-10-16 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13797308#comment-13797308 ] Sandy Ryza commented on YARN-1288: -- Uploaded a new patch. Addressed false changes and unu

[jira] [Created] (YARN-1315) TestQueueACLs should also test FairScheduler

2013-10-16 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1315: Summary: TestQueueACLs should also test FairScheduler Key: YARN-1315 URL: https://issues.apache.org/jira/browse/YARN-1315 Project: Hadoop YARN Issue Type: Bug

[jira] [Assigned] (YARN-1315) TestQueueACLs should also test FairScheduler

2013-10-16 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reassigned YARN-1315: Assignee: Sandy Ryza > TestQueueACLs should also test FairScheduler > --

[jira] [Commented] (YARN-807) When querying apps by queue, iterating over all apps is inefficient and limiting

2013-10-16 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13797019#comment-13797019 ] Sandy Ryza commented on YARN-807: - [~acmurthy]'s +1 was to the idea. This hasn't been revie

[jira] [Resolved] (YARN-1308) set default value for nodemanager aux service

2013-10-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved YARN-1308. -- Resolution: Duplicate > set default value for nodemanager aux service >

[jira] [Commented] (YARN-1308) set default value for nodemanager aux service

2013-10-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13795428#comment-13795428 ] Sandy Ryza commented on YARN-1308: -- This looks like a duplicate of YARN-1289 > set defaul

[jira] [Commented] (YARN-1290) Let continuous scheduling achieve more balanced task assignment

2013-10-14 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794788#comment-13794788 ] Sandy Ryza commented on YARN-1290: -- I was concerned that the sort would have a performance

[jira] [Commented] (YARN-1259) In Fair Scheduler web UI, queue num pending and num active apps switched

2013-10-14 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794487#comment-13794487 ] Sandy Ryza commented on YARN-1259: -- I just committed this to trunk, branch-2, and branch-2

[jira] [Commented] (YARN-1295) In UnixLocalWrapperScriptBuilder, using bash -c can cause "Text file busy" errors

2013-10-14 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794449#comment-13794449 ] Sandy Ryza commented on YARN-1295: -- [~vinodkv], any concerns? I'll commit this tomorrow m

[jira] [Commented] (YARN-1259) In Fair Scheduler web UI, queue num pending and num active apps switched

2013-10-14 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794374#comment-13794374 ] Sandy Ryza commented on YARN-1259: -- +1 > In Fair Scheduler web UI, queue num pending and

[jira] [Commented] (YARN-1044) used/min/max resources do not display info in the scheduler page

2013-10-11 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13793087#comment-13793087 ] Sandy Ryza commented on YARN-1044: -- Thanks Sangjin! I just committed this to trunk, branc

[jira] [Commented] (YARN-1300) SLS tests fail because conf puts yarn properties in fair-scheduler.xml

2013-10-11 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13793054#comment-13793054 ] Sandy Ryza commented on YARN-1300: -- +1 > SLS tests fail because conf puts yarn properties

[jira] [Commented] (YARN-305) Fair scheduler logs too many "Node offered to app:..." messages

2013-10-11 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13793053#comment-13793053 ] Sandy Ryza commented on YARN-305: - Attaching rebased patch > Fair scheduler logs too many "

[jira] [Updated] (YARN-305) Fair scheduler logs too many "Node offered to app:..." messages

2013-10-11 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-305: Attachment: YARN-305.3.patch > Fair scheduler logs too many "Node offered to app:..." messages >

[jira] [Updated] (YARN-305) Fair scheduler logs too many "Node offered to app:..." messages

2013-10-11 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-305: Summary: Fair scheduler logs too many "Node offered to app:..." messages (was: Too many 'Node offerred to ap

[jira] [Commented] (YARN-305) Too many 'Node offerred to app:..." messages in RM

2013-10-11 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13793048#comment-13793048 ] Sandy Ryza commented on YARN-305: - +1 > Too many 'Node offerred to app:..." messages in RM

[jira] [Commented] (YARN-1122) FairScheduler user-as-default-queue always defaults to 'default'

2013-10-11 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13793017#comment-13793017 ] Sandy Ryza commented on YARN-1122: -- This was fixed by YARN-1236, closing this as duplicate

[jira] [Commented] (YARN-1044) used/min/max resources do not display info in the scheduler page

2013-10-11 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13792998#comment-13792998 ] Sandy Ryza commented on YARN-1044: -- +1, will commit this shortly > used/min/max resources

[jira] [Commented] (YARN-1300) SLS tests fail because conf puts yarn properties in fair-scheduler.xml

2013-10-11 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13792985#comment-13792985 ] Sandy Ryza commented on YARN-1300: -- Thanks for the patch. If we're going to be moving the

[jira] [Commented] (YARN-1300) SLS tests fail because conf puts yarn properties in fair-scheduler.xml

2013-10-11 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13792821#comment-13792821 ] Sandy Ryza commented on YARN-1300: -- This is occurring because of YARN-1228. It used to be

[jira] [Updated] (YARN-1300) SLS tests fail because conf puts yarn properties in fair-scheduler.xml

2013-10-11 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1300: - Summary: SLS tests fail because conf puts yarn properties in fair-scheduler.xml (was: FairScheduler fails

[jira] [Moved] (YARN-1297) Miscellaneous Fair Scheduler speedups

2013-10-11 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza moved MAPREDUCE-5578 to YARN-1297: - Component/s: (was: scheduler) scheduler Ke

[jira] [Updated] (YARN-1295) In UnixLocalWrapperScriptBuilder, using bash -c can cause "Text file busy" errors

2013-10-10 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1295: - Attachment: YARN-1295.patch > In UnixLocalWrapperScriptBuilder, using bash -c can cause "Text file busy"

[jira] [Commented] (YARN-1295) In UnixLocalWrapperScriptBuilder, using bash -c can cause "Text file busy" errors

2013-10-10 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13792161#comment-13792161 ] Sandy Ryza commented on YARN-1295: -- Grepped through the code for "-c" and didn't find anyw

[jira] [Commented] (YARN-1271) "Text file busy" errors launching containers again

2013-10-10 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13792158#comment-13792158 ] Sandy Ryza commented on YARN-1271: -- These errors are still coming up for me after the patc

[jira] [Created] (YARN-1295) In UnixLocalWrapperScriptBuilder, using bash -c can cause "Text file busy" errors

2013-10-10 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1295: Summary: In UnixLocalWrapperScriptBuilder, using bash -c can cause "Text file busy" errors Key: YARN-1295 URL: https://issues.apache.org/jira/browse/YARN-1295 Project: Hadoop

[jira] [Commented] (YARN-1182) MiniYARNCluster creates and inits the RM/NM only on start()

2013-10-10 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13792099#comment-13792099 ] Sandy Ryza commented on YARN-1182: -- +1 > MiniYARNCluster creates and inits the RM/NM only

[jira] [Commented] (YARN-1291) RM INFO logs limit scheduling speed

2013-10-10 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13791999#comment-13791999 ] Sandy Ryza commented on YARN-1291: -- I would like to demote the RMContainerImpl state trans

[jira] [Created] (YARN-1291) RM INFO logs limit scheduling speed

2013-10-10 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1291: Summary: RM INFO logs limit scheduling speed Key: YARN-1291 URL: https://issues.apache.org/jira/browse/YARN-1291 Project: Hadoop YARN Issue Type: Bug Compo

[jira] [Commented] (YARN-1182) MiniYARNCluster creates and inits the RM/NM only on start()

2013-10-10 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13791952#comment-13791952 ] Sandy Ryza commented on YARN-1182: -- Nit: {code} +conf.set(YarnConfiguration.RM_ADM

[jira] [Commented] (YARN-1288) Make Fair Scheduler ACLs more user friendly

2013-10-09 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13791098#comment-13791098 ] Sandy Ryza commented on YARN-1288: -- Attached patch that makes the changes discussed above.

[jira] [Updated] (YARN-1288) Make Fair Scheduler ACLs more user friendly

2013-10-09 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1288: - Description: The Fair Scheduler currently defaults the root queue's acl to empty and all other queues' ac

[jira] [Updated] (YARN-1288) Make Fair Scheduler ACLs more user friendly

2013-10-09 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1288: - Summary: Make Fair Scheduler ACLs more user friendly (was: Make Fair Scheduler ACLs more use friendly) >

[jira] [Updated] (YARN-1288) Make Fair Scheduler ACLs more use friendly

2013-10-09 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1288: - Summary: Make Fair Scheduler ACLs more use friendly (was: Fair Scheduler child queue ACLs shouldn't give

[jira] [Updated] (YARN-1288) Make Fair Scheduler ACLs more use friendly

2013-10-09 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1288: - Description: The Fair Scheduler currently defaults the root queue's acl to empty and all other queues' ac

[jira] [Updated] (YARN-1288) Fair Scheduler child queue ACLs shouldn't give everyone access by default

2013-10-09 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1288: - Attachment: YARN-1288.patch > Fair Scheduler child queue ACLs shouldn't give everyone access by default >

[jira] [Updated] (YARN-1241) In Fair Scheduler maxRunningApps does not work for non-leaf queues

2013-10-09 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1241: - Attachment: YARN-1241-5.patch > In Fair Scheduler maxRunningApps does not work for non-leaf queues > -

[jira] [Updated] (YARN-1241) In Fair Scheduler maxRunningApps does not work for non-leaf queues

2013-10-09 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1241: - Attachment: YARN-1241-4.patch > In Fair Scheduler maxRunningApps does not work for non-leaf queues > -

[jira] [Commented] (YARN-1241) In Fair Scheduler maxRunningApps does not work for non-leaf queues

2013-10-09 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13790879#comment-13790879 ] Sandy Ryza commented on YARN-1241: -- Thanks for the review Karthik. Will post a rebased pat

[jira] [Created] (YARN-1288) Fair Scheduler child queue ACLs shouldn't give everyone access by default

2013-10-09 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1288: Summary: Fair Scheduler child queue ACLs shouldn't give everyone access by default Key: YARN-1288 URL: https://issues.apache.org/jira/browse/YARN-1288 Project: Hadoop YARN

[jira] [Updated] (YARN-1258) Allow configuring the Fair Scheduler root queue

2013-10-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1258: - Attachment: YARN-1258-1.patch > Allow configuring the Fair Scheduler root queue >

[jira] [Commented] (YARN-321) Generic application history service

2013-10-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13790047#comment-13790047 ] Sandy Ryza commented on YARN-321: - Thanks Vinod and Zhijie. Didn't see the comment. I'm go

[jira] [Updated] (YARN-321) Generic application history service

2013-10-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-321: Attachment: ApplicationHistoryServiceHighLevel.pdf > Generic application history service > --

[jira] [Created] (YARN-1287) Consolidate MockClocks

2013-10-08 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1287: Summary: Consolidate MockClocks Key: YARN-1287 URL: https://issues.apache.org/jira/browse/YARN-1287 Project: Hadoop YARN Issue Type: Improvement Reporter

[jira] [Commented] (YARN-1284) LCE: Race condition leaves dangling cgroups entries for killed containers

2013-10-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13790020#comment-13790020 ] Sandy Ryza commented on YARN-1284: -- +1 > LCE: Race condition leaves dangling cgroups entr

[jira] [Commented] (YARN-321) Generic application history service

2013-10-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13789876#comment-13789876 ] Sandy Ryza commented on YARN-321: - Was a design doc ever written up for this? The HistorySt

[jira] [Commented] (YARN-1284) LCE: Race condition leaves dangling cgroups entries for killed containers

2013-10-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13789864#comment-13789864 ] Sandy Ryza commented on YARN-1284: -- Oh, and also: {code{ +if (! new File(cgroupPath).d

[jira] [Commented] (YARN-1284) LCE: Race condition leaves dangling cgroups entries for killed containers

2013-10-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13789861#comment-13789861 ] Sandy Ryza commented on YARN-1284: -- A few nits. Otherwise LGTM. {code} + //package priv

[jira] [Commented] (YARN-250) Add a generic mechanism to the resource manager for client communication with the scheduler.

2013-10-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13789687#comment-13789687 ] Sandy Ryza commented on YARN-250: - The mechanism this JIRA proposed would make most sense fo

[jira] [Commented] (YARN-250) Add a generic mechanism to the resource manager for client communication with the scheduler.

2013-10-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13789605#comment-13789605 ] Sandy Ryza commented on YARN-250: - My original thinking was that this would be useful for al

[jira] [Resolved] (YARN-250) Add a generic mechanism to the resource manager for client communication with the scheduler.

2013-10-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved YARN-250. - Resolution: Won't Fix > Add a generic mechanism to the resource manager for client communication with > th

[jira] [Assigned] (YARN-1258) Allow configuring the Fair Scheduler root queue

2013-10-07 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reassigned YARN-1258: Assignee: Sandy Ryza > Allow configuring the Fair Scheduler root queue > ---

[jira] [Updated] (YARN-1258) Allow configuring the Fair Scheduler root queue

2013-10-07 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1258: - Attachment: YARN-1258.patch > Allow configuring the Fair Scheduler root queue > --

[jira] [Updated] (YARN-1268) TestFairScheduler.testContinuousScheduling is flaky

2013-10-05 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1268: - Hadoop Flags: Reviewed > TestFairScheduler.testContinuousScheduling is flaky > ---

[jira] [Commented] (YARN-1268) TestFairScheduler.testContinuousScheduling is flaky

2013-10-05 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13787377#comment-13787377 ] Sandy Ryza commented on YARN-1268: -- I just committed this to trunk and branch-2 > TestFai

[jira] [Commented] (YARN-1271) "Text file busy" errors launching containers again

2013-10-04 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13786960#comment-13786960 ] Sandy Ryza commented on YARN-1271: -- Thanks Vinod! > "Text file busy" errors launching con

[jira] [Updated] (YARN-1268) TestFairScheduler.testContinuousScheduling is flaky

2013-10-04 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1268: - Attachment: YARN-1268-1.patch > TestFairScheduler.testContinuousScheduling is flaky >

[jira] [Commented] (YARN-1271) "Text file busy" errors launching containers again

2013-10-04 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13786315#comment-13786315 ] Sandy Ryza commented on YARN-1271: -- Posted branch-2 addendum > "Text file busy" errors la

[jira] [Updated] (YARN-1271) "Text file busy" errors launching containers again

2013-10-04 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1271: - Attachment: YARN-1271-branch-2.patch > "Text file busy" errors launching containers again > --

[jira] [Updated] (YARN-1268) TestFairScheduler.testContinuousScheduling is flaky

2013-10-04 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1268: - Attachment: YARN-1268.patch > TestFairScheduler.testContinuousScheduling is flaky > --

[jira] [Commented] (YARN-1271) "Text file busy" errors launching containers again

2013-10-03 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13785918#comment-13785918 ] Sandy Ryza commented on YARN-1271: -- [~acmurthy], didn't notice the other version of getRun

[jira] [Commented] (YARN-677) Increase coverage to FairScheduler

2013-10-03 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13785793#comment-13785793 ] Sandy Ryza commented on YARN-677: - Thanks for looking into this, [~aklochkov]. My opinion i

[jira] [Commented] (YARN-1256) NM silently ignores non-existent service in StartContainerRequest

2013-10-03 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13785773#comment-13785773 ] Sandy Ryza commented on YARN-1256: -- Thanks for the quick turnaround! > NM silently ignore

[jira] [Commented] (YARN-1256) NM silently ignores non-existent service in StartContainerRequest

2013-10-03 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13785763#comment-13785763 ] Sandy Ryza commented on YARN-1256: -- trunk isn't compiling after this. [~bikassaha] it loo

[jira] [Updated] (YARN-1271) "Text file busy" errors launching containers again

2013-10-03 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1271: - Attachment: YARN-1271.patch > "Text file busy" errors launching containers again > ---

[jira] [Commented] (YARN-1271) "Text file busy" errors launching containers again

2013-10-03 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13785688#comment-13785688 ] Sandy Ryza commented on YARN-1271: -- {code} Exception from container-launch: org.apache.ha

[jira] [Created] (YARN-1271) "Text file busy" errors launching containers again

2013-10-03 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1271: Summary: "Text file busy" errors launching containers again Key: YARN-1271 URL: https://issues.apache.org/jira/browse/YARN-1271 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-1265) Fair Scheduler chokes on unhealthy node reconnect

2013-10-03 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13785669#comment-13785669 ] Sandy Ryza commented on YARN-1265: -- Uploaded a patch that, instead of the above, changes t

[jira] [Updated] (YARN-1265) Fair Scheduler chokes on unhealthy node reconnect

2013-10-03 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1265: - Attachment: YARN-1265-1.patch > Fair Scheduler chokes on unhealthy node reconnect > --

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2013-10-03 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13785550#comment-13785550 ] Sandy Ryza commented on YARN-1197: -- To summarize what I wrote above: YARN is already asymm

[jira] [Commented] (YARN-677) Increase coverage to FairScheduler

2013-10-03 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13785354#comment-13785354 ] Sandy Ryza commented on YARN-677: - Thanks, Jonathan. > Increase coverage to FairScheduler >

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2013-10-03 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13785310#comment-13785310 ] Sandy Ryza commented on YARN-1197: -- [~bikassaha], yeah, that's my suggestion. > Support c

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2013-10-03 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13784914#comment-13784914 ] Sandy Ryza commented on YARN-1197: -- bq. I dont think Sandy meant that the AM first tells t

[jira] [Commented] (YARN-1213) Restore config to ban submitting to undeclared pools in the Fair Scheduler

2013-10-02 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13784726#comment-13784726 ] Sandy Ryza commented on YARN-1213: -- I just committed this to trunk, branch-2, and branch-2

[jira] [Updated] (YARN-1213) Restore config to ban submitting to undeclared pools in the Fair Scheduler

2013-10-02 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1213: - Summary: Restore config to ban submitting to undeclared pools in the Fair Scheduler (was: Restore config

[jira] [Updated] (YARN-1213) Restore config to bad submitting to undeclared pools in the Fair Scheduler

2013-10-02 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1213: - Summary: Restore config to bad submitting to undeclared pools in the Fair Scheduler (was: Restore banning

[jira] [Updated] (YARN-1213) Restore banning submitting to undeclared pools in the Fair Scheduler

2013-10-02 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1213: - Summary: Restore banning submitting to undeclared pools in the Fair Scheduler (was: Add an equivalent of

[jira] [Commented] (YARN-1213) Add an equivalent of mapred.fairscheduler.allow.undeclared.pools to the Fair Scheduler

2013-10-02 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13784695#comment-13784695 ] Sandy Ryza commented on YARN-1213: -- Test failure is unrelated - TestFairScheduler.testCont

[jira] [Created] (YARN-1268) TestFairScheduler.testContinuousScheduling is flaky

2013-10-02 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1268: Summary: TestFairScheduler.testContinuousScheduling is flaky Key: YARN-1268 URL: https://issues.apache.org/jira/browse/YARN-1268 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-1265) Fair Scheduler chokes on unhealthy node reconnect

2013-10-02 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13784669#comment-13784669 ] Sandy Ryza commented on YARN-1265: -- Attached patch removes the guard against nodes not bei

[jira] [Updated] (YARN-1265) Fair Scheduler chokes on unhealthy node reconnect

2013-10-02 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1265: - Attachment: YARN-1265.patch > Fair Scheduler chokes on unhealthy node reconnect >

[jira] [Assigned] (YARN-1213) Add an equivalent of mapred.fairscheduler.allow.undeclared.pools to the Fair Scheduler

2013-10-02 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reassigned YARN-1213: Assignee: Sandy Ryza > Add an equivalent of mapred.fairscheduler.allow.undeclared.pools to the Fair

[jira] [Updated] (YARN-1213) Add an equivalent of mapred.fairscheduler.allow.undeclared.pools to the Fair Scheduler

2013-10-02 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1213: - Attachment: YARN-1213.patch > Add an equivalent of mapred.fairscheduler.allow.undeclared.pools to the Fair

[jira] [Reopened] (YARN-677) Increase coverage to FairScheduler

2013-10-02 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reopened YARN-677: - > Increase coverage to FairScheduler > -- > > Key: YARN-677 >

[jira] [Commented] (YARN-677) Increase coverage to FairScheduler

2013-10-02 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13784626#comment-13784626 ] Sandy Ryza commented on YARN-677: - I wish I had caught this earlier. The Fair Scheduler act

[jira] [Updated] (YARN-876) Node resource is added twice when node comes back from unhealthy to healthy

2013-10-02 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-876: Component/s: (was: nodemanager) resourcemanager > Node resource is added twice when node

[jira] [Created] (YARN-1265) Fair Scheduler chokes on unhealthy node reconnect

2013-10-02 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1265: Summary: Fair Scheduler chokes on unhealthy node reconnect Key: YARN-1265 URL: https://issues.apache.org/jira/browse/YARN-1265 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2013-10-02 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13784222#comment-13784222 ] Sandy Ryza commented on YARN-1197: -- It seems to me that for the reasons Bikas mentioned an

[jira] [Updated] (YARN-1262) TestApplicationCleanup relies on all containers assigned in a single heartbeat

2013-10-01 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1262: - Assignee: Karthik Kambatla (was: Sandy Ryza) > TestApplicationCleanup relies on all containers assigned i

[jira] [Assigned] (YARN-1262) TestApplicationCleanup relies on all containers assigned in a single heartbeat

2013-10-01 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reassigned YARN-1262: Assignee: Sandy Ryza (was: Karthik Kambatla) > TestApplicationCleanup relies on all containers assi

[jira] [Created] (YARN-1263) Clean up unused imports in TestFairScheduler after YARN-899

2013-10-01 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1263: Summary: Clean up unused imports in TestFairScheduler after YARN-899 Key: YARN-1263 URL: https://issues.apache.org/jira/browse/YARN-1263 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-899) Get queue administration ACLs working

2013-10-01 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13783324#comment-13783324 ] Sandy Ryza commented on YARN-899: - It looks like this added a bunch of unused imports into T

[jira] [Commented] (YARN-1262) TestApplicationCleanup relies on all containers assigned in a single heartbeat

2013-10-01 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13783300#comment-13783300 ] Sandy Ryza commented on YARN-1262: -- +1 pending jenkins > TestApplicationCleanup relies on

[jira] [Created] (YARN-1262) TestApplicationCleanup relies on all containers assigned in a single heartbeat

2013-10-01 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1262: Summary: TestApplicationCleanup relies on all containers assigned in a single heartbeat Key: YARN-1262 URL: https://issues.apache.org/jira/browse/YARN-1262 Project: Hadoop YA

[jira] [Commented] (YARN-1010) FairScheduler: decouple container scheduling from nodemanager heartbeats

2013-10-01 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13783080#comment-13783080 ] Sandy Ryza commented on YARN-1010: -- +1 > FairScheduler: decouple container scheduling fro

<    3   4   5   6   7   8   9   10   11   12   >