[jira] [Commented] (YARN-6406) Remove SchedulerRequestKeys when no more pending ResourceRequest

[ https://issues.apache.org/jira/browse/YARN-6406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969771#comment-15969771 ] Hadoop QA commented on YARN-6406: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6406) Remove SchedulerRequestKeys when no more pending ResourceRequest

[ https://issues.apache.org/jira/browse/YARN-6406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969769#comment-15969769 ] Hadoop QA commented on YARN-6406: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6406) Remove SchedulerRequestKeys when no more pending ResourceRequest

[ https://issues.apache.org/jira/browse/YARN-6406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969670#comment-15969670 ] Hadoop QA commented on YARN-6406: - (!) A patch to the testing environment has been detected. Re-executing

[jira] [Commented] (YARN-6406) Remove SchedulerRequestKeys when no more pending ResourceRequest

[ https://issues.apache.org/jira/browse/YARN-6406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969664#comment-15969664 ] Hadoop QA commented on YARN-6406: - (!) A patch to the testing environment has been detected. Re-executing

[jira] [Updated] (YARN-6406) Remove SchedulerRequestKeys when no more pending ResourceRequest

[ https://issues.apache.org/jira/browse/YARN-6406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6406: -- Attachment: YARN-6406-branch-2.002.patch Reattaching patch with HADOOP-14311 fix to see if Jenkins will

[jira] [Updated] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned by the Resource Manager as a response to the Application Master heartbeat

[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Rodríguez Hortalá updated YARN-6483: - Attachment: (was: YARN-6483.patch) > Add nodes transitioning to

[jira] [Commented] (YARN-6480) Timeout is too aggressive for TestAMRestart.testPreemptedAMRestartOnRMRestart

[ https://issues.apache.org/jira/browse/YARN-6480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969649#comment-15969649 ] Hudson commented on YARN-6480: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11587 (See

[jira] [Commented] (YARN-6438) Code can be improved in ContainersMonitorImpl.java

[ https://issues.apache.org/jira/browse/YARN-6438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969631#comment-15969631 ] Hadoop QA commented on YARN-6438: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6433) Only accessible cgroup mount directories should be selected for a controller

[ https://issues.apache.org/jira/browse/YARN-6433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969625#comment-15969625 ] Hudson commented on YARN-6433: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11586 (See

[jira] [Commented] (YARN-6480) Timeout is too aggressive for TestAMRestart.testPreemptedAMRestartOnRMRestart

[ https://issues.apache.org/jira/browse/YARN-6480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969614#comment-15969614 ] Jason Lowe commented on YARN-6480: -- +1 lgtm. Committing this. > Timeout is too aggressive for

[jira] [Commented] (YARN-6433) Only accessible cgroup mount directories should be selected for a controller

[ https://issues.apache.org/jira/browse/YARN-6433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969588#comment-15969588 ] Karthik Kambatla commented on YARN-6433: +1 > Only accessible cgroup mount directories should be

[jira] [Updated] (YARN-6438) Code can be improved in ContainersMonitorImpl.java

[ https://issues.apache.org/jira/browse/YARN-6438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6438: - Attachment: YARN-6438.003.patch > Code can be improved in ContainersMonitorImpl.java >

[jira] [Commented] (YARN-6438) Code can be improved in ContainersMonitorImpl.java

[ https://issues.apache.org/jira/browse/YARN-6438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969569#comment-15969569 ] Miklos Szegedi commented on YARN-6438: -- Good point [~templedf]. I meant to keep both, because the

[jira] [Commented] (YARN-6432) FairScheduler: Reserve preempted resources for corresponding applications

[ https://issues.apache.org/jira/browse/YARN-6432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969559#comment-15969559 ] Hadoop QA commented on YARN-6432: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6432) FairScheduler: Reserve preempted resources for corresponding applications

[ https://issues.apache.org/jira/browse/YARN-6432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6432: - Attachment: YARN-6432.branch-2.patch Thank you for checking this in. Attached the branch-2 patch.

[jira] [Commented] (YARN-6344) Add parameter for rack locality delay in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969514#comment-15969514 ] Konstantinos Karanasos commented on YARN-6344: -- Hi [~Huangkx6810]. I just uploaded a patch

[jira] [Updated] (YARN-6344) Add parameter for rack locality delay in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-6344: - Attachment: YARN-6344-branch-2.8.patch Attaching patch that can be applied to

[jira] [Commented] (YARN-6363) Extending SLS: Synthetic Load Generator

[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969452#comment-15969452 ] Hadoop QA commented on YARN-6363: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3053) [Security] Review and implement authentication in ATS v.2

[ https://issues.apache.org/jira/browse/YARN-3053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969443#comment-15969443 ] Robert Kanter commented on YARN-3053: - [~varun_saxena], thanks for posting the updated doc. It sounds

[jira] [Commented] (YARN-6363) Extending SLS: Synthetic Load Generator

[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969434#comment-15969434 ] Hadoop QA commented on YARN-6363: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6433) Only accessible cgroup mount directories should be selected for a controller

[ https://issues.apache.org/jira/browse/YARN-6433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969425#comment-15969425 ] Hadoop QA commented on YARN-6433: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3666) Federation Intercepting and propagating AM-RM communications

[ https://issues.apache.org/jira/browse/YARN-3666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969407#comment-15969407 ] Subru Krishnan commented on YARN-3666: -- Thanks [~botong] for reporting the test failure. I have

[jira] [Created] (YARN-6485) [Regression] TestFederationRMStateStoreService is failing with null pointer exception

Subru Krishnan created YARN-6485: Summary: [Regression] TestFederationRMStateStoreService is failing with null pointer exception Key: YARN-6485 URL: https://issues.apache.org/jira/browse/YARN-6485

[jira] [Created] (YARN-6484) [Documentation] Documenting the YARN Federation feature

Subru Krishnan created YARN-6484: Summary: [Documentation] Documenting the YARN Federation feature Key: YARN-6484 URL: https://issues.apache.org/jira/browse/YARN-6484 Project: Hadoop YARN

[jira] [Updated] (YARN-6363) Extending SLS: Synthetic Load Generator

[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6363: --- Attachment: YARN-6363.v13.patch Documentation. > Extending SLS: Synthetic Load Generator >

[jira] [Commented] (YARN-6472) Possible Java sandbox improvements

[ https://issues.apache.org/jira/browse/YARN-6472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969372#comment-15969372 ] Miklos Szegedi commented on YARN-6472: -- Thank you, [~gphillips]. Is there any reason why

[jira] [Updated] (YARN-6363) Extending SLS: Synthetic Load Generator

[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6363: --- Attachment: YARN-6363.v12.patch Working towards yetus happiness and partial docs. > Extending SLS:

[jira] [Updated] (YARN-6433) Only accessible cgroup mount directories should be selected for a controller

[ https://issues.apache.org/jira/browse/YARN-6433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6433: - Attachment: YARN-6433.002.patch > Only accessible cgroup mount directories should be selected for

[jira] [Comment Edited] (YARN-5331) Extend RLESparseResourceAllocation with period for supporting recurring reservations in YARN ReservationSystem

[ https://issues.apache.org/jira/browse/YARN-5331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15968207#comment-15968207 ] Sean Po edited comment on YARN-5331 at 4/14/17 6:08 PM: Thanks for the patch

[jira] [Comment Edited] (YARN-3666) Federation Intercepting and propagating AM-RM communications

[ https://issues.apache.org/jira/browse/YARN-3666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969335#comment-15969335 ] Botong Huang edited comment on YARN-3666 at 4/14/17 5:57 PM: - Hi

[jira] [Commented] (YARN-3666) Federation Intercepting and propagating AM-RM communications

[ https://issues.apache.org/jira/browse/YARN-3666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969335#comment-15969335 ] Botong Huang commented on YARN-3666: [~giovanni.fumarola] and [~subru], the following test is failing

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned by the Resource Manager as a response to the Application Master heartbeat

[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969326#comment-15969326 ] Hadoop QA commented on YARN-6483: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned by the Resource Manager as a response to the Application Master heartbeat

[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Rodríguez Hortalá updated YARN-6483: - Attachment: YARN-6483.patch > Add nodes transitioning to DECOMMISSIONING state to

[jira] [Created] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned by the Resource Manager as a response to the Application Master heartbeat

Juan Rodríguez Hortalá created YARN-6483: Summary: Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned by the Resource Manager as a response to the Application Master heartbeat Key:

[jira] [Commented] (YARN-6363) Extending SLS: Synthetic Load Generator

[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969276#comment-15969276 ] Hadoop QA commented on YARN-6363: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6396) Call verifyAndCreateRemoteLogDir at service initialization instead of application initialization to decrease load for name node

[ https://issues.apache.org/jira/browse/YARN-6396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969274#comment-15969274 ] Robert Kanter commented on YARN-6396: - That's a good point about each NM doing this check for each

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969256#comment-15969256 ] Sunil G commented on YARN-5892: --- bq.Yes, the user weight of 0 case is a special one that we would like to

[jira] [Commented] (YARN-6363) Extending SLS: Synthetic Load Generator

[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969231#comment-15969231 ] Carlo Curino commented on YARN-6363: I have fixed and tested the commandline verifying both new and old

[jira] [Commented] (YARN-5881) Enable configuration of queue capacity in terms of absolute resources

[ https://issues.apache.org/jira/browse/YARN-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969225#comment-15969225 ] Sunil G commented on YARN-5881: --- Thanks [~leftnoteasy]. Yes, we can have that linear approach as you

[jira] [Updated] (YARN-6363) Extending SLS: Synthetic Load Generator

[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6363: --- Attachment: YARN-6363.v11.patch > Extending SLS: Synthetic Load Generator >

[jira] [Comment Edited] (YARN-5994) TestCapacityScheduler.testAMLimitUsage fails intermittently

[ https://issues.apache.org/jira/browse/YARN-5994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969087#comment-15969087 ] Eric Payne edited comment on YARN-5994 at 4/14/17 4:19 PM: --- Thanks [~ebadger] for

[jira] [Commented] (YARN-5994) TestCapacityScheduler.testAMLimitUsage fails intermittently

[ https://issues.apache.org/jira/browse/YARN-5994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969222#comment-15969222 ] Hudson commented on YARN-5994: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11585 (See

[jira] [Created] (YARN-6482) TestSLSRunner runs but doesn't executed jobs (.json parsing issue)

Carlo Curino created YARN-6482: -- Summary: TestSLSRunner runs but doesn't executed jobs (.json parsing issue) Key: YARN-6482 URL: https://issues.apache.org/jira/browse/YARN-6482 Project: Hadoop YARN

[jira] [Comment Edited] (YARN-6396) Call verifyAndCreateRemoteLogDir at service initialization instead of application initialization to decrease load for name node

[ https://issues.apache.org/jira/browse/YARN-6396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969197#comment-15969197 ] zhihai xu edited comment on YARN-6396 at 4/14/17 4:02 PM: -- Thanks for the review

[jira] [Commented] (YARN-6396) Call verifyAndCreateRemoteLogDir at service initialization instead of application initialization to decrease load for name node

[ https://issues.apache.org/jira/browse/YARN-6396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969199#comment-15969199 ] Haibo Chen commented on YARN-6396: -- Robert and Jian's comments remind me of that we have seen customers

[jira] [Commented] (YARN-6396) Call verifyAndCreateRemoteLogDir at service initialization instead of application initialization to decrease load for name node

[ https://issues.apache.org/jira/browse/YARN-6396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969197#comment-15969197 ] zhihai xu commented on YARN-6396: - Thanks for the review [~jianhe] and [~rkanter]! if some one deletes the

[jira] [Commented] (YARN-5994) TestCapacityScheduler.testAMLimitUsage fails intermittently

[ https://issues.apache.org/jira/browse/YARN-5994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969151#comment-15969151 ] Hadoop QA commented on YARN-5994: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2985) YARN should support to delete the aggregated logs for Non-MapReduce applications

[ https://issues.apache.org/jira/browse/YARN-2985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969088#comment-15969088 ] Jason Lowe commented on YARN-2985: -- Doing a config for branch-2 seems reasonable. bq. my understanding is

[jira] [Commented] (YARN-5994) TestCapacityScheduler.testAMLimitUsage fails intermittently

[ https://issues.apache.org/jira/browse/YARN-5994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969087#comment-15969087 ] Eric Payne commented on YARN-5994: -- Thanks [~ebadger] for reporting and fixing this issue. The only thing

[jira] [Assigned] (YARN-3839) Quit throwing NMNotYetReadyException

[ https://issues.apache.org/jira/browse/YARN-3839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned YARN-3839: Assignee: Manikandan R > Quit throwing NMNotYetReadyException >

[jira] [Comment Edited] (YARN-6462) Add yarn command to list all queues

[ https://issues.apache.org/jira/browse/YARN-6462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15968883#comment-15968883 ] Shen Yinjie edited comment on YARN-6462 at 4/14/17 10:39 AM: -

[jira] [Commented] (YARN-6462) Add yarn command to list all queues

[ https://issues.apache.org/jira/browse/YARN-6462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15968883#comment-15968883 ] Shen Yinjie commented on YARN-6462: --- [~rohithsharma],[~sunilg] bug your review..:) > Add yarn command to

[jira] [Comment Edited] (YARN-6289) Fail to achieve data locality when runing MapReduce and Spark on HDFS

[ https://issues.apache.org/jira/browse/YARN-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15968691#comment-15968691 ] Huangkaixuan edited comment on YARN-6289 at 4/14/17 6:33 AM: - Thanks,

[jira] [Commented] (YARN-6289) Fail to achieve data locality when runing MapReduce and Spark on HDFS

[ https://issues.apache.org/jira/browse/YARN-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15968691#comment-15968691 ] Huangkaixuan commented on YARN-6289: Thanks, [~leftnoteasy]. It seems work for me. I noticed the patch

[jira] [Commented] (YARN-6344) Add parameter for rack locality delay in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15968690#comment-15968690 ] Huangkaixuan commented on YARN-6344: Thanks [~kkaranasos] I noticed the patch has been merged into