[jira] [Created] (YARN-5661) transitionToActive blocks when enable work-preserving-recovery

2016-09-22 Thread fengyongshe (JIRA)
fengyongshe created YARN-5661: - Summary: transitionToActive blocks when enable work-preserving-recovery Key: YARN-5661 URL: https://issues.apache.org/jira/browse/YARN-5661 Project: Hadoop YARN I

[jira] [Updated] (YARN-5662) Provide an option to enable ContainerMonitor

2016-09-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5662: -- Description: Currently, if vmem/pmem check is not enabled, ContainerMonitor would not run. In certain cases, Con

[jira] [Updated] (YARN-5662) Provide an option to enable ContainerMonitor

2016-09-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5662: -- Release Note: (was: Currently, if vmem/pmem check is not enabled, ContainerMonitor would not run. In certain c

[jira] [Created] (YARN-5662) Provide an option to enable ContainerMonitor

2016-09-22 Thread Jian He (JIRA)
Jian He created YARN-5662: - Summary: Provide an option to enable ContainerMonitor Key: YARN-5662 URL: https://issues.apache.org/jira/browse/YARN-5662 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-5662) Provide an option to enable ContainerMonitor

2016-09-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5662: -- Attachment: YARN-5662.1.patch > Provide an option to enable ContainerMonitor > -

[jira] [Commented] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-22 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15512673#comment-15512673 ] Varun Saxena commented on YARN-5585: Just to clarify, what I meant by having another in

[jira] [Resolved] (YARN-5661) transitionToActive blocks when enable work-preserving-recovery

2016-09-22 Thread fengyongshe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fengyongshe resolved YARN-5661. --- Resolution: Duplicate > transitionToActive blocks when enable work-preserving-recovery > --

[jira] [Commented] (YARN-3877) YarnClientImpl.submitApplication swallows exceptions

2016-09-22 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15512696#comment-15512696 ] Naganarasimha G R commented on YARN-3877: - Thanks for the comments [~Ying Zhang],

[jira] [Commented] (YARN-3877) YarnClientImpl.submitApplication swallows exceptions

2016-09-22 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15512698#comment-15512698 ] Varun Saxena commented on YARN-3877: Yes. Somebody needs to commit it. Will look at kil

[jira] [Commented] (YARN-2255) YARN Audit logging not added to log4j.properties

2016-09-22 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15512721#comment-15512721 ] Varun Saxena commented on YARN-2255: Ok...Please go ahead. > YARN Audit logging not ad

[jira] [Commented] (YARN-5662) Provide an option to enable ContainerMonitor

2016-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15512728#comment-15512728 ] Hadoop QA commented on YARN-5662: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-3877) YarnClientImpl.submitApplication swallows exceptions

2016-09-22 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3877: --- Attachment: YARN-3877.04.patch > YarnClientImpl.submitApplication swallows exceptions > ---

[jira] [Commented] (YARN-3877) YarnClientImpl.submitApplication swallows exceptions

2016-09-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15512989#comment-15512989 ] Steve Loughran commented on YARN-3877: -- was this ever committed? I guess not > YarnCl

[jira] [Commented] (YARN-3877) YarnClientImpl.submitApplication swallows exceptions

2016-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15512997#comment-15512997 ] Hadoop QA commented on YARN-3877: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-3877) YarnClientImpl.submitApplication swallows exceptions

2016-09-22 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15513003#comment-15513003 ] Naganarasimha G R commented on YARN-3877: - Thanks for the patch [~varun_saxena], wi

[jira] [Updated] (YARN-5539) TimelineClient failed to retry on "java.net.SocketTimeoutException: Read timed out"

2016-09-22 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-5539: - Attachment: YARN-5539.patch Attach a quick patch to fix for corner case here. The fix It is very straight-

[jira] [Commented] (YARN-5539) TimelineClient failed to retry on "java.net.SocketTimeoutException: Read timed out"

2016-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15513130#comment-15513130 ] Hadoop QA commented on YARN-5539: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4743) ResourceManager crash because TimSort

2016-09-22 Thread stefanlee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15513222#comment-15513222 ] stefanlee commented on YARN-4743: - Thanks [~yufeigu] ,i also met this problem,my scenario i

[jira] [Commented] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15513407#comment-15513407 ] Jian He commented on YARN-3139: --- [~templedf], would you like to check the FairScheduler chang

[jira] [Commented] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15513416#comment-15513416 ] Jian He commented on YARN-3139: --- May be it's related to some consistency issues with respect

[jira] [Comment Edited] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15513402#comment-15513402 ] Jian He edited comment on YARN-3139 at 9/22/16 2:20 PM: There are a

[jira] [Issue Comment Deleted] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-3139: -- Comment: was deleted (was: May be it's related to some consistency issues with respect to queue stats?) > Impro

[jira] [Commented] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15513402#comment-15513402 ] Jian He commented on YARN-3139: --- There are also similar comments like this... I just couldn't

[jira] [Commented] (YARN-5609) Expose upgrade and restart API in ContainerManagementProtocol

2016-09-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15513480#comment-15513480 ] Jian He commented on YARN-5609: --- looks good to me overall, I think wherever {{setIsReInitial

[jira] [Comment Edited] (YARN-5609) Expose upgrade and restart API in ContainerManagementProtocol

2016-09-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15513480#comment-15513480 ] Jian He edited comment on YARN-5609 at 9/22/16 2:44 PM: looks good

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15513545#comment-15513545 ] Sunil G commented on YARN-2009: --- Thanks [~eepayne] for the comments. Mostly makes sense, I wi

[jira] [Created] (YARN-5663) Possible resource leak

2016-09-22 Thread Oleksii Dymytrov (JIRA)
Oleksii Dymytrov created YARN-5663: -- Summary: Possible resource leak Key: YARN-5663 URL: https://issues.apache.org/jira/browse/YARN-5663 Project: Hadoop YARN Issue Type: Bug Compon

[jira] [Updated] (YARN-5663) Possible resource leak

2016-09-22 Thread Oleksii Dymytrov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oleksii Dymytrov updated YARN-5663: --- Attachment: YARN_5663_v1_001_patch.patch > Possible resource leak > -- > >

[jira] [Commented] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-22 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15513703#comment-15513703 ] Tsuyoshi Ozawa commented on YARN-3139: -- [~leftnoteasy] [~jianhe] thanks for taking thi

[jira] [Commented] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15513717#comment-15513717 ] Daniel Templeton commented on YARN-3139: Yep. I added it to my todo list, but I wo

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-22 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15513725#comment-15513725 ] Eric Payne commented on YARN-2009: -- [~leftnoteasy], I have some concerns about this algori

[jira] [Commented] (YARN-5663) Possible resource leak

2016-09-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15513754#comment-15513754 ] Daniel Templeton commented on YARN-5663: I don't think that's actually a leak, but

[jira] [Commented] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-22 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15513781#comment-15513781 ] Sangjin Lee commented on YARN-5585: --- Thanks for your comments [~varun_saxena]. Yes, we sh

[jira] [Commented] (YARN-4743) ResourceManager crash because TimSort

2016-09-22 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15513806#comment-15513806 ] Yufei Gu commented on YARN-4743: Hi [~imstefanlee], continous scheduling uses the same code

[jira] [Commented] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15513815#comment-15513815 ] Wangda Tan commented on YARN-3139: -- Actually we need to hold application's lock when this

[jira] [Commented] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15513822#comment-15513822 ] Wangda Tan commented on YARN-3139: -- [~ozawa], Yeah we plan to add multi-threading schedul

[jira] [Commented] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15513827#comment-15513827 ] Wangda Tan commented on YARN-3139: -- Thanks [~templedf], but I really want to get this done

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15513840#comment-15513840 ] Sunil G commented on YARN-2009: --- Hi [~eepayne] Couple of doubts on the comments. bq.Shouldn

[jira] [Commented] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15513883#comment-15513883 ] Karthik Kambatla commented on YARN-3139: Sorry [~leftnoteasy]. I will be traveling

[jira] [Commented] (YARN-5605) Preempt containers (all on one node) to meet the requirement of starved applications

2016-09-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15513914#comment-15513914 ] Daniel Templeton commented on YARN-5605: I think I'm happy with the last patch. +1

[jira] [Commented] (YARN-4266) Allow whitelisted users to disable user re-mapping/squashing when launching docker containers

2016-09-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15513926#comment-15513926 ] Daniel Templeton commented on YARN-4266: After some discussion and thought, I think

[jira] [Comment Edited] (YARN-4266) Allow whitelisted users to disable user re-mapping/squashing when launching docker containers

2016-09-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15513926#comment-15513926 ] Daniel Templeton edited comment on YARN-4266 at 9/22/16 5:40 PM:

[jira] [Comment Edited] (YARN-4743) ResourceManager crash because TimSort

2016-09-22 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15513806#comment-15513806 ] Yufei Gu edited comment on YARN-4743 at 9/22/16 5:46 PM: - Hi [~imst

[jira] [Commented] (YARN-5145) [YARN-3368] Move new YARN UI configuration to HADOOP_CONF_DIR

2016-09-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514003#comment-15514003 ] Wangda Tan commented on YARN-5145: -- Thanks [~kaisasak] and [~sunilg] looking into the issu

[jira] [Updated] (YARN-4329) Allow fetching exact reason as to why a submitted app is in ACCEPTED state in Fair Scheduler

2016-09-22 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4329: --- Attachment: YARN-4329.001.patch > Allow fetching exact reason as to why a submitted app is in ACCEPTED state in

[jira] [Updated] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

2016-09-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-4464: --- Attachment: YARN-4464.006.patch The docs are already correct. I foolishly believed them that t

[jira] [Commented] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-22 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514243#comment-15514243 ] Varun Saxena commented on YARN-5585: Summarizing the solution we decided upon in the ca

[jira] [Comment Edited] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-22 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514243#comment-15514243 ] Varun Saxena edited comment on YARN-5585 at 9/22/16 7:25 PM: - S

[jira] [Commented] (YARN-5659) getPathFromYarnURL should use standard methods

2016-09-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514302#comment-15514302 ] Daniel Templeton commented on YARN-5659: The checkstyle and whitespace issue (both

[jira] [Commented] (YARN-4329) Allow fetching exact reason as to why a submitted app is in ACCEPTED state in Fair Scheduler

2016-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514370#comment-15514370 ] Hadoop QA commented on YARN-4329: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Updated] (YARN-5659) getPathFromYarnURL should use standard methods

2016-09-22 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated YARN-5659: --- Attachment: YARN-5659.04.patch whitespace fixes... > getPathFromYarnURL should use standard me

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-22 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514393#comment-15514393 ] Eric Payne commented on YARN-2009: -- bq. So we could take a max(guaranteed, used). Will thi

[jira] [Commented] (YARN-3142) Improve locks in AppSchedulingInfo

2016-09-22 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514396#comment-15514396 ] Varun Saxena commented on YARN-3142: Thanks [~leftnoteasy], [~sunilg] for reviews. bq

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514405#comment-15514405 ] Wangda Tan commented on YARN-2009: -- Hi [~eepayne], bq. If Queue1 has 100 resources, and i

[jira] [Commented] (YARN-3142) Improve locks in AppSchedulingInfo

2016-09-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514415#comment-15514415 ] Wangda Tan commented on YARN-3142: -- [~varun_saxena], bq. But we wont be using this till

[jira] [Commented] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

2016-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514414#comment-15514414 ] Hadoop QA commented on YARN-4464: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (YARN-3142) Improve locks in AppSchedulingInfo

2016-09-22 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514396#comment-15514396 ] Varun Saxena edited comment on YARN-3142 at 9/22/16 8:30 PM: - T

[jira] [Updated] (YARN-3142) Improve locks in AppSchedulingInfo

2016-09-22 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3142: --- Attachment: YARN-3142.02.patch > Improve locks in AppSchedulingInfo > -

[jira] [Commented] (YARN-3142) Improve locks in AppSchedulingInfo

2016-09-22 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514449#comment-15514449 ] Varun Saxena commented on YARN-3142: Updated the patch after fixing review comments and

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-22 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514480#comment-15514480 ] Eric Payne commented on YARN-2009: -- [~leftnoteasy], Thanks. I missed that. > Priority sup

[jira] [Commented] (YARN-5659) getPathFromYarnURL should use standard methods

2016-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514558#comment-15514558 ] Hadoop QA commented on YARN-5659: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5104) TestNMProxy.testNMProxyRPCRetry failed

2016-09-22 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514589#comment-15514589 ] Yufei Gu commented on YARN-5104: This has been fixed by HADOOP-11212. With HADOOP-11212, So

[jira] [Resolved] (YARN-5104) TestNMProxy.testNMProxyRPCRetry failed

2016-09-22 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu resolved YARN-5104. Resolution: Duplicate > TestNMProxy.testNMProxyRPCRetry failed > -- > >

[jira] [Commented] (YARN-4493) move queue can make app don't belong to any queue

2016-09-22 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514602#comment-15514602 ] Yufei Gu commented on YARN-4493: I will close this as invalid. Feel free to reopen it if yo

[jira] [Commented] (YARN-5400) Light cleanup in ZKRMStateStore

2016-09-22 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514632#comment-15514632 ] Robert Kanter commented on YARN-5400: - +1 pending Jenkins > Light cleanup in ZKRMState

[jira] [Commented] (YARN-3142) Improve locks in AppSchedulingInfo

2016-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514649#comment-15514649 ] Hadoop QA commented on YARN-3142: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5324) Stateless router policies implementation

2016-09-22 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514674#comment-15514674 ] Subru Krishnan commented on YARN-5324: -- +1 on the latest patch, thanks [~curino] for a

[jira] [Commented] (YARN-5659) getPathFromYarnURL should use standard methods

2016-09-22 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514660#comment-15514660 ] Sergey Shelukhin commented on YARN-5659: Apparently editing patches directly is not

[jira] [Updated] (YARN-5659) getPathFromYarnURL should use standard methods

2016-09-22 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated YARN-5659: --- Attachment: YARN-5659.04.patch The patch without a spurious change.. > getPathFromYarnURL shou

[jira] [Updated] (YARN-5324) Stateless router policies implementation

2016-09-22 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-5324: --- Attachment: YARN-5324-YARN-2915.16.patch > Stateless router policies implementation > -

[jira] [Commented] (YARN-5324) Stateless router policies implementation

2016-09-22 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514704#comment-15514704 ] Carlo Curino commented on YARN-5324: [~subru] thanks for reviewing. I addressed the nit

[jira] [Commented] (YARN-5400) Light cleanup in ZKRMStateStore

2016-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514757#comment-15514757 ] Hadoop QA commented on YARN-5400: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5324) Stateless router policies implementation

2016-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514760#comment-15514760 ] Hadoop QA commented on YARN-5324: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5400) Light cleanup in ZKRMStateStore

2016-09-22 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514765#comment-15514765 ] Robert Kanter commented on YARN-5400: - Test failure appears to be YARN-5057. [~templed

[jira] [Commented] (YARN-5659) getPathFromYarnURL should use standard methods

2016-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514795#comment-15514795 ] Hadoop QA commented on YARN-5659: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-4973) YarnWebParams next.fresh.interval should be next.refresh.interval

2016-09-22 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514824#comment-15514824 ] Robert Kanter commented on YARN-4973: - +1 > YarnWebParams next.fresh.interval should b

[jira] [Updated] (YARN-5324) Stateless Federation router policies implementation

2016-09-22 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-5324: - Summary: Stateless Federation router policies implementation (was: Stateless router policies imple

[jira] [Commented] (YARN-4973) YarnWebParams next.fresh.interval should be next.refresh.interval

2016-09-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514885#comment-15514885 ] Hudson commented on YARN-4973: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1047

[jira] [Commented] (YARN-3877) YarnClientImpl.submitApplication swallows exceptions

2016-09-22 Thread Xabriel J Collazo Mojica (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514903#comment-15514903 ] Xabriel J Collazo Mojica commented on YARN-3877: Folks, I see that the {{In

[jira] [Commented] (YARN-3692) Allow REST API to set a user generated message when killing an application

2016-09-22 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15515000#comment-15515000 ] Naganarasimha G R commented on YARN-3692: - [~rohithsharma], Seems like patch doesnt

[jira] [Updated] (YARN-4907) Make all MockRM#waitForState consistent.

2016-09-22 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4907: --- Attachment: YARN-4907.001.patch > Make all MockRM#waitForState consistent. > -

[jira] [Comment Edited] (YARN-4907) Make all MockRM#waitForState consistent.

2016-09-22 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15515008#comment-15515008 ] Yufei Gu edited comment on YARN-4907 at 9/23/16 1:14 AM: - Some {{wa

[jira] [Commented] (YARN-4907) Make all MockRM#waitForState consistent.

2016-09-22 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15515008#comment-15515008 ] Yufei Gu commented on YARN-4907: Some {{waitForState}} return a boolean since the caller ne

[jira] [Commented] (YARN-5145) [YARN-3368] Move new YARN UI configuration to HADOOP_CONF_DIR

2016-09-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15515024#comment-15515024 ] Weiwei Yang commented on YARN-5145: --- Hello [~leftnoteasy] If all configuration are set i

[jira] [Commented] (YARN-3692) Allow REST API to set a user generated message when killing an application

2016-09-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15515059#comment-15515059 ] Hudson commented on YARN-3692: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1047

[jira] [Commented] (YARN-4743) ResourceManager crash because TimSort

2016-09-22 Thread stefanlee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15515206#comment-15515206 ] stefanlee commented on YARN-4743: - Thanks ,my hadoop version is 2.4.0 and i just found that

[jira] [Commented] (YARN-4767) Network issues can cause persistent RM UI outage

2016-09-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15515210#comment-15515210 ] Daniel Templeton commented on YARN-4767: The javadoc complaints are all about the f

[jira] [Updated] (YARN-5400) Light cleanup in ZKRMStateStore

2016-09-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-5400: --- Attachment: YARN-5400.002.patch Here's a patch to resolve the javadoc issues and a couple extra

[jira] [Commented] (YARN-4907) Make all MockRM#waitForState consistent.

2016-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15515276#comment-15515276 ] Hadoop QA commented on YARN-4907: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-5388) MAPREDUCE-6719 requires changes to DockerContainerExecutor

2016-09-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15515328#comment-15515328 ] Daniel Templeton commented on YARN-5388: [~sidharta-s], [~vvasudev], any chance you

[jira] [Commented] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

2016-09-22 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15515334#comment-15515334 ] Naganarasimha G R commented on YARN-4464: - Thanks [~templedf], +1, Latest patch LGT

[jira] [Commented] (YARN-5400) Light cleanup in ZKRMStateStore

2016-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15515405#comment-15515405 ] Hadoop QA commented on YARN-5400: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-5662) Provide an option to enable ContainerMonitor

2016-09-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5662: -- Attachment: YARN-5662.2.patch > Provide an option to enable ContainerMonitor > -

[jira] [Updated] (YARN-5551) Ignore deleted file mapping from memory computation when smaps is enabled

2016-09-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated YARN-5551: --- Attachment: YARN-5551.branch-2.002.patch Attaching .2 version which takes into account "anonymo

[jira] [Comment Edited] (YARN-5551) Ignore deleted file mapping from memory computation when smaps is enabled

2016-09-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15515481#comment-15515481 ] Rajesh Balamohan edited comment on YARN-5551 at 9/23/16 5:43 AM:

[jira] [Updated] (YARN-3142) Improve locks in AppSchedulingInfo

2016-09-22 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3142: --- Attachment: YARN-3142.03.patch > Improve locks in AppSchedulingInfo > -

[jira] [Commented] (YARN-5539) TimelineClient failed to retry on "java.net.SocketTimeoutException: Read timed out"

2016-09-22 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15515549#comment-15515549 ] Varun Saxena commented on YARN-5539: +1 Will commit it shortly. > TimelineClient faile

[jira] [Commented] (YARN-5610) Initial code for native services REST API

2016-09-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15515597#comment-15515597 ] Jian He commented on YARN-5610: --- bq. The reason these attributes are at the Application level