[jira] [Commented] (YARN-6424) TimelineCollector is not stopped when an app finishes in RM

2017-04-05 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15958299#comment-15958299 ] Rohith Sharma K S commented on YARN-6424: - Yes it is bug!! I committed to trunk and

[jira] [Updated] (YARN-6424) TimelineCollector is not stopped when an app finishes in RM

2017-04-05 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-6424: Fix Version/s: 3.0.0-alpha3 YARN-5355-branch-2 > TimelineCollector is not

[jira] [Updated] (YARN-6424) TimelineCollector is not stopped when an app finishes in RM

2017-04-05 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-6424: Issue Type: Bug (was: Sub-task) Parent: (was: YARN-5355) > TimelineCollector is

[jira] [Commented] (YARN-6403) Invalid local resource request can raise NPE and make NM exit

2017-04-05 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15958249#comment-15958249 ] Tao Yang commented on YARN-6403: [~jlowe], thanks for review and committing! > Invalid local resource

[jira] [Created] (YARN-6453) fairscheduler-statedump.log gets generated regardless of configured scheduler

2017-04-05 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created YARN-6453: -- Summary: fairscheduler-statedump.log gets generated regardless of configured scheduler Key: YARN-6453 URL: https://issues.apache.org/jira/browse/YARN-6453

[jira] [Commented] (YARN-6091) the AppMaster register failed when use Docker on LinuxContainer

2017-04-05 Thread zhengchenyu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15958176#comment-15958176 ] zhengchenyu commented on YARN-6091: --- I just changed the judging condition of pclose's return code, then

[jira] [Commented] (YARN-6368) Decommissioning an NM results in a -1 exit code

2017-04-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15958111#comment-15958111 ] Miklos Szegedi commented on YARN-6368: -- I cannot repro this. It must be a flaky test. Moreover this is

[jira] [Created] (YARN-6452) test-container-executor should not be in bin in dist tarball

2017-04-05 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created YARN-6452: -- Summary: test-container-executor should not be in bin in dist tarball Key: YARN-6452 URL: https://issues.apache.org/jira/browse/YARN-6452 Project: Hadoop YARN

[jira] [Commented] (YARN-6195) Export UsedCapacity and AbsoluteUsedCapacity to JMX

2017-04-05 Thread Benson Qiu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15958090#comment-15958090 ] Benson Qiu commented on YARN-6195: -- Version 5 outputs usedCapacity and absoluteUsedCapacity for the

[jira] [Assigned] (YARN-5949) Add PluggableConfigurationPolicy interface as a component of MutableConfigurationManager

2017-04-05 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung reassigned YARN-5949: --- Assignee: Jonathan Hung > Add PluggableConfigurationPolicy interface as a component of >

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-04-05 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15958056#comment-15958056 ] Konstantinos Karanasos commented on YARN-6344: -- Thanks for the feedback, [~jlowe]. Indeed

[jira] [Commented] (YARN-6381) FSAppAttempt has several variables that should be final

2017-04-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15958044#comment-15958044 ] Hudson commented on YARN-6381: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11536 (See

[jira] [Commented] (YARN-6368) Decommissioning an NM results in a -1 exit code

2017-04-05 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15958009#comment-15958009 ] Robert Kanter commented on YARN-6368: - [~miklos.szeg...@cloudera.com], I was about to commit this but I

[jira] [Commented] (YARN-6448) Continuous scheduling thread crashes while sorting nodes

2017-04-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15958001#comment-15958001 ] Hudson commented on YARN-6448: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11535 (See

[jira] [Commented] (YARN-6439) Fix ReservationSystem creation of default ReservationQueue

2017-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957993#comment-15957993 ] Hadoop QA commented on YARN-6439: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (YARN-6448) Continuous scheduling thread crashes while sorting nodes

2017-04-05 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved YARN-6448. Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Just committed

[jira] [Commented] (YARN-6195) Export UsedCapacity and AbsoluteUsedCapacity to JMX

2017-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957958#comment-15957958 ] Hadoop QA commented on YARN-6195: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6448) Continuous scheduling thread crashes while sorting nodes

2017-04-05 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-6448: --- Summary: Continuous scheduling thread crashes while sorting nodes (was: Continuous scheduling

[jira] [Commented] (YARN-6448) Continuous scheduling thread crash while sorting nodes

2017-04-05 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957939#comment-15957939 ] Karthik Kambatla commented on YARN-6448: +1. Committing this based on the Jenkins run against v2

[jira] [Updated] (YARN-6448) Continuous scheduling thread crash while sorting nodes

2017-04-05 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6448: --- Attachment: YARN-6448.004.patch > Continuous scheduling thread crash while sorting nodes >

[jira] [Commented] (YARN-6448) Continuous scheduling thread crash while sorting nodes

2017-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957933#comment-15957933 ] Hadoop QA commented on YARN-6448: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2017-04-05 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957929#comment-15957929 ] Chris Trezzo commented on YARN-5797: Branch-2 test failures are unrelated. From my perspective the

[jira] [Updated] (YARN-6448) Continuous scheduling thread crash while sorting nodes

2017-04-05 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6448: --- Attachment: YARN-6448.003.patch Patch v3 change the unit test name. > Continuous scheduling thread crash

[jira] [Commented] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2017-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957915#comment-15957915 ] Hadoop QA commented on YARN-5797: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6439) Fix ReservationSystem creation of default ReservationQueue

2017-04-05 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6439: --- Attachment: YARN-6439.v2.patch > Fix ReservationSystem creation of default ReservationQueue >

[jira] [Commented] (YARN-6439) Fix ReservationSystem creation of default ReservationQueue

2017-04-05 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957856#comment-15957856 ] Carlo Curino commented on YARN-6439: Fixed the checkstyle... The

[jira] [Commented] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957850#comment-15957850 ] Hadoop QA commented on YARN-6363: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-04-05 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957849#comment-15957849 ] Jason Lowe commented on YARN-6344: -- I'd prefer a configured rack locality delay of zero means no

[jira] [Commented] (YARN-6091) the AppMaster register failed when use Docker on LinuxContainer

2017-04-05 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957837#comment-15957837 ] Eric Badger commented on YARN-6091: --- I think the issue is that the container-executor is calling pclose()

[jira] [Commented] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2017-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957836#comment-15957836 ] Hadoop QA commented on YARN-5797: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6448) Continuous scheduling thread crash while sorting nodes

2017-04-05 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6448: --- Summary: Continuous scheduling thread crash while sorting nodes (was: Add back the lock in continuous

[jira] [Updated] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-04-05 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6363: --- Attachment: YARN-6363.v7.patch (missed one method rename) > Extending SLS: Synthetic Load Generator >

[jira] [Commented] (YARN-6439) Fix ReservationSystem creation of default ReservationQueue

2017-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957835#comment-15957835 ] Hadoop QA commented on YARN-6439: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6448) Add back the lock in continuous scheduling while sorting nodes

2017-04-05 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6448: --- Description: YARN-4719 remove the lock in continuous scheduling while sorting nodes. It breaks the order in

[jira] [Updated] (YARN-6448) Add back the lock in continuous scheduling while sorting nodes

2017-04-05 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6448: --- Description: YARN-4719 remove the lock in continuous scheduling while sorting nodes. It breaks the order in

[jira] [Commented] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957826#comment-15957826 ] Hadoop QA commented on YARN-6363: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-04-05 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6363: --- Attachment: YARN-6363.v6.patch Fixing dirty shutdown issue > Extending SLS: Synthetic Load Generator

[jira] [Assigned] (YARN-6443) Allow for Priority order relaxing in favor of improved node/rack locality

2017-04-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-6443: - Assignee: Hitesh Sharma (was: Arun Suresh) > Allow for Priority order relaxing in favor of

[jira] [Commented] (YARN-6448) Add back the lock in continuous scheduling while sorting nodes

2017-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957810#comment-15957810 ] Hadoop QA commented on YARN-6448: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2017-04-05 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957794#comment-15957794 ] Chris Trezzo edited comment on YARN-5797 at 4/5/17 9:43 PM: Also attached is a

[jira] [Created] (YARN-6451) Create a monitor to check whether we maintain RM (scheduling) invariants

2017-04-05 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-6451: -- Summary: Create a monitor to check whether we maintain RM (scheduling) invariants Key: YARN-6451 URL: https://issues.apache.org/jira/browse/YARN-6451 Project: Hadoop

[jira] [Updated] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2017-04-05 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-5797: --- Attachment: YARN-5797-branch-2.001.patch Also attached is a v1 branch-2 patch. The only conflict was

[jira] [Updated] (YARN-6448) Add back the lock in continuous scheduling while sorting nodes

2017-04-05 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6448: --- Attachment: YARN-6448.002.patch > Add back the lock in continuous scheduling while sorting nodes >

[jira] [Commented] (YARN-6448) Add back the lock in continuous scheduling while sorting nodes

2017-04-05 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957768#comment-15957768 ] Yufei Gu commented on YARN-6448: Patch v2 add a unit test. > Add back the lock in continuous scheduling

[jira] [Commented] (YARN-3760) FSDataOutputStream leak in AggregatedLogFormat.LogWriter.close()

2017-04-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957749#comment-15957749 ] Miklos Szegedi commented on YARN-3760: -- +1 (non-binding) > FSDataOutputStream leak in

[jira] [Assigned] (YARN-3760) FSDataOutputStream leak in AggregatedLogFormat.LogWriter.close()

2017-04-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-3760: Assignee: Miklos Szegedi (was: Haibo Chen) > FSDataOutputStream leak in

[jira] [Updated] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2017-04-05 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-5797: --- Attachment: YARN-5797-trunk.003.patch Attached is a v3 patch that is rebased on trunk. > Add metrics

[jira] [Commented] (YARN-6445) Improve YARN-3926 performance with respect to SLS

2017-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957705#comment-15957705 ] Hadoop QA commented on YARN-6445: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3760) FSDataOutputStream leak in AggregatedLogFormat.LogWriter.close()

2017-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957698#comment-15957698 ] Hadoop QA commented on YARN-3760: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6449) Enable YARN to accept jobs with < 1 core allocations

2017-04-05 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957687#comment-15957687 ] Karthik Kambatla commented on YARN-6449: Which scheduler are you using? FairScheduler already

[jira] [Commented] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-04-05 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957655#comment-15957655 ] Carlo Curino commented on YARN-6363: [~wangda] I believe I addressed your concerns, and added the

[jira] [Commented] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-04-05 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957657#comment-15957657 ] Carlo Curino commented on YARN-6363: QA rightfully gripes because we depend on YARN-6439. > Extending

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-04-05 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957652#comment-15957652 ] Konstantinos Karanasos commented on YARN-6344: -- Thanks for checking the patch, [~leftnoteasy].

[jira] [Updated] (YARN-6435) [ATSv2] Can't retrieve more than 1000 versions of metrics in time series

2017-04-05 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-6435: --- Issue Type: Sub-task (was: Bug) Parent: YARN-5355 > [ATSv2] Can't retrieve more than 1000

[jira] [Commented] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957638#comment-15957638 ] Hadoop QA commented on YARN-6363: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6437) TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently

2017-04-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957640#comment-15957640 ] Hudson commented on YARN-6437: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11532 (See

[jira] [Updated] (YARN-6448) Add back the lock in continuous scheduling while sorting nodes

2017-04-05 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6448: --- Attachment: YARN-6448.001.patch > Add back the lock in continuous scheduling while sorting nodes >

[jira] [Updated] (YARN-6450) TestContainerManagerWithLCE requires override for each new test added to ContainerManagerTest

2017-04-05 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-6450: - Attachment: YARN-6450.001.patch Using {{Assume.assumeTrue(shouldRunTest())}} in the existing setup

[jira] [Created] (YARN-6450) TestContainerManagerWithLCE requires override for each new test added to ContainerManagerTest

2017-04-05 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-6450: Summary: TestContainerManagerWithLCE requires override for each new test added to ContainerManagerTest Key: YARN-6450 URL: https://issues.apache.org/jira/browse/YARN-6450

[jira] [Updated] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-04-05 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6363: --- Attachment: YARN-6363.v5.patch > Extending SLS: Synthetic Load Generator >

[jira] [Updated] (YARN-3760) FSDataOutputStream leak in AggregatedLogFormat.LogWriter.close()

2017-04-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-3760: - Attachment: YARN-3760.01.patch Updated the patch to address Miklos' comment per offline discussion. >

[jira] [Commented] (YARN-6448) Add back the lock in continuous scheduling while sorting nodes

2017-04-05 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957606#comment-15957606 ] Yufei Gu commented on YARN-6448: According to my tests, any changes to {{unallocatedResource}} of a node

[jira] [Updated] (YARN-6195) Export UsedCapacity and AbsoluteUsedCapacity to JMX

2017-04-05 Thread Benson Qiu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benson Qiu updated YARN-6195: - Attachment: YARN-6195.005.patch > Export UsedCapacity and AbsoluteUsedCapacity to JMX >

[jira] [Commented] (YARN-5602) Utils for Federation State and Policy Store

2017-04-05 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957540#comment-15957540 ] Subru Krishnan commented on YARN-5602: -- Thanks [~giovanni.fumarola] for addressing my comments. +1 on

[jira] [Commented] (YARN-6381) FSAppAttempt has several variables that should be final

2017-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957539#comment-15957539 ] Hadoop QA commented on YARN-6381: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6195) Export UsedCapacity and AbsoluteUsedCapacity to JMX

2017-04-05 Thread Benson Qiu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957532#comment-15957532 ] Benson Qiu commented on YARN-6195: -- I will fix the findbugs issue from HadoopQA. > Export UsedCapacity

[jira] [Commented] (YARN-6449) Enable YARN to accept jobs with < 1 core allocations

2017-04-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957495#comment-15957495 ] Miklos Szegedi commented on YARN-6449: -- vcore is a setting per container. Another option is to use

[jira] [Commented] (YARN-6438) Code can be improved in ContainersMonitorImpl.java

2017-04-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957488#comment-15957488 ] Miklos Szegedi commented on YARN-6438: -- Thank you, [~yufeigu]. > Code can be improved in

[jira] [Commented] (YARN-6449) Enable YARN to accept jobs with < 1 core allocations

2017-04-05 Thread Daniel Tomes (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957484#comment-15957484 ] Daniel Tomes commented on YARN-6449: [~miklos.szeg...@cloudera.com] That would work in theory but that

[jira] [Commented] (YARN-6449) Enable YARN to accept jobs with < 1 core allocations

2017-04-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957478#comment-15957478 ] Miklos Szegedi commented on YARN-6449: -- [~Jrtorres42], thank you for the suggestion. Why do not you

[jira] [Commented] (YARN-6449) Enable YARN to accept jobs with < 1 core allocations

2017-04-05 Thread Daniel Tomes (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957479#comment-15957479 ] Daniel Tomes commented on YARN-6449: I realize this topic has been discussed in detail but thought it

[jira] [Commented] (YARN-5366) Add support for toggling the removal of completed and failed docker containers

2017-04-05 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957458#comment-15957458 ] Vinod Kumar Vavilapalli commented on YARN-5366: --- bq. While it is possible to do a docker kill

[jira] [Updated] (YARN-6449) Enable YARN to accept jobs with < 1 core allocations

2017-04-05 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6449: --- Issue Type: Improvement (was: Bug) > Enable YARN to accept jobs with < 1 core allocations >

[jira] [Created] (YARN-6449) Enable YARN to accept jobs with < 1 core allocations

2017-04-05 Thread Daniel Tomes (JIRA)
Daniel Tomes created YARN-6449: -- Summary: Enable YARN to accept jobs with < 1 core allocations Key: YARN-6449 URL: https://issues.apache.org/jira/browse/YARN-6449 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-6448) Add back the lock in continuous scheduling while sorting nodes

2017-04-05 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957436#comment-15957436 ] Yufei Gu commented on YARN-6448: Seems better to add a write lock in {{ClusterNodeTracker#sortedNodeList}}.

[jira] [Commented] (YARN-6406) Remove SchedulerRequestKeys when no more pending ResourceRequest

2017-04-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957432#comment-15957432 ] Hudson commented on YARN-6406: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11531 (See

[jira] [Commented] (YARN-5602) Utils for Federation State and Policy Store

2017-04-05 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957431#comment-15957431 ] Giovanni Matteo Fumarola commented on YARN-5602: Thanks [~subru] for reviewing the patch.

[jira] [Commented] (YARN-6195) Export UsedCapacity and AbsoluteUsedCapacity to JMX

2017-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957423#comment-15957423 ] Hadoop QA commented on YARN-6195: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-04-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957412#comment-15957412 ] Wangda Tan commented on YARN-6344: -- Thanks [~kkaranasos], {code} 281 private int

[jira] [Commented] (YARN-6438) Code can be improved in ContainersMonitorImpl.java

2017-04-05 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957408#comment-15957408 ] Yufei Gu commented on YARN-6438: +1 (non-binding) > Code can be improved in ContainersMonitorImpl.java >

[jira] [Created] (YARN-6448) Add back the lock in continuous scheduling while sorting nodes

2017-04-05 Thread Yufei Gu (JIRA)
Yufei Gu created YARN-6448: -- Summary: Add back the lock in continuous scheduling while sorting nodes Key: YARN-6448 URL: https://issues.apache.org/jira/browse/YARN-6448 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-5602) Utils for Federation State and Policy Store

2017-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957391#comment-15957391 ] Hadoop QA commented on YARN-5602: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6406) Remove SchedulerRequestKeys when no more pending ResourceRequest

2017-04-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957387#comment-15957387 ] Wangda Tan commented on YARN-6406: -- [~asuresh], I committed but forgot push to trunk yesterday. Just

[jira] [Commented] (YARN-6004) Refactor TestResourceLocalizationService#testDownloadingResourcesOnContainer so that it is less than 150 lines

2017-04-05 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957380#comment-15957380 ] Chris Trezzo commented on YARN-6004: Thanks [~mingma]! > Refactor

[jira] [Commented] (YARN-6381) FSAppAttempt has several variables that should be final

2017-04-05 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957363#comment-15957363 ] Daniel Templeton commented on YARN-6381: LGTM +1 I'll commit in a bit. > FSAppAttempt has several

[jira] [Commented] (YARN-6438) Code can be improved in ContainersMonitorImpl.java

2017-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957335#comment-15957335 ] Hadoop QA commented on YARN-6438: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5602) Utils for Federation State and Policy Store

2017-04-05 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-5602: --- Attachment: (was: YARN-5602-YARN-2915.v6.patch) > Utils for Federation

[jira] [Updated] (YARN-5602) Utils for Federation State and Policy Store

2017-04-05 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-5602: --- Attachment: YARN-5602-YARN-2915.v6.patch > Utils for Federation State and

[jira] [Commented] (YARN-6403) Invalid local resource request can raise NPE and make NM exit

2017-04-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957322#comment-15957322 ] Hudson commented on YARN-6403: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11530 (See

[jira] [Commented] (YARN-6443) Allow for Priority order relaxing in favor of improved node/rack locality

2017-04-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957308#comment-15957308 ] Arun Suresh commented on YARN-6443: --- (+ [~hrsharma] , [~roniburd] since they've been investigating very

[jira] [Commented] (YARN-6403) Invalid local resource request can raise NPE and make NM exit

2017-04-05 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957290#comment-15957290 ] Jason Lowe commented on YARN-6403: -- +1 for the latest trunk and 2.8 patches. Committing this. > Invalid

[jira] [Updated] (YARN-6438) Code can be improved in ContainersMonitorImpl.java

2017-04-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6438: - Attachment: YARN-6438.002.patch Addressing comments > Code can be improved in

[jira] [Commented] (YARN-6438) Code can be improved in ContainersMonitorImpl.java

2017-04-05 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957278#comment-15957278 ] Yufei Gu commented on YARN-6438: Patch looks good. Only one nit, this comments should be rewrite. {code}

[jira] [Updated] (YARN-6438) Code can be improved in ContainersMonitorImpl.java

2017-04-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6438: - Attachment: YARN-6438.001.patch Thank you for the review [~yufeigu]. Addressing the comments >

[jira] [Commented] (YARN-3760) FSDataOutputStream leak in AggregatedLogFormat.LogWriter.close()

2017-04-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957202#comment-15957202 ] Haibo Chen commented on YARN-3760: -- [~miklos.szeg...@cloudera.com] Both the writer and the

[jira] [Commented] (YARN-6403) Invalid local resource request can raise NPE and make NM exit

2017-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957174#comment-15957174 ] Hadoop QA commented on YARN-6403: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5531) UnmanagedAM pool manager for federating application across clusters

2017-04-05 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957131#comment-15957131 ] Botong Huang commented on YARN-5531: Thanks [~kasha] for the review! For 2, sure I will add more logs.

[jira] [Updated] (YARN-6195) Export UsedCapacity and AbsoluteUsedCapacity to JMX

2017-04-05 Thread Benson Qiu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benson Qiu updated YARN-6195: - Attachment: YARN-6195.004.patch > Export UsedCapacity and AbsoluteUsedCapacity to JMX >

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2017-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957125#comment-15957125 ] Hadoop QA commented on YARN-5892: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6091) the AppMaster register failed when use Docker on LinuxContainer

2017-04-05 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957094#comment-15957094 ] Eric Badger commented on YARN-6091: --- [~zhengchenyu], do you have logs for this issue or are you able to

  1   2   >