[jira] [Commented] (YARN-4597) Add SCHEDULE to NM container lifecycle

2016-11-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15656417#comment-15656417 ] Arun Suresh commented on YARN-4597: --- Appreciate the review [~kkaranasos], 1. bq. The Container has two

[jira] [Updated] (YARN-5792) adopt the id prefix for YARN, MR, and DS entities

2016-11-10 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-5792: --- Attachment: YARN-5792-YARN-5355.03.patch > adopt the id prefix for YARN, MR, and DS entities >

[jira] [Commented] (YARN-5765) LinuxContainerExecutor creates appcache and its subdirectories with wrong group owner.

2016-11-10 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15656333#comment-15656333 ] Naganarasimha G R commented on YARN-5765: - @Thanks [~haibochen] & [~miklos.szeg...@cloudera.com]

[jira] [Commented] (YARN-5600) Add a parameter to ContainerLaunchContext to emulate yarn.nodemanager.delete.debug-delay-sec on a per-application basis

2016-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15656248#comment-15656248 ] Hadoop QA commented on YARN-5600: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5600) Add a parameter to ContainerLaunchContext to emulate yarn.nodemanager.delete.debug-delay-sec on a per-application basis

2016-11-10 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-5600: - Attachment: YARN-5600.008.patch Updated patch based on the previous request. > Add a parameter to

[jira] [Updated] (YARN-5814) Add druid as storage backend in YARN Timeline Service

2016-11-10 Thread Bingxue Qiu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bingxue Qiu updated YARN-5814: -- Attachment: Add-Druid-in-YARN-Timeline-Service.pdf > Add druid as storage backend in YARN Timeline

[jira] [Updated] (YARN-5814) Add druid as storage backend in YARN Timeline Service

2016-11-10 Thread Bingxue Qiu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bingxue Qiu updated YARN-5814: -- Attachment: (was: Add-Druid-in-YARN-Timeline-Service.pdf) > Add druid as storage backend in YARN

[jira] [Updated] (YARN-5814) Add druid as storage backend in YARN Timeline Service

2016-11-10 Thread Bingxue Qiu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bingxue Qiu updated YARN-5814: -- Attachment: Add-Druid-in-YARN-Timeline-Service.pdf > Add druid as storage backend in YARN Timeline

[jira] [Commented] (YARN-4597) Add SCHEDULE to NM container lifecycle

2016-11-10 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655975#comment-15655975 ] Konstantinos Karanasos commented on YARN-4597: -- Thanks for working on this, [~asuresh]! I am

[jira] [Commented] (YARN-5761) Separate QueueManager from Scheduler

2016-11-10 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655868#comment-15655868 ] Jonathan Hung commented on YARN-5761: - This looks good, a few comments: # We can probably put the

[jira] [Commented] (YARN-4752) [Umbrella] FairScheduler: Improve preemption

2016-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655861#comment-15655861 ] Hadoop QA commented on YARN-4752: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5600) Add a parameter to ContainerLaunchContext to emulate yarn.nodemanager.delete.debug-delay-sec on a per-application basis

2016-11-10 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655828#comment-15655828 ] Miklos Szegedi commented on YARN-5600: -- Thank you for reviewing the patch [~wangda], and also thank

[jira] [Commented] (YARN-5819) Verify fairshare and minshare preemption

2016-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655814#comment-15655814 ] Hadoop QA commented on YARN-5819: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5634) Simplify initialization/use of RouterPolicy via a RouterPolicyFacade

2016-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655793#comment-15655793 ] Hadoop QA commented on YARN-5634: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5600) Add a parameter to ContainerLaunchContext to emulate yarn.nodemanager.delete.debug-delay-sec on a per-application basis

2016-11-10 Thread Tan, Wangda (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655703#comment-15655703 ] Tan, Wangda commented on YARN-5600: --- This is a very useful feature without any doubt, thanks

[jira] [Updated] (YARN-5634) Simplify initialization/use of RouterPolicy via a RouterPolicyFacade

2016-11-10 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-5634: --- Attachment: YARN-5634-YARN-2915.03.patch > Simplify initialization/use of RouterPolicy via a

[jira] [Updated] (YARN-4752) [Umbrella] FairScheduler: Improve preemption

2016-11-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4752: --- Attachment: yarn-4752.2.patch > [Umbrella] FairScheduler: Improve preemption >

[jira] [Updated] (YARN-5819) Verify fairshare and minshare preemption

2016-11-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5819: --- Attachment: yarn-5819.YARN-4752.5.patch Rebased YARN-4752 on trunk. Updating this patch to

[jira] [Commented] (YARN-3053) [Security] Review and implement security in ATS v.2

2016-11-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655625#comment-15655625 ] Sangjin Lee commented on YARN-3053: --- Thanks [~varun_saxena] for putting together the proposal! It's a

[jira] [Commented] (YARN-5600) Add a parameter to ContainerLaunchContext to emulate yarn.nodemanager.delete.debug-delay-sec on a per-application basis

2016-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655581#comment-15655581 ] Hadoop QA commented on YARN-5600: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5792) adopt the id prefix for YARN, MR, and DS entities

2016-11-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1561#comment-1561 ] Sangjin Lee commented on YARN-5792: --- At a high level, I'd like to discuss options. I see that you're

[jira] [Commented] (YARN-5792) adopt the id prefix for YARN, MR, and DS entities

2016-11-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655540#comment-15655540 ] Sangjin Lee commented on YARN-5792: --- Patch v.2 fails compilation: {noformat} [INFO]

[jira] [Updated] (YARN-5044) Add peak memory usage counter for each task

2016-11-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5044: --- Assignee: (was: Yufei Gu) > Add peak memory usage counter for each task >

[jira] [Updated] (YARN-4715) Add support to read resource types from a config file

2016-11-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-4715: -- Fix Version/s: YARN-3926 Setting the missed fix-version to the branch-name. >

[jira] [Commented] (YARN-5864) Capacity Scheduler preemption for fragmented cluster

2016-11-10 Thread Tan, Wangda (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655514#comment-15655514 ] Tan, Wangda commented on YARN-5864: --- Thanks [~curino] for sharing these insightful suggestions. The

[jira] [Updated] (YARN-4829) Add support for binary units

2016-11-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-4829: -- Fix Version/s: YARN-3926 Setting the missed fix-version to the branch-name. >

[jira] [Updated] (YARN-4830) Add support for resource types in the nodemanager

2016-11-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-4830: -- Fix Version/s: YARN-3926 Setting the missed fix-version to the branch-name. >

[jira] [Commented] (YARN-4218) Metric for resource*time that was preempted

2016-11-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655459#comment-15655459 ] Hudson commented on YARN-4218: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10815 (See

[jira] [Updated] (YARN-5600) Add a parameter to ContainerLaunchContext to emulate yarn.nodemanager.delete.debug-delay-sec on a per-application basis

2016-11-10 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-5600: - Attachment: YARN-5600.007.patch Resubmitting the patch. > Add a parameter to

[jira] [Commented] (YARN-5765) LinuxContainerExecutor creates appcache and its subdirectories with wrong group owner.

2016-11-10 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655375#comment-15655375 ] Miklos Szegedi commented on YARN-5765: -- Thank you, [~Naganarasimha] for the patch and [~haibochen] for

[jira] [Commented] (YARN-5834) TestNodeStatusUpdater.testNMRMConnectionConf compares nodemanager wait time to the incorrect value

2016-11-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655347#comment-15655347 ] Hudson commented on YARN-5834: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10814 (See

[jira] [Updated] (YARN-5834) TestNodeStatusUpdater.testNMRMConnectionConf compares nodemanager wait time to the incorrect value

2016-11-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5834: --- Fix Version/s: 3.0.0-alpha2 > TestNodeStatusUpdater.testNMRMConnectionConf compares

[jira] [Commented] (YARN-5825) ProportionalPreemptionalPolicy could use readLock over LeafQueue instead of synchronized block

2016-11-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655310#comment-15655310 ] Jian He commented on YARN-5825: --- looks good overall, looks like this method added is not used? can be

[jira] [Commented] (YARN-5834) TestNodeStatusUpdater.testNMRMConnectionConf compares nodemanager wait time to the incorrect value

2016-11-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655304#comment-15655304 ] Karthik Kambatla commented on YARN-5834: +1. Checking this in.. >

[jira] [Updated] (YARN-5834) TestNodeStatusUpdater.testNMRMConnectionConf compares nodemanager wait time to the incorrect value

2016-11-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5834: --- Priority: Trivial (was: Minor) > TestNodeStatusUpdater.testNMRMConnectionConf compares

[jira] [Commented] (YARN-4218) Metric for resource*time that was preempted

2016-11-10 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655289#comment-15655289 ] Eric Payne commented on YARN-4218: -- +1 Thanks [~lichangleo] for the patches and the work done on this

[jira] [Commented] (YARN-5819) Verify fairshare and minshare preemption

2016-11-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655248#comment-15655248 ] Karthik Kambatla commented on YARN-5819: Since updating {{Resource}} is not atomic, it seemed safer

[jira] [Updated] (YARN-5792) adopt the id prefix for YARN, MR, and DS entities

2016-11-10 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-5792: --- Attachment: YARN-5792-YARN-5355.02.patch Fixed checkstyle and javadoc issues > adopt the id prefix

[jira] [Commented] (YARN-5819) Verify fairshare and minshare preemption

2016-11-10 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655170#comment-15655170 ] Daniel Templeton commented on YARN-5819: Do you need to synchronize {{getPreemptedResources()}}?

[jira] [Commented] (YARN-4206) Add life time value in Application report and web UI

2016-11-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655155#comment-15655155 ] Jian He commented on YARN-4206: --- The remaining time can be inferred from the absolute timeout value ? If so,

[jira] [Updated] (YARN-5792) adopt the id prefix for YARN, MR, and DS entities

2016-11-10 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-5792: --- Attachment: (was: YARN-5792-YARN-5355.02.patch) > adopt the id prefix for YARN, MR, and DS

[jira] [Updated] (YARN-5792) adopt the id prefix for YARN, MR, and DS entities

2016-11-10 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-5792: --- Attachment: YARN-5792-YARN-5355.02.patch > adopt the id prefix for YARN, MR, and DS entities >

[jira] [Commented] (YARN-5792) adopt the id prefix for YARN, MR, and DS entities

2016-11-10 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655096#comment-15655096 ] Varun Saxena commented on YARN-5792: Tests pass in local. Lets see what comes up when build is invoked

[jira] [Commented] (YARN-5792) adopt the id prefix for YARN, MR, and DS entities

2016-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655013#comment-15655013 ] Hadoop QA commented on YARN-5792: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5600) Add a parameter to ContainerLaunchContext to emulate yarn.nodemanager.delete.debug-delay-sec on a per-application basis

2016-11-10 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15654874#comment-15654874 ] Miklos Szegedi commented on YARN-5600: -- The build error seems to be unrelated to the change: Failed to

[jira] [Commented] (YARN-3955) Support for priority ACLs in CapacityScheduler

2016-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15654866#comment-15654866 ] Hadoop QA commented on YARN-3955: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5600) Add a parameter to ContainerLaunchContext to emulate yarn.nodemanager.delete.debug-delay-sec on a per-application basis

2016-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15654842#comment-15654842 ] Hadoop QA commented on YARN-5600: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5634) Simplify initialization/use of RouterPolicy via a RouterPolicyFacade

2016-11-10 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15654839#comment-15654839 ] Carlo Curino commented on YARN-5634: [~subru] thanks for the prompt feedback. I addressed most of your

[jira] [Comment Edited] (YARN-5694) ZKRMStateStore should always start its verification thread to prevent accidental state store corruption

2016-11-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15654697#comment-15654697 ] Jian He edited comment on YARN-5694 at 11/10/16 6:09 PM: - bq. If we agree that it's

[jira] [Commented] (YARN-5694) ZKRMStateStore should always start its verification thread to prevent accidental state store corruption

2016-11-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15654697#comment-15654697 ] Jian He commented on YARN-5694: --- bq. If we agree that it's bad to have two RMs accidentally sharing the same

[jira] [Commented] (YARN-5834) TestNodeStatusUpdater.testNMRMConnectionConf compares nodemanager wait time to the incorrect value

2016-11-10 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15654682#comment-15654682 ] Miklos Szegedi commented on YARN-5834: -- +1 non-binding. Thank you, [~lichangleo]! The change looks

[jira] [Updated] (YARN-5600) Add a parameter to ContainerLaunchContext to emulate yarn.nodemanager.delete.debug-delay-sec on a per-application basis

2016-11-10 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-5600: - Attachment: YARN-5600.006.patch Fixing checkstyle issue > Add a parameter to

[jira] [Updated] (YARN-5865) Retrospect updateApplicationPriority api to handle state store exception in align with YARN-5611

2016-11-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5865: -- Issue Type: Sub-task (was: Bug) Parent: YARN-1963 > Retrospect updateApplicationPriority api to handle

[jira] [Updated] (YARN-3955) Support for priority ACLs in CapacityScheduler

2016-11-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3955: -- Attachment: YARN-3955.0001.patch Thanks [~jianhe] for the comments. bq.I think readLock is not needed, the

[jira] [Commented] (YARN-5825) ProportionalPreemptionalPolicy could use readLock over LeafQueue instead of synchronized block

2016-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15654471#comment-15654471 ] Hadoop QA commented on YARN-5825: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5867) DirectoryCollection#checkDirs can cause incorrect permission of nmlocal dir

2016-11-10 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15654405#comment-15654405 ] Jason Lowe commented on YARN-5867: -- I'm curious how the top-level local directory was deleted in the first

[jira] [Commented] (YARN-5651) Changes to NMStateStore to persist reinitialization and rollback state

2016-11-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15654347#comment-15654347 ] Arun Suresh commented on YARN-5651: --- [~jianhe], Wondering what the right approach for this is.

[jira] [Commented] (YARN-5792) adopt the id prefix for YARN, MR, and DS entities

2016-11-10 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15654321#comment-15654321 ] Varun Saxena commented on YARN-5792: The patch does the following. # Uses inverse of container start

[jira] [Commented] (YARN-5867) DirectoryCollection#checkDirs can cause incorrect permission of nmlocal dir

2016-11-10 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15654312#comment-15654312 ] Bibin A Chundatt commented on YARN-5867: cc/ [~jlowe] and [~vvasudev] . Could you please share your

[jira] [Updated] (YARN-5792) adopt the id prefix for YARN, MR, and DS entities

2016-11-10 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-5792: --- Attachment: YARN-5792-YARN-5355.01.patch > adopt the id prefix for YARN, MR, and DS entities >

[jira] [Commented] (YARN-5694) ZKRMStateStore should always start its verification thread to prevent accidental state store corruption

2016-11-10 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15654259#comment-15654259 ] Daniel Templeton commented on YARN-5694: Yes, but if the RM isn't in HA mode, the fencing is

[jira] [Comment Edited] (YARN-5867) DirectoryCollection#checkDirs can cause incorrect permission of nmlocal dir

2016-11-10 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15653928#comment-15653928 ] Bibin A Chundatt edited comment on YARN-5867 at 11/10/16 2:28 PM: --

[jira] [Comment Edited] (YARN-5825) ProportionalPreemptionalPolicy could use readLock over LeafQueue instead of synchronized block

2016-11-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15654156#comment-15654156 ] Sunil G edited comment on YARN-5825 at 11/10/16 2:19 PM: - Attaching an initial

[jira] [Updated] (YARN-5825) ProportionalPreemptionalPolicy could use readLock over LeafQueue instead of synchronized block

2016-11-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5825: -- Attachment: YARN-5825.0001.patch Attaching an initial version of patch. In PCPP#cloneQueues, we use CSQueue

[jira] [Updated] (YARN-5792) adopt the id prefix for YARN, MR, and DS entities

2016-11-10 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-5792: --- Attachment: (was: YARN-5792-YARN-5355.01.patch) > adopt the id prefix for YARN, MR, and DS

[jira] [Updated] (YARN-5792) adopt the id prefix for YARN, MR, and DS entities

2016-11-10 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-5792: --- Attachment: YARN-5792-YARN-5355.01.patch > adopt the id prefix for YARN, MR, and DS entities >

[jira] [Commented] (YARN-5865) Retrospect updateApplicationPriority api to handle state store exception in align with YARN-5611

2016-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15654119#comment-15654119 ] Hadoop QA commented on YARN-5865: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5865) Retrospect updateApplicationPriority api to handle state store exception in align with YARN-5611

2016-11-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5865: -- Attachment: YARN-5865.0001.patch Updating an initial version of the patch. cc/[~rohithsharma] and [~jianhe] >

[jira] [Commented] (YARN-5867) DirectoryCollection#checkDirs can cause incorrect permission of nmlocal dir

2016-11-10 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15653928#comment-15653928 ] Bibin A Chundatt commented on YARN-5867: [~naganarasimha...@apache.org] Not related to appcache..

[jira] [Updated] (YARN-5867) DirectoryCollection#checkDirs can cause incorrect permission of nmlocal dir

2016-11-10 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-5867: --- Description: Steps to reproduce === # Set umask to 077 for user # Start

[jira] [Commented] (YARN-5545) App submit failure on queue with label when default queue partition capacity is zero

2016-11-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15653916#comment-15653916 ] Sunil G commented on YARN-5545: --- +1 > App submit failure on queue with label when default queue partition

[jira] [Commented] (YARN-5867) DirectoryCollection#checkDirs can cause incorrect permission of nmlocal dir

2016-11-10 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15653904#comment-15653904 ] Naganarasimha G R commented on YARN-5867: - I think its kind of related to YARN-5765 and YARN-5287

[jira] [Updated] (YARN-5867) DirectoryCollection#checkDirs can cause incorrect permission of nmlocal dir

2016-11-10 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-5867: --- Description: Steps to reproduce === # Set umask to 077 for user # Start

[jira] [Commented] (YARN-5545) App submit failure on queue with label when default queue partition capacity is zero

2016-11-10 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15653872#comment-15653872 ] Naganarasimha G R commented on YARN-5545: - Thanks [~bibinchundatt], +1, Latest patch looks good to

[jira] [Commented] (YARN-5867) DirectoryCollection#checkDirs can cause incorrect permission of nmlocal dir

2016-11-10 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15653868#comment-15653868 ] Bibin A Chundatt commented on YARN-5867: *Solution* # We can check and try creation of localdir

[jira] [Created] (YARN-5867) DirectoryCollection#checkDirs can cause incorrect permission of nmlocal dir

2016-11-10 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-5867: -- Summary: DirectoryCollection#checkDirs can cause incorrect permission of nmlocal dir Key: YARN-5867 URL: https://issues.apache.org/jira/browse/YARN-5867 Project:

[jira] [Commented] (YARN-4218) Metric for resource*time that was preempted

2016-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15653752#comment-15653752 ] Hadoop QA commented on YARN-4218: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4218) Metric for resource*time that was preempted

2016-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15653631#comment-15653631 ] Hadoop QA commented on YARN-4218: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5834) TestNodeStatusUpdater.testNMRMConnectionConf compares nodemanager wait time to the incorrect value

2016-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15653530#comment-15653530 ] Hadoop QA commented on YARN-5834: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5545) App submit failure on queue with label when default queue partition capacity is zero

2016-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15653440#comment-15653440 ] Hadoop QA commented on YARN-5545: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5453) FairScheduler#update may skip update demand resource of child queue/app if current demand reached maxResource

2016-11-10 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15653433#comment-15653433 ] sandflee commented on YARN-5453: thanks [~kasha] for review and commit ! > FairScheduler#update may skip

[jira] [Commented] (YARN-5834) TestNodeStatusUpdater.testNMRMConnectionConf compares nodemanager wait time to the incorrect value

2016-11-10 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15653391#comment-15653391 ] Chang Li commented on YARN-5834: Thanks for reporting. Yes it's meant to be nmRmConnectionWaitMs. Provide

[jira] [Updated] (YARN-5834) TestNodeStatusUpdater.testNMRMConnectionConf compares nodemanager wait time to the incorrect value

2016-11-10 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated YARN-5834: --- Attachment: YARN-5834-branch-2.001.patch > TestNodeStatusUpdater.testNMRMConnectionConf compares nodemanager

[jira] [Assigned] (YARN-5834) TestNodeStatusUpdater.testNMRMConnectionConf compares nodemanager wait time to the incorrect value

2016-11-10 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li reassigned YARN-5834: -- Assignee: Chang Li > TestNodeStatusUpdater.testNMRMConnectionConf compares nodemanager wait time > to

[jira] [Commented] (YARN-5453) FairScheduler#update may skip update demand resource of child queue/app if current demand reached maxResource

2016-11-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15653367#comment-15653367 ] Hudson commented on YARN-5453: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10811 (See