[jira] [Commented] (YARN-5814) Add druid as storage backend in YARN Timeline Service

2016-11-17 Thread Bingxue Qiu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15676080#comment-15676080 ] Bingxue Qiu commented on YARN-5814: --- Thanks [~sjlee0] for your Suggestions! On the Druid reader side,

[jira] [Commented] (YARN-5866) [YARN-3368] Fix few issues reported by jshint in new YARN UI

2016-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15676019#comment-15676019 ] Hadoop QA commented on YARN-5866: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5866) [YARN-3368] Fix few issues reported by jshint in new YARN UI

2016-11-17 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB updated YARN-5866: --- Attachment: YARN-5866.002.patch > [YARN-3368] Fix few issues reported by jshint in new YARN UI >

[jira] [Commented] (YARN-5911) DrainDispatcher does not drain all events on stop even if setDrainEventsOnStop is true

2016-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675964#comment-15675964 ] Hadoop QA commented on YARN-5911: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5911) DrainDispatcher does not drain all events on stop even if setDrainEventsOnStop is true

2016-11-17 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675927#comment-15675927 ] Varun Saxena commented on YARN-5911: Added the test case in TestAsyncDispatcher itself instead of

[jira] [Updated] (YARN-5911) DrainDispatcher does not drain all events on stop even if setDrainEventsOnStop is true

2016-11-17 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-5911: --- Description: DrainDispatcher#serviceStop sets the stopped flag first before draining the event queue.

[jira] [Updated] (YARN-5911) DrainDispatcher does not drain all events on stop even if setDrainEventsOnStop is true

2016-11-17 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-5911: --- Attachment: YARN-5911.01.patch > DrainDispatcher does not drain all events on stop even if >

[jira] [Updated] (YARN-5911) DrainDispatcher does not drain all events on stop even if setDrainEventsOnStop is true

2016-11-17 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-5911: --- Summary: DrainDispatcher does not drain all events on stop even if setDrainEventsOnStop is true (was:

[jira] [Created] (YARN-5911) DrainDispatcher does not drain on all events on stop even if setDrainEventsOnStop is true

2016-11-17 Thread Varun Saxena (JIRA)
Varun Saxena created YARN-5911: -- Summary: DrainDispatcher does not drain on all events on stop even if setDrainEventsOnStop is true Key: YARN-5911 URL: https://issues.apache.org/jira/browse/YARN-5911

[jira] [Updated] (YARN-5888) [YARN-3368] Add test cases in new YARN UI

2016-11-17 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB updated YARN-5888: --- Summary: [YARN-3368] Add test cases in new YARN UI (was: Add test cases in new YARN UI) > [YARN-3368] Add

[jira] [Updated] (YARN-5866) [YARN-3368] Fix few issues reported by jshint in new YARN UI

2016-11-17 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB updated YARN-5866: --- Summary: [YARN-3368] Fix few issues reported by jshint in new YARN UI (was: Fix few issues reported by jshint

[jira] [Updated] (YARN-5792) adopt the id prefix for YARN, MR, and DS entities

2016-11-17 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-5792: --- Attachment: YARN-5792-YARN-5355.06.patch > adopt the id prefix for YARN, MR, and DS entities >

[jira] [Commented] (YARN-5271) ATS client doesn't work with Jersey 2 on the classpath

2016-11-17 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675854#comment-15675854 ] Weiwei Yang commented on YARN-5271: --- Great, thanks [~jojochuang] :) > ATS client doesn't work with

[jira] [Commented] (YARN-5271) ATS client doesn't work with Jersey 2 on the classpath

2016-11-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675749#comment-15675749 ] Hudson commented on YARN-5271: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10860 (See

[jira] [Updated] (YARN-5271) ATS client doesn't work with Jersey 2 on the classpath

2016-11-17 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated YARN-5271: -- Release Note: A workaround to avoid dependency conflict with Spark2, before a full classpath

[jira] [Commented] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-11-17 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675728#comment-15675728 ] Varun Saxena commented on YARN-5739: Well, found a link of HBase book which recommends using both

[jira] [Comment Edited] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-11-17 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675693#comment-15675693 ] Varun Saxena edited comment on YARN-5739 at 11/18/16 4:29 AM: -- [~vrushalic],

[jira] [Updated] (YARN-5271) ATS client doesn't work with Jersey 2 on the classpath

2016-11-17 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated YARN-5271: -- Release Note: Skip instantiating a Timeline Service client if encountering NoClassDefFoundError.

[jira] [Commented] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-11-17 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675693#comment-15675693 ] Varun Saxena commented on YARN-5739: [~vrushalic], FirstKeyOnlyFilter will return the first KV from

[jira] [Commented] (YARN-5646) Documentation for scheduling of OPPORTUNISTIC containers

2016-11-17 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675677#comment-15675677 ] Konstantinos Karanasos commented on YARN-5646: -- Please let's wait for a few days before

[jira] [Updated] (YARN-5646) Documentation for scheduling of OPPORTUNISTIC containers

2016-11-17 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-5646: - Attachment: YARN-5646.001.patch Attaching documentation. > Documentation for

[jira] [Commented] (YARN-5667) Move HBase backend code in ATS v2 into its separate module

2016-11-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675617#comment-15675617 ] Sangjin Lee commented on YARN-5667: --- Originally this was targeted for our feature branch (YARN-5355)

[jira] [Commented] (YARN-5271) ATS client doesn't work with Jersey 2 on the classpath

2016-11-17 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675616#comment-15675616 ] Weiwei Yang commented on YARN-5271: --- Thank you! > ATS client doesn't work with Jersey 2 on the classpath

[jira] [Comment Edited] (YARN-4206) Add life time value in Application report and CLI

2016-11-17 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675011#comment-15675011 ] Jian He edited comment on YARN-4206 at 11/18/16 3:07 AM: - looks good overall

[jira] [Commented] (YARN-5271) ATS client doesn't work with Jersey 2 on the classpath

2016-11-17 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675562#comment-15675562 ] Wei-Chiu Chuang commented on YARN-5271: --- Thanks for reminder. +1 and will commit soon. > ATS client

[jira] [Commented] (YARN-5271) ATS client doesn't work with Jersey 2 on the classpath

2016-11-17 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1567#comment-1567 ] Weiwei Yang commented on YARN-5271: --- Hello [~jojochuang] Is there anything else you want me to work on

[jira] [Commented] (YARN-5600) Add a parameter to ContainerLaunchContext to emulate yarn.nodemanager.delete.debug-delay-sec on a per-application basis

2016-11-17 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675547#comment-15675547 ] Miklos Szegedi commented on YARN-5600: -- Thank you, [~vvasudev] for the comment! We will get 600 in all

[jira] [Commented] (YARN-5904) Reduce the number of default server threads for AMRMProxyService

2016-11-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675525#comment-15675525 ] Hudson commented on YARN-5904: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10859 (See

[jira] [Commented] (YARN-5676) Add a HashBasedRouterPolicy, that routes jobs based on queue name hash.

2016-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675458#comment-15675458 ] Hadoop QA commented on YARN-5676: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5890) FairScheduler should log information about AM-resource-usage and max-AM-share for queues

2016-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675436#comment-15675436 ] Hadoop QA commented on YARN-5890: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5904) Reduce the number of default server threads for AMRMProxyService

2016-11-17 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675420#comment-15675420 ] Arun Suresh commented on YARN-5904: --- +1, LGTM > Reduce the number of default server threads for

[jira] [Commented] (YARN-5898) Container can not stop, because the call stopContainer NMClient method appears DIGEST-MD5 exception, onGetContainerStatusError NMClientAsync method is also the same

2016-11-17 Thread gaoyanfu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675413#comment-15675413 ] gaoyanfu commented on YARN-5898: AppMaster did not restart, usually, appMaster after running for some time,

[jira] [Commented] (YARN-3538) TimelineServer doesn't catch/translate all exceptions raised

2016-11-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675343#comment-15675343 ] Hudson commented on YARN-3538: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10858 (See

[jira] [Commented] (YARN-5905) Update the RM webapp host that is reported as part of Federation membership to current primary RM's IP

2016-11-17 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675333#comment-15675333 ] Subru Krishnan commented on YARN-5905: -- Thanks [~curino] for the quick review. And good point on

[jira] [Updated] (YARN-5676) Add a HashBasedRouterPolicy, that routes jobs based on queue name hash.

2016-11-17 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-5676: --- Attachment: YARN-5676-YARN-2915.02.patch > Add a HashBasedRouterPolicy, that routes jobs based on

[jira] [Commented] (YARN-5905) Update the RM webapp host that is reported as part of Federation membership to current primary RM's IP

2016-11-17 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675324#comment-15675324 ] Carlo Curino commented on YARN-5905: +1 pending yetus. It would be good to test this running in a live

[jira] [Commented] (YARN-4770) Auto-restart of containers should work across NM restarts.

2016-11-17 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675321#comment-15675321 ] Jian He commented on YARN-4770: --- [~hex108], bq. If container crashed during the NM reboot, container would

[jira] [Updated] (YARN-5890) FairScheduler should log information about AM-resource-usage and max-AM-share for queues

2016-11-17 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5890: --- Attachment: YARN-5890.001.patch > FairScheduler should log information about AM-resource-usage and

[jira] [Assigned] (YARN-5355) YARN Timeline Service v.2: alpha 2

2016-11-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee reassigned YARN-5355: - Assignee: Sangjin Lee > YARN Timeline Service v.2: alpha 2 > -- >

[jira] [Updated] (YARN-5667) Move HBase backend code in ATS v2 into its separate module

2016-11-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5667: -- Affects Version/s: 3.0.0-alpha1 Target Version/s: 3.0.0-alpha2 Priority: Blocker (was:

[jira] [Commented] (YARN-5774) MR Job stuck in ACCEPTED status without any progress in Fair Scheduler if set yarn.scheduler.minimum-allocation-mb to 0.

2016-11-17 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675216#comment-15675216 ] Daniel Templeton commented on YARN-5774: I'm still not in love with that exception. Maybe log it

[jira] [Commented] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-11-17 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675199#comment-15675199 ] Vrushali C commented on YARN-5739: -- Thanks [~gtCarrera9] for the patch. [~varun_saxena] I think we do

[jira] [Updated] (YARN-5905) Update the RM webapp host that is reported as part of Federation membership to current primary RM's IP

2016-11-17 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-5905: - Attachment: YARN-5905-YARN-2915-v1.patch Missed the branch suffix so uploading the same patch with

[jira] [Commented] (YARN-5905) Update the RM webapp host that is reported as part of Federation membership to current primary RM's IP

2016-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675190#comment-15675190 ] Hadoop QA commented on YARN-5905: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5905) Update the RM webapp host that is reported as part of Federation membership to current primary RM's IP

2016-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675110#comment-15675110 ] Hadoop QA commented on YARN-5905: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-5910) Support for multi-cluster delegation tokens

2016-11-17 Thread Clay B. (JIRA)
Clay B. created YARN-5910: - Summary: Support for multi-cluster delegation tokens Key: YARN-5910 URL: https://issues.apache.org/jira/browse/YARN-5910 Project: Hadoop YARN Issue Type: New Feature

[jira] [Updated] (YARN-5905) Update the RM webapp host that is reported as part of Federation membership to current primary RM's IP

2016-11-17 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-5905: - Attachment: YARN-5905-v1.patch Attaching a simple patch that updates the RM webapp host that is

[jira] [Created] (YARN-5909) Upgrade framework jetty version

2016-11-17 Thread Jian He (JIRA)
Jian He created YARN-5909: - Summary: Upgrade framework jetty version Key: YARN-5909 URL: https://issues.apache.org/jira/browse/YARN-5909 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-5478) [YARN-4902] Define Java API for generalized & unified scheduling-strategies.

2016-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675072#comment-15675072 ] Hadoop QA commented on YARN-5478: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5676) Add a HashBasedRouterPolicy, that routes jobs based on queue name hash.

2016-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675051#comment-15675051 ] Hadoop QA commented on YARN-5676: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5906) Update AppSchedulingInfo to use SchedulingPlacementSet

2016-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675024#comment-15675024 ] Hadoop QA commented on YARN-5906: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4206) Add life time value in Application report and CLI

2016-11-17 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675011#comment-15675011 ] Jian He commented on YARN-4206: --- looks good overall ,thanks Rohith, few comments - what is this code for, we

[jira] [Comment Edited] (YARN-4206) Add life time value in Application report and CLI

2016-11-17 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675011#comment-15675011 ] Jian He edited comment on YARN-4206 at 11/17/16 10:35 PM: -- looks good overall

[jira] [Commented] (YARN-5634) Simplify initialization/use of RouterPolicy via a RouterPolicyFacade

2016-11-17 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674951#comment-15674951 ] Carlo Curino commented on YARN-5634: Thanks [~subru] for reviewing and committing. > Simplify

[jira] [Created] (YARN-5908) Add affinity/anti-affinity field to ResourceRequest API

2016-11-17 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-5908: Summary: Add affinity/anti-affinity field to ResourceRequest API Key: YARN-5908 URL: https://issues.apache.org/jira/browse/YARN-5908 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-5907) [Umbrella] [YARN-1042] add ability to specify affinity/anti-affinity in container requests

2016-11-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5907: - Issue Type: New Feature (was: Sub-task) Parent: (was: YARN-397) > [Umbrella] [YARN-1042] add

[jira] [Updated] (YARN-5907) [Umbrella] [YARN-1042] add ability to specify affinity/anti-affinity in container requests

2016-11-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5907: - Description: container requests to the AM should be able to request anti-affinity to ensure that things

[jira] [Commented] (YARN-1042) add ability to specify affinity/anti-affinity in container requests

2016-11-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674879#comment-15674879 ] Wangda Tan commented on YARN-1042: -- {color:red} Opened YARN-5907 as umbrella JIRA of this ticket. {color}

[jira] [Created] (YARN-5907) [Umbrella] [YARN-1042] add ability to specify affinity/anti-affinity in container requests

2016-11-17 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-5907: Summary: [Umbrella] [YARN-1042] add ability to specify affinity/anti-affinity in container requests Key: YARN-5907 URL: https://issues.apache.org/jira/browse/YARN-5907

[jira] [Updated] (YARN-5478) [YARN-4902] Define Java API for generalized & unified scheduling-strategies.

2016-11-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5478: - Attachment: YARN-5478.1.patch Attached ver.1 patch, this patch is targeted to be used inside scheduler so

[jira] [Updated] (YARN-5906) Update AppSchedulingInfo to use SchedulingPlacementSet

2016-11-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5906: - Attachment: YARN-5906.1.patch Attached ver.1 patch for review. + [~jianhe], [~kasha], [~asuresh],

[jira] [Created] (YARN-5906) Update AppSchedulingInfo to use SchedulingPlacementSet

2016-11-17 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-5906: Summary: Update AppSchedulingInfo to use SchedulingPlacementSet Key: YARN-5906 URL: https://issues.apache.org/jira/browse/YARN-5906 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-5904) Reduce the number of default server threads for AMRMProxyService

2016-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674847#comment-15674847 ] Hadoop QA commented on YARN-5904: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5904) Reduce the number of default server threads for AMRMProxyService

2016-11-17 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-5904: - Summary: Reduce the number of default server threads for AMRMProxyService (was: Reduce the number

[jira] [Updated] (YARN-5904) Reduce the number of default server threads for AMRMProxyService

2016-11-17 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-5904: - Attachment: YARN-5904-v1.patch Attaching a trivial patch that updates the default number of server

[jira] [Created] (YARN-5905) Update the RM webapp host that is reported as part of Federation membership to current primary RM's IP

2016-11-17 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5905: Summary: Update the RM webapp host that is reported as part of Federation membership to current primary RM's IP Key: YARN-5905 URL:

[jira] [Updated] (YARN-5257) Fix all Bad Practices

2016-11-17 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5257: --- Summary: Fix all Bad Practices (was: Fix all Bad Practices flagged in Fortify) > Fix all Bad Practices >

[jira] [Created] (YARN-5904) Reduce the number of server threads for AMRMProxy

2016-11-17 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5904: Summary: Reduce the number of server threads for AMRMProxy Key: YARN-5904 URL: https://issues.apache.org/jira/browse/YARN-5904 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-3409) Add constraint node labels

2016-11-17 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-3409: Attachment: Constraint-Node-Labels-Requirements-Design-doc_v1.pdf As discussed offline with

[jira] [Assigned] (YARN-3409) Add constraint node labels

2016-11-17 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R reassigned YARN-3409: --- Assignee: Naganarasimha G R (was: Wangda Tan) > Add constraint node labels >

[jira] [Commented] (YARN-4206) Add life time value in Application report and CLI

2016-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674602#comment-15674602 ] Hadoop QA commented on YARN-4206: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5903) Fix race condition in TestResourceManagerAdministrationProtocolPBClientImpl beforeclass setup method

2016-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674587#comment-15674587 ] Hadoop QA commented on YARN-5903: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5901) Fix race condition in TestGetGroups beforeclass setup()

2016-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674566#comment-15674566 ] Hadoop QA commented on YARN-5901: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5902) yarn.scheduler.increment-allocation-mb and yarn.scheduler.increment-allocation-vcores are undocumented

2016-11-17 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-5902: --- Summary: yarn.scheduler.increment-allocation-mb and yarn.scheduler.increment-allocation-vcores

[jira] [Updated] (YARN-5355) YARN Timeline Service v.2: alpha 2

2016-11-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5355: - Assignee: (was: Haibo Chen) > YARN Timeline Service v.2: alpha 2 > --

[jira] [Updated] (YARN-5903) Fix race condition in TestResourceManagerAdministrationProtocolPBClientImpl beforeclass setup method

2016-11-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5903: - Attachment: yarn5903.001.patch Uploading the same fix as for YARN-5901. If this unreliable check is used

[jira] [Created] (YARN-5903) Fix race condition in TestResourceManagerAdministrationProtocolPBClientImpl beforeclass setup method

2016-11-17 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-5903: Summary: Fix race condition in TestResourceManagerAdministrationProtocolPBClientImpl beforeclass setup method Key: YARN-5903 URL: https://issues.apache.org/jira/browse/YARN-5903

[jira] [Updated] (YARN-5901) Fix race condition in TestGetGroups beforeclass setup()

2016-11-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5901: - Attachment: yarn5901.001.patch > Fix race condition in TestGetGroups beforeclass setup() >

[jira] [Updated] (YARN-5902) yarn.scheduler.increment-allocation-mb and yarn.scheduler.increment-allocation-vcores should be documented in yarn-default.xml

2016-11-17 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-5902: --- Attachment: YARN-5902.001.patch Here's what the change would look like. >

[jira] [Commented] (YARN-5864) Capacity Scheduler preemption for fragmented cluster

2016-11-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674481#comment-15674481 ] Wangda Tan commented on YARN-5864: -- Thanks [~curino] for sharing the firmament paper. I just read it, it

[jira] [Commented] (YARN-5902) yarn.scheduler.increment-allocation-mb and yarn.scheduler.increment-allocation-vcores should be documented in yarn-default.xml

2016-11-17 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674470#comment-15674470 ] Daniel Templeton commented on YARN-5902: Since these properties are only in the fair scheduler, in

[jira] [Created] (YARN-5902) yarn.scheduler.increment-allocation-mb and yarn.scheduler.increment-allocation-vcores should be documented in yarn-default.xml

2016-11-17 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-5902: -- Summary: yarn.scheduler.increment-allocation-mb and yarn.scheduler.increment-allocation-vcores should be documented in yarn-default.xml Key: YARN-5902 URL:

[jira] [Updated] (YARN-5901) Fix race condition in TestGetGroups beforeclass setup()

2016-11-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5901: - Labels: unittest (was: ) > Fix race condition in TestGetGroups beforeclass setup() >

[jira] [Created] (YARN-5901) Fix race condition in TestGetGroups beforeclass setup()

2016-11-17 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-5901: Summary: Fix race condition in TestGetGroups beforeclass setup() Key: YARN-5901 URL: https://issues.apache.org/jira/browse/YARN-5901 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-5280) Allow YARN containers to run with Java Security Manager

2016-11-17 Thread Greg Phillips (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674456#comment-15674456 ] Greg Phillips commented on YARN-5280: - That sounds fantastic. I will add those changes to the next

[jira] [Commented] (YARN-3053) [Security] Review and implement security in ATS v.2

2016-11-17 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674445#comment-15674445 ] Joep Rottinghuis commented on YARN-3053: For delegation tokens there is a mechanism for renewal. If

[jira] [Commented] (YARN-3053) [Security] Review and implement security in ATS v.2

2016-11-17 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674433#comment-15674433 ] Joep Rottinghuis commented on YARN-3053: Once we trust that the connection to the collector is

[jira] [Assigned] (YARN-5355) YARN Timeline Service v.2: alpha 2

2016-11-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-5355: Assignee: Haibo Chen (was: Sangjin Lee) > YARN Timeline Service v.2: alpha 2 >

[jira] [Updated] (YARN-5851) TestContainerManagerSecurity testContainerManager[1] failed

2016-11-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5851: - Labels: unittest (was: security unittest) > TestContainerManagerSecurity testContainerManager[1] failed

[jira] [Commented] (YARN-3053) [Security] Review and implement security in ATS v.2

2016-11-17 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674398#comment-15674398 ] Joep Rottinghuis commented on YARN-3053: Two questions: - are there race conditions going to be

[jira] [Commented] (YARN-2009) CapacityScheduler: Add intra-queue preemption for app priority support

2016-11-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674397#comment-15674397 ] Wangda Tan commented on YARN-2009: -- [~eepayne], I'm OK with backporting all required preemption related

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

2016-11-17 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674342#comment-15674342 ] Eric Payne commented on YARN-5889: -- Thanks [~sunilg] and [~leftnoteasy] for the heads up. I will look at

[jira] [Commented] (YARN-2009) CapacityScheduler: Add intra-queue preemption for app priority support

2016-11-17 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674334#comment-15674334 ] Eric Payne commented on YARN-2009: -- Hey [~leftnoteasy]. The fate of branch-2.8 is still up in the air, but

[jira] [Assigned] (YARN-4206) Add life time value in Application report and CLI

2016-11-17 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S reassigned YARN-4206: --- Assignee: Rohith Sharma K S (was: nijel) > Add life time value in Application report

[jira] [Updated] (YARN-4206) Add life time value in Application report and CLI

2016-11-17 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-4206: Attachment: YARN-4506.1.patch Updating patch for supporting YarnClient API, ApplicationCLI

[jira] [Commented] (YARN-5859) TestResourceLocalizationService#testParallelDownloadAttemptsForPublicResource sometimes fails

2016-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674046#comment-15674046 ] Hadoop QA commented on YARN-5859: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-5600) Add a parameter to ContainerLaunchContext to emulate yarn.nodemanager.delete.debug-delay-sec on a per-application basis

2016-11-17 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674060#comment-15674060 ] Varun Vasudev edited comment on YARN-5600 at 11/17/16 3:59 PM: ---

[jira] [Commented] (YARN-5600) Add a parameter to ContainerLaunchContext to emulate yarn.nodemanager.delete.debug-delay-sec on a per-application basis

2016-11-17 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674060#comment-15674060 ] Varun Vasudev commented on YARN-5600: - [~miklos.szeg...@cloudera.com] - can you explain when the

[jira] [Commented] (YARN-5280) Allow YARN containers to run with Java Security Manager

2016-11-17 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15673999#comment-15673999 ] Varun Vasudev commented on YARN-5280: - {quote} The difficulty arises when moving the functionality from

[jira] [Commented] (YARN-5877) Allow all nm-whitelist-env to get overridden during launch

2016-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15673988#comment-15673988 ] Hadoop QA commented on YARN-5877: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

  1   2   >