[jira] [Commented] (YARN-8559) Expose mutable-conf scheduler's configuration in RM /scheduler-conf endpoint

2018-07-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564841#comment-16564841 ] genericqa commented on YARN-8559: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-8606) Opportunistic scheduling does not work post RM failover

2018-07-31 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8606: - Summary: Opportunistic scheduling does not work post RM failover (was: Opportunistic scheduling d

[jira] [Commented] (YARN-8553) Reduce complexity of AHSWebService getApps method

2018-07-31 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564823#comment-16564823 ] Szilard Nemeth commented on YARN-8553: -- Uploaded patch 002 that fixes javadoc and whi

[jira] [Updated] (YARN-8553) Reduce complexity of AHSWebService getApps method

2018-07-31 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8553: - Attachment: YARN-8553.002.patch > Reduce complexity of AHSWebService getApps method >

[jira] [Updated] (YARN-7833) [PERF/TEST] Extend SLS to support simulation of a Federated Environment

2018-07-31 Thread Tanuj Nayak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanuj Nayak updated YARN-7833: -- Attachment: YARN-7833.v7.patch > [PERF/TEST] Extend SLS to support simulation of a Federated Environment

[jira] [Commented] (YARN-8593) Add new RM web service endpoint to get cluster user info

2018-07-31 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564804#comment-16564804 ] Sunil Govindan commented on YARN-8593: -- Sorry for some last minute comments. # Pls a

[jira] [Commented] (YARN-8568) Replace the deprecated zk-address property in the HA config example in ResourceManagerHA.md

2018-07-31 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564802#comment-16564802 ] Szilard Nemeth commented on YARN-8568: -- LGTM +1 (non-binding) from me as well! > Rep

[jira] [Updated] (YARN-7833) [PERF/TEST] Extend SLS to support simulation of a Federated Environment

2018-07-31 Thread Tanuj Nayak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanuj Nayak updated YARN-7833: -- Attachment: (was: YARN-7833.v7.patch) > [PERF/TEST] Extend SLS to support simulation of a Federated

[jira] [Updated] (YARN-7833) [PERF/TEST] Extend SLS to support simulation of a Federated Environment

2018-07-31 Thread Tanuj Nayak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanuj Nayak updated YARN-7833: -- Attachment: YARN-7833.v7.patch > [PERF/TEST] Extend SLS to support simulation of a Federated Environment

[jira] [Commented] (YARN-8601) Print ExecutionType in Container report CLI

2018-07-31 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564792#comment-16564792 ] Bilwa S T commented on YARN-8601: - [~bibinchundatt] In testcase containerReport is mocked

[jira] [Commented] (YARN-8522) Application fails with InvalidResourceRequestException

2018-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564779#comment-16564779 ] Hudson commented on YARN-8522: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #146

[jira] [Updated] (YARN-8155) Improve ATSv2 client logging in RM and NM publisher

2018-07-31 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-8155: Attachment: YARN-8155-branch-2.v3.patch > Improve ATSv2 client logging in RM and NM publisher >

[jira] [Commented] (YARN-8606) Opportunistic scheduling doesnt work after failover

2018-07-31 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564778#comment-16564778 ] Sunil Govindan commented on YARN-8606: -- Looks good to me as well. Committing shortly.

[jira] [Commented] (YARN-8606) Opportunistic scheduling doesnt work after failover

2018-07-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564775#comment-16564775 ] Wangda Tan commented on YARN-8606: -- [~bibinchundatt],  Gotcha, fix make sense to me. +1

[jira] [Comment Edited] (YARN-8606) Opportunistic scheduling doesnt work after failover

2018-07-31 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564737#comment-16564737 ] Bibin A Chundatt edited comment on YARN-8606 at 8/1/18 5:22 AM:

[jira] [Updated] (YARN-8607) Incorrect annotation in ApplicationAttemptStateData#getResourceSecondsMap

2018-07-31 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yeliang Cang updated YARN-8607: --- Attachment: YARN-8607.002.patch > Incorrect annotation in ApplicationAttemptStateData#getResourceSecon

[jira] [Commented] (YARN-8606) Opportunistic scheduling doesnt work after failover

2018-07-31 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564737#comment-16564737 ] Bibin A Chundatt commented on YARN-8606: [~suma.shivaprasad] {quote} EventDispat

[jira] [Commented] (YARN-8607) Incorrect annotation in ApplicationAttemptStateData#getResourceSecondsMap

2018-07-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564730#comment-16564730 ] genericqa commented on YARN-8607: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-8559) Expose mutable-conf scheduler's configuration in RM /scheduler-conf endpoint

2018-07-31 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564705#comment-16564705 ] Weiwei Yang commented on YARN-8559: --- Attached v4 patch, 1) added document; 2) added ACL

[jira] [Updated] (YARN-8559) Expose mutable-conf scheduler's configuration in RM /scheduler-conf endpoint

2018-07-31 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8559: -- Attachment: YARN-8559.004.patch > Expose mutable-conf scheduler's configuration in RM /scheduler-conf en

[jira] [Commented] (YARN-8593) Add new RM web service endpoint to get cluster user info

2018-07-31 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564675#comment-16564675 ] Sunil Govindan commented on YARN-8593: -- Thanks [~rohithsharma] for the details. You a

[jira] [Commented] (YARN-8397) Potential thread leak in ActivitiesManager

2018-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564667#comment-16564667 ] Hudson commented on YARN-8397: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #146

[jira] [Updated] (YARN-8397) Potential thread leak in ActivitiesManager

2018-07-31 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8397: - Summary: Potential thread leak in ActivitiesManager (was: Thread leak in ActivitiesManager) > Po

[jira] [Commented] (YARN-8559) Expose mutable-conf scheduler's configuration in RM /scheduler-conf endpoint

2018-07-31 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564662#comment-16564662 ] Weiwei Yang commented on YARN-8559: --- Hi [~suma.shivaprasad]/[~leftnoteasy] Thanks for t

[jira] [Updated] (YARN-8607) Incorrect annotation in ApplicationAttemptStateData#getResourceSecondsMap

2018-07-31 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yeliang Cang updated YARN-8607: --- Attachment: YARN-8607.001.patch > Incorrect annotation in ApplicationAttemptStateData#getResourceSecon

[jira] [Updated] (YARN-8607) Incorrect annotation in ApplicationAttemptStateData#getResourceSecondsMap

2018-07-31 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yeliang Cang updated YARN-8607: --- Labels: docuentation (was: ) > Incorrect annotation in ApplicationAttemptStateData#getResourceSeconds

[jira] [Created] (YARN-8607) Incorrect annotation in ApplicationAttemptStateData#getResourceSecondsMap

2018-07-31 Thread Yeliang Cang (JIRA)
Yeliang Cang created YARN-8607: -- Summary: Incorrect annotation in ApplicationAttemptStateData#getResourceSecondsMap Key: YARN-8607 URL: https://issues.apache.org/jira/browse/YARN-8607 Project: Hadoop YAR

[jira] [Commented] (YARN-8546) Resource leak caused by a reserved container being released more than once under async scheduling

2018-07-31 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564638#comment-16564638 ] Tao Yang commented on YARN-8546: Thanks [~leftnoteasy]! > Resource leak caused by a reser

[jira] [Commented] (YARN-7494) Add muti node lookup support for better placement

2018-07-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564589#comment-16564589 ] Wangda Tan commented on YARN-7494: -- [~sunilg], Thanks for updating the patch, some comm

[jira] [Commented] (YARN-7833) [PERF/TEST] Extend SLS to support simulation of a Federated Environment

2018-07-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564555#comment-16564555 ] genericqa commented on YARN-7833: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (YARN-8160) Yarn Service Upgrade: Support upgrade of service that use docker containers

2018-07-31 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16441414#comment-16441414 ] Chandni Singh edited comment on YARN-8160 at 8/1/18 12:29 AM: --

[jira] [Commented] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-07-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564538#comment-16564538 ] Haibo Chen commented on YARN-8468: -- Chatted with [~wilfreds] on how the scheduler can pic

[jira] [Commented] (YARN-6966) NodeManager metrics may return wrong negative values when NM restart

2018-07-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564512#comment-16564512 ] Haibo Chen commented on YARN-6966: -- [~snemeth] The unit tests are related. Seems that the

[jira] [Commented] (YARN-6966) NodeManager metrics may return wrong negative values when NM restart

2018-07-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564474#comment-16564474 ] genericqa commented on YARN-6966: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-8579) New AM attempt could not retrieve previous attempt component data

2018-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564456#comment-16564456 ] Hudson commented on YARN-8579: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #146

[jira] [Commented] (YARN-7974) Allow updating application tracking url after registration

2018-07-31 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564451#comment-16564451 ] Jonathan Hung commented on YARN-7974: - Attached branch-2.001 patch. Main incompatibili

[jira] [Updated] (YARN-7974) Allow updating application tracking url after registration

2018-07-31 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7974: Attachment: YARN-7974-branch-2.001.patch > Allow updating application tracking url after registratio

[jira] [Commented] (YARN-8522) Application fails with InvalidResourceRequestException

2018-07-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564437#comment-16564437 ] Wangda Tan commented on YARN-8522: -- LGTM +1, thanks [~Zian Chen], Will commit shortly, we

[jira] [Updated] (YARN-8522) Application fails with InvalidResourceRequestException

2018-07-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8522: - Target Version/s: 3.2.0, 3.1.1 Priority: Critical (was: Major) > Application fails with Inval

[jira] [Commented] (YARN-8553) Reduce complexity of AHSWebService getApps method

2018-07-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564424#comment-16564424 ] genericqa commented on YARN-8553: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-6966) NodeManager metrics may return wrong negative values when NM restart

2018-07-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564421#comment-16564421 ] Haibo Chen commented on YARN-6966: -- Retriggerred a Jenkins job now that HADOOP-15644 is f

[jira] [Commented] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-07-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564416#comment-16564416 ] Haibo Chen commented on YARN-8468: -- Thanks [~bsteinbach] for the patch and the detailed r

[jira] [Updated] (YARN-7833) [PERF/TEST] Extend SLS to support simulation of a Federated Environment

2018-07-31 Thread Tanuj Nayak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanuj Nayak updated YARN-7833: -- Attachment: YARN-7833.v6.patch > [PERF/TEST] Extend SLS to support simulation of a Federated Environment

[jira] [Updated] (YARN-7833) [PERF/TEST] Extend SLS to support simulation of a Federated Environment

2018-07-31 Thread Tanuj Nayak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanuj Nayak updated YARN-7833: -- Attachment: (was: YARN-7833.v6.patch) > [PERF/TEST] Extend SLS to support simulation of a Federated

[jira] [Updated] (YARN-7833) [PERF/TEST] Extend SLS to support simulation of a Federated Environment

2018-07-31 Thread Tanuj Nayak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanuj Nayak updated YARN-7833: -- Attachment: YARN-7833.v6.patch > [PERF/TEST] Extend SLS to support simulation of a Federated Environment

[jira] [Updated] (YARN-8600) RegistryDNS hang when remote lookup does not reply

2018-07-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8600: - Priority: Critical (was: Major) > RegistryDNS hang when remote lookup does not reply > --

[jira] [Updated] (YARN-8579) New AM attempt could not retrieve previous attempt component data

2018-07-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8579: - Target Version/s: 3.2.0, 3.1.2 Fix Version/s: (was: 3.1.2) (was: 3.2.0

[jira] [Updated] (YARN-8518) test-container-executor test_is_empty() is broken

2018-07-31 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-8518: Fix Version/s: 3.0.3 2.9.2 3.1.1 > test-container-executor tes

[jira] [Commented] (YARN-8509) Fix UserLimit calculation for preemption to balance scenario after queue satisfied

2018-07-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564326#comment-16564326 ] genericqa commented on YARN-8509: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-8392) Allow multiple tags for anti-affinity placement policy in service specification

2018-07-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564309#comment-16564309 ] genericqa commented on YARN-8392: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (YARN-7512) Support service upgrade via YARN Service API and CLI

2018-07-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7512: - Target Version/s: 3.1.2 (was: 3.1.1) > Support service upgrade via YARN Service API and CLI > ---

[jira] [Updated] (YARN-8399) NodeManager is giving 403 GSS exception post upgrade to 3.1 in secure mode

2018-07-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8399: - Target Version/s: 2.10.0, 3.2.0, 3.0.3, 3.1.2 (was: 2.10.0, 3.2.0, 3.1.1, 3.0.3) > NodeManager is giving

[jira] [Updated] (YARN-8520) Document best practice for user management

2018-07-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8520: - Target Version/s: 3.2.0, 3.1.2 (was: 3.2.0, 3.1.1) > Document best practice for user management > ---

[jira] [Updated] (YARN-8052) Move overwriting of service definition during flex to service master

2018-07-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8052: - Target Version/s: 3.1.2 (was: 3.1.1) > Move overwriting of service definition during flex to service mast

[jira] [Updated] (YARN-8136) Add version attribute to site doc examples and quickstart

2018-07-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8136: - Target Version/s: 3.1.2 (was: 3.1.1) > Add version attribute to site doc examples and quickstart > --

[jira] [Updated] (YARN-8399) NodeManager is giving 403 GSS exception post upgrade to 3.1 in secure mode

2018-07-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8399: - Target Version/s: 2.10.0, 3.2.0, 3.0.3 (was: 2.10.0, 3.2.0, 3.0.3, 3.1.2) > NodeManager is giving 403 GSS

[jira] [Updated] (YARN-8161) ServiceState FLEX should be removed

2018-07-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8161: - Target Version/s: 3.2.0, 3.1.2 (was: 3.2.0, 3.1.1) > ServiceState FLEX should be removed > --

[jira] [Updated] (YARN-8366) Expose debug log information when user intend to enable GPU without setting nvidia-smi path

2018-07-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8366: - Target Version/s: 3.2.0, 3.1.2 (was: 3.2.0, 3.1.1) > Expose debug log information when user intend to ena

[jira] [Updated] (YARN-8453) Additional Unit tests to verify queue limit and max-limit with multiple resource types

2018-07-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8453: - Target Version/s: 3.0.4, 3.1.2 (was: 3.1.1, 3.0.4) > Additional Unit tests to verify queue limit and max

[jira] [Updated] (YARN-8552) [DS] Container report fails for distributed containers

2018-07-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8552: - Target Version/s: 3.1.2 (was: 3.1.1) > [DS] Container report fails for distributed containers >

[jira] [Commented] (YARN-7833) [PERF/TEST] Extend SLS to support simulation of a Federated Environment

2018-07-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564304#comment-16564304 ] genericqa commented on YARN-7833: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-07-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8468: - Component/s: (was: resourcemanager) fairscheduler > Limit container sizes per queue i

[jira] [Updated] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-07-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8468: - Labels: (was: patch) > Limit container sizes per queue in FairScheduler > --

[jira] [Updated] (YARN-8553) Reduce complexity of AHSWebService getApps method

2018-07-31 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8553: - Attachment: YARN-8553.001.patch > Reduce complexity of AHSWebService getApps method >

[jira] [Commented] (YARN-8553) Reduce complexity of AHSWebService getApps method

2018-07-31 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564301#comment-16564301 ] Szilard Nemeth commented on YARN-8553: -- Re-uploading patch, somehow yetus did not rec

[jira] [Updated] (YARN-7833) [PERF/TEST] Extend SLS to support simulation of a Federated Environment

2018-07-31 Thread Tanuj Nayak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanuj Nayak updated YARN-7833: -- Attachment: YARN-7833.v5.patch > [PERF/TEST] Extend SLS to support simulation of a Federated Environment

[jira] [Commented] (YARN-8392) Allow multiple tags for anti-affinity placement policy in service specification

2018-07-31 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564275#comment-16564275 ] Gour Saha commented on YARN-8392: - Thanks [~billie.rinaldi]. Patch 4 looks good. The docum

[jira] [Commented] (YARN-8418) App local logs could leaked if log aggregation fails to initialize for the app

2018-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564273#comment-16564273 ] Hudson commented on YARN-8418: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #146

[jira] [Commented] (YARN-8263) DockerClient still touches hadoop.tmp.dir

2018-07-31 Thread Craig Condit (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564271#comment-16564271 ] Craig Condit commented on YARN-8263: I can dig into that further. Will submit a new pa

[jira] [Commented] (YARN-8301) Yarn Service Upgrade: Add documentation

2018-07-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564255#comment-16564255 ] Wangda Tan commented on YARN-8301: -- Committed to branch-3.1.1, thanks [~csingh]/[~eyang].

[jira] [Updated] (YARN-8508) On NodeManager container gets cleaned up before its pid file is created

2018-07-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8508: - Fix Version/s: (was: 3.1.2) 3.1.1 > On NodeManager container gets cleaned up before

[jira] [Commented] (YARN-8508) On NodeManager container gets cleaned up before its pid file is created

2018-07-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564256#comment-16564256 ] Wangda Tan commented on YARN-8508: -- Committed to branch-3.1.1, thanks [~csingh]! > On No

[jira] [Commented] (YARN-8546) Resource leak caused by a reserved container being released more than once under async scheduling

2018-07-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564254#comment-16564254 ] Wangda Tan commented on YARN-8546: -- Committed to branch-3.1.1, thanks [~Tao Yang]/[~cheer

[jira] [Updated] (YARN-8301) Yarn Service Upgrade: Add documentation

2018-07-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8301: - Fix Version/s: (was: 3.1.2) 3.1.1 > Yarn Service Upgrade: Add documentation > -

[jira] [Commented] (YARN-8528) Final states in ContainerAllocation might be modified externally causing unexpected allocation results

2018-07-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564253#comment-16564253 ] Wangda Tan commented on YARN-8528: -- Committed to branch-3.1.1, thanks [~cheersyang] > Fi

[jira] [Updated] (YARN-8546) Resource leak caused by a reserved container being released more than once under async scheduling

2018-07-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8546: - Fix Version/s: (was: 3.1.2) 3.1.1 > Resource leak caused by a reserved container be

[jira] [Updated] (YARN-8528) Final states in ContainerAllocation might be modified externally causing unexpected allocation results

2018-07-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8528: - Fix Version/s: (was: 3.1.2) 3.1.1 > Final states in ContainerAllocation might be mo

[jira] [Commented] (YARN-8579) New AM attempt could not retrieve previous attempt component data

2018-07-31 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564250#comment-16564250 ] Gour Saha commented on YARN-8579: - Thanks [~csingh]. [~eyang] please review and commit whe

[jira] [Commented] (YARN-8559) Expose mutable-conf scheduler's configuration in RM /scheduler-conf endpoint

2018-07-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564213#comment-16564213 ] Wangda Tan commented on YARN-8559: -- Thanks [~cheersyang], Some suggestions: 1) Instead

[jira] [Commented] (YARN-8605) TestDominantResourceFairnessPolicy.testModWhileSorting is flaky

2018-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564205#comment-16564205 ] Hudson commented on YARN-8605: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #146

[jira] [Commented] (YARN-8392) Allow multiple tags for anti-affinity placement policy in service specification

2018-07-31 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564200#comment-16564200 ] Billie Rinaldi commented on YARN-8392: -- Thanks for the review, [~gsaha]! Patch 4 impr

[jira] [Updated] (YARN-8392) Allow multiple tags for anti-affinity placement policy in service specification

2018-07-31 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-8392: - Attachment: YARN-8392.4.patch > Allow multiple tags for anti-affinity placement policy in service

[jira] [Commented] (YARN-8605) TestDominantResourceFairnessPolicy.testModWhileSorting: flaky

2018-07-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564146#comment-16564146 ] Haibo Chen commented on YARN-8605: -- +1 on the patch. Checking in shortly. > TestDominant

[jira] [Updated] (YARN-8605) TestDominantResourceFairnessPolicy.testModWhileSorting is flaky

2018-07-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8605: - Summary: TestDominantResourceFairnessPolicy.testModWhileSorting is flaky (was: TestDominantResourceFairne

[jira] [Commented] (YARN-8263) DockerClient still touches hadoop.tmp.dir

2018-07-31 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564136#comment-16564136 ] Jason Lowe commented on YARN-8263: -- Thanks for the patch! Patch looks good, but I think

[jira] [Commented] (YARN-6966) NodeManager metrics may return wrong negative values when NM restart

2018-07-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564137#comment-16564137 ] Haibo Chen commented on YARN-6966: -- I created HADOOP-15644 to fix the branch-2 docker bui

[jira] [Commented] (YARN-8606) Opportunistic scheduling doesnt work after failover

2018-07-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564089#comment-16564089 ] Wangda Tan commented on YARN-8606: -- [~bibinchundatt], is this a regression recently? If y

[jira] [Updated] (YARN-4946) RM should not consider an application as COMPLETED when log aggregation is not in a terminal state

2018-07-31 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-4946: - Summary: RM should not consider an application as COMPLETED when log aggregation is not in a termi

[jira] [Updated] (YARN-4946) RM should not consider an application as COMPLETED when log aggregation is not in terminal state

2018-07-31 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-4946: - Attachment: YARN-4946.001.patch > RM should not consider an application as COMPLETED when log aggr

[jira] [Updated] (YARN-4946) RM should not consider an application as COMPLETED when log aggregation is not in terminal state

2018-07-31 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-4946: - Summary: RM should not consider an application as COMPLETED when log aggregation is not in termina

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2018-07-31 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564065#comment-16564065 ] Manikandan R commented on YARN-7159: [~sunilg] Jenkins results are fine. Is this good

[jira] [Commented] (YARN-8579) New AM attempt could not retrieve previous attempt component data

2018-07-31 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564062#comment-16564062 ] Chandni Singh commented on YARN-8579: - +1 LGTM > New AM attempt could not retrieve pr

[jira] [Comment Edited] (YARN-4175) Example of use YARN-1197

2018-07-31 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564057#comment-16564057 ] Manikandan R edited comment on YARN-4175 at 7/31/18 5:45 PM: -

[jira] [Updated] (YARN-4175) Example of use YARN-1197

2018-07-31 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-4175: --- Attachment: YARN-4175.004.patch > Example of use YARN-1197 > > >

[jira] [Commented] (YARN-4175) Example of use YARN-1197

2018-07-31 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564057#comment-16564057 ] Manikandan R commented on YARN-4175: Thanks [~asuresh]. Updated earlier patch to do un

[jira] [Commented] (YARN-8606) Opportunistic scheduling doesnt work after failover

2018-07-31 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564054#comment-16564054 ] Suma Shivaprasad commented on YARN-8606: Thanks for the patch [~bibinchundatt]. cr

[jira] [Commented] (YARN-7948) Enable refreshing maximum allocation for multiple resource types

2018-07-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564049#comment-16564049 ] Haibo Chen commented on YARN-7948: -- Thanks [~snemeth] for updating the patch. I have a fe

[jira] [Commented] (YARN-8559) Expose mutable-conf scheduler's configuration in RM /scheduler-conf endpoint

2018-07-31 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564015#comment-16564015 ] Suma Shivaprasad commented on YARN-8559: Thanks [~cheersyang] Missed this in the e

[jira] [Commented] (YARN-8175) Add support for Node Labels in SLS

2018-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564000#comment-16564000 ] Hudson commented on YARN-8175: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #146

[jira] [Assigned] (YARN-8242) YARN NM: OOM error while reading back the state store on recovery

2018-07-31 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned YARN-8242: Assignee: Pradeep Ambati Thanks for picking this up, [~pradeepambati]! RecoveryIterator should ext

  1   2   >