[jira] [Updated] (YARN-9519) TFile log aggregation file format is insensitive to the yarn.log-aggregation.TFile.remote-app-log-dir config

2019-04-30 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9519: - Description: The TFile log aggregation file format is not sensitive to the yarn.log-aggregation.T

[jira] [Commented] (YARN-9519) TFile log aggregation file format is insensitive to the yarn.log-aggregation.TFile.remote-app-log-dir config

2019-04-30 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16830051#comment-16830051 ] Szilard Nemeth commented on YARN-9519: -- Hi [~adam.antal]! Thanks for this patch! +1 (

[jira] [Commented] (YARN-9518) can't use CGroups with YARN in centos7

2019-04-30 Thread Shurong Mai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16830057#comment-16830057 ] Shurong Mai commented on YARN-9518: --- Hi, [~Jim_Brennan] ,  does "latest code (trunk)" me

[jira] [Updated] (YARN-9475) Create basic VE plugin

2019-04-30 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9475: --- Fix Version/s: 3.3.0 > Create basic VE plugin > -- > > Key: YARN-9

[jira] [Updated] (YARN-9518) can't use CGroups with YARN in centos7

2019-04-30 Thread Shurong Mai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shurong Mai updated YARN-9518: -- Attachment: (was: YARN-9518.patch) > can't use CGroups with YARN in centos7 > -

[jira] [Updated] (YARN-9518) can't use CGroups with YARN in centos7

2019-04-30 Thread Shurong Mai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shurong Mai updated YARN-9518: -- Attachment: YARN-9518.patch > can't use CGroups with YARN in centos7 >

[jira] [Commented] (YARN-9518) can't use CGroups with YARN in centos7

2019-04-30 Thread Shurong Mai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16830103#comment-16830103 ] Shurong Mai commented on YARN-9518: --- [~Jim_Brennan], I have red the source code about th

[jira] [Comment Edited] (YARN-9518) can't use CGroups with YARN in centos7

2019-04-30 Thread Shurong Mai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16830103#comment-16830103 ] Shurong Mai edited comment on YARN-9518 at 4/30/19 9:44 AM: [~

[jira] [Created] (YARN-9521) RM filed to start due to system services

2019-04-30 Thread kyungwan nam (JIRA)
kyungwan nam created YARN-9521: -- Summary: RM filed to start due to system services Key: YARN-9521 URL: https://issues.apache.org/jira/browse/YARN-9521 Project: Hadoop YARN Issue Type: Bug Af

[jira] [Updated] (YARN-9521) RM filed to start due to system services

2019-04-30 Thread kyungwan nam (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kyungwan nam updated YARN-9521: --- Attachment: YARN-9521.001.patch > RM filed to start due to system services > -

[jira] [Commented] (YARN-9518) can't use CGroups with YARN in centos7

2019-04-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16830132#comment-16830132 ] Hadoop QA commented on YARN-9518: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-9518) can't use CGroups with YARN in centos7

2019-04-30 Thread Shurong Mai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shurong Mai updated YARN-9518: -- Description: The os version is centos7.   When I had set configuration variables  for cgroup with yarn

[jira] [Commented] (YARN-9518) can't use CGroups with YARN in centos7

2019-04-30 Thread Shurong Mai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16830140#comment-16830140 ] Shurong Mai commented on YARN-9518: --- [~Jim_Brennan],  I have read YARN-5301 and the patc

[jira] [Created] (YARN-9522) AppBlock ignores full qualified class name of PseudoAuthenticationHandler

2019-04-30 Thread Prabhu Joseph (JIRA)
Prabhu Joseph created YARN-9522: --- Summary: AppBlock ignores full qualified class name of PseudoAuthenticationHandler Key: YARN-9522 URL: https://issues.apache.org/jira/browse/YARN-9522 Project: Hadoop Y

[jira] [Updated] (YARN-9522) AppBlock ignores full qualified class name of PseudoAuthenticationHandler

2019-04-30 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9522: Affects Version/s: 3.2.0 > AppBlock ignores full qualified class name of PseudoAuthenticationHandler

[jira] [Commented] (YARN-9521) RM filed to start due to system services

2019-04-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16830174#comment-16830174 ] Hadoop QA commented on YARN-9521: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-9518) can't use CGroups with YARN in centos7

2019-04-30 Thread Shurong Mai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shurong Mai updated YARN-9518: -- Description: The os version is centos7.  {code:java} cat /etc/redhat-release CentOS Linux release 7.3.16

[jira] [Updated] (YARN-9477) Implement VE discovery using libudev

2019-04-30 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9477: --- Attachment: YARN-9477-POC2.patch > Implement VE discovery using libudev >

[jira] [Commented] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-04-30 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16830264#comment-16830264 ] Tao Yang commented on YARN-9440: Thanks [~cheersyang] for some advices when we talked on t

[jira] [Updated] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-04-30 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9440: --- Attachment: YARN-9440.003.patch > Improve diagnostics for scheduler and app activities > -

[jira] [Commented] (YARN-9477) Implement VE discovery using libudev

2019-04-30 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16830272#comment-16830272 ] Szilard Nemeth commented on YARN-9477: -- Hi [~pbacsko]! Some comments: 1. In UdevUtil

[jira] [Updated] (YARN-9477) Implement VE discovery using libudev

2019-04-30 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9477: --- Attachment: YARN-9477-POC3.patch > Implement VE discovery using libudev >

[jira] [Commented] (YARN-9477) Implement VE discovery using libudev

2019-04-30 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16830297#comment-16830297 ] Peter Bacsko commented on YARN-9477: Thanks [~snemeth] for the comments. _In VEDevice

[jira] [Commented] (YARN-9477) Implement VE discovery using libudev

2019-04-30 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16830306#comment-16830306 ] Szilard Nemeth commented on YARN-9477: -- Thanks [~pbacsko] for the quick update! The l

[jira] [Commented] (YARN-9518) can't use CGroups with YARN in centos7

2019-04-30 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16830347#comment-16830347 ] Jim Brennan commented on YARN-9518: --- [~shurong.mai], your patch needs to be based on bra

[jira] [Comment Edited] (YARN-9520) fair scheduler: inter-queue-preemption.enabled, intra-queue-preemption.enabled options

2019-04-30 Thread Sudhir Babu Pothineni (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16830398#comment-16830398 ] Sudhir Babu Pothineni edited comment on YARN-9520 at 4/30/19 3:29 PM: --

[jira] [Commented] (YARN-9520) fair scheduler: inter-queue-preemption.enabled, intra-queue-preemption.enabled options

2019-04-30 Thread Sudhir Babu Pothineni (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16830398#comment-16830398 ] Sudhir Babu Pothineni commented on YARN-9520: - Thanks [~yufeigu] didn't though

[jira] [Commented] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-04-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16830417#comment-16830417 ] Hadoop QA commented on YARN-9440: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (YARN-9523) Rename docker profile to dist profile

2019-04-30 Thread Eric Yang (JIRA)
Eric Yang created YARN-9523: --- Summary: Rename docker profile to dist profile Key: YARN-9523 URL: https://issues.apache.org/jira/browse/YARN-9523 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-9523) Rename docker profile to dist profile

2019-04-30 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16830545#comment-16830545 ] Jonathan Eagles commented on YARN-9523: --- Pointing out the highly relevant community

[jira] [Commented] (YARN-9523) Rename docker profile to dist profile

2019-04-30 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16830578#comment-16830578 ] Eric Yang commented on YARN-9523: - [~jeagles] With all due respect, this issue will not be

[jira] [Assigned] (YARN-9523) Rename docker profile to dist profile

2019-04-30 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-9523: --- Assignee: Eric Yang > Rename docker profile to dist profile > - >

[jira] [Commented] (YARN-9523) Rename docker profile to dist profile

2019-04-30 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16830586#comment-16830586 ] Jonathan Eagles commented on YARN-9523: --- bq. please work on changing the JIRA summar

[jira] [Commented] (YARN-9523) Rename docker profile to dist profile

2019-04-30 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16830658#comment-16830658 ] Eric Yang commented on YARN-9523: - [~jeagles], [~ebadger] you are welcome to chime in to H

[jira] [Updated] (YARN-9523) Build application catalog docker image as part of hadoop dist build

2019-04-30 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-9523: Summary: Build application catalog docker image as part of hadoop dist build (was: Rename docker profile to

[jira] [Comment Edited] (YARN-9523) Build application catalog docker image as part of hadoop dist build

2019-04-30 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16830658#comment-16830658 ] Eric Yang edited comment on YARN-9523 at 4/30/19 8:21 PM: -- [~jeag

[jira] [Commented] (YARN-6929) yarn.nodemanager.remote-app-log-dir structure is not scalable

2019-04-30 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16830687#comment-16830687 ] Eric Yang commented on YARN-6929: - +1 Patch 11 looks good to me. > yarn.nodemanager.remot

[jira] [Commented] (YARN-6929) yarn.nodemanager.remote-app-log-dir structure is not scalable

2019-04-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16830714#comment-16830714 ] Hudson commented on YARN-6929: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #164

[jira] [Commented] (YARN-9520) fair scheduler: inter-queue-preemption.enabled, intra-queue-preemption.enabled options

2019-04-30 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16830769#comment-16830769 ] Yufei Gu commented on YARN-9520: * inter-queue preemption will not happen among the applic

[jira] [Updated] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-04-30 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9440: --- Attachment: YARN-9440.003.patch > Improve diagnostics for scheduler and app activities > -

[jira] [Updated] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-04-30 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9440: --- Attachment: (was: YARN-9440.003.patch) > Improve diagnostics for scheduler and app activities > --

[jira] [Updated] (YARN-9507) Fix NPE in NodeManager#serviceStop on startup failure

2019-04-30 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-9507: --- Summary: Fix NPE in NodeManager#serviceStop on startup failure (was: Fix NPE if NM fails to i

[jira] [Commented] (YARN-6929) yarn.nodemanager.remote-app-log-dir structure is not scalable

2019-04-30 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16830815#comment-16830815 ] Prabhu Joseph commented on YARN-6929: - Thanks [~eyang]. > yarn.nodemanager.remote-app

[jira] [Commented] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-04-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16830859#comment-16830859 ] Hadoop QA commented on YARN-9440: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||