[jira] [Commented] (YARN-8873) Add CSI java-based client library

2018-10-22 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660117#comment-16660117 ] Sunil Govindan commented on YARN-8873: -- Thanks [~cheersyang] for clarifying. Lets do these logging

[jira] [Updated] (YARN-8599) Build Master module for MaWo app

2018-10-22 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora updated YARN-8599: - Attachment: YARN-8599.002.patch > Build Master module for MaWo app > > >

[jira] [Commented] (YARN-8873) Add CSI java-based client library

2018-10-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660115#comment-16660115 ] Weiwei Yang commented on YARN-8873: --- Hi [~sunilg] Thanks for the comments, pls see my thoughts #1 

[jira] [Updated] (YARN-8598) Build Master Job Module for MaWo Application

2018-10-22 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora updated YARN-8598: - Attachment: YARN-8598.002.patch > Build Master Job Module for MaWo Application >

[jira] [Updated] (YARN-8597) Build Worker utility for MaWo Application

2018-10-22 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora updated YARN-8597: - Attachment: YARN-8597.002.patch > Build Worker utility for MaWo Application >

[jira] [Assigned] (YARN-8934) [GPG] Add JvmMetricsInfo and pause monitor

2018-10-22 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T reassigned YARN-8934: --- Assignee: Bilwa S T > [GPG] Add JvmMetricsInfo and pause monitor >

[jira] [Commented] (YARN-8897) LoadBasedRouterPolicy throws "NPE" in case of sub cluster unavailability

2018-10-22 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660104#comment-16660104 ] Bibin A Chundatt commented on YARN-8897: Thank you [~giovanni.fumarola] for the comments # What i

[jira] [Created] (YARN-8934) [GPG] Add JvmMetricsInfo and pause monitor

2018-10-22 Thread Bilwa S T (JIRA)
Bilwa S T created YARN-8934: --- Summary: [GPG] Add JvmMetricsInfo and pause monitor Key: YARN-8934 URL: https://issues.apache.org/jira/browse/YARN-8934 Project: Hadoop YARN Issue Type: Improvement

[jira] [Commented] (YARN-8551) Build Common module for MaWo application

2018-10-22 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660102#comment-16660102 ] Yesha Vora commented on YARN-8551: -- Thanks [~eyang]. Patch#3 is submitted with Apache license headers. >

[jira] [Updated] (YARN-8551) Build Common module for MaWo application

2018-10-22 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora updated YARN-8551: - Attachment: YARN-8551.003.patch > Build Common module for MaWo application >

[jira] [Commented] (YARN-8873) Add CSI java-based client library

2018-10-22 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660082#comment-16660082 ] Sunil Govindan commented on YARN-8873: -- Hi [~cheersyang] I wad going through this patch during my

[jira] [Commented] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-10-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660076#comment-16660076 ] Hadoop QA commented on YARN-8672: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8868) Set HTTPOnly attribute to Cookie

2018-10-22 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8868: - Fix Version/s: 3.2.1 3.1.2 > Set HTTPOnly attribute to Cookie >

[jira] [Updated] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-10-22 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8672: Attachment: YARN-8672.002.patch > TestContainerManager#testLocalingResourceWhileContainerRunning

[jira] [Commented] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-10-22 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660005#comment-16660005 ] Chandni Singh commented on YARN-8672: - Instead of waiting for the previous localizer runner to finish,

[jira] [Updated] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-10-22 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8672: Attachment: (was: YARN-8672.002.patch) >

[jira] [Updated] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-10-22 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8672: Attachment: YARN-8672.002.patch > TestContainerManager#testLocalingResourceWhileContainerRunning

[jira] [Commented] (YARN-8893) [AMRMProxy] Fix thread leak in AMRMClientRelayer and UAM client

2018-10-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659949#comment-16659949 ] Hadoop QA commented on YARN-8893: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8814) Yarn Service Upgrade: Update the swagger definition

2018-10-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659941#comment-16659941 ] Hadoop QA commented on YARN-8814: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8919) Some tests fail due to NoClassDefFoundError for OperatorCreationException

2018-10-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659927#comment-16659927 ] Hadoop QA commented on YARN-8919: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8930) CGroup-based strict container memory enforcement does not work with CGroupElasticMemoryController

2018-10-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659907#comment-16659907 ] Hadoop QA commented on YARN-8930: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8920) LogAggregation should be configurable to allow writing to underlying storage as appOwner or yarn user

2018-10-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659906#comment-16659906 ] Hadoop QA commented on YARN-8920: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8551) Build Common module for MaWo application

2018-10-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659904#comment-16659904 ] Hadoop QA commented on YARN-8551: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-22 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659902#comment-16659902 ] Wilfred Spiegelenburg commented on YARN-8865: - junit test failures: * TestRMDelegationTokens:

[jira] [Updated] (YARN-8933) [AMRMProxy] Fix potential empty AvailableResource and NumClusterNode in allocation response

2018-10-22 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8933: --- Summary: [AMRMProxy] Fix potential empty AvailableResource and NumClusterNode in allocation response

[jira] [Commented] (YARN-8933) [AMRMProxy] Fix potential null AvailableResource and NumClusterNode in allocation response

2018-10-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659888#comment-16659888 ] Hadoop QA commented on YARN-8933: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8814) Yarn Service Upgrade: Update the swagger definition

2018-10-22 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659889#comment-16659889 ] Chandni Singh commented on YARN-8814: - [~eyang] [~gsaha]  could you please review? > Yarn Service

[jira] [Updated] (YARN-8814) Yarn Service Upgrade: Update the swagger definition

2018-10-22 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8814: Description: Yarn swagger definition is missing states and API definitions added recently with

[jira] [Updated] (YARN-8814) Yarn Service Upgrade: Update the swagger definition

2018-10-22 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8814: Attachment: YARN-8814.001.patch > Yarn Service Upgrade: Update the swagger definition >

[jira] [Commented] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-10-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659885#comment-16659885 ] Hadoop QA commented on YARN-8672: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6167) RM option to delegate NM loss container action to AM

2018-10-22 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659882#comment-16659882 ] Billie Rinaldi commented on YARN-6167: -- Thanks for taking a look, [~leftnoteasy]! bq. Inside

[jira] [Commented] (YARN-8919) Some tests fail due to NoClassDefFoundError for OperatorCreationException

2018-10-22 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659872#comment-16659872 ] Takanobu Asanuma commented on YARN-8919: Thanks [~rkanter] and [~eyang] for the discussion and the

[jira] [Updated] (YARN-8919) Some tests fail due to NoClassDefFoundError for OperatorCreationException

2018-10-22 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated YARN-8919: --- Attachment: YARN-8919.2.patch > Some tests fail due to NoClassDefFoundError for

[jira] [Commented] (YARN-8761) Service AM support for decommissioning component instances

2018-10-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659862#comment-16659862 ] Hadoop QA commented on YARN-8761: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8551) Build Common module for MaWo application

2018-10-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659856#comment-16659856 ] Eric Yang commented on YARN-8551: - [~yeshavora], the newly added files don't have Apache license headers.

[jira] [Commented] (YARN-8911) ContainerScheduler incorrectly uses percentage number as the cpu resource utlization

2018-10-22 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659851#comment-16659851 ] Íñigo Goiri commented on YARN-8911: --- I don't think we have very good coverage of this code. Is there any

[jira] [Commented] (YARN-6167) RM option to delegate NM loss container action to AM

2018-10-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659844#comment-16659844 ] Hadoop QA commented on YARN-6167: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8928) TestRMAdminService is failing

2018-10-22 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659841#comment-16659841 ] Íñigo Goiri commented on YARN-8928: --- Another option is to parse the string and do the assertion with no

[jira] [Commented] (YARN-8928) TestRMAdminService is failing

2018-10-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659829#comment-16659829 ] Hadoop QA commented on YARN-8928: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8923) Cleanup references to ENV file type in YARN service code

2018-10-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659817#comment-16659817 ] Hudson commented on YARN-8923: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15289 (See

[jira] [Updated] (YARN-8930) CGroup-based strict container memory enforcement does not work with CGroupElasticMemoryController

2018-10-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8930: - Attachment: YARN-8930.01.patch > CGroup-based strict container memory enforcement does not work with >

[jira] [Commented] (YARN-8930) CGroup-based strict container memory enforcement does not work with CGroupElasticMemoryController

2018-10-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659812#comment-16659812 ] Haibo Chen commented on YARN-8930: -- Cleaned up the checkstyle issues in the new patch. > CGroup-based

[jira] [Commented] (YARN-8569) Create an interface to provide cluster information to application

2018-10-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659797#comment-16659797 ] Hadoop QA commented on YARN-8569: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8930) CGroup-based strict container memory enforcement does not work with CGroupElasticMemoryController

2018-10-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659792#comment-16659792 ] Hadoop QA commented on YARN-8930: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-10-22 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8672: Attachment: YARN-8672.001.patch > TestContainerManager#testLocalingResourceWhileContainerRunning

[jira] [Commented] (YARN-8923) Cleanup references to ENV file type in YARN service code

2018-10-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659774#comment-16659774 ] Eric Yang commented on YARN-8923: - Thank you [~suma.shivaprasad] for the patch. +1 for patch 002,

[jira] [Commented] (YARN-8929) DefaultOOMHandler should only pick running containers to kill upon oom events

2018-10-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659770#comment-16659770 ] Hadoop QA commented on YARN-8929: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8933) [AMRMProxy] Fix potential null AvailableResource and NumClusterNode in allocation response

2018-10-22 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8933: --- Attachment: YARN-8933.v1.patch > [AMRMProxy] Fix potential null AvailableResource and NumClusterNode

[jira] [Commented] (YARN-8930) CGroup-based strict container memory enforcement does not work with CGroupElasticMemoryController

2018-10-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659761#comment-16659761 ] Haibo Chen commented on YARN-8930: -- The patch allows the polling-based memory check to kick in, when the

[jira] [Updated] (YARN-8933) [AMRMProxy] Fix potential null AvailableResource and NumClusterNode in allocation response

2018-10-22 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8933: --- Issue Type: Sub-task (was: Task) Parent: YARN-5597 > [AMRMProxy] Fix potential null

[jira] [Updated] (YARN-8933) [AMRMProxy] Fix potential null AvailableResource and NumClusterNode in allocation response

2018-10-22 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8933: --- Component/s: federation amrmproxy > [AMRMProxy] Fix potential null AvailableResource

[jira] [Created] (YARN-8933) [AMRMProxy] Fix potential null AvailableResource and NumClusterNode in allocation response

2018-10-22 Thread Botong Huang (JIRA)
Botong Huang created YARN-8933: -- Summary: [AMRMProxy] Fix potential null AvailableResource and NumClusterNode in allocation response Key: YARN-8933 URL: https://issues.apache.org/jira/browse/YARN-8933

[jira] [Updated] (YARN-8932) ResourceUtilization cpu is misused in oversubscription as a percentage

2018-10-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8932: - Summary: ResourceUtilization cpu is misused in oversubscription as a percentage (was:

[jira] [Commented] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-10-22 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659755#comment-16659755 ] Chandni Singh commented on YARN-8672: - The test {{testLocalizingResourceWhileContainerRunning}} tries

[jira] [Commented] (YARN-8919) Some tests fail due to NoClassDefFoundError for OperatorCreationException

2018-10-22 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659750#comment-16659750 ] Robert Kanter commented on YARN-8919: - The MR client is decoupled from the web-proxy server, in a

[jira] [Commented] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659747#comment-16659747 ] Wangda Tan commented on YARN-8851: -- [~tangzhankun], Thanks for updating the patch, the latest patch

[jira] [Updated] (YARN-8920) LogAggregation should be configurable to allow writing to underlying storage as appOwner or yarn user

2018-10-22 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8920: --- Attachment: YARN-8920.5.patch > LogAggregation should be configurable to allow writing to

[jira] [Commented] (YARN-8920) LogAggregation should be configurable to allow writing to underlying storage as appOwner or yarn user

2018-10-22 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659746#comment-16659746 ] Suma Shivaprasad commented on YARN-8920: Fixed pending CS issues. > LogAggregation should be

[jira] [Commented] (YARN-8923) Cleanup references to ENV file type in YARN service code

2018-10-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659737#comment-16659737 ] Hadoop QA commented on YARN-8923: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8911) ContainerScheduler incorrectly uses percentage number as the cpu resource utlization

2018-10-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659739#comment-16659739 ] Haibo Chen commented on YARN-8911: -- Uploaded a new patch that 1) updates the ResourceUtilization cpu

[jira] [Updated] (YARN-8911) ContainerScheduler incorrectly uses percentage number as the cpu resource utlization

2018-10-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8911: - Attachment: YARN-8911.01.patch > ContainerScheduler incorrectly uses percentage number as the cpu

[jira] [Commented] (YARN-8918) [Submarine] Correct method usage of str.subString in CliUtils

2018-10-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659725#comment-16659725 ] Wangda Tan commented on YARN-8918: -- +1, thanks [~tangzhankun]. > [Submarine] Correct method usage of

[jira] [Commented] (YARN-8928) TestRMAdminService is failing

2018-10-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659724#comment-16659724 ] Hadoop QA commented on YARN-8928: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8924) Refine the document or code related to legacy CPU isolation/enforcement

2018-10-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659723#comment-16659723 ] Wangda Tan commented on YARN-8924: -- Thanks [~tangzhankun] for filing and Jira and put analysis.

[jira] [Commented] (YARN-6167) RM option to delegate NM loss container action to AM

2018-10-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659719#comment-16659719 ] Wangda Tan commented on YARN-6167: -- Thanks [~billie.rinaldi], 1) Inside releaseContainers, why add

[jira] [Updated] (YARN-8911) ContainerScheduler incorrectly uses percentage number as the cpu resource utlization

2018-10-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8911: - Description: *UPDATE*:  *per discussion below, the cpu resource utlization (ResourceUtilzation.cpu) is

[jira] [Updated] (YARN-8911) ContainerScheduler incorrectly uses percentage number as the cpu resource utlization

2018-10-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8911: - Summary: ContainerScheduler incorrectly uses percentage number as the cpu resource utlization (was: NM

[jira] [Commented] (YARN-8928) TestRMAdminService is failing

2018-10-22 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659696#comment-16659696 ] Íñigo Goiri commented on YARN-8928: --- For the comment, I meant consolidating everything into the new

[jira] [Updated] (YARN-8761) Service AM support for decommissioning component instances

2018-10-22 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-8761: - Attachment: YARN-8761.02.patch > Service AM support for decommissioning component instances >

[jira] [Commented] (YARN-8778) Add Command Line interface to invoke interactive docker shell

2018-10-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659676#comment-16659676 ] Hadoop QA commented on YARN-8778: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8913) Add helper scripts to launch MaWo App to run Hadoop unit tests on Hadoop Cluster

2018-10-22 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora updated YARN-8913: - Attachment: YARN-8913.001.patch > Add helper scripts to launch MaWo App to run Hadoop unit tests on

[jira] [Commented] (YARN-8542) Yarn Service: Add component name to container json

2018-10-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659663#comment-16659663 ] Hudson commented on YARN-8542: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15287 (See

[jira] [Commented] (YARN-8920) LogAggregation should be configurable to allow writing to underlying storage as appOwner or yarn user

2018-10-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659660#comment-16659660 ] Hadoop QA commented on YARN-8920: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-8932) ResourceUtilization cpu is misused in oversubscription

2018-10-22 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-8932: Summary: ResourceUtilization cpu is misused in oversubscription Key: YARN-8932 URL: https://issues.apache.org/jira/browse/YARN-8932 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-8930) CGroup-based strict container memory enforcement does not work with CGroupElasticMemoryController

2018-10-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8930: - Attachment: YARN-8930.00.patch > CGroup-based strict container memory enforcement does not work with >

[jira] [Commented] (YARN-8919) Some tests fail due to NoClassDefFoundError for OperatorCreationException

2018-10-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659638#comment-16659638 ] Eric Yang commented on YARN-8919: - [~rkanter] Thank you for the explanation. I don't disagree with

[jira] [Updated] (YARN-8928) TestRMAdminService is failing

2018-10-22 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated YARN-8928: -- Attachment: YARN-8928.3.patch > TestRMAdminService is failing > - > >

[jira] [Commented] (YARN-8928) TestRMAdminService is failing

2018-10-22 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659637#comment-16659637 ] BELUGA BEHR commented on YARN-8928: --- Hey [~elgoiri], thanks for the review.  I'm sorry for the headache

[jira] [Commented] (YARN-8922) Fix test-container-executor

2018-10-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659631#comment-16659631 ] Hudson commented on YARN-8922: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15286 (See

[jira] [Commented] (YARN-8928) TestRMAdminService is failing

2018-10-22 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659620#comment-16659620 ] Íñigo Goiri commented on YARN-8928: --- Thanks [~belugabehr] for [^YARN-8928.2.patch]. A couple comments:

[jira] [Commented] (YARN-8569) Create an interface to provide cluster information to application

2018-10-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659618#comment-16659618 ] Eric Yang commented on YARN-8569: - Patch 015 rebased on YARN-8922. > Create an interface to provide

[jira] [Updated] (YARN-8569) Create an interface to provide cluster information to application

2018-10-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8569: Attachment: YARN-8569.015.patch > Create an interface to provide cluster information to application >

[jira] [Commented] (YARN-8542) Yarn Service: Add component name to container json

2018-10-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659605#comment-16659605 ] Eric Yang commented on YARN-8542: - [~csingh] Thank you for the patch. +1 for patch 002, will commit

[jira] [Created] (YARN-8931) Yarn Service GET APIs missing for components

2018-10-22 Thread Chandni Singh (JIRA)
Chandni Singh created YARN-8931: --- Summary: Yarn Service GET APIs missing for components Key: YARN-8931 URL: https://issues.apache.org/jira/browse/YARN-8931 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-8922) Fix test-container-executor

2018-10-22 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659599#comment-16659599 ] Robert Kanter commented on YARN-8922: - Thanks [~eyang] for your help figuring this out! > Fix

[jira] [Commented] (YARN-8921) SnapshotBasedOverAllocationPolicy always caps the amount of memory availabe to 4 GBs

2018-10-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659557#comment-16659557 ] Hadoop QA commented on YARN-8921: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8929) DefaultOOMHandler should only pick running containers to kill upon oom events

2018-10-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659526#comment-16659526 ] Haibo Chen commented on YARN-8929: -- The patch does three things 1) To kill a container, read its

[jira] [Updated] (YARN-8930) CGroup-based strict container memory enforcement does not work with CGroupElasticMemoryController

2018-10-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8930: - Summary: CGroup-based strict container memory enforcement does not work with

[jira] [Commented] (YARN-8922) Fix test-container-executor

2018-10-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659517#comment-16659517 ] Eric Yang commented on YARN-8922: - Thank you [~rkanter] for the patch. +1 patch 002 works as intended.

[jira] [Created] (YARN-8930) CGroup-based strict container memory management does not work with CGroupElasticMemoryController

2018-10-22 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-8930: Summary: CGroup-based strict container memory management does not work with CGroupElasticMemoryController Key: YARN-8930 URL: https://issues.apache.org/jira/browse/YARN-8930

[jira] [Updated] (YARN-6167) RM option to delegate NM loss container action to AM

2018-10-22 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-6167: - Fix Version/s: (was: yarn-native-services) > RM option to delegate NM loss container action

[jira] [Comment Edited] (YARN-6167) RM option to delegate NM loss container action to AM

2018-10-22 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659496#comment-16659496 ] Billie Rinaldi edited comment on YARN-6167 at 10/22/18 7:23 PM: Attached a

[jira] [Updated] (YARN-6167) RM option to delegate NM loss container action to AM

2018-10-22 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-6167: - Target Version/s: 3.3.0 > RM option to delegate NM loss container action to AM >

[jira] [Commented] (YARN-6167) RM option to delegate NM loss container action to AM

2018-10-22 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659496#comment-16659496 ] Billie Rinaldi commented on YARN-6167: -- Attached a first draft of this patch. I'd like to get

[jira] [Commented] (YARN-8922) Fix test-container-executor

2018-10-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659476#comment-16659476 ] Hadoop QA commented on YARN-8922: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6167) RM option to delegate NM loss container action to AM

2018-10-22 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-6167: - Attachment: YARN-6167.01.patch > RM option to delegate NM loss container action to AM >

[jira] [Updated] (YARN-8929) DefaultOOMHandler should only pick running containers to kill upon oom events

2018-10-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8929: - Attachment: YARN-8929.00.patch > DefaultOOMHandler should only pick running containers to kill upon oom

[jira] [Assigned] (YARN-6167) RM option to delegate NM loss container action to AM

2018-10-22 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi reassigned YARN-6167: Assignee: Billie Rinaldi > RM option to delegate NM loss container action to AM >

[jira] [Updated] (YARN-8929) DefaultOOMHandler should only pick running containers to kill upon oom events

2018-10-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8929: - Attachment: (was: YARN-8921-YARN-1011.00.patch) > DefaultOOMHandler should only pick running

[jira] [Updated] (YARN-8929) DefaultOOMHandler should only pick running containers to kill upon oom events

2018-10-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8929: - Attachment: YARN-8921-YARN-1011.00.patch > DefaultOOMHandler should only pick running containers to kill

  1   2   >