[jira] [Commented] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644491#comment-16644491 ] Hadoop QA commented on YARN-8858: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644482#comment-16644482 ] Hadoop QA commented on YARN-8842: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-09 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644473#comment-16644473 ] Wilfred Spiegelenburg edited comment on YARN-8842 at 10/10/18 5:29 AM:

[jira] [Commented] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-09 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644473#comment-16644473 ] Wilfred Spiegelenburg commented on YARN-8842: - Thank you [~snemeth]. I am glad we gave this

[jira] [Commented] (YARN-8753) [UI2] Lost nodes representation missing from Nodemanagers Chart

2018-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644454#comment-16644454 ] Hadoop QA commented on YARN-8753: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-5742) Serve aggregated logs of historical apps from timeline service

2018-10-09 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644453#comment-16644453 ] Rohith Sharma K S edited comment on YARN-5742 at 10/10/18 4:51 AM: ---

[jira] [Commented] (YARN-5742) Serve aggregated logs of historical apps from timeline service

2018-10-09 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644453#comment-16644453 ] Rohith Sharma K S commented on YARN-5742: - [~vinodkv] [~vrushalic] [~sunilg] could you guys take a

[jira] [Commented] (YARN-5742) Serve aggregated logs of historical apps from timeline service

2018-10-09 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644452#comment-16644452 ] Rohith Sharma K S commented on YARN-5742: - Thanks [~abmodi] bq. throw new

[jira] [Updated] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8468: -- Attachment: YARN-8468-branch-3.1.020.patch > Enable the use of queue based maximum container allocation

[jira] [Reopened] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reopened YARN-8468: --- > Enable the use of queue based maximum container allocation limit and > implement it in FairScheduler >

[jira] [Commented] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1660#comment-1660 ] Weiwei Yang commented on YARN-8468: --- Manually trigger the build won't work as the patch is already

[jira] [Reopened] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reopened YARN-8468: --- > Enable the use of queue based maximum container allocation limit and > implement it in FairScheduler >

[jira] [Resolved] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YARN-8468. --- Resolution: Fixed > Enable the use of queue based maximum container allocation limit and > implement

[jira] [Commented] (YARN-8569) Create an interface to provide cluster information to application

2018-10-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644427#comment-16644427 ] Wangda Tan commented on YARN-8569: -- [~eyang],    {quote}In sync_yarn_sysfs, check_nm_local_dir make sure

[jira] [Updated] (YARN-8827) Plumb aggregated application resource utilization from the NM to RM

2018-10-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-8827: -- Fix Version/s: YARN-1011 > Plumb aggregated application resource utilization from the NM to RM >

[jira] [Updated] (YARN-8827) Plumb aggregated application resource utilization from the NM to RM

2018-10-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-8827: -- Affects Version/s: YARN-1011 > Plumb aggregated application resource utilization from the NM to RM >

[jira] [Updated] (YARN-8827) Plumb aggregated application resource utilization from the NM to RM

2018-10-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-8827: -- Summary: Plumb aggregated application resource utilization from the NM to RM (was: Plumb per

[jira] [Commented] (YARN-8827) Plumb per application resource utilization from the NM to RM

2018-10-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644410#comment-16644410 ] Arun Suresh commented on YARN-8827: --- Thanks for the review [~elgoiri]. Committing this.. > Plumb per

[jira] [Updated] (YARN-8827) Plumb per application resource utilization from the NM to RM

2018-10-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-8827: -- Summary: Plumb per application resource utilization from the NM to RM (was: Plumb per app, per user

[jira] [Updated] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-09 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8842: - Attachment: YARN-8842.008.patch > Update QueueMetrics with custom resource values >

[jira] [Commented] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-09 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644398#comment-16644398 ] Szilard Nemeth commented on YARN-8842: -- patch008 fixes a missing null check > Update QueueMetrics

[jira] [Commented] (YARN-8862) [GPG] add Yarn Registry cleanup in ApplicationCleaner

2018-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644397#comment-16644397 ] Hadoop QA commented on YARN-8862: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644380#comment-16644380 ] Hadoop QA commented on YARN-8842: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644375#comment-16644375 ] Weiwei Yang commented on YARN-8858: --- Hi [~leftnoteasy], the patch has conflict to branch-2.8, could you

[jira] [Reopened] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reopened YARN-8858: --- > CapacityScheduler should respect maximum node resource when per-queue > maximum-allocation is being

[jira] [Updated] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8858: -- Attachment: YARN-8858-branch-2.8.001.patch > CapacityScheduler should respect maximum node resource

[jira] [Commented] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644374#comment-16644374 ] Weiwei Yang commented on YARN-8858: --- Hi [~leftnoteasy] I have committed the patch to trunk,

[jira] [Updated] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8858: -- Fix Version/s: 2.10.0 > CapacityScheduler should respect maximum node resource when per-queue >

[jira] [Updated] (YARN-8720) CapacityScheduler does not enforce max resource allocation check at queue level

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8720: -- Fix Version/s: 2.10.0 > CapacityScheduler does not enforce max resource allocation check at queue >

[jira] [Commented] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644359#comment-16644359 ] Hudson commented on YARN-8858: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15164 (See

[jira] [Updated] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8858: -- Fix Version/s: 2.9.2 > CapacityScheduler should respect maximum node resource when per-queue >

[jira] [Updated] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8858: -- Fix Version/s: 3.0.4 > CapacityScheduler should respect maximum node resource when per-queue >

[jira] [Updated] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8858: -- Fix Version/s: 3.1.2 > CapacityScheduler should respect maximum node resource when per-queue >

[jira] [Updated] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-09 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8842: - Attachment: YARN-8842.007.patch > Update QueueMetrics with custom resource values >

[jira] [Commented] (YARN-8827) Plumb per app, per user and per queue resource utilization from the NM to RM

2018-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644330#comment-16644330 ] Hadoop QA commented on YARN-8827: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644322#comment-16644322 ] Weiwei Yang edited comment on YARN-8858 at 10/10/18 1:31 AM: - +1. The UT

[jira] [Commented] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644322#comment-16644322 ] Weiwei Yang commented on YARN-8858: --- +1. The UT failure should not be related. I applied the patch and

[jira] [Updated] (YARN-8862) [GPG] add Yarn Registry cleanup in ApplicationCleaner

2018-10-09 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8862: --- Attachment: YARN-8862-YARN-7402.v2.patch > [GPG] add Yarn Registry cleanup in ApplicationCleaner >

[jira] [Comment Edited] (YARN-8569) Create an interface to provide cluster information to application

2018-10-09 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644277#comment-16644277 ] Eric Yang edited comment on YARN-8569 at 10/10/18 12:25 AM: {quote} 1) We use

[jira] [Commented] (YARN-8862) [GPG] add Yarn Registry cleanup in ApplicationCleaner

2018-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644283#comment-16644283 ] Hadoop QA commented on YARN-8862: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8569) Create an interface to provide cluster information to application

2018-10-09 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644277#comment-16644277 ] Eric Yang commented on YARN-8569: - {quote} 1) We use use set_user before the method to drop privileges.

[jira] [Commented] (YARN-8827) Plumb per app, per user and per queue resource utilization from the NM to RM

2018-10-09 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644275#comment-16644275 ] Íñigo Goiri commented on YARN-8827: --- I assume that Yetus will come without the javadoc -1 for

[jira] [Updated] (YARN-8864) NM incorrectly logs container user as the user who sent a stop container request in its audit log

2018-10-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8864: - Description: As in  ContainerManagerImpl.java {code:java} protected void

[jira] [Created] (YARN-8864) NM incorrectly logs container user as the user who sent a stop container request in its audit log

2018-10-09 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-8864: Summary: NM incorrectly logs container user as the user who sent a stop container request in its audit log Key: YARN-8864 URL: https://issues.apache.org/jira/browse/YARN-8864

[jira] [Commented] (YARN-7644) NM gets backed up deleting docker containers

2018-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644263#comment-16644263 ] Hadoop QA commented on YARN-7644: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-8863) Define yarn node manager local dirs in container-executor.cfg

2018-10-09 Thread Eric Yang (JIRA)
Eric Yang created YARN-8863: --- Summary: Define yarn node manager local dirs in container-executor.cfg Key: YARN-8863 URL: https://issues.apache.org/jira/browse/YARN-8863 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-7225) Add queue and partition info to RM audit log

2018-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644243#comment-16644243 ] Hadoop QA commented on YARN-7225: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8569) Create an interface to provide cluster information to application

2018-10-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644223#comment-16644223 ] Wangda Tan commented on YARN-8569: -- Discussed with [~eyang]/[~suma.shivaprasad] offline,  Several

[jira] [Commented] (YARN-8813) Improve debug messages for NM preemption of OPPORTUNISTIC containers

2018-10-09 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644221#comment-16644221 ] Robert Kanter commented on YARN-8813: - Thanks [~haibochen].  Committed to YARN-1011 branch! >

[jira] [Commented] (YARN-8813) Improve debug messages for NM preemption of OPPORTUNISTIC containers

2018-10-09 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644220#comment-16644220 ] Robert Kanter commented on YARN-8813: - +1 LGTM > Improve debug messages for NM preemption of

[jira] [Commented] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644219#comment-16644219 ] Weiwei Yang commented on YARN-8468: --- Thanks [~leftnoteasy], I over looked that issue in the jenkins

[jira] [Comment Edited] (YARN-3854) Add localization support for docker images

2018-10-09 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644218#comment-16644218 ] Chandni Singh edited comment on YARN-3854 at 10/9/18 11:13 PM: --- Discussed

[jira] [Commented] (YARN-3854) Add localization support for docker images

2018-10-09 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644218#comment-16644218 ] Chandni Singh commented on YARN-3854: - Discussed the requirements for localization of docker images

[jira] [Commented] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644213#comment-16644213 ] Hadoop QA commented on YARN-8858: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-3854) Add localization support for docker images

2018-10-09 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-3854: Attachment: Localization Support For Docker Images.pdf > Add localization support for docker images

[jira] [Updated] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-09 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8842: - Attachment: YARN-8842.006.patch > Update QueueMetrics with custom resource values >

[jira] [Commented] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-09 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644207#comment-16644207 ] Szilard Nemeth commented on YARN-8842: -- According to our offline discussion with [~haibochen], here

[jira] [Updated] (YARN-8862) [GPG] add Yarn Registry cleanup in ApplicationCleaner

2018-10-09 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8862: --- Attachment: YARN-8862-YARN-7402.v1.patch > [GPG] add Yarn Registry cleanup in ApplicationCleaner >

[jira] [Created] (YARN-8862) [GPG] add Yarn Registry cleanup in ApplicationCleaner

2018-10-09 Thread Botong Huang (JIRA)
Botong Huang created YARN-8862: -- Summary: [GPG] add Yarn Registry cleanup in ApplicationCleaner Key: YARN-8862 URL: https://issues.apache.org/jira/browse/YARN-8862 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-8862) [GPG] add Yarn Registry cleanup in ApplicationCleaner

2018-10-09 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8862: --- Issue Type: Sub-task (was: Task) Parent: YARN-7402 > [GPG] add Yarn Registry cleanup in

[jira] [Commented] (YARN-7644) NM gets backed up deleting docker containers

2018-10-09 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644179#comment-16644179 ] Chandni Singh commented on YARN-7644: - Introduced a checkstyle warning in patch 5. Fixed it in patch

[jira] [Updated] (YARN-7644) NM gets backed up deleting docker containers

2018-10-09 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-7644: Attachment: YARN-7644.006.patch > NM gets backed up deleting docker containers >

[jira] [Commented] (YARN-8813) Improve debug messages for NM preemption of OPPORTUNISTIC containers

2018-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644178#comment-16644178 ] Hadoop QA commented on YARN-8813: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7644) NM gets backed up deleting docker containers

2018-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644174#comment-16644174 ] Hadoop QA commented on YARN-7644: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8827) Plumb per app, per user and per queue resource utilization from the NM to RM

2018-10-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-8827: -- Attachment: YARN-8827-YARN-1011.07.patch > Plumb per app, per user and per queue resource utilization

[jira] [Commented] (YARN-8807) FairScheduler crashes RM with oversubscription turned on if an application is killed.

2018-10-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644132#comment-16644132 ] Haibo Chen commented on YARN-8807: -- Thanks [~rkanter], and [~zsiegl] for the review! > FairScheduler

[jira] [Commented] (YARN-7644) NM gets backed up deleting docker containers

2018-10-09 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644125#comment-16644125 ] Jason Lowe commented on YARN-7644: -- Thanks for updating the patch! +1 for patch 5 pending Jenkins. > NM

[jira] [Updated] (YARN-7225) Add queue and partition info to RM audit log

2018-10-09 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7225: - Attachment: YARN-7225.branch-2.8.001.patch > Add queue and partition info to RM audit log >

[jira] [Commented] (YARN-8827) Plumb per app, per user and per queue resource utilization from the NM to RM

2018-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644106#comment-16644106 ] Hadoop QA commented on YARN-8827: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8813) Improve debug messages for NM preemption of OPPORTUNISTIC containers

2018-10-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644096#comment-16644096 ] Haibo Chen commented on YARN-8813: -- That makes sense to me now. I have updated the patch as such. >

[jira] [Updated] (YARN-8813) Improve debug messages for NM preemption of OPPORTUNISTIC containers

2018-10-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8813: - Attachment: YARN-8813-YARN-1011.02.patch > Improve debug messages for NM preemption of OPPORTUNISTIC

[jira] [Commented] (YARN-8807) FairScheduler crashes RM with oversubscription turned on if an application is killed.

2018-10-09 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644094#comment-16644094 ] Robert Kanter commented on YARN-8807: - +1 LGTM > FairScheduler crashes RM with oversubscription

[jira] [Commented] (YARN-8710) Service AM should set a finite limit on NM container max retries

2018-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644090#comment-16644090 ] Hadoop QA commented on YARN-8710: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8813) Improve debug messages for NM preemption of OPPORTUNISTIC containers

2018-10-09 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644091#comment-16644091 ] Robert Kanter commented on YARN-8813: - It looks like the {{LOG}} is missing the {{final}} keyword. +1

[jira] [Commented] (YARN-7644) NM gets backed up deleting docker containers

2018-10-09 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644085#comment-16644085 ] Chandni Singh commented on YARN-7644: - Made {{reapContainer}} package-private as well in Patch 5. >

[jira] [Updated] (YARN-7644) NM gets backed up deleting docker containers

2018-10-09 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-7644: Attachment: YARN-7644.005.patch > NM gets backed up deleting docker containers >

[jira] [Commented] (YARN-7644) NM gets backed up deleting docker containers

2018-10-09 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644080#comment-16644080 ] Chandni Singh commented on YARN-7644: - Addressed the review comments in Patch 4. > NM gets backed up

[jira] [Updated] (YARN-7644) NM gets backed up deleting docker containers

2018-10-09 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-7644: Attachment: YARN-7644.004.patch > NM gets backed up deleting docker containers >

[jira] [Commented] (YARN-8569) Create an interface to provide cluster information to application

2018-10-09 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644071#comment-16644071 ] Suma Shivaprasad commented on YARN-8569: [~eyang] Thanks for updating the patch. +1 > Create an

[jira] [Commented] (YARN-8845) hadoop.registry.rm.enabled is not used

2018-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644063#comment-16644063 ] Hudson commented on YARN-8845: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15156 (See

[jira] [Commented] (YARN-8448) AM HTTPS Support

2018-10-09 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644059#comment-16644059 ] Robert Kanter commented on YARN-8448: - I discussed this with [~haibochen] offline and we agreed that

[jira] [Comment Edited] (YARN-8852) Add documentation for submarine installation details

2018-10-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643766#comment-16643766 ] Wangda Tan edited comment on YARN-8852 at 10/9/18 8:38 PM: --- Committed to

[jira] [Updated] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-10-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8858: - Attachment: YARN-8858.002.patch > CapacityScheduler should respect maximum node resource when per-queue

[jira] [Commented] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-10-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644058#comment-16644058 ] Wangda Tan commented on YARN-8858: -- Attached ver.2 patch, addressed all comments. > CapacityScheduler

[jira] [Commented] (YARN-7644) NM gets backed up deleting docker containers

2018-10-09 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644044#comment-16644044 ] Jason Lowe commented on YARN-7644: -- Thanks for updating the patch! compareAndSetAlreadyLaunched is too

[jira] [Commented] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-10-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644040#comment-16644040 ] Wangda Tan commented on YARN-8468: -- [~bsteinbach],  It could be caused by some test issue:  {code:java}

[jira] [Commented] (YARN-8845) hadoop.registry.rm.enabled is not used

2018-10-09 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644022#comment-16644022 ] Íñigo Goiri commented on YARN-8845: --- Thanks [~eyang], I'll rebase HADOOP-15821. >

[jira] [Commented] (YARN-8845) hadoop.registry.rm.enabled is not used

2018-10-09 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644014#comment-16644014 ] Eric Yang commented on YARN-8845: - +1 on patch 001. > hadoop.registry.rm.enabled is not used >

[jira] [Commented] (YARN-8827) Plumb per app, per user and per queue resource utilization from the NM to RM

2018-10-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643991#comment-16643991 ] Arun Suresh commented on YARN-8827: --- The {{TestCapacityOverTimePolicy}} failure is unrelated and

[jira] [Commented] (YARN-8827) Plumb per app, per user and per queue resource utilization from the NM to RM

2018-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643985#comment-16643985 ] Hadoop QA commented on YARN-8827: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8710) Service AM should set a finite limit on NM container max retries

2018-10-09 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643975#comment-16643975 ] Suma Shivaprasad commented on YARN-8710: Thanks [~billie.rinaldi] Have updated the patch to set to

[jira] [Updated] (YARN-8710) Service AM should set a finite limit on NM container max retries

2018-10-09 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8710: --- Attachment: YARN-8710.2.patch > Service AM should set a finite limit on NM container max

[jira] [Commented] (YARN-8569) Create an interface to provide cluster information to application

2018-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643972#comment-16643972 ] Hadoop QA commented on YARN-8569: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8710) Service AM should set a finite limit on NM container max retries

2018-10-09 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8710: --- Attachment: (was: YARN-8710.2.patch) > Service AM should set a finite limit on NM

[jira] [Updated] (YARN-8710) Service AM should set a finite limit on NM container max retries

2018-10-09 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8710: --- Attachment: YARN-8710.2.patch > Service AM should set a finite limit on NM container max

[jira] [Commented] (YARN-7592) yarn.federation.failover.enabled missing in yarn-default.xml

2018-10-09 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643949#comment-16643949 ] Subru Krishnan commented on YARN-7592: -- I want to make sure I fully understand the proposal - we will

[jira] [Commented] (YARN-7644) NM gets backed up deleting docker containers

2018-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643942#comment-16643942 ] Hadoop QA commented on YARN-7644: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-10-09 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643931#comment-16643931 ] Antal Bálint Steinbach commented on YARN-8468: -- Thanks a lot [~cheersyang] . What about the

[jira] [Updated] (YARN-8753) [UI2] Lost nodes representation missing from Nodemanagers Chart

2018-10-09 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora updated YARN-8753: - Attachment: YARN-8753.002.patch > [UI2] Lost nodes representation missing from Nodemanagers Chart >

[jira] [Commented] (YARN-7652) Handle AM register requests asynchronously in FederationInterceptor

2018-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643901#comment-16643901 ] Hudson commented on YARN-7652: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15152 (See

  1   2   >