[jira] [Commented] (YARN-8346) Upgrading to 3.1 kills running containers with error "Opportunistic container queue is full"

2018-05-23 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488526#comment-16488526 ] Rohith Sharma K S commented on YARN-8346: - committing shortly > Upgrading to 3.1 k

[jira] [Commented] (YARN-7340) Missing the time stamp in exception message in Class NoOverCommitPolicy

2018-05-23 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488480#comment-16488480 ] Yufei Gu commented on YARN-7340: [~dineshchitlangia], sorry for delay. Other than the times

[jira] [Commented] (YARN-8351) RM is flooded with node attributes manager logs

2018-05-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488448#comment-16488448 ] genericqa commented on YARN-8351: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-8346) Upgrading to 3.1 kills running containers with error "Opportunistic container queue is full"

2018-05-23 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488439#comment-16488439 ] Rohith Sharma K S commented on YARN-8346: - Thanks [~jlowe] for quick turnaround. I

[jira] [Commented] (YARN-8351) RM is flooded with node attributes manager logs

2018-05-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488371#comment-16488371 ] Weiwei Yang commented on YARN-8351: --- Thanks [~sunilg] for the quick response! > RM is fl

[jira] [Commented] (YARN-8351) RM is flooded with node attributes manager logs

2018-05-23 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488368#comment-16488368 ] Sunil Govindan commented on YARN-8351: -- Patch looks straight forward. Committing short

[jira] [Updated] (YARN-8352) AM should retry on a different node after the previous application attempt fail

2018-05-23 Thread Zhizhen Hou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhizhen Hou updated YARN-8352: -- Description: I submit a job to the yarn, and both two times the AM is allocated on the same node.  After

[jira] [Updated] (YARN-8351) RM is flooded with node attributes manager logs

2018-05-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8351: -- Attachment: YARN-8351-YARN-3409.001.patch > RM is flooded with node attributes manager logs > ---

[jira] [Commented] (YARN-8351) RM is flooded with node attributes manager logs

2018-05-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488362#comment-16488362 ] genericqa commented on YARN-8351: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-8351) RM is flooded with node attributes manager logs

2018-05-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8351: -- Attachment: YARN-8351.001.patch > RM is flooded with node attributes manager logs > -

[jira] [Created] (YARN-8352) AM should retry on a different node after the previous application attempt fail

2018-05-23 Thread Zhizhen Hou (JIRA)
Zhizhen Hou created YARN-8352: - Summary: AM should retry on a different node after the previous application attempt fail Key: YARN-8352 URL: https://issues.apache.org/jira/browse/YARN-8352 Project: Hadoop

[jira] [Created] (YARN-8351) RM is flooded with node attributes manager logs

2018-05-23 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-8351: - Summary: RM is flooded with node attributes manager logs Key: YARN-8351 URL: https://issues.apache.org/jira/browse/YARN-8351 Project: Hadoop YARN Issue Type: Sub-t

[jira] [Commented] (YARN-5764) NUMA awareness support for launching containers

2018-05-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488321#comment-16488321 ] Weiwei Yang commented on YARN-5764: --- Hi [~devaraj.k], [~miklos.szeg...@cloudera.com], can

[jira] [Commented] (YARN-7530) hadoop-yarn-services-api should be part of hadoop-yarn-services

2018-05-23 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488320#comment-16488320 ] Eric Yang commented on YARN-7530: - +1 for branch-3.1 change. > hadoop-yarn-services-api sh

[jira] [Commented] (YARN-6677) Preempt opportunistic containers when root container cgroup goes over memory limit

2018-05-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488291#comment-16488291 ] genericqa commented on YARN-6677: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-8333) Load balance YARN services using RegistryDNS multiple A records

2018-05-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488283#comment-16488283 ] genericqa commented on YARN-8333: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Updated] (YARN-8350) NPE in service AM related to placement policy

2018-05-23 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-8350: - Description: It seems like this NPE is happening in a service with more than one component when on

[jira] [Commented] (YARN-4677) RMNodeResourceUpdateEvent update from scheduler can lead to race condition

2018-05-23 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488271#comment-16488271 ] Robert Kanter commented on YARN-4677: - Thanks [~wilfreds] for the trunk patch and [~gph

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

2018-05-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488266#comment-16488266 ] genericqa commented on YARN-8292: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-8326) Yarn 3.0 seems runs slower than Yarn 2.6

2018-05-23 Thread Hsin-Liang Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488263#comment-16488263 ] Hsin-Liang Huang commented on YARN-8326: Here is more detail information from node

[jira] [Commented] (YARN-8350) NPE in service AM related to placement policy

2018-05-23 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488242#comment-16488242 ] Billie Rinaldi commented on YARN-8350: -- I also tried adding a placement policy with an

[jira] [Commented] (YARN-8333) Load balance YARN services using RegistryDNS multiple A records

2018-05-23 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488241#comment-16488241 ] Eric Yang commented on YARN-8333: - Patch 001 added multi-A record per component. > Load ba

[jira] [Updated] (YARN-8333) Load balance YARN services using RegistryDNS multiple A records

2018-05-23 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8333: Attachment: YARN-8333.001.patch > Load balance YARN services using RegistryDNS multiple A records > -

[jira] [Created] (YARN-8350) NPE in service AM related to placement policy

2018-05-23 Thread Billie Rinaldi (JIRA)
Billie Rinaldi created YARN-8350: Summary: NPE in service AM related to placement policy Key: YARN-8350 URL: https://issues.apache.org/jira/browse/YARN-8350 Project: Hadoop YARN Issue Type: B

[jira] [Commented] (YARN-4599) Set OOM control for memory cgroups

2018-05-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488224#comment-16488224 ] Hudson commented on YARN-4599: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1427

[jira] [Commented] (YARN-8342) Using docker image from a non-privileged registry, the launch_command is not honored

2018-05-23 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488222#comment-16488222 ] Eric Yang commented on YARN-8342: - We have the following options: 1. Allow exemption to b

[jira] [Updated] (YARN-6677) Preempt opportunistic containers when root container cgroup goes over memory limit

2018-05-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6677: - Summary: Preempt opportunistic containers when root container cgroup goes over memory limit (was: Preempt

[jira] [Updated] (YARN-6677) Preempt opportunistic containers when root container cgroup goes over memory limit

2018-05-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6677: - Attachment: YARN-6677.00.patch > Preempt opportunistic containers when root container cgroup goes over memo

[jira] [Commented] (YARN-4599) Set OOM control for memory cgroups

2018-05-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488210#comment-16488210 ] Haibo Chen commented on YARN-4599: -- Thanks [~sandflee] for the initial proposal, [~miklos.

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

2018-05-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488201#comment-16488201 ] Wangda Tan commented on YARN-8292: -- Updated (008) patch. > Fix the dominant resource pree

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

2018-05-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488200#comment-16488200 ] Wangda Tan commented on YARN-8292: -- Thanks [~jlowe], addressed all comments. TestPreemptio

[jira] [Updated] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

2018-05-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8292: - Attachment: YARN-8292.008.patch > Fix the dominant resource preemption cannot happen when some of the resou

[jira] [Commented] (YARN-8327) Fix TestAggregatedLogFormat#testReadAcontainerLogs1 on Windows

2018-05-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488198#comment-16488198 ] Hudson commented on YARN-8327: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1427

[jira] [Commented] (YARN-7899) [AMRMProxy] Stateful FederationInterceptor for pending requests

2018-05-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488179#comment-16488179 ] genericqa commented on YARN-7899: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-8327) Fix TestAggregatedLogFormat#testReadAcontainerLogs1 on Windows

2018-05-23 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488159#comment-16488159 ] Íñigo Goiri commented on YARN-8327: --- +1 on [^YARN-8327.v2.patch]. Committing. > Fix Tes

[jira] [Commented] (YARN-8348) Incorrect and missing AfterClass in HBase-tests to fix NPE failures

2018-05-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488111#comment-16488111 ] Hudson commented on YARN-8348: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1427

[jira] [Commented] (YARN-7530) hadoop-yarn-services-api should be part of hadoop-yarn-services

2018-05-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488100#comment-16488100 ] genericqa commented on YARN-7530: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

2018-05-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488092#comment-16488092 ] Jason Lowe commented on YARN-8292: -- Thanks for updating the patch! The TestPreemptionForQ

[jira] [Commented] (YARN-8343) YARN should have ability to run images only from a whitelist docker registries

2018-05-23 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488084#comment-16488084 ] Eric Badger commented on YARN-8343: --- I think we need to do a rework around privileged/non

[jira] [Updated] (YARN-8348) Incorrect and missing AfterClass in HBase-tests to fix NPE failures

2018-05-23 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-8348: -- Description: HBase tests are failing in [linux|https://builds.apache.org/view/H-L/view/Hadoop/job/hadoop

[jira] [Commented] (YARN-8344) Missing nm.stop() in TestNodeManagerResync to fix testKillContainersOnResync

2018-05-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488079#comment-16488079 ] Hudson commented on YARN-8344: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1427

[jira] [Commented] (YARN-8342) Using docker image from a non-privileged registry, the launch_command is not honored

2018-05-23 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488073#comment-16488073 ] Eric Badger commented on YARN-8342: --- {quote}Looks like the name {{docker.privileged-conta

[jira] [Updated] (YARN-8348) Incorrect and missing AfterClass in HBase-tests to fix NPE failures

2018-05-23 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-8348: --- Description: HBase tests are failing in [linux|https://builds.apache.org/view/

[jira] [Updated] (YARN-8348) Incorrect and missing AfterClass in HBase-tests to fix NPE failures

2018-05-23 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-8348: --- Summary: Incorrect and missing AfterClass in HBase-tests to fix NPE failures (

[jira] [Commented] (YARN-6919) Add default volume mount list

2018-05-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488071#comment-16488071 ] genericqa commented on YARN-6919: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-7530) hadoop-yarn-services-api should be part of hadoop-yarn-services

2018-05-23 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-7530: Attachment: YARN-7530-branch-3.1.001.patch > hadoop-yarn-services-api should be part of hadoop-yarn-s

[jira] [Commented] (YARN-8348) Incorrect and missing AfterClass in HBase-tests

2018-05-23 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488066#comment-16488066 ] Íñigo Goiri commented on YARN-8348: --- Do you mind updating the description to make clear w

[jira] [Comment Edited] (YARN-8326) Yarn 3.0 seems runs slower than Yarn 2.6

2018-05-23 Thread Hsin-Liang Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488013#comment-16488013 ] Hsin-Liang Huang edited comment on YARN-8326 at 5/23/18 9:19 PM:

[jira] [Issue Comment Deleted] (YARN-8326) Yarn 3.0 seems runs slower than Yarn 2.6

2018-05-23 Thread Hsin-Liang Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hsin-Liang Huang updated YARN-8326: --- Comment: was deleted (was: HI Eric,     I tried the suggestion and changed the setting.  The r

[jira] [Comment Edited] (YARN-8326) Yarn 3.0 seems runs slower than Yarn 2.6

2018-05-23 Thread Hsin-Liang Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488013#comment-16488013 ] Hsin-Liang Huang edited comment on YARN-8326 at 5/23/18 9:15 PM:

[jira] [Updated] (YARN-8344) Missing nm.stop() in TestNodeManagerResync to fix testKillContainersOnResync

2018-05-23 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-8344: --- Summary: Missing nm.stop() in TestNodeManagerResync to fix testKillContainersOn

[jira] [Issue Comment Deleted] (YARN-8326) Yarn 3.0 seems runs slower than Yarn 2.6

2018-05-23 Thread Hsin-Liang Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hsin-Liang Huang updated YARN-8326: --- Comment: was deleted (was: [~eyang]   this afternoon,  I tried the command and the performance

[jira] [Commented] (YARN-6919) Add default volume mount list

2018-05-23 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488049#comment-16488049 ] Eric Badger commented on YARN-6919: --- Hey [~shaneku...@gmail.com], I think this should go

[jira] [Updated] (YARN-6919) Add default volume mount list

2018-05-23 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-6919: -- Attachment: YARN-6919-branch-3.1.002.patch > Add default volume mount list >

[jira] [Updated] (YARN-7899) [AMRMProxy] Stateful FederationInterceptor for pending requests

2018-05-23 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7899: --- Attachment: YARN-7899.v2.patch > [AMRMProxy] Stateful FederationInterceptor for pending requests >

[jira] [Updated] (YARN-7530) hadoop-yarn-services-api should be part of hadoop-yarn-services

2018-05-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7530: - Fix Version/s: 3.2.0 > hadoop-yarn-services-api should be part of hadoop-yarn-services > --

[jira] [Updated] (YARN-7530) hadoop-yarn-services-api should be part of hadoop-yarn-services

2018-05-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7530: - Priority: Blocker (was: Trivial) > hadoop-yarn-services-api should be part of hadoop-yarn-services > -

[jira] [Updated] (YARN-7530) hadoop-yarn-services-api should be part of hadoop-yarn-services

2018-05-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7530: - Fix Version/s: (was: 3.2.0) > hadoop-yarn-services-api should be part of hadoop-yarn-services > ---

[jira] [Commented] (YARN-8326) Yarn 3.0 seems runs slower than Yarn 2.6

2018-05-23 Thread Hsin-Liang Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488013#comment-16488013 ] Hsin-Liang Huang commented on YARN-8326: Hi  [~eyang]    Here is another update. 

[jira] [Commented] (YARN-8348) Incorrect and missing AfterClass in HBase-tests

2018-05-23 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488002#comment-16488002 ] Giovanni Matteo Fumarola commented on YARN-8348: Thanks [~elgoiri] for the

[jira] [Commented] (YARN-8342) Using docker image from a non-privileged registry, the launch_command is not honored

2018-05-23 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16487992#comment-16487992 ] Shane Kumpf commented on YARN-8342: --- This sounds like a reasonable proposal. In cases whe

[jira] [Commented] (YARN-8344) Missing nm.close() in TestNodeManagerResync to fix testKillContainersOnResync

2018-05-23 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16487987#comment-16487987 ] Íñigo Goiri commented on YARN-8344: --- +1 on [^YARN-8344.v2.patch]. We still need to figur

[jira] [Commented] (YARN-8348) Incorrect and missing AfterClass in HBase-tests

2018-05-23 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16487984#comment-16487984 ] Íñigo Goiri commented on YARN-8348: --- Good news is that the NPE is gone. However, the orig

[jira] [Assigned] (YARN-8333) Load balance YARN services using RegistryDNS multiple A records

2018-05-23 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-8333: --- Assignee: Eric Yang > Load balance YARN services using RegistryDNS multiple A records > --

[jira] [Commented] (YARN-8342) Using docker image from a non-privileged registry, the launch_command is not honored

2018-05-23 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16487952#comment-16487952 ] Eric Yang commented on YARN-8342: - [~vinodkv] Launch command was dropped in YARN-7516 due t

[jira] [Commented] (YARN-8348) Incorrect and missing AfterClass in HBase-tests

2018-05-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16487951#comment-16487951 ] genericqa commented on YARN-8348: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Assigned] (YARN-8349) Remove YARN registry entries when a service is killed by the RM

2018-05-23 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf reassigned YARN-8349: - Assignee: Billie Rinaldi > Remove YARN registry entries when a service is killed by the RM > -

[jira] [Created] (YARN-8349) Remove YARN registry entries when a service is killed by the RM

2018-05-23 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-8349: - Summary: Remove YARN registry entries when a service is killed by the RM Key: YARN-8349 URL: https://issues.apache.org/jira/browse/YARN-8349 Project: Hadoop YARN

[jira] [Resolved] (YARN-8334) [GPG] Fix potential connection leak in GPGUtils

2018-05-23 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang resolved YARN-8334. Resolution: Fixed > [GPG] Fix potential connection leak in GPGUtils > ---

[jira] [Commented] (YARN-8334) [GPG] Fix potential connection leak in GPGUtils

2018-05-23 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16487945#comment-16487945 ] Botong Huang commented on YARN-8334: Committed to YARN-7402 as db183f2ea. Thanks [~giov

[jira] [Reopened] (YARN-7530) hadoop-yarn-services-api should be part of hadoop-yarn-services

2018-05-23 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger reopened YARN-7530: --- This change breaks branch-3.1 compilation if the .m2 directory is cleaned. {noformat} [ERROR] [ERROR] Some

[jira] [Updated] (YARN-8334) [] Fix potential connection leak in GPGUtils

2018-05-23 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8334: --- Summary: [] Fix potential connection leak in GPGUtils (was: Fix potential connection leak in GPGUtils)

[jira] [Updated] (YARN-8334) [GPG] Fix potential connection leak in GPGUtils

2018-05-23 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8334: --- Summary: [GPG] Fix potential connection leak in GPGUtils (was: [] Fix potential connection leak in GPG

[jira] [Commented] (YARN-4781) Support intra-queue preemption for fairness ordering policy.

2018-05-23 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16487902#comment-16487902 ] Eric Payne commented on YARN-4781: -- bq. FairOrdering policy could be used with weights? [

[jira] [Commented] (YARN-8344) Missing nm.close() in TestNodeManagerResync to fix testKillContainersOnResync

2018-05-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16487894#comment-16487894 ] genericqa commented on YARN-8344: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-8336) Fix potential connection leak in SchedConfCLI and YarnWebServiceUtils

2018-05-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16487895#comment-16487895 ] Hudson commented on YARN-8336: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1427

[jira] [Commented] (YARN-8348) Incorrect and missing AfterClass in HBase-tests

2018-05-23 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16487886#comment-16487886 ] Íñigo Goiri commented on YARN-8348: --- Technically the null check in AfterClass shouldn't b

[jira] [Commented] (YARN-8346) Upgrading to 3.1 kills running containers with error "Opportunistic container queue is full"

2018-05-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16487887#comment-16487887 ] genericqa commented on YARN-8346: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-8348) Incorrect and missing AfterClass in HBase-tests

2018-05-23 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16487861#comment-16487861 ] Giovanni Matteo Fumarola commented on YARN-8348: [^YARN-8348.v1.patch] will

[jira] [Updated] (YARN-8348) Incorrect and missing AfterClass in HBase-tests

2018-05-23 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-8348: --- Description: HBase tests are failing in [linux|https://builds.apache.org/view/

[jira] [Updated] (YARN-8348) Incorrect and missing AfterClass in HBase-tests

2018-05-23 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-8348: --- Description: HBase tests are failing in [linux|https://builds.apache.org/view/

[jira] [Commented] (YARN-8348) Incorrect and missing AfterClass in HBase-tests

2018-05-23 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16487848#comment-16487848 ] Giovanni Matteo Fumarola commented on YARN-8348: Before my patch: [ERROR] E

[jira] [Assigned] (YARN-8348) Incorrect and missing AfterClass in HBase-tests

2018-05-23 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola reassigned YARN-8348: -- Assignee: Giovanni Matteo Fumarola > Incorrect and missing AfterClass in

[jira] [Updated] (YARN-8348) Incorrect and missing AfterClass in HBase-tests

2018-05-23 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-8348: --- Attachment: YARN-8348.v1.patch > Incorrect and missing AfterClass in HBase-test

[jira] [Comment Edited] (YARN-8336) Fix potential connection leak in SchedConfCLI and YarnWebServiceUtils

2018-05-23 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16487775#comment-16487775 ] Íñigo Goiri edited comment on YARN-8336 at 5/23/18 6:54 PM: Bot

[jira] [Created] (YARN-8348) Incorrect and missing AfterClass in HBase-tests

2018-05-23 Thread Giovanni Matteo Fumarola (JIRA)
Giovanni Matteo Fumarola created YARN-8348: -- Summary: Incorrect and missing AfterClass in HBase-tests Key: YARN-8348 URL: https://issues.apache.org/jira/browse/YARN-8348 Project: Hadoop YARN

[jira] [Commented] (YARN-8108) RM metrics rest API throws GSSException in kerberized environment

2018-05-23 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16487825#comment-16487825 ] Eric Yang commented on YARN-8108: - [~yzhangal] My preference is to fix this in 3.0.3 releas

[jira] [Commented] (YARN-8346) Upgrading to 3.1 kills running containers with error "Opportunistic container queue is full"

2018-05-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16487810#comment-16487810 ] Yongjun Zhang commented on YARN-8346: - Thanks a lot for the quick turnaround [~jlowe] a

[jira] [Commented] (YARN-8108) RM metrics rest API throws GSSException in kerberized environment

2018-05-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16487806#comment-16487806 ] Yongjun Zhang commented on YARN-8108: - Hi [~eyang], It seems the issue also exists in

[jira] [Commented] (YARN-8346) Upgrading to 3.1 kills running containers with error "Opportunistic container queue is full"

2018-05-23 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16487803#comment-16487803 ] Konstantinos Karanasos commented on YARN-8346: -- Thanks for the patch, [~jlowe]

[jira] [Comment Edited] (YARN-8344) Missing nm.close() in TestNodeManagerResync to fix testKillContainersOnResync

2018-05-23 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16487778#comment-16487778 ] Giovanni Matteo Fumarola edited comment on YARN-8344 at 5/23/18 6:22 PM:

[jira] [Updated] (YARN-8344) Missing nm.close() in TestNodeManagerResync to fix testKillContainersOnResync

2018-05-23 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-8344: --- Summary: Missing nm.close() in TestNodeManagerResync to fix testKillContainersO

[jira] [Updated] (YARN-8346) Upgrading to 3.1 kills running containers with error "Opportunistic container queue is full"

2018-05-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-8346: - Attachment: YARN-8346.001.patch > Upgrading to 3.1 kills running containers with error "Opportunistic conta

[jira] [Commented] (YARN-8344) Missing nm.close() in TestNodeManagerResync to fix testKillContainersOnResync on Windows

2018-05-23 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16487778#comment-16487778 ] Giovanni Matteo Fumarola commented on YARN-8344: Attached v2 with the fix f

[jira] [Commented] (YARN-8336) Fix potential connection leak in SchedConfCLI and YarnWebServiceUtils

2018-05-23 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16487775#comment-16487775 ] Íñigo Goiri commented on YARN-8336: --- Both [TestLogsCLI|https://builds.apache.org/job/Pre

[jira] [Comment Edited] (YARN-8334) Fix potential connection leak in GPGUtils

2018-05-23 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16487766#comment-16487766 ] Íñigo Goiri edited comment on YARN-8334 at 5/23/18 6:06 PM: The

[jira] [Commented] (YARN-8334) Fix potential connection leak in GPGUtils

2018-05-23 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16487766#comment-16487766 ] Íñigo Goiri commented on YARN-8334: --- The TestPolicyGenerator unit test runs [here|https:

[jira] [Updated] (YARN-8344) Missing nm.close() in TestNodeManagerResync to fix testKillContainersOnResync on Windows

2018-05-23 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-8344: --- Attachment: YARN-8344.v2.patch > Missing nm.close() in TestNodeManagerResync to

[jira] [Commented] (YARN-8344) Missing nm.close() in TestNodeManagerResync to fix testKillContainersOnResync on Windows

2018-05-23 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16487762#comment-16487762 ] Íñigo Goiri commented on YARN-8344: --- Why does this fail on Windows specifically? > Missi

[jira] [Updated] (YARN-8344) Missing nm.close() in TestNodeManagerResync to fix testKillContainersOnResync on Windows

2018-05-23 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-8344: -- Description: Missing nm.close() in TestNodeManagerResync to fix testKillContainersOnResync on Windows. >

  1   2   >