[jira] [Commented] (YARN-9639) DecommissioningNodesWatcher cause memory leak

2019-06-25 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872922#comment-16872922 ] Sunil Govindan commented on YARN-9639: -- Thanks [~BilwaST] for pointing out. I have seen once, when

[jira] [Updated] (YARN-9649) Display Blacklisted Nodes By AM in RM Log and AM Rest api

2019-06-25 Thread Amithsha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amithsha updated YARN-9649: --- Issue Type: Improvement (was: Bug) > Display Blacklisted Nodes By AM in RM Log and AM Rest api >

[jira] [Created] (YARN-9649) Display Blacklisted Nodes By AM in RM Log and AM Rest api

2019-06-25 Thread Amithsha (JIRA)
Amithsha created YARN-9649: -- Summary: Display Blacklisted Nodes By AM in RM Log and AM Rest api Key: YARN-9649 URL: https://issues.apache.org/jira/browse/YARN-9649 Project: Hadoop YARN Issue Type:

[jira] [Assigned] (YARN-7721) TestContinuousScheduling fails sporadically with NPE

2019-06-25 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan reassigned YARN-7721: Assignee: Sunil Govindan (was: Wilfred Spiegelenburg) > TestContinuousScheduling fails

[jira] [Commented] (YARN-6629) NPE occurred when container allocation proposal is applied but its resource requests are removed before

2019-06-25 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872902#comment-16872902 ] Aihua Xu commented on YARN-6629: Thanks. Just notice it's not included in 2.9.2 but it's in 2.10. > NPE

[jira] [Commented] (YARN-6629) NPE occurred when container allocation proposal is applied but its resource requests are removed before

2019-06-25 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872862#comment-16872862 ] Tao Yang commented on YARN-6629: Hi, [~aihuaxu]. This patch has been already involved in branch-2 for more

[jira] [Commented] (YARN-9646) Yarn miniYarn cluster tests failed to bind to a local host name

2019-06-25 Thread Ray Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872815#comment-16872815 ] Ray Yang commented on YARN-9646: The change made in the referenced issue doesn't appear to fix the issue I

[jira] [Commented] (YARN-9648) Improve serialization of Server side errors for YARN ApiServiceClient

2019-06-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872800#comment-16872800 ] Hadoop QA commented on YARN-9648: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-25 Thread Craig Condit (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872799#comment-16872799 ] Craig Condit commented on YARN-9560: [~eyang], overloading static methods, especially in a context

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-25 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872786#comment-16872786 ] Eric Yang commented on YARN-9560: - {quote}Eric Yang, making getRuntimeType() static would require the base

[jira] [Created] (YARN-9648) Improve serialization of Server side errors for YARN ApiServiceClient

2019-06-25 Thread Eric Yang (JIRA)
Eric Yang created YARN-9648: --- Summary: Improve serialization of Server side errors for YARN ApiServiceClient Key: YARN-9648 URL: https://issues.apache.org/jira/browse/YARN-9648 Project: Hadoop YARN

[jira] [Updated] (YARN-9648) Improve serialization of Server side errors for YARN ApiServiceClient

2019-06-25 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-9648: Attachment: YARN-9648.001.patch > Improve serialization of Server side errors for YARN ApiServiceClient >

[jira] [Assigned] (YARN-9648) Improve serialization of Server side errors for YARN ApiServiceClient

2019-06-25 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-9648: --- Assignee: Eric Yang > Improve serialization of Server side errors for YARN ApiServiceClient >

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872775#comment-16872775 ] Hadoop QA commented on YARN-9560: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-25 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872726#comment-16872726 ] Jim Brennan commented on YARN-9560: --- +1 (non-binding) on patch 011. > Restructure

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-25 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872716#comment-16872716 ] Eric Badger commented on YARN-9560: --- Patch 011 changes the names of the non static keys from all caps to

[jira] [Updated] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-25 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9560: -- Attachment: YARN-9560.011.patch > Restructure DockerLinuxContainerRuntime to extend a new

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-25 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872711#comment-16872711 ] Jim Brennan commented on YARN-9560: --- {quote} I'm not sure about the checkstyle warnings. The variables

[jira] [Commented] (YARN-6629) NPE occurred when container allocation proposal is applied but its resource requests are removed before

2019-06-25 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872701#comment-16872701 ] Aihua Xu commented on YARN-6629: Can we also backport this change to branch-2? It's critical since it's

[jira] [Comment Edited] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-25 Thread Craig Condit (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872696#comment-16872696 ] Craig Condit edited comment on YARN-9560 at 6/25/19 8:36 PM: - [~eyang], making

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-25 Thread Craig Condit (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872696#comment-16872696 ] Craig Condit commented on YARN-9560: [~eyang], making getRuntimeType() static would require the base

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-25 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872678#comment-16872678 ] Eric Yang commented on YARN-9560: - [~ebadger] I think this can be fixed by making those variables static,

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-25 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872669#comment-16872669 ] Eric Badger commented on YARN-9560: --- I'm not sure about the checkstyle warnings. The variables are all

[jira] [Commented] (YARN-8193) YARN RM hangs abruptly (stops allocating resources) when running successive applications.

2019-06-25 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872665#comment-16872665 ] Aihua Xu commented on YARN-8193: Can we also push this patch to 2.9.x branch? It's causing RM to crash. >

[jira] [Commented] (YARN-9477) Implement VE discovery using libudev

2019-06-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872661#comment-16872661 ] Hadoop QA commented on YARN-9477: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9646) Yarn miniYarn cluster tests failed to bind to a local host name

2019-06-25 Thread Ray Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Yang updated YARN-9646: --- Affects Version/s: 2.7.4 > Yarn miniYarn cluster tests failed to bind to a local host name >

[jira] [Updated] (YARN-9646) Yarn miniYarn cluster tests failed to bind to a local host name

2019-06-25 Thread Ray Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Yang updated YARN-9646: --- Component/s: test > Yarn miniYarn cluster tests failed to bind to a local host name >

[jira] [Commented] (YARN-9646) Yarn miniYarn cluster tests failed to bind to a local host name

2019-06-25 Thread Ray Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872562#comment-16872562 ] Ray Yang commented on YARN-9646: I mean this test doesn't try to connect to "localhost". I just saw

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-25 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872467#comment-16872467 ] Jim Brennan commented on YARN-9560: --- Thanks for the update [~ebadger]!  I am +1 (non-binding) on patch

[jira] [Updated] (YARN-9477) Implement VE discovery using libudev

2019-06-25 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9477: --- Attachment: YARN-9477-006.patch > Implement VE discovery using libudev >

[jira] [Commented] (YARN-9477) Implement VE discovery using libudev

2019-06-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872392#comment-16872392 ] Hadoop QA commented on YARN-9477: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9646) Yarn miniYarn cluster tests failed to bind to a local host name

2019-06-25 Thread Ray Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872377#comment-16872377 ] Ray Yang commented on YARN-9646: Which wiki page? I thought your suggestion was to add an entry mapping

[jira] [Commented] (YARN-9645) Restaring NM's throwing Invalid event: FINISHED_CONTAINERS_PULLED_BY_AM at NEW

2019-06-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872299#comment-16872299 ] Hadoop QA commented on YARN-9645: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9629) Support configurable MIN_LOG_ROLLING_INTERVAL

2019-06-25 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872282#comment-16872282 ] Szilard Nemeth commented on YARN-9629: -- Hi [~adam.antal]! Thanks for the updated patch! Couple of

[jira] [Commented] (YARN-9646) Yarn miniYarn cluster tests failed to bind to a local host name

2019-06-25 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872218#comment-16872218 ] Steve Loughran commented on YARN-9646: -- I'd try that. If you look @ the edit history of the wiki page

[jira] [Updated] (YARN-9477) Implement VE discovery using libudev

2019-06-25 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9477: --- Attachment: YARN-9477-005.patch > Implement VE discovery using libudev >

[jira] [Commented] (YARN-9645) Restaring NM's throwing Invalid event: FINISHED_CONTAINERS_PULLED_BY_AM at NEW

2019-06-25 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872196#comment-16872196 ] Bilwa S T commented on YARN-9645: - we can add a transition on state RMNodeImpl.NEW on event 

[jira] [Updated] (YARN-9645) Restaring NM's throwing Invalid event: FINISHED_CONTAINERS_PULLED_BY_AM at NEW

2019-06-25 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T updated YARN-9645: Attachment: YARN-9645-001.patch > Restaring NM's throwing Invalid event: FINISHED_CONTAINERS_PULLED_BY_AM

[jira] [Commented] (YARN-9635) Nodes page displayed duplicate nodes

2019-06-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872188#comment-16872188 ] Hadoop QA commented on YARN-9635: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9639) DecommissioningNodesWatcher cause memory leak

2019-06-25 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872182#comment-16872182 ] Bilwa S T commented on YARN-9639: - [~sunilg] pollTimer object gets created in constructor . So null check

[jira] [Commented] (YARN-9639) DecommissioningNodesWatcher cause memory leak

2019-06-25 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872174#comment-16872174 ] Sunil Govindan commented on YARN-9639: -- [~bibinchundatt] a quick question. is it better to have a

[jira] [Commented] (YARN-9625) UI2 - No link to a queue on the Queues page for Fair Scheduler

2019-06-25 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872137#comment-16872137 ] Szilard Nemeth commented on YARN-9625: -- Hi [~zsiegl]! Could you please take care of this? I didn't

[jira] [Commented] (YARN-9647) Docker launch fails when local-dirs or log-dirs is unhealthy.

2019-06-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872117#comment-16872117 ] Hadoop QA commented on YARN-9647: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9635) Nodes page displayed duplicate nodes

2019-06-25 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872077#comment-16872077 ] Wanqiang Ji commented on YARN-9635: --- Hi, [~Tao Yang] and [~sunilg]. In my opinion, although user used

[jira] [Updated] (YARN-9635) Nodes page displayed duplicate nodes

2019-06-25 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9635: -- Component/s: (was: api) resourcemanager nodemanager > Nodes page

[jira] [Commented] (YARN-9635) Nodes page displayed duplicate nodes

2019-06-25 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872059#comment-16872059 ] Tao Yang commented on YARN-9635: Hi, [~jiwq] and [~sunilg] Let's clarify this issue again to help for the

[jira] [Updated] (YARN-9647) Docker launch fails when local-dirs or log-dirs is unhealthy.

2019-06-25 Thread KWON BYUNGCHANG (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KWON BYUNGCHANG updated YARN-9647: -- Affects Version/s: 3.1.2 > Docker launch fails when local-dirs or log-dirs is unhealthy. >

[jira] [Created] (YARN-9647) Docker launch fails when local-dirs or log-dirs is unhealthy.

2019-06-25 Thread KWON BYUNGCHANG (JIRA)
KWON BYUNGCHANG created YARN-9647: - Summary: Docker launch fails when local-dirs or log-dirs is unhealthy. Key: YARN-9647 URL: https://issues.apache.org/jira/browse/YARN-9647 Project: Hadoop YARN