[jira] [Updated] (YARN-8632) No data in file realtimetrack.json after running SchedulerLoadSimulator

2018-08-23 Thread Xianghao Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianghao Lu updated YARN-8632: -- Attachment: YARN-8632.003.patch > No data in file realtimetrack.json after running SchedulerLoadSimulato

[jira] [Commented] (YARN-8701) If the single parameter in Resources#createResourceWithSameValue is greater than Integer.MAX_VALUE, then the value of vcores will be -1

2018-08-23 Thread Sen Zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16589909#comment-16589909 ] Sen Zhao commented on YARN-8701: Hi, [~leftnoteasy],[~snemeth], could you give me some adv

[jira] [Resolved] (YARN-8691) AMRMClient unregisterApplicationMaster Api's appMessage should have a maximum size

2018-08-23 Thread Yicong Cai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yicong Cai resolved YARN-8691. -- Resolution: Duplicate Fix Version/s: (was: 2.7.7) 3.0.0-alpha4

[jira] [Commented] (YARN-8632) No data in file realtimetrack.json after running SchedulerLoadSimulator

2018-08-23 Thread Xianghao Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16589918#comment-16589918 ] Xianghao Lu commented on YARN-8632: --- It seems that "setUncaughtExceptionHandler" is not

[jira] [Comment Edited] (YARN-8632) No data in file realtimetrack.json after running SchedulerLoadSimulator

2018-08-23 Thread Xianghao Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16589918#comment-16589918 ] Xianghao Lu edited comment on YARN-8632 at 8/23/18 8:49 AM: It

[jira] [Commented] (YARN-8632) No data in file realtimetrack.json after running SchedulerLoadSimulator

2018-08-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590028#comment-16590028 ] genericqa commented on YARN-8632: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (YARN-8702) TestContainerSchedulerQueuing.testKillOnlyRequiredOpportunisticContainers() failing randomly

2018-08-23 Thread Rakesh Shah (JIRA)
Rakesh Shah created YARN-8702: - Summary: TestContainerSchedulerQueuing.testKillOnlyRequiredOpportunisticContainers() failing randomly Key: YARN-8702 URL: https://issues.apache.org/jira/browse/YARN-8702 P

[jira] [Commented] (YARN-8675) Setting hostname of docker container breaks with "host" networking mode for Apps which do not run as a YARN service

2018-08-23 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590143#comment-16590143 ] Shane Kumpf commented on YARN-8675: --- Looking back over the history here, I think we made

[jira] [Reopened] (YARN-8675) Setting hostname of docker container breaks with "host" networking mode for Apps which do not run as a YARN service

2018-08-23 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf reopened YARN-8675: --- > Setting hostname of docker container breaks with "host" networking mode for > Apps which do not run as

[jira] [Commented] (YARN-8702) TestContainerSchedulerQueuing.testKillOnlyRequiredOpportunisticContainers() failing randomly

2018-08-23 Thread Rakesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590161#comment-16590161 ] Rakesh Shah commented on YARN-8702: --- I would like to contribute, could someone assign m

[jira] [Updated] (YARN-8702) TestContainerSchedulerQueuing.testKillOnlyRequiredOpportunisticContainers() failing randomly

2018-08-23 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-8702: --- Affects Version/s: (was: 3.1.0) (was: 2.8.3) > TestContainerSch

[jira] [Commented] (YARN-8702) TestContainerSchedulerQueuing.testKillOnlyRequiredOpportunisticContainers() failing randomly

2018-08-23 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590168#comment-16590168 ] Bibin A Chundatt commented on YARN-8702: [~Rakesh_Shah] Thank you for raising th

[jira] [Assigned] (YARN-8702) TestContainerSchedulerQueuing.testKillOnlyRequiredOpportunisticContainers() failing randomly

2018-08-23 Thread Rakesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Shah reassigned YARN-8702: - Assignee: Rakesh Shah > TestContainerSchedulerQueuing.testKillOnlyRequiredOpportunisticContainers

[jira] [Updated] (YARN-8702) TestContainerSchedulerQueuing.testKillOnlyRequiredOpportunisticContainers() failing randomly

2018-08-23 Thread Rakesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Shah updated YARN-8702: -- Description: this ut fails because of the container status not getting correctly {quote} h3. Error Messa

[jira] [Commented] (YARN-7680) ContainerMetrics is registered even if yarn.nodemanager.container-metrics.enable is set to false

2018-08-23 Thread Zoltan Siegl (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590235#comment-16590235 ] Zoltan Siegl commented on YARN-7680: Hey [~ajisakaa]! I have been trying to fix or re

[jira] [Commented] (YARN-7773) YARN Federation used Mysql as state store throw exception, Unknown column 'homeSubCluster' in 'field list'

2018-08-23 Thread Y. SREENIVASULU REDDY (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590254#comment-16590254 ] Y. SREENIVASULU REDDY commented on YARN-7773: - I found problem in the branch-3

[jira] [Comment Edited] (YARN-7680) ContainerMetrics is registered even if yarn.nodemanager.container-metrics.enable is set to false

2018-08-23 Thread Zoltan Siegl (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590235#comment-16590235 ] Zoltan Siegl edited comment on YARN-7680 at 8/23/18 2:04 PM: -

[jira] [Created] (YARN-8703) Localized resource may leak on disk if container is killed while localizing

2018-08-23 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-8703: Summary: Localized resource may leak on disk if container is killed while localizing Key: YARN-8703 URL: https://issues.apache.org/jira/browse/YARN-8703 Project: Hadoop YARN

[jira] [Commented] (YARN-8638) Allow linux container runtimes to be pluggable

2018-08-23 Thread Craig Condit (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590307#comment-16590307 ] Craig Condit commented on YARN-8638: [~csingh], the intent with this patch is to be as

[jira] [Commented] (YARN-8649) Similar as YARN-4355:NPE while processing localizer heartbeat

2018-08-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590302#comment-16590302 ] Jason Lowe commented on YARN-8649: -- Thanks for updating the patch! +1 lgtm. While revie

[jira] [Updated] (YARN-8649) NPE in localizer hearbeat processing if a container is killed while localizing

2018-08-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-8649: - Summary: NPE in localizer hearbeat processing if a container is killed while localizing (was: Similar as

[jira] [Commented] (YARN-8638) Allow linux container runtimes to be pluggable

2018-08-23 Thread Craig Condit (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590315#comment-16590315 ] Craig Condit commented on YARN-8638: [~leftnoteasy], I believe runc support (especiall

[jira] [Commented] (YARN-8649) NPE in localizer hearbeat processing if a container is killed while localizing

2018-08-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590345#comment-16590345 ] Hudson commented on YARN-8649: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #148

[jira] [Commented] (YARN-8703) Localized resource may leak on disk if container is killed while localizing

2018-08-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590347#comment-16590347 ] Jason Lowe commented on YARN-8703: -- The ResourceLocalizedEvent has a local path, so it lo

[jira] [Commented] (YARN-8638) Allow linux container runtimes to be pluggable

2018-08-23 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590376#comment-16590376 ] Eric Badger commented on YARN-8638: --- bq. It will be very clean if we can make runc/conta

[jira] [Commented] (YARN-8638) Allow linux container runtimes to be pluggable

2018-08-23 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590390#comment-16590390 ] Eric Yang commented on YARN-8638: - [~leftnoteasy] The purpose of this JIRA is to swap cont

[jira] [Commented] (YARN-8638) Allow linux container runtimes to be pluggable

2018-08-23 Thread Craig Condit (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590403#comment-16590403 ] Craig Condit commented on YARN-8638: [~ebadger], isRuntimeRequested() was added to all

[jira] [Commented] (YARN-7863) Modify placement constraints to support node attributes

2018-08-23 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590410#comment-16590410 ] Naganarasimha G R commented on YARN-7863: - Thanks [~cheersyang] for the detailed c

[jira] [Commented] (YARN-8638) Allow linux container runtimes to be pluggable

2018-08-23 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590412#comment-16590412 ] Eric Badger commented on YARN-8638: --- bq. Default's logic is as before, but since pluggab

[jira] [Commented] (YARN-8638) Allow linux container runtimes to be pluggable

2018-08-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590416#comment-16590416 ] Jason Lowe commented on YARN-8638: -- Unless I'm missing something, the whole point of a pl

[jira] [Updated] (YARN-6456) Allow administrators to set a single ContainerRuntime for all containers

2018-08-23 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-6456: -- Attachment: YARN-6456-ForceDockerRuntimeIfSupported.patch > Allow administrators to set a single Contain

[jira] [Comment Edited] (YARN-8638) Allow linux container runtimes to be pluggable

2018-08-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590416#comment-16590416 ] Jason Lowe edited comment on YARN-8638 at 8/23/18 4:01 PM: --- bq.

[jira] [Commented] (YARN-6456) Allow administrators to set a single ContainerRuntime for all containers

2018-08-23 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590423#comment-16590423 ] Eric Badger commented on YARN-6456: --- [~ccondit-target], I attached a patch of what we're

[jira] [Commented] (YARN-8638) Allow linux container runtimes to be pluggable

2018-08-23 Thread Craig Condit (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590430#comment-16590430 ] Craig Condit commented on YARN-8638: bq. As I see it, the concern here is whether we'r

[jira] [Comment Edited] (YARN-8638) Allow linux container runtimes to be pluggable

2018-08-23 Thread Craig Condit (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590430#comment-16590430 ] Craig Condit edited comment on YARN-8638 at 8/23/18 4:12 PM: -

[jira] [Commented] (YARN-8675) Setting hostname of docker container breaks with "host" networking mode for Apps which do not run as a YARN service

2018-08-23 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590436#comment-16590436 ] Billie Rinaldi commented on YARN-8675: -- i think we're conflating two problems, 1) whe

[jira] [Commented] (YARN-8675) Setting hostname of docker container breaks with "host" networking mode for Apps which do not run as a YARN service

2018-08-23 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590459#comment-16590459 ] Billie Rinaldi commented on YARN-8675: -- I guess a remaining question is whether we wa

[jira] [Commented] (YARN-8638) Allow linux container runtimes to be pluggable

2018-08-23 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590477#comment-16590477 ] Eric Yang commented on YARN-8638: - [~jlowe] {quote} Unless I'm missing something, the whol

[jira] [Commented] (YARN-8638) Allow linux container runtimes to be pluggable

2018-08-23 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590483#comment-16590483 ] Eric Badger commented on YARN-8638: --- bq. LinuxContainerRuntime is already marked @Privat

[jira] [Commented] (YARN-8638) Allow linux container runtimes to be pluggable

2018-08-23 Thread Craig Condit (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590489#comment-16590489 ] Craig Condit commented on YARN-8638: bq. I think this is the correct way to go and is

[jira] [Commented] (YARN-8675) Setting hostname of docker container breaks with "host" networking mode for Apps which do not run as a YARN service

2018-08-23 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590499#comment-16590499 ] Eric Yang commented on YARN-8675: - [~billie.rinaldi] When net != host, AM must set the hos

[jira] [Commented] (YARN-7086) Release all containers aynchronously

2018-08-23 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590507#comment-16590507 ] Manikandan R commented on YARN-7086: Attached .001 patch for early review. It has chan

[jira] [Updated] (YARN-7086) Release all containers aynchronously

2018-08-23 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-7086: --- Attachment: YARN-7086.001.patch > Release all containers aynchronously > -

[jira] [Comment Edited] (YARN-7086) Release all containers aynchronously

2018-08-23 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590507#comment-16590507 ] Manikandan R edited comment on YARN-7086 at 8/23/18 4:49 PM: -

[jira] [Created] (YARN-8704) Improve the error message for an invalid docker rw mount to be more informative

2018-08-23 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-8704: - Summary: Improve the error message for an invalid docker rw mount to be more informative Key: YARN-8704 URL: https://issues.apache.org/jira/browse/YARN-8704 Project: Hadoop

[jira] [Updated] (YARN-8704) Improve the error message for an invalid docker rw mount to be more informative

2018-08-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8704: -- Description: Seeing following error message while starting a privileged docker container {noformat} Erro

[jira] [Updated] (YARN-8704) Improve the error message for an invalid docker rw mount to be more informative

2018-08-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8704: -- Description: Seeing following error message while starting a privileged docker container {noformat} Erro

[jira] [Commented] (YARN-8704) Improve the error message for an invalid docker rw mount to be more informative

2018-08-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590528#comment-16590528 ] Weiwei Yang commented on YARN-8704: --- cc [~shaneku...@gmail.com], [~eyang] > Improve the

[jira] [Commented] (YARN-7086) Release all containers aynchronously

2018-08-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590556#comment-16590556 ] Jason Lowe commented on YARN-7086: -- bq. I assume you are referring the lock inside LeafQu

[jira] [Commented] (YARN-8638) Allow linux container runtimes to be pluggable

2018-08-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590572#comment-16590572 ] Jason Lowe commented on YARN-8638: -- bq. However, it also can cause security issues, if co

[jira] [Commented] (YARN-8632) No data in file realtimetrack.json after running SchedulerLoadSimulator

2018-08-23 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590570#comment-16590570 ] Yufei Gu commented on YARN-8632: [~luxianghao], thanks for the patch. Nice finding. +1 for

[jira] [Updated] (YARN-8697) LocalityMulticastAMRMProxyPolicy should fallback to random sub-cluster when cannot resolve resource

2018-08-23 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8697: --- Attachment: YARN-8697.v2.patch > LocalityMulticastAMRMProxyPolicy should fallback to random sub-cluste

[jira] [Commented] (YARN-8638) Allow linux container runtimes to be pluggable

2018-08-23 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590587#comment-16590587 ] Eric Yang commented on YARN-8638: - [~ccondit-target] Can {@link #STATIC_NON_PRIMITIVE_FIEL

[jira] [Commented] (YARN-8704) Improve the error message for an invalid docker rw mount to be more informative

2018-08-23 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590633#comment-16590633 ] Shane Kumpf commented on YARN-8704: --- [~cheersyang] - Thanks for reporting this. Can you

[jira] [Commented] (YARN-8704) Improve the error message for an invalid docker rw mount to be more informative

2018-08-23 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590639#comment-16590639 ] Eric Yang commented on YARN-8704: - If I recall correctly, the message does print the path

[jira] [Commented] (YARN-8697) LocalityMulticastAMRMProxyPolicy should fallback to random sub-cluster when cannot resolve resource

2018-08-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590663#comment-16590663 ] genericqa commented on YARN-8697: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Created] (YARN-8705) Refactor in preparation for YARN-8696

2018-08-23 Thread Botong Huang (JIRA)
Botong Huang created YARN-8705: -- Summary: Refactor in preparation for YARN-8696 Key: YARN-8705 URL: https://issues.apache.org/jira/browse/YARN-8705 Project: Hadoop YARN Issue Type: Task

[jira] [Updated] (YARN-8705) Refactor in preparation for YARN-8696

2018-08-23 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8705: --- Issue Type: Sub-task (was: Task) Parent: YARN-5597 > Refactor in preparation for YARN-8696 >

[jira] [Updated] (YARN-8675) Setting hostname of docker container breaks with "host" networking mode for Apps which do not run as a YARN service

2018-08-23 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8675: --- Attachment: YARN-8675.1.patch > Setting hostname of docker container breaks with "host" networ

[jira] [Commented] (YARN-8675) Setting hostname of docker container breaks with "host" networking mode for Apps which do not run as a YARN service

2018-08-23 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590706#comment-16590706 ] Suma Shivaprasad commented on YARN-8675: Attached patch which sets hostname if spe

[jira] [Commented] (YARN-8638) Allow linux container runtimes to be pluggable

2018-08-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590762#comment-16590762 ] genericqa commented on YARN-8638: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (YARN-8706) DelayedProcessKiller is executed for Docker containers even though docker stop sends a KILL signal after the specified grace period

2018-08-23 Thread Chandni Singh (JIRA)
Chandni Singh created YARN-8706: --- Summary: DelayedProcessKiller is executed for Docker containers even though docker stop sends a KILL signal after the specified grace period Key: YARN-8706 URL: https://issues.apach

[jira] [Commented] (YARN-8675) Setting hostname of docker container breaks with "host" networking mode for Apps which do not run as a YARN service

2018-08-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590794#comment-16590794 ] genericqa commented on YARN-8675: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-8705) Refactor in preparation for YARN-8696

2018-08-23 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8705: --- Attachment: YARN-8705.v1.patch > Refactor in preparation for YARN-8696 > -

[jira] [Updated] (YARN-8705) Refactor in preparation for YARN-8696

2018-08-23 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8705: --- Attachment: (was: YARN-8705.v1.patch) > Refactor in preparation for YARN-8696 > --

[jira] [Updated] (YARN-8705) Refactor in preparation for YARN-8696

2018-08-23 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8705: --- Attachment: YARN-8705.v1.patch > Refactor in preparation for YARN-8696 > -

[jira] [Updated] (YARN-8706) DelayedProcessKiller is executed for Docker containers even though docker stop sends a KILL signal after the specified grace period

2018-08-23 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8706: Description: {{DockerStopCommand}} adds a grace period of 10 seconds. 10 seconds is also the defaul

[jira] [Updated] (YARN-8706) DelayedProcessKiller is executed for Docker containers even though docker stop sends a KILL signal after the specified grace period

2018-08-23 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8706: Description: {{DockerStopCommand}} adds a grace period of 10 seconds. 10 seconds is also the defaul

[jira] [Commented] (YARN-8638) Allow linux container runtimes to be pluggable

2018-08-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590869#comment-16590869 ] genericqa commented on YARN-8638: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (YARN-8638) Allow linux container runtimes to be pluggable

2018-08-23 Thread Craig Condit (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590876#comment-16590876 ] Craig Condit edited comment on YARN-8638 at 8/23/18 10:22 PM: --

[jira] [Commented] (YARN-8638) Allow linux container runtimes to be pluggable

2018-08-23 Thread Craig Condit (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590876#comment-16590876 ] Craig Condit commented on YARN-8638: Current warnings (shouldn't prevent merging IMO):

[jira] [Commented] (YARN-8705) Refactor in preparation for YARN-8696

2018-08-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590909#comment-16590909 ] genericqa commented on YARN-8705: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-8705) Refactor in preparation for YARN-8696

2018-08-23 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8705: --- Attachment: YARN-8705.v2.patch > Refactor in preparation for YARN-8696 > -

[jira] [Updated] (YARN-8488) YARN service/components/instances should have SUCCEEDED/FAILED states

2018-08-23 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8488: --- Attachment: YARN-8488.6.patch > YARN service/components/instances should have SUCCEEDED/FAILED

[jira] [Commented] (YARN-8488) YARN service/components/instances should have SUCCEEDED/FAILED states

2018-08-23 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590973#comment-16590973 ] Suma Shivaprasad commented on YARN-8488: Thanks [~eyang] Attached patch with revie

[jira] [Commented] (YARN-8705) Refactor in preparation for YARN-8696

2018-08-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590992#comment-16590992 ] genericqa commented on YARN-8705: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-8488) YARN service/components/instances should have SUCCEEDED/FAILED states

2018-08-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16591033#comment-16591033 ] genericqa commented on YARN-8488: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-7773) YARN Federation used Mysql as state store throw exception, Unknown column 'homeSubCluster' in 'field list'

2018-08-23 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-7773: --- Fix Version/s: 3.1.2 > YARN Federation used Mysql as state store throw exception, Unknown colu

[jira] [Comment Edited] (YARN-8698) [Submarine] Failed to add hadoop dependencies in docker container when submitting a submarine job

2018-08-23 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16591040#comment-16591040 ] Zac Zhou edited comment on YARN-8698 at 8/24/18 1:47 AM: - Hi [~tan

[jira] [Commented] (YARN-8704) Improve the error message for an invalid docker rw mount to be more informative

2018-08-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16591039#comment-16591039 ] Weiwei Yang commented on YARN-8704: --- Hi [~eyang], [~shaneku...@gmail.com] Thanks for th

[jira] [Commented] (YARN-8698) [Submarine] Failed to add hadoop dependencies in docker container when submitting a submarine job

2018-08-23 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16591040#comment-16591040 ] Zac Zhou commented on YARN-8698: Hi [~tangzhankun], yeah, I specified "DOCKER_HADOOP_HDFS

[jira] [Closed] (YARN-8704) Improve the error message for an invalid docker rw mount to be more informative

2018-08-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang closed YARN-8704. - > Improve the error message for an invalid docker rw mount to be more > informative > ---

[jira] [Resolved] (YARN-8704) Improve the error message for an invalid docker rw mount to be more informative

2018-08-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YARN-8704. --- Resolution: Invalid > Improve the error message for an invalid docker rw mount to be more > informati

[jira] [Comment Edited] (YARN-8698) [Submarine] Failed to add hadoop dependencies in docker container when submitting a submarine job

2018-08-23 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16591040#comment-16591040 ] Zac Zhou edited comment on YARN-8698 at 8/24/18 1:55 AM: - Hi [~tan

[jira] [Commented] (YARN-8698) [Submarine] Failed to add hadoop dependencies in docker container when submitting a submarine job

2018-08-23 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16591120#comment-16591120 ] Zhankun Tang commented on YARN-8698: [~yuan_zac] Yeah. Thanks for clarification. Actua

[jira] [Commented] (YARN-7773) YARN Federation used Mysql as state store throw exception, Unknown column 'homeSubCluster' in 'field list'

2018-08-23 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16591138#comment-16591138 ] Bibin A Chundatt commented on YARN-7773: Backported to branch-3.1 too > YARN Fede

[jira] [Created] (YARN-8707) It's not reasonable to decide whether app is starved by fairShare

2018-08-23 Thread Zhaohui Xin (JIRA)
Zhaohui Xin created YARN-8707: - Summary: It's not reasonable to decide whether app is starved by fairShare Key: YARN-8707 URL: https://issues.apache.org/jira/browse/YARN-8707 Project: Hadoop YARN

[jira] [Commented] (YARN-8670) Support scheduling request for SLS input and attributes for Node in SLS

2018-08-23 Thread Sichen zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16591187#comment-16591187 ] Sichen zhao commented on YARN-8670: --- Hi, My idea of a large number of jobs/requests wit