[jira] [Commented] (YARN-8471) YARN RM hangs and stops allocating resources when applications successively running

2018-06-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528553#comment-16528553 ] genericqa commented on YARN-8471: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (YARN-8193) YARN RM hangs abruptly (stops allocating resources) when running successive applications.

2018-06-29 Thread tianjuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528549#comment-16528549 ] tianjuan edited comment on YARN-8193 at 6/30/18 5:11 AM: - attachin

[jira] [Commented] (YARN-8471) YARN RM hangs and stops allocating resources when applications successively running

2018-06-29 Thread tianjuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528551#comment-16528551 ] tianjuan commented on YARN-8471: sure. I reopened YARN-8193 and attached patch. > YARN RM

[jira] [Updated] (YARN-8193) YARN RM hangs abruptly (stops allocating resources) when running successive applications.

2018-06-29 Thread tianjuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tianjuan updated YARN-8193: --- Fix Version/s: 2.9.0 > YARN RM hangs abruptly (stops allocating resources) when running successive > applicat

[jira] [Reopened] (YARN-8193) YARN RM hangs abruptly (stops allocating resources) when running successive applications.

2018-06-29 Thread tianjuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tianjuan reopened YARN-8193: attaching patching for 2.9.0 > YARN RM hangs abruptly (stops allocating resources) when running successive > a

[jira] [Updated] (YARN-8193) YARN RM hangs abruptly (stops allocating resources) when running successive applications.

2018-06-29 Thread tianjuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tianjuan updated YARN-8193: --- Attachment: YARN-8193-branch-2.9.0-001.patch > YARN RM hangs abruptly (stops allocating resources) when runnin

[jira] [Assigned] (YARN-8193) YARN RM hangs abruptly (stops allocating resources) when running successive applications.

2018-06-29 Thread tianjuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tianjuan reassigned YARN-8193: -- Assignee: Zian Chen (was: tianjuan) > YARN RM hangs abruptly (stops allocating resources) when running

[jira] [Assigned] (YARN-8193) YARN RM hangs abruptly (stops allocating resources) when running successive applications.

2018-06-29 Thread tianjuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tianjuan reassigned YARN-8193: -- Assignee: tianjuan (was: Zian Chen) > YARN RM hangs abruptly (stops allocating resources) when running

[jira] [Commented] (YARN-8471) YARN RM hangs and stops allocating resources when applications successively running

2018-06-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528545#comment-16528545 ] Wangda Tan commented on YARN-8471: -- [~jutia], if this is mostly same as YARN-8193, could

[jira] [Resolved] (YARN-8478) The capacity scheduler logs too frequently seriously affecting performance

2018-06-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-8478. -- Resolution: Duplicate > The capacity scheduler logs too frequently seriously affecting performance > ---

[jira] [Commented] (YARN-8479) The capacity scheduler logs too frequently seriously affecting performance

2018-06-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528543#comment-16528543 ] Wangda Tan commented on YARN-8479: -- Thanks [~daemon], [~cheersyang], Basically, inside

[jira] [Updated] (YARN-8471) YARN RM hangs and stops allocating resources when applications successively running

2018-06-29 Thread tianjuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tianjuan updated YARN-8471: --- Attachment: YARN-8471-branch-2.9.0-001.patch > YARN RM hangs and stops allocating resources when applications

[jira] [Commented] (YARN-8459) Improve logs of Capacity Scheduler to better debug invalid states

2018-06-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528540#comment-16528540 ] Wangda Tan commented on YARN-8459: -- Thanks [~bibinchundatt], Can we move this to the YAR

[jira] [Comment Edited] (YARN-8471) YARN RM hangs and stops allocating resources when applications successively running

2018-06-29 Thread tianjuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528538#comment-16528538 ] tianjuan edited comment on YARN-8471 at 6/30/18 4:32 AM: - Thanks i

[jira] [Commented] (YARN-8471) YARN RM hangs and stops allocating resources when applications successively running

2018-06-29 Thread tianjuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528538#comment-16528538 ] tianjuan commented on YARN-8471: Thanks inigo for reminding me this. and I will update pat

[jira] [Commented] (YARN-8483) Logs in FederationInterceptorREST should give some information on the exception

2018-06-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528536#comment-16528536 ] genericqa commented on YARN-8483: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-8465) Dshell docker container gets marked as lost after NM restart

2018-06-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528501#comment-16528501 ] genericqa commented on YARN-8465: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-8484) Fix NPE during ServiceStop in Router classes

2018-06-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528486#comment-16528486 ] genericqa commented on YARN-8484: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-8483) Logs in FederationInterceptorREST should give some information on the exception

2018-06-29 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-8483: -- Attachment: YARN-8483.000.patch > Logs in FederationInterceptorREST should give some information on the

[jira] [Updated] (YARN-7899) [AMRMProxy] Stateful FederationInterceptor for pending requests

2018-06-29 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7899: --- Attachment: (was: YARN-7899.v3.patch) > [AMRMProxy] Stateful FederationInterceptor for pending req

[jira] [Updated] (YARN-8484) Fix NPE during ServiceStop in Router classes

2018-06-29 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-8484: -- Description: Fix NPE during ServiceStop in Router classes. > Fix NPE during ServiceStop in Router classe

[jira] [Updated] (YARN-8484) Fix NPE during ServiceStop in Router classes

2018-06-29 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-8484: --- Affects Version/s: 2.9.0 > Fix NPE during ServiceStop in Router classes >

[jira] [Commented] (YARN-7899) [AMRMProxy] Stateful FederationInterceptor for pending requests

2018-06-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528450#comment-16528450 ] genericqa commented on YARN-7899: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (YARN-8484) Fix NPE during ServiceStop in Router classes

2018-06-29 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-8484: --- Attachment: YARN-8484.v1.patch > Fix NPE during ServiceStop in Router classes

[jira] [Assigned] (YARN-8484) Fix NPE during ServiceStop in Router classes

2018-06-29 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola reassigned YARN-8484: -- Assignee: Giovanni Matteo Fumarola > Fix NPE during ServiceStop in Rout

[jira] [Created] (YARN-8484) Fix NPE during ServiceStop in Router classes

2018-06-29 Thread Giovanni Matteo Fumarola (JIRA)
Giovanni Matteo Fumarola created YARN-8484: -- Summary: Fix NPE during ServiceStop in Router classes Key: YARN-8484 URL: https://issues.apache.org/jira/browse/YARN-8484 Project: Hadoop YARN

[jira] [Commented] (YARN-8445) YARN native service doesn't allow service name equals to component name

2018-06-29 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528382#comment-16528382 ] Gour Saha commented on YARN-8445: - We might have to revisit this. It seems to be an issue

[jira] [Updated] (YARN-8465) Dshell docker container gets marked as lost after NM restart

2018-06-29 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-8465: -- Attachment: YARN-8465.001.patch > Dshell docker container gets marked as lost after NM restart > ---

[jira] [Commented] (YARN-8465) Dshell docker container gets marked as lost after NM restart

2018-06-29 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528378#comment-16528378 ] Shane Kumpf commented on YARN-8465: --- This is a bug from YARN-8259. I overlooked that a s

[jira] [Updated] (YARN-8465) Dshell docker container gets marked as lost after NM restart

2018-06-29 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-8465: -- Affects Version/s: 3.2.0 Target Version/s: 3.2.0, 3.1.1 Labels: Docker (was: ) > Ds

[jira] [Updated] (YARN-8465) Dshell docker container gets marked as lost after NM restart

2018-06-29 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-8465: -- Issue Type: Sub-task (was: Bug) Parent: YARN-3611 > Dshell docker container gets marked as lost

[jira] [Comment Edited] (YARN-8435) NPE when the same client simultaneously contact for the first time Yarn Router

2018-06-29 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528350#comment-16528350 ] Giovanni Matteo Fumarola edited comment on YARN-8435 at 6/29/18 10:59 PM: --

[jira] [Commented] (YARN-8435) NPE when the same client simultaneously contact for the first time Yarn Router

2018-06-29 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528350#comment-16528350 ] Giovanni Matteo Fumarola commented on YARN-8435: Thanks [~tanujnay] for va

[jira] [Updated] (YARN-7899) [AMRMProxy] Stateful FederationInterceptor for pending requests

2018-06-29 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7899: --- Attachment: YARN-7899.v3.patch > [AMRMProxy] Stateful FederationInterceptor for pending requests > ---

[jira] [Commented] (YARN-8435) NPE when the same client simultaneously contact for the first time Yarn Router

2018-06-29 Thread Tanuj Nayak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528342#comment-16528342 ] Tanuj Nayak commented on YARN-8435: --- Hey, I applied this to a small cluster and this see

[jira] [Commented] (YARN-6672) Add NM preemption of opportunistic containers when utilization goes high

2018-06-29 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-6672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528340#comment-16528340 ] Íñigo Goiri commented on YARN-6672: --- +1 on [^YARN-6672-YARN-1011.06.patch]. Let's do YA

[jira] [Commented] (YARN-6672) Add NM preemption of opportunistic containers when utilization goes high

2018-06-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528338#comment-16528338 ] genericqa commented on YARN-6672: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (YARN-8299) Yarn Service Upgrade: Add GET APIs that returns instances matching query params

2018-06-29 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8299: Summary: Yarn Service Upgrade: Add GET APIs that returns instances matching query params (was: Yarn

[jira] [Updated] (YARN-8299) Yarn Service Upgrade: Add GET APIs that returns instances matching query params

2018-06-29 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8299: Description: We need APIs that returns containers that match the query params. These are needed so t

[jira] [Updated] (YARN-7899) [AMRMProxy] Stateful FederationInterceptor for pending requests

2018-06-29 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7899: --- Attachment: (was: YARN-7899.v2.patch) > [AMRMProxy] Stateful FederationInterceptor for pending req

[jira] [Updated] (YARN-7899) [AMRMProxy] Stateful FederationInterceptor for pending requests

2018-06-29 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7899: --- Attachment: YARN-7899.v3.patch > [AMRMProxy] Stateful FederationInterceptor for pending requests > ---

[jira] [Commented] (YARN-8302) ATS v2 should handle HBase connection issue properly

2018-06-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528287#comment-16528287 ] genericqa commented on YARN-8302: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-6672) Add NM preemption of opportunistic containers when utilization goes high

2018-06-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528269#comment-16528269 ] Haibo Chen commented on YARN-6672: -- Thanks [~elgoiri] for the review! {quote} * In testPr

[jira] [Updated] (YARN-6672) Add NM preemption of opportunistic containers when utilization goes high

2018-06-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6672: - Attachment: YARN-6672-YARN-1011.06.patch > Add NM preemption of opportunistic containers when utilization

[jira] [Commented] (YARN-7334) Add documentation of oversubscription

2018-06-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528267#comment-16528267 ] Haibo Chen commented on YARN-7334: -- Sure, [~elgoiri] I will get on this once we are done

[jira] [Created] (YARN-8483) Logs in FederationInterceptorREST should give some information on the exception

2018-06-29 Thread JIRA
Íñigo Goiri created YARN-8483: - Summary: Logs in FederationInterceptorREST should give some information on the exception Key: YARN-8483 URL: https://issues.apache.org/jira/browse/YARN-8483 Project: Hadoop

[jira] [Created] (YARN-8482) [Router] Add cache service for fast answers to getApps

2018-06-29 Thread Giovanni Matteo Fumarola (JIRA)
Giovanni Matteo Fumarola created YARN-8482: -- Summary: [Router] Add cache service for fast answers to getApps Key: YARN-8482 URL: https://issues.apache.org/jira/browse/YARN-8482 Project: Hadoop

[jira] [Commented] (YARN-7898) [FederationStateStore] Create a proxy chain for FederationStateStore API in the Router

2018-06-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528178#comment-16528178 ] genericqa commented on YARN-7898: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-8302) ATS v2 should handle HBase connection issue properly

2018-06-29 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528173#comment-16528173 ] Billie Rinaldi commented on YARN-8302: -- Attaching a patch that runs a monitor thread

[jira] [Commented] (YARN-8474) sleeper service fails to launch with "Authentication Required"

2018-06-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528159#comment-16528159 ] genericqa commented on YARN-8474: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (YARN-8302) ATS v2 should handle HBase connection issue properly

2018-06-29 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-8302: - Attachment: YARN-8302.1.patch > ATS v2 should handle HBase connection issue properly > ---

[jira] [Assigned] (YARN-8302) ATS v2 should handle HBase connection issue properly

2018-06-29 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi reassigned YARN-8302: Assignee: Billie Rinaldi > ATS v2 should handle HBase connection issue properly > -

[jira] [Commented] (YARN-7898) [FederationStateStore] Create a proxy chain for FederationStateStore API in the Router

2018-06-29 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528158#comment-16528158 ] Giovanni Matteo Fumarola commented on YARN-7898: Thanks [~elgoiri]. Yes we

[jira] [Commented] (YARN-8379) Improve balancing resources in already satisfied queues by using Capacity Scheduler preemption

2018-06-29 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528146#comment-16528146 ] Sunil Govindan commented on YARN-8379: -- In 2.9, we have added Queue Priorities and po

[jira] [Commented] (YARN-8379) Improve balancing resources in already satisfied queues by using Capacity Scheduler preemption

2018-06-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528143#comment-16528143 ] Vinod Kumar Vavilapalli commented on YARN-8379: --- This looks like a new featu

[jira] [Commented] (YARN-8481) AMRMProxyPolicies should accept heartbeat response from new/unknown subclusters

2018-06-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528110#comment-16528110 ] Hudson commented on YARN-8481: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #145

[jira] [Commented] (YARN-8481) AMRMProxyPolicies should accept heartbeat response from new/unknown subclusters

2018-06-29 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528099#comment-16528099 ] Botong Huang commented on YARN-8481: Thanks [~giovanni.fumarola] for the quick review

[jira] [Comment Edited] (YARN-8481) AMRMProxyPolicies should accept heartbeat response from new/unknown subclusters

2018-06-29 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528085#comment-16528085 ] Giovanni Matteo Fumarola edited comment on YARN-8481 at 6/29/18 6:57 PM: ---

[jira] [Commented] (YARN-8474) sleeper service fails to launch with "Authentication Required"

2018-06-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528096#comment-16528096 ] Eric Yang commented on YARN-8474: - Patch 003 fixed white space and added unit test. > sle

[jira] [Updated] (YARN-8474) sleeper service fails to launch with "Authentication Required"

2018-06-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8474: Attachment: YARN-8474.003.patch > sleeper service fails to launch with "Authentication Required" > -

[jira] [Commented] (YARN-8481) AMRMProxyPolicies should accept heartbeat response from new/unknown subclusters

2018-06-29 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528085#comment-16528085 ] Giovanni Matteo Fumarola commented on YARN-8481: Thanks [~botong] for the

[jira] [Commented] (YARN-8451) Multiple NM heartbeat thread created when a slow NM resync with RM

2018-06-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528057#comment-16528057 ] Hudson commented on YARN-8451: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #145

[jira] [Commented] (YARN-8481) AMRMProxyPolicies should accept heartbeat response from new/unknown subclusters

2018-06-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528053#comment-16528053 ] genericqa commented on YARN-8481: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-8477) Minor code refactor on ProcfsBasedProcessTree.java

2018-06-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528052#comment-16528052 ] genericqa commented on YARN-8477: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-8469) [UI2] URL needs to be trimmed to handle index.html redirection while accessing via knox

2018-06-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528038#comment-16528038 ] Hudson commented on YARN-8469: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #145

[jira] [Commented] (YARN-8451) Multiple NM heartbeat thread created when a slow NM resync with RM

2018-06-29 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528033#comment-16528033 ] Botong Huang commented on YARN-8451: Thanks [~jlowe]! Please also cherry-pick this to

[jira] [Commented] (YARN-7334) Add documentation of oversubscription

2018-06-29 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528031#comment-16528031 ] Íñigo Goiri commented on YARN-7334: --- I think there are a couple things left in YARN-1011

[jira] [Commented] (YARN-6672) Add NM preemption of opportunistic containers when utilization goes high

2018-06-29 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-6672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528028#comment-16528028 ] Íñigo Goiri commented on YARN-6672: --- [~haibochen], thanks for [^YARN-6672-YARN-1011.05.p

[jira] [Commented] (YARN-8481) AMRMProxyPolicies should accept heartbeat response from new/unknown subclusters

2018-06-29 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528027#comment-16528027 ] Giovanni Matteo Fumarola commented on YARN-8481: Thanks [~botong] . LGTM +

[jira] [Commented] (YARN-8451) Multiple NM heartbeat thread created when a slow NM resync with RM

2018-06-29 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528025#comment-16528025 ] Jason Lowe commented on YARN-8451: -- Thanks for updating the patch! +1 lgtm. Committing

[jira] [Commented] (YARN-8455) Add basic ACL check for all ATS v2 REST APIs

2018-06-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528018#comment-16528018 ] Hudson commented on YARN-8455: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #145

[jira] [Updated] (YARN-8481) AMRMProxyPolicies should accept heartbeat response from new/unknown subclusters

2018-06-29 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8481: --- Attachment: YARN-8481.v1.patch > AMRMProxyPolicies should accept heartbeat response from new/unknown

[jira] [Commented] (YARN-8471) YARN RM hangs and stops allocating resources when applications successively running

2018-06-29 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16527992#comment-16527992 ] Íñigo Goiri commented on YARN-8471: --- bq. this is an applicable patch for 2.9.0 Tag the

[jira] [Commented] (YARN-6672) Add NM preemption of opportunistic containers when utilization goes high

2018-06-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16527991#comment-16527991 ] genericqa commented on YARN-6672: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (YARN-8481) AMRMProxyPolicies should accept heartbeat response from new/unknown subclusters

2018-06-29 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8481: --- Component/s: federation amrmproxy > AMRMProxyPolicies should accept heartbeat respons

[jira] [Updated] (YARN-8451) Multiple NM heartbeat thread created when a slow NM resync with RM

2018-06-29 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8451: --- Component/s: nodemanager > Multiple NM heartbeat thread created when a slow NM resync with RM > --

[jira] [Created] (YARN-8481) AMRMProxyPolicies should accept heartbeat response from new/unknown subclusters

2018-06-29 Thread Botong Huang (JIRA)
Botong Huang created YARN-8481: -- Summary: AMRMProxyPolicies should accept heartbeat response from new/unknown subclusters Key: YARN-8481 URL: https://issues.apache.org/jira/browse/YARN-8481 Project: Hado

[jira] [Commented] (YARN-8480) Add boolean option for resources

2018-06-29 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16527962#comment-16527962 ] Jason Lowe commented on YARN-8480: -- Could someone elaborate a bit more on the use-case fo

[jira] [Commented] (YARN-8474) sleeper service fails to launch with "Authentication Required"

2018-06-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16527959#comment-16527959 ] genericqa commented on YARN-8474: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-8455) Add basic ACL check for all ATS v2 REST APIs

2018-06-29 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8455: - Summary: Add basic ACL check for all ATS v2 REST APIs (was: Add basic acl check for all TS v2 RES

[jira] [Commented] (YARN-8455) Add basic acl check for all TS v2 REST APIs

2018-06-29 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16527953#comment-16527953 ] Sunil Govindan commented on YARN-8455: -- Thanks [~rohithsharma] for testing and verify

[jira] [Updated] (YARN-6672) Add NM preemption of opportunistic containers when utilization goes high

2018-06-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6672: - Attachment: YARN-6672-YARN-1011.05.patch > Add NM preemption of opportunistic containers when utilization

[jira] [Commented] (YARN-6672) Add NM preemption of opportunistic containers when utilization goes high

2018-06-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16527882#comment-16527882 ] Haibo Chen commented on YARN-6672: -- Thanks [~elgoiri] for the follow-up review!  {quote}

[jira] [Commented] (YARN-8474) sleeper service fails to launch with "Authentication Required"

2018-06-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16527876#comment-16527876 ] Eric Yang commented on YARN-8474: - - Patch 002 make sure in non-HA case, the challenge and

[jira] [Updated] (YARN-8474) sleeper service fails to launch with "Authentication Required"

2018-06-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8474: Attachment: YARN-8474.002.patch > sleeper service fails to launch with "Authentication Required" > -

[jira] [Commented] (YARN-8326) Yarn 3.0 seems runs slower than Yarn 2.6

2018-06-29 Thread Dmitry Chuyko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16527840#comment-16527840 ] Dmitry Chuyko commented on YARN-8326: - Thanks for fixing this! We at BellSoft also not

[jira] [Commented] (YARN-8467) AsyncDispatcher should have a name & display it in logs to improve debug

2018-06-29 Thread Shuai Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16527540#comment-16527540 ] Shuai Zhang commented on YARN-8467: --- Because it's just related to debug logs, there's no

[jira] [Commented] (YARN-8479) The capacity scheduler logs too frequently seriously affecting performance

2018-06-29 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16527488#comment-16527488 ] YunFan Zhou commented on YARN-8479: --- Thank [~cheersyang] I totally agree with you and i

[jira] [Commented] (YARN-8479) The capacity scheduler logs too frequently seriously affecting performance

2018-06-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16527371#comment-16527371 ] Weiwei Yang commented on YARN-8479: --- Hi [~daemon] In my opinion, reduce the verbose of

[jira] [Commented] (YARN-6265) yarn.resourcemanager.fail-fast is used inconsistently

2018-06-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16527270#comment-16527270 ] Junping Du commented on YARN-6265: -- Looks like patch doesn't apply any more. [~yuanbo] ,