[jira] [Updated] (YARN-7756) AMRMProxyService cann't enable ’hadoop.security.authorization‘

2018-01-15 Thread leiqiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leiqiang updated YARN-7756: --- Description: after set hadoop.security.authorization=true, start AMRMProxyService  will has such error

[jira] [Comment Edited] (YARN-7451) Resources Types should be visible in the Cluster Apps API "resourceRequests" section

2018-01-15 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326301#comment-16326301 ] Szilard Nemeth edited comment on YARN-7451 at 1/16/18 7:53 AM: --- Thanks

[jira] [Updated] (YARN-7756) AMRMProxyService cann't enable ’hadoop.security.authorization‘

2018-01-15 Thread leiqiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leiqiang updated YARN-7756: --- Component/s: nodemanager > AMRMProxyService cann't enable ’hadoop.security.authorization‘ >

[jira] [Created] (YARN-7756) AMRMProxyService cann't enable ’hadoop.security.authorization‘

2018-01-15 Thread leiqiang (JIRA)
leiqiang created YARN-7756: -- Summary: AMRMProxyService cann't enable ’hadoop.security.authorization‘ Key: YARN-7756 URL: https://issues.apache.org/jira/browse/YARN-7756 Project: Hadoop YARN Issue

[jira] [Comment Edited] (YARN-3409) Support Node Attribute functionality

2018-01-15 Thread LiangYe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317920#comment-16317920 ] LiangYe edited comment on YARN-3409 at 1/16/18 7:14 AM: Node labels for partition

[jira] [Commented] (YARN-7749) [UI2] GPU information tab in left hand side disappears when we click other tabs below

2018-01-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326822#comment-16326822 ] ASF GitHub Bot commented on YARN-7749: -- Github user Abdimaliksk commented on the issue:

[jira] [Commented] (YARN-6856) Support CLI for Node Attributes Mapping

2018-01-15 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326800#comment-16326800 ] genericqa commented on YARN-6856: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-6856) Support CLI for Node Attributes Mapping

2018-01-15 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326787#comment-16326787 ] Weiwei Yang edited comment on YARN-6856 at 1/16/18 5:57 AM: Hi

[jira] [Commented] (YARN-6856) Support CLI for Node Attributes Mapping

2018-01-15 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326787#comment-16326787 ] Weiwei Yang commented on YARN-6856: --- Hi [~Naganarasimha], [~sunilg] I took a look at the patch, looks

[jira] [Commented] (YARN-7031) Support distributed node attributes

2018-01-15 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326781#comment-16326781 ] Weiwei Yang commented on YARN-7031: --- Uploaded an initial patch, class \{{RMNodeAttributesManager}} can be

[jira] [Updated] (YARN-7031) Support distributed node attributes

2018-01-15 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7031: -- Attachment: YARN-7031-YARN-3409.001.patch > Support distributed node attributes >

[jira] [Commented] (YARN-7031) Support distributed node attributes

2018-01-15 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326779#comment-16326779 ] Weiwei Yang commented on YARN-7031: --- Hi [~bibinchundatt] Thanks for the comments. I have a patch that

[jira] [Commented] (YARN-6856) Support CLI for Node Attributes Mapping

2018-01-15 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326777#comment-16326777 ] Sunil G commented on YARN-6856: --- It seems some issue in branch itself. > Support CLI for Node Attributes

[jira] [Commented] (YARN-6856) Support CLI for Node Attributes Mapping

2018-01-15 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326775#comment-16326775 ] Bibin A Chundatt commented on YARN-6856: Hi Naga, I have retriggered the build again > Support

[jira] [Commented] (YARN-7031) Support distributed node attributes

2018-01-15 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326766#comment-16326766 ] Bibin A Chundatt commented on YARN-7031: [~cheersyang] As discussed offline by [~Naganarasimha]

[jira] [Commented] (YARN-6918) Remove acls after queue delete to avoid memory leak

2018-01-15 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326741#comment-16326741 ] Bibin A Chundatt commented on YARN-6918: [~sunilg] Could you review the patch attached. > Remove

[jira] [Updated] (YARN-5742) Serve aggregated logs of historical apps from timeline service

2018-01-15 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-5742: Description: ATSv1.5 daemon has servlet to serve aggregated logs. But enabling only ATSv2,

[jira] [Commented] (YARN-5742) Serve aggregated logs of historical apps from timeline service

2018-01-15 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326729#comment-16326729 ] Rohith Sharma K S commented on YARN-5742: - One of the workaround for this as of today is post

[jira] [Commented] (YARN-6486) FairScheduler: Deprecate continuous scheduling

2018-01-15 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326728#comment-16326728 ] Wilfred Spiegelenburg commented on YARN-6486: - Updated the patch with the extra deprecation

[jira] [Created] (YARN-7755) Clean up deprecation messages for allocation increments in FS config

2018-01-15 Thread Wilfred Spiegelenburg (JIRA)
Wilfred Spiegelenburg created YARN-7755: --- Summary: Clean up deprecation messages for allocation increments in FS config Key: YARN-7755 URL: https://issues.apache.org/jira/browse/YARN-7755

[jira] [Updated] (YARN-7754) [Atsv2] Update document for running v1 and v2 TS

2018-01-15 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-7754: Description: Post YARN-6736, RM can publish events into both v1 and v2 TS. Newer

[jira] [Commented] (YARN-7479) TestContainerManagerSecurity.testContainerManager[Simple] flaky in trunk

2018-01-15 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326724#comment-16326724 ] genericqa commented on YARN-7479: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7754) [Atsv2] Update document for running v1 and v2 TS

2018-01-15 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-7754: Environment: (was: Post YARN-6736, RM can publish events into both v1 and v2 TS. Newer

[jira] [Created] (YARN-7754) [Atsv2] Update document for running v1 and v2 TS

2018-01-15 Thread Rohith Sharma K S (JIRA)
Rohith Sharma K S created YARN-7754: --- Summary: [Atsv2] Update document for running v1 and v2 TS Key: YARN-7754 URL: https://issues.apache.org/jira/browse/YARN-7754 Project: Hadoop YARN

[jira] [Updated] (YARN-6486) FairScheduler: Deprecate continuous scheduling

2018-01-15 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-6486: Attachment: YARN-6486.006.patch > FairScheduler: Deprecate continuous scheduling >

[jira] [Assigned] (YARN-3409) Support Node Attribute functionality

2018-01-15 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned YARN-3409: - Assignee: Naganarasimha G R (was: Weiwei Yang) > Support Node Attribute functionality >

[jira] [Assigned] (YARN-3409) Support Node Attribute functionality

2018-01-15 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned YARN-3409: - Assignee: Weiwei Yang (was: Naganarasimha G R) > Support Node Attribute functionality >

[jira] [Commented] (YARN-6736) Consider writing to both ats v1 & v2 from RM for smoother upgrades

2018-01-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326715#comment-16326715 ] Hudson commented on YARN-6736: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13499 (See

[jira] [Created] (YARN-7753) [UI2] Application logs has to be pulled from ATS 1.5 instead of ATS2

2018-01-15 Thread Sunil G (JIRA)
Sunil G created YARN-7753: - Summary: [UI2] Application logs has to be pulled from ATS 1.5 instead of ATS2 Key: YARN-7753 URL: https://issues.apache.org/jira/browse/YARN-7753 Project: Hadoop YARN

[jira] [Commented] (YARN-6736) Consider writing to both ats v1 & v2 from RM for smoother upgrades

2018-01-15 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326689#comment-16326689 ] Rohith Sharma K S commented on YARN-6736: - committing shortly! test failures and findbugs are not

[jira] [Commented] (YARN-7747) YARN UI is broken in the minicluster

2018-01-15 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326684#comment-16326684 ] Gera Shegalov commented on YARN-7747: - TestContainerLogsPage failure is tracked in YARN-7734.

[jira] [Commented] (YARN-7031) Support distributed node attributes

2018-01-15 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326679#comment-16326679 ] Weiwei Yang commented on YARN-7031: --- I got some thoughts on how to implement distributed node attributes,

[jira] [Updated] (YARN-7031) Support distributed node attributes

2018-01-15 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7031: -- Attachment: Distributed node attributes v1.pdf > Support distributed node attributes >

[jira] [Commented] (YARN-6599) Support rich placement constraints in scheduler

2018-01-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326591#comment-16326591 ] Arun Suresh commented on YARN-6599: --- Sure - will check it out today eve. > Support rich placement

[jira] [Commented] (YARN-6619) AMRMClient Changes to use the PlacementConstraint and SchcedulingRequest objects

2018-01-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326589#comment-16326589 ] Arun Suresh commented on YARN-6619: --- Fixing some of the checkstyle. {{TestAMRMClientONRMRestart}} is an

[jira] [Updated] (YARN-6619) AMRMClient Changes to use the PlacementConstraint and SchcedulingRequest objects

2018-01-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6619: -- Attachment: YARN-6619-YARN-6592.002.patch > AMRMClient Changes to use the PlacementConstraint and

[jira] [Created] (YARN-7752) Handle AllocationTags for Opportunistic containers.

2018-01-15 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-7752: - Summary: Handle AllocationTags for Opportunistic containers. Key: YARN-7752 URL: https://issues.apache.org/jira/browse/YARN-7752 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-7451) Resources Types should be visible in the Cluster Apps API "resourceRequests" section

2018-01-15 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326419#comment-16326419 ] genericqa commented on YARN-7451: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7451) Resources Types should be visible in the Cluster Apps API "resourceRequests" section

2018-01-15 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326411#comment-16326411 ] genericqa commented on YARN-7451: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7624) RM gives YARNFeatureNotEnabledException even when resource profile feature is not enabled

2018-01-15 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326342#comment-16326342 ] genericqa commented on YARN-7624: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-7451) Resources Types should be visible in the Cluster Apps API "resourceRequests" section

2018-01-15 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326301#comment-16326301 ] Szilard Nemeth edited comment on YARN-7451 at 1/15/18 2:56 PM: --- Thanks

[jira] [Updated] (YARN-7451) Resources Types should be visible in the Cluster Apps API "resourceRequests" section

2018-01-15 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-7451: - Attachment: YARN-7451.009.patch > Resources Types should be visible in the Cluster Apps API

[jira] [Commented] (YARN-7451) Resources Types should be visible in the Cluster Apps API "resourceRequests" section

2018-01-15 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326301#comment-16326301 ] Szilard Nemeth commented on YARN-7451: -- Thanks [~grepas] for your comments. Please see my updated

[jira] [Updated] (YARN-7451) Resources Types should be visible in the Cluster Apps API "resourceRequests" section

2018-01-15 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-7451: - Attachment: YARN-7451.008.patch > Resources Types should be visible in the Cluster Apps API

[jira] [Commented] (YARN-5590) Add support for increase and decrease of container resources with resource profiles

2018-01-15 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326273#comment-16326273 ] Manikandan R commented on YARN-5590: [~vvasudev] I am interested in working on this. Can you please add

[jira] [Commented] (YARN-7624) RM gives YARNFeatureNotEnabledException even when resource profile feature is not enabled

2018-01-15 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326271#comment-16326271 ] Manikandan R commented on YARN-7624: [~sunilg] Attached patch. > RM gives

[jira] [Assigned] (YARN-7624) RM gives YARNFeatureNotEnabledException even when resource profile feature is not enabled

2018-01-15 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R reassigned YARN-7624: -- Assignee: Manikandan R (was: Sunil G) > RM gives YARNFeatureNotEnabledException even when

[jira] [Updated] (YARN-7624) RM gives YARNFeatureNotEnabledException even when resource profile feature is not enabled

2018-01-15 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-7624: --- Attachment: YARN-7624.001.patch > RM gives YARNFeatureNotEnabledException even when resource profile

[jira] [Commented] (YARN-7031) Support distributed node attributes

2018-01-15 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326212#comment-16326212 ] Weiwei Yang commented on YARN-7031: --- Hi [~bibinchundatt] Are you working on this JIRA? I am working on a

[jira] [Updated] (YARN-5742) Serve aggregated logs of historical apps from timeline service

2018-01-15 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-5742: Target Version/s: 3.1.0, 3.0.1 > Serve aggregated logs of historical apps from timeline

[jira] [Commented] (YARN-5742) Serve aggregated logs of historical apps from timeline service

2018-01-15 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326162#comment-16326162 ] Rohith Sharma K S commented on YARN-5742: - Marked this JIRA as Blocker since enabling ATSv2 breaks

[jira] [Updated] (YARN-5742) Serve aggregated logs of historical apps from timeline service

2018-01-15 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-5742: Priority: Blocker (was: Major) > Serve aggregated logs of historical apps from timeline

[jira] [Commented] (YARN-7451) Resources Types should be visible in the Cluster Apps API "resourceRequests" section

2018-01-15 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326088#comment-16326088 ] Gergo Repas commented on YARN-7451: --- Thanks [~snemeth] for the updated patch. The lack of extensibility

[jira] [Created] (YARN-7751) Decommissioned NM leaves orphaned containers

2018-01-15 Thread Tao Yang (JIRA)
Tao Yang created YARN-7751: -- Summary: Decommissioned NM leaves orphaned containers Key: YARN-7751 URL: https://issues.apache.org/jira/browse/YARN-7751 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-7479) TestContainerManagerSecurity.testContainerManager[Simple] flaky in trunk

2018-01-15 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16325987#comment-16325987 ] Akira Ajisaka commented on YARN-7479: - Umm, YARN-7479.001 patch is actually used in precommit job :( >

[jira] [Commented] (YARN-7479) TestContainerManagerSecurity.testContainerManager[Simple] flaky in trunk

2018-01-15 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16325983#comment-16325983 ] genericqa commented on YARN-7479: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||