[jira] [Commented] (YARN-10425) Replace the legacy placement engine in CS with the new one

2020-10-30 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223833#comment-17223833 ] Hadoop QA commented on YARN-10425: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-10475) Scale RM-NM heartbeat interval based on node utilization

2020-10-30 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223831#comment-17223831 ] Hadoop QA commented on YARN-10475: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10475) Scale RM-NM heartbeat interval based on node utilization

2020-10-30 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223818#comment-17223818 ] Eric Payne commented on YARN-10475: --- Thanks [~Jim_Brennan] for providing resolutions for this issue,

[jira] [Commented] (YARN-10442) RM should make sure node label file highly available

2020-10-30 Thread Hemanth Boyina (Jira)
[ https://issues.apache.org/jira/browse/YARN-10442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223811#comment-17223811 ] Hemanth Boyina commented on YARN-10442: --- thanks [~surendrasingh] for the contribution committed to

[jira] [Updated] (YARN-10458) Hive On Tez queries fails upon submission to dynamically created pools

2020-10-30 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10458: -- Fix Version/s: 3.4.0 > Hive On Tez queries fails upon submission to dynamically created pools >

[jira] [Commented] (YARN-10458) Hive On Tez queries fails upon submission to dynamically created pools

2020-10-30 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223771#comment-17223771 ] Wangda Tan commented on YARN-10458: --- I just committed the patch to trunk, thanks [~anand.srinivasan] 

[jira] [Commented] (YARN-10458) Hive On Tez queries fails upon submission to dynamically created pools

2020-10-30 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223764#comment-17223764 ] Hadoop QA commented on YARN-10458: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10458) Hive On Tez queries fails upon submission to dynamically created pools

2020-10-30 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223735#comment-17223735 ] Wangda Tan commented on YARN-10458: --- +1, thanks [~pbacsko], will get it committed later today.  > Hive

[jira] [Updated] (YARN-10475) Scale RM-NM heartbeat interval based on node utilization

2020-10-30 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10475: --- Attachment: YARN-10475-branch-3.2.003.patch > Scale RM-NM heartbeat interval based on node

[jira] [Commented] (YARN-10475) Scale RM-NM heartbeat interval based on node utilization

2020-10-30 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223733#comment-17223733 ] Jim Brennan commented on YARN-10475: [~epayne], I have put up patches for branch-3.3 and branch-3.2

[jira] [Updated] (YARN-10475) Scale RM-NM heartbeat interval based on node utilization

2020-10-30 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10475: --- Attachment: YARN-10475-branch-3.3.003.patch > Scale RM-NM heartbeat interval based on node

[jira] [Commented] (YARN-10425) Replace the legacy placement engine in CS with the new one

2020-10-30 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223708#comment-17223708 ] Peter Bacsko commented on YARN-10425: - Thanks for the explanation [~shuzirra], I'll do another round

[jira] [Commented] (YARN-10425) Replace the legacy placement engine in CS with the new one

2020-10-30 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223701#comment-17223701 ] Gergely Pollak commented on YARN-10425: --- Thank you for the review [~pbacsko], [~BilwaST] and

[jira] [Updated] (YARN-10425) Replace the legacy placement engine in CS with the new one

2020-10-30 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10425: -- Attachment: YARN-10425.005.patch > Replace the legacy placement engine in CS with the new one

[jira] [Commented] (YARN-10458) Hive On Tez queries fails upon submission to dynamically created pools

2020-10-30 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223683#comment-17223683 ] Peter Bacsko commented on YARN-10458: - [~leftnoteasy] please review patch v4, it should be good as a

[jira] [Commented] (YARN-10475) Scale RM-NM heartbeat interval based on node utilization

2020-10-30 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223668#comment-17223668 ] Jim Brennan commented on YARN-10475: Thanks for the suggestion [~bibinchundatt]! I think a plugin

[jira] [Updated] (YARN-10458) Hive On Tez queries fails upon submission to dynamically created pools

2020-10-30 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10458: Attachment: YARN-10458-004.patch > Hive On Tez queries fails upon submission to dynamically

[jira] [Commented] (YARN-10458) Hive On Tez queries fails upon submission to dynamically created pools

2020-10-30 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223657#comment-17223657 ] Hadoop QA commented on YARN-10458: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-10471) Prevent logs for any container from becoming larger than a configurable size.

2020-10-30 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223656#comment-17223656 ] Jim Brennan commented on YARN-10471: [~epayne] I agree we don't need to go to branch-3.1 nor

[jira] [Updated] (YARN-10458) Hive On Tez queries fails upon submission to dynamically created pools

2020-10-30 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10458: Attachment: YARN-10458-003.patch > Hive On Tez queries fails upon submission to dynamically

[jira] [Commented] (YARN-10458) Hive On Tez queries fails upon submission to dynamically created pools

2020-10-30 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223564#comment-17223564 ] Peter Bacsko commented on YARN-10458: - Many thanks [~wangda]. The test works with the proposed

[jira] [Updated] (YARN-10472) Backport YARN-10314 to branch-3.2

2020-10-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/YARN-10472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated YARN-10472: --- Fix Version/s: 3.2.2 cherry-pick to branch-3.2.2 and verify at local, Thanks [~smeng]. > Backport

[jira] [Updated] (YARN-10471) Prevent logs for any container from becoming larger than a configurable size.

2020-10-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/YARN-10471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated YARN-10471: --- Fix Version/s: 3.2.2 cherry-pick to branch-3.2.2 and verify at local, Thanks [~Jim_Brennan] and

[jira] [Updated] (YARN-10467) ContainerIdPBImpl objects can be leaked in RMNodeImpl.completedContainers

2020-10-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/YARN-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated YARN-10467: --- Fix Version/s: 3.2.2 cherry-pick to branch-3.2.2 and verify at local, Thanks all. >

[jira] [Commented] (YARN-10450) Add cpu and memory utilization per node and cluster-wide metrics

2020-10-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/YARN-10450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223510#comment-17223510 ] Xiaoqiao He commented on YARN-10450: commit this to branch-3.2.2. Thanks [~ebadger] and

[jira] [Updated] (YARN-10450) Add cpu and memory utilization per node and cluster-wide metrics

2020-10-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/YARN-10450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated YARN-10450: --- Fix Version/s: 3.2.2 > Add cpu and memory utilization per node and cluster-wide metrics >

[jira] [Commented] (YARN-7651) branch-2 application master (MR) cannot run in 3.1 cluster

2020-10-30 Thread chan (Jira)
[ https://issues.apache.org/jira/browse/YARN-7651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223502#comment-17223502 ] chan commented on YARN-7651: hey [~sunilg],i think your cluster has multi version jar,you can make all node

[jira] [Commented] (YARN-10440) resource manager hangs,and i cannot submit any new jobs,but rm and nm processes are normal

2020-10-30 Thread chan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223495#comment-17223495 ] chan commented on YARN-10440: - @[~Jufeng]  i had ever met this problem and i set the config,hope to help you!

[jira] [Comment Edited] (YARN-10475) Scale RM-NM heartbeat interval based on node utilization

2020-10-30 Thread Bibin Chundatt (Jira)
[ https://issues.apache.org/jira/browse/YARN-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223491#comment-17223491 ] Bibin Chundatt edited comment on YARN-10475 at 10/30/20, 8:36 AM: -- Thank

[jira] [Commented] (YARN-10475) Scale RM-NM heartbeat interval based on node utilization

2020-10-30 Thread Bibin Chundatt (Jira)
[ https://issues.apache.org/jira/browse/YARN-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223491#comment-17223491 ] Bibin Chundatt commented on YARN-10475: --- Thank you [~Jim_Brennan] working on this. Could you

[jira] [Commented] (YARN-10472) Backport YARN-10314 to branch-3.2

2020-10-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/YARN-10472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223431#comment-17223431 ] Xiaoqiao He commented on YARN-10472: Thanks [~smeng], I would like to do cherry-pick them together