[jira] [Created] (YARN-10335) Improve scheduling of containers based on node health

2020-07-01 Thread Bibin Chundatt (Jira)
Bibin Chundatt created YARN-10335: - Summary: Improve scheduling of containers based on node health Key: YARN-10335 URL: https://issues.apache.org/jira/browse/YARN-10335 Project: Hadoop YARN I

[jira] [Updated] (YARN-10335) Improve scheduling of containers based on node health

2020-07-01 Thread Bibin Chundatt (Jira)
[ https://issues.apache.org/jira/browse/YARN-10335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin Chundatt updated YARN-10335: -- Description: YARN-7494 supports providing interface to choose nodeset for scheduler allocation

[jira] [Updated] (YARN-10335) Improve scheduling of containers based on node health

2020-07-01 Thread Bibin Chundatt (Jira)
[ https://issues.apache.org/jira/browse/YARN-10335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin Chundatt updated YARN-10335: -- Description: YARN-7494 supports providing interface to choose nodeset for scheduler allocation

[jira] [Commented] (YARN-10330) Add missing test scenarios to TestUserGroupMappingPlacementRule and TestAppNameMappingPlacementRule

2020-07-01 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149188#comment-17149188 ] Szilard Nemeth commented on YARN-10330: --- Hi [~pbacsko], Can you please justify the

[jira] [Assigned] (YARN-10335) Improve scheduling of containers based on node health

2020-07-01 Thread Cyrus Jackson (Jira)
[ https://issues.apache.org/jira/browse/YARN-10335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cyrus Jackson reassigned YARN-10335: Assignee: Cyrus Jackson > Improve scheduling of containers based on node health >

[jira] [Commented] (YARN-10335) Improve scheduling of containers based on node health

2020-07-01 Thread Cyrus Jackson (Jira)
[ https://issues.apache.org/jira/browse/YARN-10335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149190#comment-17149190 ] Cyrus Jackson commented on YARN-10335: -- I would like to work on this. [~bibinchundat

[jira] [Updated] (YARN-10330) Add missing test scenarios to TestUserGroupMappingPlacementRule and TestAppNameMappingPlacementRule

2020-07-01 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10330: Attachment: YARN-10330-004.patch > Add missing test scenarios to TestUserGroupMappingPlacementRule

[jira] [Commented] (YARN-10330) Add missing test scenarios to TestUserGroupMappingPlacementRule and TestAppNameMappingPlacementRule

2020-07-01 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149230#comment-17149230 ] Peter Bacsko commented on YARN-10330: - Yes, it's YARN-10329. TestDelegationTokenRenew

[jira] [Updated] (YARN-10332) RESOURCE_UPDATE event was repeatedly registered in DECOMMISSIONING state

2020-07-01 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-10332: -- Parent: YARN-914 Issue Type: Sub-task (was: Improvement) > RESOURCE_UPDATE event was repeatedl

[jira] [Commented] (YARN-10315) Avoid sending RMNodeResoureupdate event if resource is same

2020-07-01 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149232#comment-17149232 ] Adam Antal commented on YARN-10315: --- Moved this under YARN-914. > Avoid sending RMNode

[jira] [Updated] (YARN-10315) Avoid sending RMNodeResoureupdate event if resource is same

2020-07-01 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-10315: -- Parent: YARN-914 Issue Type: Sub-task (was: Improvement) > Avoid sending RMNodeResoureupdate e

[jira] [Commented] (YARN-10332) RESOURCE_UPDATE event was repeatedly registered in DECOMMISSIONING state

2020-07-01 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149233#comment-17149233 ] Adam Antal commented on YARN-10332: --- Moved this under YARN-914. I agree with [~bibinch

[jira] [Commented] (YARN-10319) Record Last N Scheduler Activities from ActivitiesManager

2020-07-01 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149253#comment-17149253 ] Adam Antal commented on YARN-10319: --- Thanks for the patch [~prabhujoseph]. I have some

[jira] [Commented] (YARN-10334) TestDistributedShell leaks resources on timeout/failure

2020-07-01 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149259#comment-17149259 ] Adam Antal commented on YARN-10334: --- Nice finding [~ahussein]. It could potentially cau

[jira] [Commented] (YARN-10106) Yarn logs CLI filtering by application attempt

2020-07-01 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149277#comment-17149277 ] Adam Antal commented on YARN-10106: --- Thanks for the patch [~mhudaky]. For backward com

[jira] [Commented] (YARN-10319) Record Last N Scheduler Activities from ActivitiesManager

2020-07-01 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149285#comment-17149285 ] Tao Yang commented on YARN-10319: - Thanks [~adam.antal] for the review and comments, [~pr

[jira] [Resolved] (YARN-10266) Setting debug delay to a too high number will cause NM fail to start

2020-07-01 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal resolved YARN-10266. --- Assignee: Adam Antal Resolution: Won't Fix > Setting debug delay to a too high number will caus

[jira] [Commented] (YARN-10266) Setting debug delay to a too high number will cause NM fail to start

2020-07-01 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149311#comment-17149311 ] Adam Antal commented on YARN-10266: --- I agree [~BilwaST]. It makes no sense to handle th

[jira] [Commented] (YARN-10332) RESOURCE_UPDATE event was repeatedly registered in DECOMMISSIONING state

2020-07-01 Thread yehuanhuan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149336#comment-17149336 ] yehuanhuan commented on YARN-10332: --- [~bibinchundatt] In RMNodeImpl, RESOURCE_UPDATE ev

[jira] [Comment Edited] (YARN-10332) RESOURCE_UPDATE event was repeatedly registered in DECOMMISSIONING state

2020-07-01 Thread yehuanhuan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149338#comment-17149338 ] yehuanhuan edited comment on YARN-10332 at 7/1/20, 11:22 AM: -

[jira] [Issue Comment Deleted] (YARN-10332) RESOURCE_UPDATE event was repeatedly registered in DECOMMISSIONING state

2020-07-01 Thread yehuanhuan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yehuanhuan updated YARN-10332: -- Comment: was deleted (was: [~bibinchundatt] In RMNodeImpl, RESOURCE_UPDATE event was registered twice

[jira] [Comment Edited] (YARN-10332) RESOURCE_UPDATE event was repeatedly registered in DECOMMISSIONING state

2020-07-01 Thread yehuanhuan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149338#comment-17149338 ] yehuanhuan edited comment on YARN-10332 at 7/1/20, 11:22 AM: -

[jira] [Commented] (YARN-10332) RESOURCE_UPDATE event was repeatedly registered in DECOMMISSIONING state

2020-07-01 Thread yehuanhuan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149338#comment-17149338 ] yehuanhuan commented on YARN-10332: --- [~adam.antal] Thank you for your reply. This trans

[jira] [Comment Edited] (YARN-10332) RESOURCE_UPDATE event was repeatedly registered in DECOMMISSIONING state

2020-07-01 Thread yehuanhuan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149338#comment-17149338 ] yehuanhuan edited comment on YARN-10332 at 7/1/20, 11:23 AM: -

[jira] [Updated] (YARN-10333) YarnClient obtain Delegation Token for Log Aggregation Path

2020-07-01 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-10333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-10333: - Attachment: YARN-10333-002.patch > YarnClient obtain Delegation Token for Log Aggregation Path >

[jira] [Commented] (YARN-10318) ApplicationHistory Web UI incorrect column indexing

2020-07-01 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149340#comment-17149340 ] Szilard Nemeth commented on YARN-10318: --- Thanks [~gandras], Committed patch to bran

[jira] [Updated] (YARN-10318) ApplicationHistory Web UI incorrect column indexing

2020-07-01 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10318: -- Fix Version/s: (was: 3.3.0) 3.3.1 > ApplicationHistory Web UI incorrect

[jira] [Updated] (YARN-10325) Document max-parallel-apps for Capacity Scheduler

2020-07-01 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10325: -- Fix Version/s: 3.3.1 3.4.0 > Document max-parallel-apps for Capacity Schedul

[jira] [Commented] (YARN-10325) Document max-parallel-apps for Capacity Scheduler

2020-07-01 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149351#comment-17149351 ] Szilard Nemeth commented on YARN-10325: --- Thanks [~pbacsko], Patch LGTM, committed t

[jira] [Commented] (YARN-10325) Document max-parallel-apps for Capacity Scheduler

2020-07-01 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/YARN-10325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149364#comment-17149364 ] Hudson commented on YARN-10325: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #

[jira] [Commented] (YARN-10330) Add missing test scenarios to TestUserGroupMappingPlacementRule and TestAppNameMappingPlacementRule

2020-07-01 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149370#comment-17149370 ] Hadoop QA commented on YARN-10330: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (YARN-10330) Add missing test scenarios to TestUserGroupMappingPlacementRule and TestAppNameMappingPlacementRule

2020-07-01 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10330: -- Fix Version/s: 3.4.0 > Add missing test scenarios to TestUserGroupMappingPlacementRule and > T

[jira] [Commented] (YARN-10330) Add missing test scenarios to TestUserGroupMappingPlacementRule and TestAppNameMappingPlacementRule

2020-07-01 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149382#comment-17149382 ] Szilard Nemeth commented on YARN-10330: --- Thanks [~pbacsko], Latest patch LGTM, comm

[jira] [Updated] (YARN-10330) Add missing test scenarios to TestUserGroupMappingPlacementRule and TestAppNameMappingPlacementRule

2020-07-01 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10330: Attachment: YARN-10330-branch-3.3-001.patch > Add missing test scenarios to TestUserGroupMappingPla

[jira] [Commented] (YARN-10330) Add missing test scenarios to TestUserGroupMappingPlacementRule and TestAppNameMappingPlacementRule

2020-07-01 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/YARN-10330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149394#comment-17149394 ] Hudson commented on YARN-10330: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #

[jira] [Commented] (YARN-10333) YarnClient obtain Delegation Token for Log Aggregation Path

2020-07-01 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149426#comment-17149426 ] Hadoop QA commented on YARN-10333: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (YARN-10304) Create an endpoint for remote application log directory path query

2020-07-01 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Gyori updated YARN-10304: Attachment: YARN-10304.007.patch > Create an endpoint for remote application log directory path que

[jira] [Commented] (YARN-10304) Create an endpoint for remote application log directory path query

2020-07-01 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149485#comment-17149485 ] Andras Gyori commented on YARN-10304: - Thank you [~mhudaky] for the review, good catc

[jira] [Commented] (YARN-10330) Add missing test scenarios to TestUserGroupMappingPlacementRule and TestAppNameMappingPlacementRule

2020-07-01 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149497#comment-17149497 ] Hadoop QA commented on YARN-10330: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-10330) Add missing test scenarios to TestUserGroupMappingPlacementRule and TestAppNameMappingPlacementRule

2020-07-01 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149519#comment-17149519 ] Hadoop QA commented on YARN-10330: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-10330) Add missing test scenarios to TestUserGroupMappingPlacementRule and TestAppNameMappingPlacementRule

2020-07-01 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149527#comment-17149527 ] Szilard Nemeth commented on YARN-10330: --- Thanks [~pbacsko], Also committed branch-3

[jira] [Updated] (YARN-10330) Add missing test scenarios to TestUserGroupMappingPlacementRule and TestAppNameMappingPlacementRule

2020-07-01 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10330: -- Fix Version/s: 3.3.1 > Add missing test scenarios to TestUserGroupMappingPlacementRule and > T

[jira] [Commented] (YARN-10304) Create an endpoint for remote application log directory path query

2020-07-01 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149557#comment-17149557 ] Hadoop QA commented on YARN-10304: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (YARN-10333) YarnClient obtain Delegation Token for Log Aggregation Path

2020-07-01 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-10333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-10333: - Attachment: YARN-10333-003.patch > YarnClient obtain Delegation Token for Log Aggregation Path >

[jira] [Commented] (YARN-10333) YarnClient obtain Delegation Token for Log Aggregation Path

2020-07-01 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-10333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149595#comment-17149595 ] Prabhu Joseph commented on YARN-10333: -- [~sunil.gov...@gmail.com] Can you review thi

[jira] [Comment Edited] (YARN-10333) YarnClient obtain Delegation Token for Log Aggregation Path

2020-07-01 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-10333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149595#comment-17149595 ] Prabhu Joseph edited comment on YARN-10333 at 7/1/20, 5:41 PM:

[jira] [Commented] (YARN-10251) Show extended resources on legacy RM UI.

2020-07-01 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149627#comment-17149627 ] Eric Payne commented on YARN-10251: --- RE: UT failures for the branch-2.10 patch: {{TestC

[jira] [Commented] (YARN-10333) YarnClient obtain Delegation Token for Log Aggregation Path

2020-07-01 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149646#comment-17149646 ] Hadoop QA commented on YARN-10333: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-10251) Show extended resources on legacy RM UI.

2020-07-01 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149673#comment-17149673 ] Jim Brennan commented on YARN-10251: Thanks for the additional patches [~epayne]!  I

[jira] [Commented] (YARN-10251) Show extended resources on legacy RM UI.

2020-07-01 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149697#comment-17149697 ] Jonathan Hung commented on YARN-10251: -- [~epayne] thanks, generally 006 looks good t

[jira] [Commented] (YARN-10335) Improve scheduling of containers based on node health

2020-07-01 Thread Bibin Chundatt (Jira)
[ https://issues.apache.org/jira/browse/YARN-10335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149843#comment-17149843 ] Bibin Chundatt commented on YARN-10335: --- Thank you for showing interest in the JIRA

[jira] [Comment Edited] (YARN-10335) Improve scheduling of containers based on node health

2020-07-01 Thread Bibin Chundatt (Jira)
[ https://issues.apache.org/jira/browse/YARN-10335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149843#comment-17149843 ] Bibin Chundatt edited comment on YARN-10335 at 7/2/20, 4:45 AM: ---