[jira] [Assigned] (YARN-7840) Update PB for prefix support of node attributes

2018-01-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned YARN-7840: - Assignee: Naganarasimha G R (was: Weiwei Yang) > Update PB for prefix support of node attributes

[jira] [Assigned] (YARN-7840) Update PB for prefix support of node attributes

2018-01-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned YARN-7840: - Assignee: Weiwei Yang > Update PB for prefix support of node attributes >

[jira] [Created] (YARN-7840) Update PB for prefix support of node attributes

2018-01-29 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-7840: - Summary: Update PB for prefix support of node attributes Key: YARN-7840 URL: https://issues.apache.org/jira/browse/YARN-7840 Project: Hadoop YARN Issue Type: Sub-t

[jira] [Commented] (YARN-7822) Constraint satisfaction checker support for composite OR and AND constraints

2018-01-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343062#comment-16343062 ] genericqa commented on YARN-7822: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7839) Check node capacity before placing in the Algorithm

2018-01-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343069#comment-16343069 ] Weiwei Yang commented on YARN-7839: --- Hi [~asuresh] When there is multiple threads runnin

[jira] [Commented] (YARN-7765) [Atsv2] GSSException: No valid credentials provided - Failed to find any Kerberos tgt thrown by Timelinev2Client & HBaseClient in NM

2018-01-29 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343080#comment-16343080 ] Rohith Sharma K S commented on YARN-7765: - thanks Jian for the review and committin

[jira] [Created] (YARN-7841) Cleanup AllocationFileLoaderService's reloadAllocations method

2018-01-29 Thread Szilard Nemeth (JIRA)
Szilard Nemeth created YARN-7841: Summary: Cleanup AllocationFileLoaderService's reloadAllocations method Key: YARN-7841 URL: https://issues.apache.org/jira/browse/YARN-7841 Project: Hadoop YARN

[jira] [Assigned] (YARN-4490) RM restart the finished app shows wrong Diagnostics status

2018-01-29 Thread Shen Yinjie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shen Yinjie reassigned YARN-4490: - Assignee: Shen Yinjie > RM restart the finished app shows wrong Diagnostics status > -

[jira] [Updated] (YARN-7822) Constraint satisfaction checker support for composite OR and AND constraints

2018-01-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7822: -- Attachment: YARN-7822-YARN-6592.004.patch > Constraint satisfaction checker support for composite OR and

[jira] [Commented] (YARN-7822) Constraint satisfaction checker support for composite OR and AND constraints

2018-01-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343108#comment-16343108 ] Weiwei Yang commented on YARN-7822: --- Thanks [~asuresh] {quote}Maybe instead of stating in

[jira] [Commented] (YARN-7820) Fix the currentAppAttemptId error in AHS when an application is running

2018-01-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343113#comment-16343113 ] genericqa commented on YARN-7820: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4490) RM restart the finished app shows wrong Diagnostics status

2018-01-29 Thread Shen Yinjie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343128#comment-16343128 ] Shen Yinjie commented on YARN-4490: --- Hi,[~mohdshahidkhan],we applied YARN-5437 and found

[jira] [Updated] (YARN-4490) RM restart the finished app shows wrong Diagnostics status

2018-01-29 Thread Shen Yinjie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shen Yinjie updated YARN-4490: -- Attachment: YARN-4490_1.patch > RM restart the finished app shows wrong Diagnostics status >

[jira] [Commented] (YARN-7839) Check node capacity before placing in the Algorithm

2018-01-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343133#comment-16343133 ] Arun Suresh commented on YARN-7839: --- [~cheersyang], bq. Instead, I am thinking... can we

[jira] [Commented] (YARN-7835) [Atsv2] Race condition in NM while publishing events if second attempt launched on same node

2018-01-29 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343132#comment-16343132 ] Rohith Sharma K S commented on YARN-7835: - cc:/ [~vrushalic] > [Atsv2] Race condit

[jira] [Comment Edited] (YARN-7839) Check node capacity before placing in the Algorithm

2018-01-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343133#comment-16343133 ] Arun Suresh edited comment on YARN-7839 at 1/29/18 9:36 AM: [~c

[jira] [Commented] (YARN-7698) A misleading variable's name in ApplicationAttemptEventDispatcher

2018-01-29 Thread Jinjiang Ling (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343139#comment-16343139 ] Jinjiang Ling commented on YARN-7698: - This patch is just changing two variables' name,

[jira] [Commented] (YARN-7698) A misleading variable's name in ApplicationAttemptEventDispatcher

2018-01-29 Thread Jinjiang Ling (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343142#comment-16343142 ] Jinjiang Ling commented on YARN-7698: - Hi [~ajisakaa], could please you review it ? >

[jira] [Commented] (YARN-7839) Check node capacity before placing in the Algorithm

2018-01-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343154#comment-16343154 ] Weiwei Yang commented on YARN-7839: --- Hi [~asuresh] OK, I think I was talking about the A

[jira] [Created] (YARN-7842) PB changes to carry node-attributes in NM heartbeat

2018-01-29 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-7842: - Summary: PB changes to carry node-attributes in NM heartbeat Key: YARN-7842 URL: https://issues.apache.org/jira/browse/YARN-7842 Project: Hadoop YARN Issue Type: S

[jira] [Updated] (YARN-7842) PB changes to carry node-attributes in NM heartbeat

2018-01-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7842: -- Attachment: YARN-7842-YARN-3409.001.patch > PB changes to carry node-attributes in NM heartbeat > ---

[jira] [Updated] (YARN-7820) Fix the currentAppAttemptId error in AHS when an application is running

2018-01-29 Thread Jinjiang Ling (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinjiang Ling updated YARN-7820: Attachment: YARN-7820.003.patch > Fix the currentAppAttemptId error in AHS when an application is run

[jira] [Commented] (YARN-3687) We should be able to remove node-label if there's no queue can use it.

2018-01-29 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343236#comment-16343236 ] Manikandan R commented on YARN-3687: [~leftnoteasy] Is this still valid? I was able to

[jira] [Commented] (YARN-7822) Constraint satisfaction checker support for composite OR and AND constraints

2018-01-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343244#comment-16343244 ] genericqa commented on YARN-7822: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Assigned] (YARN-7835) [Atsv2] Race condition in NM while publishing events if second attempt launched on same node

2018-01-29 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S reassigned YARN-7835: --- Assignee: Rohith Sharma K S > [Atsv2] Race condition in NM while publishing events if

[jira] [Updated] (YARN-7841) Cleanup AllocationFileLoaderService's reloadAllocations method

2018-01-29 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-7841: - Attachment: YARN-7841-001.patch > Cleanup AllocationFileLoaderService's reloadAllocations method >

[jira] [Commented] (YARN-7796) Container-executor fails with segfault on certain OS configurations

2018-01-29 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343304#comment-16343304 ] Gergo Repas commented on YARN-7796: --- [~Jim_Brennan] I have the same gcc version (gcc vers

[jira] [Commented] (YARN-7820) Fix the currentAppAttemptId error in AHS when an application is running

2018-01-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343341#comment-16343341 ] genericqa commented on YARN-7820: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-7793) Lots of parsing error reported on nodemanager after activating yarn.nodemanager.container-monitor.procfs-tree.smaps-based-rss.enabled

2018-01-29 Thread Nicolas Fraison (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Fraison updated YARN-7793: -- Attachment: YARN-7793.002.patch > Lots of parsing error reported on nodemanager after activating

[jira] [Commented] (YARN-7793) Lots of parsing error reported on nodemanager after activating yarn.nodemanager.container-monitor.procfs-tree.smaps-based-rss.enabled

2018-01-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343359#comment-16343359 ] genericqa commented on YARN-7793: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-7840) Update PB for prefix support of node attributes

2018-01-29 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-7840: Attachment: YARN-7840-YARN-3409.001.patch > Update PB for prefix support of node attributes >

[jira] [Commented] (YARN-7790) Improve Capacity Scheduler Async Scheduling to better handle node failures

2018-01-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343387#comment-16343387 ] Sunil G commented on YARN-7790: --- Looks good. Committing shortly. > Improve Capacity Schedule

[jira] [Updated] (YARN-7841) Cleanup AllocationFileLoaderService's reloadAllocations method

2018-01-29 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-7841: - Attachment: YARN-7841-001.patch > Cleanup AllocationFileLoaderService's reloadAllocations method >

[jira] [Updated] (YARN-7841) Cleanup AllocationFileLoaderService's reloadAllocations method

2018-01-29 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-7841: - Attachment: (was: YARN-7841-001.patch) > Cleanup AllocationFileLoaderService's reloadAllocation

[jira] [Commented] (YARN-7840) Update PB for prefix support of node attributes

2018-01-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343437#comment-16343437 ] Weiwei Yang commented on YARN-7840: --- Hi [~Naganarasimha] Thanks for working on this. The

[jira] [Commented] (YARN-7822) Constraint satisfaction checker support for composite OR and AND constraints

2018-01-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343449#comment-16343449 ] Weiwei Yang commented on YARN-7822: --- [~asuresh], [~kkaranasos], how about v4 patch looks

[jira] [Commented] (YARN-7796) Container-executor fails with segfault on certain OS configurations

2018-01-29 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343452#comment-16343452 ] Jim Brennan commented on YARN-7796: --- [~miklos.szeg...@cloudera.com] - I believe the max s

[jira] [Commented] (YARN-7840) Update PB for prefix support of node attributes

2018-01-29 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343456#comment-16343456 ] Bibin A Chundatt commented on YARN-7840: Thank you [~Naganarasimha] for quick patch

[jira] [Comment Edited] (YARN-7840) Update PB for prefix support of node attributes

2018-01-29 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343456#comment-16343456 ] Bibin A Chundatt edited comment on YARN-7840 at 1/29/18 3:06 PM:

[jira] [Updated] (YARN-7835) [Atsv2] Race condition in NM while publishing events if second attempt launched on same node

2018-01-29 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-7835: Attachment: YARN-7835.001.patch > [Atsv2] Race condition in NM while publishing events if sec

[jira] [Comment Edited] (YARN-7840) Update PB for prefix support of node attributes

2018-01-29 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343456#comment-16343456 ] Bibin A Chundatt edited comment on YARN-7840 at 1/29/18 3:09 PM:

[jira] [Commented] (YARN-7698) A misleading variable's name in ApplicationAttemptEventDispatcher

2018-01-29 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343461#comment-16343461 ] Akira Ajisaka commented on YARN-7698: - +1, committing this. > A misleading variable's

[jira] [Comment Edited] (YARN-7840) Update PB for prefix support of node attributes

2018-01-29 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343456#comment-16343456 ] Bibin A Chundatt edited comment on YARN-7840 at 1/29/18 3:11 PM:

[jira] [Updated] (YARN-7698) A misleading variable's name in ApplicationAttemptEventDispatcher

2018-01-29 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-7698: Priority: Minor (was: Major) Issue Type: Bug (was: Improvement) > A misleading variable's nam

[jira] [Commented] (YARN-7698) A misleading variable's name in ApplicationAttemptEventDispatcher

2018-01-29 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343472#comment-16343472 ] Akira Ajisaka commented on YARN-7698: - In addition, this fixes the following error mess

[jira] [Commented] (YARN-7840) Update PB for prefix support of node attributes

2018-01-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343486#comment-16343486 ] genericqa commented on YARN-7840: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7811) Service AM should use configured default docker network

2018-01-29 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343513#comment-16343513 ] Billie Rinaldi commented on YARN-7811: -- Thanks for taking a look, [~gsaha]. Yes, a lis

[jira] [Commented] (YARN-7790) Improve Capacity Scheduler Async Scheduling to better handle node failures

2018-01-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343519#comment-16343519 ] Hudson commented on YARN-7790: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1357

[jira] [Commented] (YARN-7698) A misleading variable's name in ApplicationAttemptEventDispatcher

2018-01-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343518#comment-16343518 ] Hudson commented on YARN-7698: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1357

[jira] [Commented] (YARN-7842) PB changes to carry node-attributes in NM heartbeat

2018-01-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343528#comment-16343528 ] genericqa commented on YARN-7842: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7835) [Atsv2] Race condition in NM while publishing events if second attempt launched on same node

2018-01-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343541#comment-16343541 ] genericqa commented on YARN-7835: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2018-01-29 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343552#comment-16343552 ] Manikandan R commented on YARN-7159: [~templedf] Had a chance to look into this? > Nor

[jira] [Updated] (YARN-5148) [YARN-3368] Add page to new YARN UI to view server side configurations/logs/JVM-metrics

2018-01-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5148: -- Attachment: Screen Shot 2018-01-29 at 9.39.07 PM.png Screen Shot 2018-01-29 at 9.38.53 PM.png > [

[jira] [Commented] (YARN-5148) [YARN-3368] Add page to new YARN UI to view server side configurations/logs/JVM-metrics

2018-01-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343560#comment-16343560 ] Sunil G commented on YARN-5148: --- Sure. Thanks [~leftnoteasy]. Attached screen shots with 29th

[jira] [Created] (YARN-7843) Container Localizer is failing with NPE

2018-01-29 Thread Rohith Sharma K S (JIRA)
Rohith Sharma K S created YARN-7843: --- Summary: Container Localizer is failing with NPE Key: YARN-7843 URL: https://issues.apache.org/jira/browse/YARN-7843 Project: Hadoop YARN Issue Type: B

[jira] [Commented] (YARN-5028) RMStateStore should trim down app state for completed applications

2018-01-29 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343593#comment-16343593 ] Gergo Repas commented on YARN-5028: --- Hi [~templedf] - can I please pick this ticket up?

[jira] [Commented] (YARN-7841) Cleanup AllocationFileLoaderService's reloadAllocations method

2018-01-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343599#comment-16343599 ] genericqa commented on YARN-7841: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (YARN-7844) Expose metrics for scheduler operation (allocate, schedulerEvent) to JMX

2018-01-29 Thread Wei Yan (JIRA)
Wei Yan created YARN-7844: - Summary: Expose metrics for scheduler operation (allocate, schedulerEvent) to JMX Key: YARN-7844 URL: https://issues.apache.org/jira/browse/YARN-7844 Project: Hadoop YARN

[jira] [Updated] (YARN-7841) Cleanup AllocationFileLoaderService's reloadAllocations method

2018-01-29 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-7841: - Attachment: YARN-7841-002.patch > Cleanup AllocationFileLoaderService's reloadAllocations method >

[jira] [Commented] (YARN-7841) Cleanup AllocationFileLoaderService's reloadAllocations method

2018-01-29 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343702#comment-16343702 ] Szilard Nemeth commented on YARN-7841: -- fixed reasonable checkstyle issues. The unit t

[jira] [Created] (YARN-7845) H

2018-01-29 Thread Said Ali Alshwqbi (JIRA)
Said Ali Alshwqbi created YARN-7845: --- Summary: H Key: YARN-7845 URL: https://issues.apache.org/jira/browse/YARN-7845 Project: Hadoop YARN Issue Type: Improvement Components: appli

[jira] [Created] (YARN-7846) Ss

2018-01-29 Thread Said Ali Alshwqbi (JIRA)
Said Ali Alshwqbi created YARN-7846: --- Summary: Ss Key: YARN-7846 URL: https://issues.apache.org/jira/browse/YARN-7846 Project: Hadoop YARN Issue Type: Improvement Components: appl

[jira] [Updated] (YARN-6675) Add NM support to launch opportunistic containers based on overallocation

2018-01-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6675: - Attachment: YARN-6675-YARN-1011.prelim0.patch > Add NM support to launch opportunistic containers based on

[jira] [Commented] (YARN-7655) avoid AM preemption caused by RRs for specific nodes or racks

2018-01-29 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343803#comment-16343803 ] Yufei Gu commented on YARN-7655: Yes, let's move forward with this patch. We are trying to

[jira] [Commented] (YARN-7829) Rebalance UI2 cluster overview page

2018-01-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343819#comment-16343819 ] Eric Yang commented on YARN-7829: - [~GergelyNovak] Thank you for the patch.  The dashboard

[jira] [Commented] (YARN-7845) H

2018-01-29 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343823#comment-16343823 ] Shane Kumpf commented on YARN-7845: --- I'm going to close this as invalid. If you intended

[jira] [Updated] (YARN-7845) H

2018-01-29 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-7845: -- Affects Version/s: (was: 2.7.5) Target Version/s: (was: 3.0.0-alpha2) Fix Version/s:

[jira] [Resolved] (YARN-7845) H

2018-01-29 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf resolved YARN-7845. --- Resolution: Invalid > H > - > > Key: YARN-7845 > URL: https://issues.ap

[jira] [Updated] (YARN-7846) Ss

2018-01-29 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-7846: -- Affects Version/s: (was: 2.7.5) Target Version/s: (was: 3.0.0-alpha2) Fix Version/s:

[jira] [Updated] (YARN-7846) Ss

2018-01-29 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-7846: -- Hadoop Flags: (was: Incompatible change,Reviewed) > Ss > -- > > Key: YARN-7846 >

[jira] [Commented] (YARN-7846) Ss

2018-01-29 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343825#comment-16343825 ] Shane Kumpf commented on YARN-7846: --- Another that I'm going to close this as invalid. If 

[jira] [Updated] (YARN-7846) Ss

2018-01-29 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-7846: -- Flags: (was: Patch,Important) > Ss > -- > > Key: YARN-7846 > URL: https

[jira] [Resolved] (YARN-7846) Ss

2018-01-29 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf resolved YARN-7846. --- Resolution: Invalid > Ss > -- > > Key: YARN-7846 > URL: https://issues.

[jira] [Commented] (YARN-7839) Check node capacity before placing in the Algorithm

2018-01-29 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343850#comment-16343850 ] Konstantinos Karanasos commented on YARN-7839: -- I think the change makes sense

[jira] [Commented] (YARN-7835) [Atsv2] Race condition in NM while publishing events if second attempt launched on same node

2018-01-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343871#comment-16343871 ] Haibo Chen commented on YARN-7835: -- [~rohithsharma] Trying to understand the issue here. I

[jira] [Commented] (YARN-7598) Document how to use classpath isolation for aux-services in YARN

2018-01-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343874#comment-16343874 ] Junping Du commented on YARN-7598: -- Thanks [~vinodkv] for comments. I agree that's a reaso

[jira] [Commented] (YARN-7841) Cleanup AllocationFileLoaderService's reloadAllocations method

2018-01-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343887#comment-16343887 ] genericqa commented on YARN-7841: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7822) Constraint satisfaction checker support for composite OR and AND constraints

2018-01-29 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343897#comment-16343897 ] Konstantinos Karanasos commented on YARN-7822: -- Patch looks good, thanks [~che

[jira] [Commented] (YARN-7780) Documentation for Placement Constraints

2018-01-29 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343904#comment-16343904 ] Konstantinos Karanasos commented on YARN-7780: -- Thanks for the comments, [~sun

[jira] [Commented] (YARN-2175) Container localization has no timeouts and tasks can be stuck there for a long time

2018-01-29 Thread Tao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343997#comment-16343997 ] Tao Zhang commented on YARN-2175: - We're facing this issue too. Localization in part of con

[jira] [Commented] (YARN-7815) Mount the filecache as read-only in Docker containers

2018-01-29 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16344007#comment-16344007 ] Jason Lowe commented on YARN-7815: -- bq. Would it make sense to detach the appcache and mou

[jira] [Commented] (YARN-7811) Service AM should use configured default docker network

2018-01-29 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16344011#comment-16344011 ] Gour Saha commented on YARN-7811: - /cc [~shaneku...@gmail.com] . I remember a discussion wh

[jira] [Commented] (YARN-7811) Service AM should use configured default docker network

2018-01-29 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16344022#comment-16344022 ] Shane Kumpf commented on YARN-7811: --- There has been discussion, but no work has started t

[jira] [Commented] (YARN-7815) Mount the filecache as read-only in Docker containers

2018-01-29 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16344052#comment-16344052 ] Miklos Szegedi commented on YARN-7815: -- Thank you [~jlowe] for the response. I agree w

[jira] [Commented] (YARN-7815) Mount the filecache as read-only in Docker containers

2018-01-29 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16344067#comment-16344067 ] Jason Lowe commented on YARN-7815: -- This would break a framework where containers on the s

[jira] [Commented] (YARN-7815) Mount the filecache as read-only in Docker containers

2018-01-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16344071#comment-16344071 ] Eric Yang commented on YARN-7815: - [~miklos.szeg...@cloudera.com] It will be hard to enforc

[jira] [Commented] (YARN-7815) Mount the filecache as read-only in Docker containers

2018-01-29 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16344082#comment-16344082 ] Miklos Szegedi commented on YARN-7815: -- Thank you, for the replies [~jlowe] and [~eyan

[jira] [Created] (YARN-7847) Provide permalinks for container logs

2018-01-29 Thread Gera Shegalov (JIRA)
Gera Shegalov created YARN-7847: --- Summary: Provide permalinks for container logs Key: YARN-7847 URL: https://issues.apache.org/jira/browse/YARN-7847 Project: Hadoop YARN Issue Type: New Feature

[jira] [Updated] (YARN-7677) HADOOP_CONF_DIR should not be automatically put in task environment

2018-01-29 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-7677: -- Attachment: YARN-7677.001.patch > HADOOP_CONF_DIR should not be automatically put in task environment > -

[jira] [Commented] (YARN-7815) Mount the filecache as read-only in Docker containers

2018-01-29 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16344123#comment-16344123 ] Jason Lowe commented on YARN-7815: -- bq. Can we break anything if we move localized user-pr

[jira] [Updated] (YARN-7598) Document how to use classpath isolation for aux-services in YARN

2018-01-29 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-7598: Attachment: YARN-7598.2.patch > Document how to use classpath isolation for aux-services in YARN > --

[jira] [Commented] (YARN-7598) Document how to use classpath isolation for aux-services in YARN

2018-01-29 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16344130#comment-16344130 ] Xuan Gong commented on YARN-7598: - [~djp] Thanks for the comment. Attached a new patch for

[jira] [Created] (YARN-7848) Force removal of docker containers that do not get removed on first try

2018-01-29 Thread Eric Badger (JIRA)
Eric Badger created YARN-7848: - Summary: Force removal of docker containers that do not get removed on first try Key: YARN-7848 URL: https://issues.apache.org/jira/browse/YARN-7848 Project: Hadoop YARN

[jira] [Commented] (YARN-7677) HADOOP_CONF_DIR should not be automatically put in task environment

2018-01-29 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16344137#comment-16344137 ] Jim Brennan commented on YARN-7677: --- Based on the discussion here and in YARN-7226, and a

[jira] [Commented] (YARN-7778) Merging of constraints defined at different levels

2018-01-29 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16344154#comment-16344154 ] Konstantinos Karanasos commented on YARN-7778: -- Hi [~cheersyang], just checked

[jira] [Created] (YARN-7849) TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization

2018-01-29 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-7849: Summary: TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization Key: YARN-7849 URL: https://issues.apache.org/jira/browse/YARN-7849 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-7723) Avoid using docker volume --format option to compatible to older docker releases

2018-01-29 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16344211#comment-16344211 ] Eric Badger commented on YARN-7723: --- Sorry for the long hiatus. Patch looks good to me. +

[jira] [Commented] (YARN-7849) TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization

2018-01-29 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16344214#comment-16344214 ] Jason Lowe commented on YARN-7849: -- Looks like this started failing after YARN-7102. I th

[jira] [Created] (YARN-7850) New UI does not show status for Log Aggregation

2018-01-29 Thread Yesha Vora (JIRA)
Yesha Vora created YARN-7850: Summary: New UI does not show status for Log Aggregation Key: YARN-7850 URL: https://issues.apache.org/jira/browse/YARN-7850 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-7556) Fair scheduler configuration should allow resource types in the minResources and maxResources properties

2018-01-29 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16344252#comment-16344252 ] Daniel Templeton commented on YARN-7556: During my break I realized that I need to

  1   2   >