[jira] [Commented] (YARN-4673) race condition in ResourceTrackerService#nodeHeartBeat while processing deduplicated msg

2016-02-24 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166867#comment-15166867 ] Tsuyoshi Ozawa commented on YARN-4673: -- Hi [~sandflee] thank you for the contribution. Could you

[jira] [Updated] (YARN-4731) Linux container executor fails to delete nmlocal folders

2016-02-24 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4731: --- Description: Enable LCE and CGroups Submit a mapreduce job {noformat} 2016-02-24 18:56:46,889

[jira] [Commented] (YARN-4673) race condition in ResourceTrackerService#nodeHeartBeat while processing deduplicated msg

2016-02-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166842#comment-15166842 ] Hadoop QA commented on YARN-4673: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (YARN-4730) YARN preemption based on instantaneous fair share

2016-02-24 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph resolved YARN-4730. - Resolution: Duplicate YARN-2026 > YARN preemption based on instantaneous fair share >

[jira] [Commented] (YARN-4720) Skip unnecessary NN operations in log aggregation

2016-02-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166819#comment-15166819 ] Hadoop QA commented on YARN-4720: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4735) Remove stale LogAggregationReport from NM's context

2016-02-24 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166778#comment-15166778 ] Karthik Kambatla commented on YARN-4735: We have seen this issue as well. > Remove stale

[jira] [Updated] (YARN-4731) Linux container executor fails on DeleteAsUser

2016-02-24 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4731: --- Priority: Critical (was: Major) > Linux container executor fails on DeleteAsUser >

[jira] [Commented] (YARN-4720) Skip unnecessary NN operations in log aggregation

2016-02-24 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166741#comment-15166741 ] Jun Gong commented on YARN-4720: Thanks for the suggestion. Attach a new patch to address it. {quote} ah,

[jira] [Created] (YARN-4735) Remove stale LogAggregationReport from NM's context

2016-02-24 Thread Jun Gong (JIRA)
Jun Gong created YARN-4735: -- Summary: Remove stale LogAggregationReport from NM's context Key: YARN-4735 URL: https://issues.apache.org/jira/browse/YARN-4735 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-4712) CPU Usage Metric is not captured properly in YARN-2928

2016-02-24 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166740#comment-15166740 ] Naganarasimha G R commented on YARN-4712: - One way to avoid ( in particular to CPU usage) is

[jira] [Updated] (YARN-4720) Skip unnecessary NN operations in log aggregation

2016-02-24 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Gong updated YARN-4720: --- Attachment: YARN-4720.04.patch > Skip unnecessary NN operations in log aggregation >

[jira] [Commented] (YARN-4720) Skip unnecessary NN operations in log aggregation

2016-02-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166710#comment-15166710 ] Hadoop QA commented on YARN-4720: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4720) Skip unnecessary NN operations in log aggregation

2016-02-24 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166691#comment-15166691 ] Ming Ma commented on YARN-4720: --- ah, that is a good point. So for long running service, the

[jira] [Commented] (YARN-4712) CPU Usage Metric is not captured properly in YARN-2928

2016-02-24 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166682#comment-15166682 ] Naganarasimha G R commented on YARN-4712: - Thanks [~sunilg], Yes the first scenario is same as that

[jira] [Updated] (YARN-4673) race condition in ResourceTrackerService#nodeHeartBeat while processing deduplicated msg

2016-02-24 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sandflee updated YARN-4673: --- Attachment: YARN-4673.01.patch > race condition in ResourceTrackerService#nodeHeartBeat while processing >

[jira] [Commented] (YARN-4731) Linux container executor fails on DeleteAsUser

2016-02-24 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1516#comment-1516 ] Bibin A Chundatt commented on YARN-4731: *Command array logs*

[jira] [Commented] (YARN-4729) SchedulerApplicationAttempt#getTotalRequiredResources can throw an NPE

2016-02-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166648#comment-15166648 ] Hudson commented on YARN-4729: -- FAILURE: Integrated in Hadoop-trunk-Commit #9366 (See

[jira] [Commented] (YARN-4720) Skip unnecessary NN operations in log aggregation

2016-02-24 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166644#comment-15166644 ] Jun Gong commented on YARN-4720: Thanks for explaining. Attach a new patch to fix it. {quote} Yes, NM can

[jira] [Updated] (YARN-4720) Skip unnecessary NN operations in log aggregation

2016-02-24 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Gong updated YARN-4720: --- Attachment: YARN-4720.03.patch > Skip unnecessary NN operations in log aggregation >

[jira] [Commented] (YARN-1040) De-link container life cycle from the process and add ability to execute multiple processes in the same long-lived container

2016-02-24 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166633#comment-15166633 ] Bikas Saha commented on YARN-1040: -- I am sorry if I caused a digression by mentioning Slider etc. I am

[jira] [Commented] (YARN-556) [Umbrella] RM Restart phase 2 - Work preserving restart

2016-02-24 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166612#comment-15166612 ] Rohith Sharma K S commented on YARN-556: You probably hitting any one of the following issues

[jira] [Commented] (YARN-4624) NPE in PartitionQueueCapacitiesInfo while accessing Schduler UI

2016-02-24 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166593#comment-15166593 ] Rohith Sharma K S commented on YARN-4624: - thanks [~brahmareddy] for providing patch. one nit: why

[jira] [Commented] (YARN-4720) Skip unnecessary NN operations in log aggregation

2016-02-24 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166575#comment-15166575 ] Ming Ma commented on YARN-4720: --- It seems that {{LogAggregationStatus.RUNNING}} implies the log aggregation

[jira] [Commented] (YARN-3998) Add retry-times to let NM re-launch container when it fails to run

2016-02-24 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166567#comment-15166567 ] Jun Gong commented on YARN-3998: Thanks [~vinodkv] for explaining it. {quote} My point was mainly about

[jira] [Updated] (YARN-4731) Linux container executor fails on DeleteAsUser

2016-02-24 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4731: --- Description: Enable LCE and CGroups Submit a mapreduce job {noformat} 2016-02-24 18:56:46,889

[jira] [Commented] (YARN-4720) Skip unnecessary NN operations in log aggregation

2016-02-24 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166538#comment-15166538 ] Jun Gong commented on YARN-4720: Thanks [~mingma] for review and comments. {quote} When

[jira] [Updated] (YARN-4731) Linux container executor fails on DeleteAsUser

2016-02-24 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4731: --- Summary: Linux container executor fails on DeleteAsUser (was: Linux container executor

[jira] [Commented] (YARN-4729) SchedulerApplicationAttempt#getTotalRequiredResources can throw an NPE

2016-02-24 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166526#comment-15166526 ] Brahma Reddy Battula commented on YARN-4729: [~kasha] thanks for reporting and working on

[jira] [Commented] (YARN-4359) Update LowCost agents logic to take advantage of YARN-4358

2016-02-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166498#comment-15166498 ] Hadoop QA commented on YARN-4359: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3863) Support complex filters in TimelineReader

2016-02-24 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166487#comment-15166487 ] Sangjin Lee commented on YARN-3863: --- I completed one full pass over the patch (it's large!), and I

[jira] [Commented] (YARN-4734) Merge branch:YARN-3368 to trunk

2016-02-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166482#comment-15166482 ] Hadoop QA commented on YARN-4734: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4734) Merge branch:YARN-3368 to trunk

2016-02-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4734: - Summary: Merge branch:YARN-3368 to trunk (was: Merge YARN-3368 commit to trunk) > Merge branch:YARN-3368

[jira] [Commented] (YARN-4723) NodesListManager$UnknownNodeId ClassCastException

2016-02-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166469#comment-15166469 ] Hadoop QA commented on YARN-4723: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-1040) De-link container life cycle from the process and add ability to execute multiple processes in the same long-lived container

2016-02-24 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166462#comment-15166462 ] Arun Suresh commented on YARN-1040: --- So that we are on the same page, If we were to separate what needs

[jira] [Commented] (YARN-3863) Support complex filters in TimelineReader

2016-02-24 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166456#comment-15166456 ] Sangjin Lee commented on YARN-3863: --- {quote} Yes, code is similar. We are looping over a filter list and

[jira] [Updated] (YARN-4734) Merge YARN-3368 commit to trunk

2016-02-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4734: - Attachment: YARN-4734.1.patch Attached patch for merge. > Merge YARN-3368 commit to trunk >

[jira] [Created] (YARN-4734) Merge YARN-3368 commit to trunk

2016-02-24 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-4734: Summary: Merge YARN-3368 commit to trunk Key: YARN-4734 URL: https://issues.apache.org/jira/browse/YARN-4734 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-4734) Merge YARN-3368 commit to trunk

2016-02-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4734: - Description: YARN-2928 branch is planned to merge back to trunk shortly, it depends on changes of

[jira] [Resolved] (YARN-4733) [YARN-3368] Commit initial web UI patch to branch: YARN-3368

2016-02-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-4733. -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: YARN-3368 This JIRA is created to

[jira] [Commented] (YARN-4359) Update LowCost agents logic to take advantage of YARN-4358

2016-02-24 Thread Ishai Menache (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166439#comment-15166439 ] Ishai Menache commented on YARN-4359: - Will add additional tests soon. > Update LowCost agents logic

[jira] [Updated] (YARN-4359) Update LowCost agents logic to take advantage of YARN-4358

2016-02-24 Thread Ishai Menache (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ishai Menache updated YARN-4359: Attachment: YARN-4359.0.patch first version of the patch > Update LowCost agents logic to take

[jira] [Created] (YARN-4733) [YARN-3368] Commit initial web UI patch to branch: YARN-3368

2016-02-24 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-4733: Summary: [YARN-3368] Commit initial web UI patch to branch: YARN-3368 Key: YARN-4733 URL: https://issues.apache.org/jira/browse/YARN-4733 Project: Hadoop YARN

[jira] [Updated] (YARN-4733) [YARN-3368] Commit initial web UI patch to branch: YARN-3368

2016-02-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4733: - Issue Type: Sub-task (was: Task) Parent: YARN-3368 > [YARN-3368] Commit initial web UI patch to

[jira] [Commented] (YARN-4097) Create POC timeline web UI with new YARN web UI framework

2016-02-24 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166386#comment-15166386 ] Li Lu commented on YARN-4097: - BTW, I haven't fine-tune the styles of our current pages. More decorations will

[jira] [Updated] (YARN-4097) Create POC timeline web UI with new YARN web UI framework

2016-02-24 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4097: Attachment: Screen Shot 2016-02-24 at 15.58.26.png Screen Shot 2016-02-24 at 15.58.08.png

[jira] [Commented] (YARN-4697) NM aggregation thread pool is not bound by limits

2016-02-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166325#comment-15166325 ] Hudson commented on YARN-4697: -- FAILURE: Integrated in Hadoop-trunk-Commit #9364 (See

[jira] [Commented] (YARN-1040) De-link container life cycle from the process and add ability to execute multiple processes in the same long-lived container

2016-02-24 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15165668#comment-15165668 ] Bikas Saha commented on YARN-1040: -- Agree with your scenarios. I am trying to figure a way by which this

[jira] [Commented] (YARN-4680) TimerTasks leak in ATS V1.5 Writer

2016-02-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15165655#comment-15165655 ] Hudson commented on YARN-4680: -- FAILURE: Integrated in Hadoop-trunk-Commit #9363 (See

[jira] [Commented] (YARN-4701) When task logs are not available, port 8041 is referenced instead of port 8042

2016-02-24 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15165651#comment-15165651 ] Robert Kanter commented on YARN-4701: - LGTM +1 pending Jenkins > When task logs are not available,

[jira] [Commented] (YARN-4720) Skip unnecessary NN operations in log aggregation

2016-02-24 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15163918#comment-15163918 ] Ming Ma commented on YARN-4720: --- Thanks [~hex108] for the update. The patch looks good overall. It does

[jira] [Commented] (YARN-4729) SchedulerApplicationAttempt#getTotalRequiredResources can throw an NPE

2016-02-24 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15163879#comment-15163879 ] Robert Kanter commented on YARN-4729: - +1 LGTM > SchedulerApplicationAttempt#getTotalRequiredResources

[jira] [Commented] (YARN-4730) YARN preemption based on instantaneous fair share

2016-02-24 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15163873#comment-15163873 ] Karthik Kambatla commented on YARN-4730: IIRR, FairScheduler preemption is based on instantaneous

[jira] [Updated] (YARN-4730) YARN preemption based on instantaneous fair share

2016-02-24 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4730: --- Component/s: fairscheduler > YARN preemption based on instantaneous fair share >

[jira] [Commented] (YARN-1040) De-link container life cycle from the process and add ability to execute multiple processes in the same long-lived container

2016-02-24 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15163864#comment-15163864 ] Arun Suresh commented on YARN-1040: --- Thanks for the feedback [~bikassaha] I understand we might not want

[jira] [Commented] (YARN-4729) SchedulerApplicationAttempt#getTotalRequiredResources can throw an NPE

2016-02-24 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15163860#comment-15163860 ] Karthik Kambatla commented on YARN-4729: Test failures are not related. >

[jira] [Updated] (YARN-4723) NodesListManager$UnknownNodeId ClassCastException

2016-02-24 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-4723: -- Attachment: YARN-4723.001.patch Attaching preliminary patch based on approach#2 by [~jlowe]. Also added

[jira] [Commented] (YARN-4723) NodesListManager$UnknownNodeId ClassCastException

2016-02-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15163729#comment-15163729 ] Jason Lowe commented on YARN-4723: -- I haven't looked at it in detail, but can we simply avoid doing any

[jira] [Commented] (YARN-1040) De-link container life cycle from the process and add ability to execute multiple processes in the same long-lived container

2016-02-24 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15163708#comment-15163708 ] Bikas Saha commented on YARN-1040: -- I am not sure we need to place (somewhat artificial) constraints on

[jira] [Created] (YARN-4732) *ProcessTree classes have too many whitespace issues

2016-02-24 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-4732: -- Summary: *ProcessTree classes have too many whitespace issues Key: YARN-4732 URL: https://issues.apache.org/jira/browse/YARN-4732 Project: Hadoop YARN

[jira] [Updated] (YARN-4732) *ProcessTree classes have too many whitespace issues

2016-02-24 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-4732: - Assignee: Haibo Chen > *ProcessTree classes have too many whitespace issues >

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2016-02-24 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15163573#comment-15163573 ] Karthik Kambatla commented on YARN-3304: [~djp] - did we ever file follow up JIRAs to delete these

[jira] [Commented] (YARN-1040) De-link container life cycle from the process and add ability to execute multiple processes in the same long-lived container

2016-02-24 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15163564#comment-15163564 ] Arun Suresh commented on YARN-1040: --- Spent some time going thru the conversation (this one as well as

[jira] [Updated] (YARN-4699) Scheduler UI and REST o/p is not in sync when -replaceLabelsOnNode is used to change label of a node

2016-02-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4699: -- Attachment: 0001-YARN-4699.patch As I see it, if we can update usedCapacity of the label while changing label on

[jira] [Commented] (YARN-4718) Rename variables in SchedulerNode to reduce ambiguity post YARN-1011

2016-02-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15163441#comment-15163441 ] Hadoop QA commented on YARN-4718: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4722) AsyncDispatcher logs redundant event queue sizes

2016-02-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15163406#comment-15163406 ] Jason Lowe commented on YARN-4722: -- Thanks, Sangjin! > AsyncDispatcher logs redundant event queue sizes

[jira] [Commented] (YARN-4722) AsyncDispatcher logs redundant event queue sizes

2016-02-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15163389#comment-15163389 ] Hudson commented on YARN-4722: -- FAILURE: Integrated in Hadoop-trunk-Commit #9360 (See

[jira] [Created] (YARN-4731) Linux container executor exception on DeleteAsUser

2016-02-24 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-4731: -- Summary: Linux container executor exception on DeleteAsUser Key: YARN-4731 URL: https://issues.apache.org/jira/browse/YARN-4731 Project: Hadoop YARN

[jira] [Commented] (YARN-4720) Skip unnecessary NN operations in log aggregation

2016-02-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15163327#comment-15163327 ] Hadoop QA commented on YARN-4720: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4696) EntityGroupFSTimelineStore to work in the absence of an RM

2016-02-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15163307#comment-15163307 ] Hadoop QA commented on YARN-4696: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4723) NodesListManager$UnknownNodeId ClassCastException

2016-02-24 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15163294#comment-15163294 ] Kuhu Shukla commented on YARN-4723: --- The primary reason for this failure is the {{UnknownNodeId}} object.

[jira] [Commented] (YARN-4720) Skip unnecessary NN operations in log aggregation

2016-02-24 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15163282#comment-15163282 ] Jun Gong commented on YARN-4720: Thanks [~mingma] for the review. Attach a new patch to address above

[jira] [Updated] (YARN-4720) Skip unnecessary NN operations in log aggregation

2016-02-24 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Gong updated YARN-4720: --- Attachment: YARN-4720.02.patch > Skip unnecessary NN operations in log aggregation >

[jira] [Commented] (YARN-4696) EntityGroupFSTimelineStore to work in the absence of an RM

2016-02-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15163273#comment-15163273 ] Hadoop QA commented on YARN-4696: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4705) ATS 1.5 parse pipeline to consider handling open() events recoverably

2016-02-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15163232#comment-15163232 ] Steve Loughran commented on YARN-4705: -- All we need to know is "does flush() write data back so that

[jira] [Commented] (YARN-4705) ATS 1.5 parse pipeline to consider handling open() events recoverably

2016-02-24 Thread jay vyas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15163222#comment-15163222 ] jay vyas commented on YARN-4705: Ah the GlusterFS consistency model ? From my experience its not strongly

[jira] [Commented] (YARN-556) [Umbrella] RM Restart phase 2 - Work preserving restart

2016-02-24 Thread Johannes Zillmann (JIRA)
[ https://issues.apache.org/jira/browse/YARN-556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15163215#comment-15163215 ] Johannes Zillmann commented on YARN-556: Mmh, have a test-cluster where the resource-manager fails

[jira] [Commented] (YARN-4705) ATS 1.5 parse pipeline to consider handling open() events recoverably

2016-02-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15163205#comment-15163205 ] Steve Loughran commented on YARN-4705: -- YARN-4696 contains my current logic to handle failures to

[jira] [Commented] (YARN-4680) TimerTasks leak in ATS V1.5 Writer

2016-02-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15163192#comment-15163192 ] Junping Du commented on YARN-4680: -- +1 on latest patch. [~gtCarrera9], please go ahead to commit this

[jira] [Updated] (YARN-4680) TimerTasks leak in ATS V1.5 Writer

2016-02-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4680: - Target Version/s: 2.8.0 > TimerTasks leak in ATS V1.5 Writer > -- > >

[jira] [Updated] (YARN-4696) EntityGroupFSTimelineStore to work in the absence of an RM

2016-02-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-4696: - Attachment: YARN-4696-008.patch Patch -008. This removes a subclass of RawLocalFileSystem that I'd

[jira] [Updated] (YARN-4696) EntityGroupFSTimelineStore to work in the absence of an RM

2016-02-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-4696: - Attachment: YARN-4696-007.patch Patch 007 files that are stat-ed as empty are not skipped, but no

[jira] [Commented] (YARN-4630) Remove useless boxing/unboxing code (Hadoop YARN)

2016-02-24 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15163144#comment-15163144 ] Akira AJISAKA commented on YARN-4630: - Found unnecessarily call of {{ApplicationAttemptId#compareTo}}.

[jira] [Commented] (YARN-4630) Remove useless boxing/unboxing code (Hadoop YARN)

2016-02-24 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15163125#comment-15163125 ] Akira AJISAKA commented on YARN-4630: - bq. can I check this since it seems to include the changes

[jira] [Commented] (YARN-4630) Remove useless boxing/unboxing code (Hadoop YARN)

2016-02-24 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15163046#comment-15163046 ] Tsuyoshi Ozawa commented on YARN-4630: -- Hey Akira, can I check this since it seems to include the

[jira] [Comment Edited] (YARN-4630) Remove useless boxing/unboxing code (Hadoop YARN)

2016-02-24 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15163046#comment-15163046 ] Tsuyoshi Ozawa edited comment on YARN-4630 at 2/24/16 2:15 PM: --- Hey Akira,

[jira] [Commented] (YARN-4333) Fair scheduler should support preemption within queue

2016-02-24 Thread Ashwin Shankar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15162904#comment-15162904 ] Ashwin Shankar commented on YARN-4333: -- I'm out of town until end of this week. Will take a look when

[jira] [Commented] (YARN-4630) Remove useless boxing/unboxing code (Hadoop YARN)

2016-02-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15162897#comment-15162897 ] Hadoop QA commented on YARN-4630: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-1489) [Umbrella] Work-preserving ApplicationMaster restart

2016-02-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15162794#comment-15162794 ] Junping Du commented on YARN-1489: -- bq. That and the "Old running containers don't know where the new AM

[jira] [Commented] (YARN-4729) SchedulerApplicationAttempt#getTotalRequiredResources can throw an NPE

2016-02-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15162702#comment-15162702 ] Hadoop QA commented on YARN-4729: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4634) Scheduler UI/Metrics need to consider cases like non-queue label mappings

2016-02-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15162699#comment-15162699 ] Hadoop QA commented on YARN-4634: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||