[jira] [Commented] (YARN-4935) TestYarnClient#testSubmitIncorrectQueue fails with FairScheduler

2016-04-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251424#comment-15251424 ] Hudson commented on YARN-4935: -- FAILURE: Integrated in Hadoop-trunk-Commit #9642 (See [https:

[jira] [Commented] (YARN-4784) Fairscheduler: defaultQueueSchedulingPolicy should not accept FIFO

2016-04-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251425#comment-15251425 ] Hudson commented on YARN-4784: -- FAILURE: Integrated in Hadoop-trunk-Commit #9642 (See [https:

[jira] [Created] (YARN-4981) limit the max containers to assign to one application per heartbeart

2016-04-21 Thread ChenFolin (JIRA)
ChenFolin created YARN-4981: --- Summary: limit the max containers to assign to one application per heartbeart Key: YARN-4981 URL: https://issues.apache.org/jira/browse/YARN-4981 Project: Hadoop YARN

[jira] [Updated] (YARN-4981) limit the max containers to assign to one application per heartbeart

2016-04-21 Thread ChenFolin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ChenFolin updated YARN-4981: Attachment: YARN-4981.patch > limit the max containers to assign to one application per heartbeart >

[jira] [Commented] (YARN-4979) FSAppAttempt adds duplicate ResourceRequest to demand in updateDemand.

2016-04-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251605#comment-15251605 ] Hadoop QA commented on YARN-4979: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4957) Add getNewReservation in ApplicationClientProtocol

2016-04-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251606#comment-15251606 ] Hadoop QA commented on YARN-4957: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-4846) Random failures for TestCapacitySchedulerPreemption#testPreemptionPolicyShouldRespectAlreadyMarkedKillableContainers

2016-04-21 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4846: --- Attachment: 0003-YARN-4846.patch > Random failures for > TestCapacitySchedulerPreemption#testP

[jira] [Commented] (YARN-4846) Random failures for TestCapacitySchedulerPreemption#testPreemptionPolicyShouldRespectAlreadyMarkedKillableContainers

2016-04-21 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251622#comment-15251622 ] Bibin A Chundatt commented on YARN-4846: [~sunilg]/[~leftnoteasy] Alternate approac

[jira] [Created] (YARN-4982) Test timeout :TestAMRMProxy testcase timeout always

2016-04-21 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-4982: -- Summary: Test timeout :TestAMRMProxy testcase timeout always Key: YARN-4982 URL: https://issues.apache.org/jira/browse/YARN-4982 Project: Hadoop YARN Iss

[jira] [Commented] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

2016-04-21 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251820#comment-15251820 ] Eric Payne commented on YARN-3362: -- {quote} bq. If you think it would be cleaner, I can co

[jira] [Commented] (YARN-4982) Test timeout :TestAMRMProxy testcase timeout always

2016-04-21 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251840#comment-15251840 ] Bibin A Chundatt commented on YARN-4982: Looks like the root cause for the failure

[jira] [Commented] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

2016-04-21 Thread Naganarasimha Garla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251882#comment-15251882 ] Naganarasimha Garla commented on YARN-3362: --- Will have chk once, please wait till

[jira] [Commented] (YARN-4954) TestYarnClient.testReservationAPIs fails on machines with less than 4 GB available memory

2016-04-21 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251884#comment-15251884 ] Junping Du commented on YARN-4954: -- Agree. I just kick off test again to see if timeout is

[jira] [Commented] (YARN-4958) The file localization process should allow for wildcards to reduce the application footprint in the state store

2016-04-21 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251911#comment-15251911 ] Daniel Templeton commented on YARN-4958: This JIRA is in the same space as HADOOP-1

[jira] [Updated] (YARN-4958) The file localization process should allow for wildcards to reduce the application footprint in the state store

2016-04-21 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-4958: --- Description: When using the -libjars option to add classes to the classpath, every library so

[jira] [Commented] (YARN-4958) The file localization process should allow for wildcards to reduce the application footprint in the state store

2016-04-21 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251925#comment-15251925 ] Daniel Templeton commented on YARN-4958: [~jira.shegalov], I just noticed your comm

[jira] [Updated] (YARN-4958) The file localization process should allow for wildcards to reduce the application footprint in the state store

2016-04-21 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-4958: --- Description: When using the -libjars option to add classes to the classpath, every library so

[jira] [Commented] (YARN-4958) The file localization process should allow for wildcards to reduce the application footprint in the state store

2016-04-21 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251934#comment-15251934 ] Daniel Templeton commented on YARN-4958: On closer examination, HADOOP-12747 may be

[jira] [Commented] (YARN-4890) Unit test intermittent failure: TestNodeLabelContainerAllocation#testQueueUsedCapacitiesUpdate

2016-04-21 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251951#comment-15251951 ] Sunil G commented on YARN-4890: --- Thanks [~leftnoteasy] for the review and commit, and thanks

[jira] [Updated] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

2016-04-21 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-4311: -- Attachment: YARN-4311-v16.patch Fixing checkstyle and findbugs issues. Test failures are locally passing

[jira] [Updated] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

2016-04-21 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-4311: -- Attachment: YARN-4311-v16.patch > Removing nodes from include and exclude lists will not remove them from

[jira] [Updated] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

2016-04-21 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-4311: -- Attachment: (was: YARN-4311-v16.patch) > Removing nodes from include and exclude lists will not remov

[jira] [Commented] (YARN-1458) FairScheduler: Zero weight can lead to livelock

2016-04-21 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252087#comment-15252087 ] zhihai xu commented on YARN-1458: - Ok, no problem, you can try it at your convenience. than

[jira] [Commented] (YARN-4976) Missing NullPointer check in ContainerLaunchContextPBImpl causes RM to die

2016-04-21 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252091#comment-15252091 ] Giovanni Matteo Fumarola commented on YARN-4976: Uploading a new patch with

[jira] [Updated] (YARN-4976) Missing NullPointer check in ContainerLaunchContextPBImpl causes RM to die

2016-04-21 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-4976: --- Attachment: YARN-4976.v3.patch > Missing NullPointer check in ContainerLaunchCo

[jira] [Commented] (YARN-4954) TestYarnClient.testReservationAPIs fails on machines with less than 4 GB available memory

2016-04-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252115#comment-15252115 ] Hadoop QA commented on YARN-4954: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4784) Fairscheduler: defaultQueueSchedulingPolicy should not accept FIFO

2016-04-21 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252136#comment-15252136 ] Yufei Gu commented on YARN-4784: [~kasha], Thanks a lot for review and commit! > Fairsched

[jira] [Commented] (YARN-4935) TestYarnClient#testSubmitIncorrectQueue fails with FairScheduler

2016-04-21 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252141#comment-15252141 ] Yufei Gu commented on YARN-4935: Thanks for the review and commit, [~kasha]! > TestYarnCli

[jira] [Commented] (YARN-4976) Missing NullPointer check in ContainerLaunchContextPBImpl causes RM to die

2016-04-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252142#comment-15252142 ] Hadoop QA commented on YARN-4976: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-4697) NM aggregation thread pool is not bound by limits

2016-04-21 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252164#comment-15252164 ] Junping Du commented on YARN-4697: -- bq. My concern is that if don't fix the root-cause, th

[jira] [Commented] (YARN-3816) [Aggregation] App-level aggregation and accumulation for YARN system metrics

2016-04-21 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252202#comment-15252202 ] Sangjin Lee commented on YARN-3816: --- This is somewhat unrelated to the TestHBaseTimelineS

[jira] [Commented] (YARN-3816) [Aggregation] App-level aggregation and accumulation for YARN system metrics

2016-04-21 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252263#comment-15252263 ] Li Lu commented on YARN-3816: - Thanks [~sjlee0]! Took a look at it. The test failure happened w

[jira] [Commented] (YARN-4957) Add getNewReservation in ApplicationClientProtocol

2016-04-21 Thread Sean Po (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252303#comment-15252303 ] Sean Po commented on YARN-4957: --- In YARN-4957.v4.patch I fixed the checkstyle and Javadoc iss

[jira] [Commented] (YARN-4957) Add getNewReservation in ApplicationClientProtocol

2016-04-21 Thread Sean Po (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252304#comment-15252304 ] Sean Po commented on YARN-4957: --- All other test failures are accounted for above. > Add getN

[jira] [Updated] (YARN-4846) Random failures for TestCapacitySchedulerPreemption#testPreemptionPolicyShouldRespectAlreadyMarkedKillableContainers

2016-04-21 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4846: --- Attachment: (was: 0003-YARN-4846.patch) > Random failures for > TestCapacitySchedulerPreem

[jira] [Updated] (YARN-4846) Random failures for TestCapacitySchedulerPreemption#testPreemptionPolicyShouldRespectAlreadyMarkedKillableContainers

2016-04-21 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4846: --- Attachment: 0003-YARN-4846.patch > Random failures for > TestCapacitySchedulerPreemption#testP

[jira] [Commented] (YARN-4976) Missing NullPointer check in ContainerLaunchContextPBImpl causes RM to die

2016-04-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252354#comment-15252354 ] Hudson commented on YARN-4976: -- FAILURE: Integrated in Hadoop-trunk-Commit #9645 (See [https:

[jira] [Commented] (YARN-4150) Failure in TestNMClient because nodereports were not available

2016-04-21 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252380#comment-15252380 ] Ray Chiang commented on YARN-4150: -- I can't replicate the issue. Is this still a problem?

[jira] [Commented] (YARN-4976) Missing NullPointer check in ContainerLaunchContextPBImpl causes RM to die

2016-04-21 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252394#comment-15252394 ] Giovanni Matteo Fumarola commented on YARN-4976: Thanks [~chris.douglas] an

[jira] [Created] (YARN-4983) JVM and UGI metrics disappear after RM is once transitioned to standby mode

2016-04-21 Thread Li Lu (JIRA)
Li Lu created YARN-4983: --- Summary: JVM and UGI metrics disappear after RM is once transitioned to standby mode Key: YARN-4983 URL: https://issues.apache.org/jira/browse/YARN-4983 Project: Hadoop YARN

[jira] [Commented] (YARN-3816) [Aggregation] App-level aggregation and accumulation for YARN system metrics

2016-04-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252458#comment-15252458 ] Hadoop QA commented on YARN-3816: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

2016-04-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252464#comment-15252464 ] Hadoop QA commented on YARN-4311: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-4954) TestYarnClient.testReservationAPIs fails on machines with less than 4 GB available memory

2016-04-21 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-4954: -- Issue Type: Sub-task (was: Test) Parent: YARN-4478 > TestYarnClient.test

[jira] [Created] (YARN-4984) LogAggregationService shouldn't swallow exception in handling createAppDir() which cause thread leak.

2016-04-21 Thread Junping Du (JIRA)
Junping Du created YARN-4984: Summary: LogAggregationService shouldn't swallow exception in handling createAppDir() which cause thread leak. Key: YARN-4984 URL: https://issues.apache.org/jira/browse/YARN-4984

[jira] [Commented] (YARN-4984) LogAggregationService shouldn't swallow exception in handling createAppDir() which cause thread leak.

2016-04-21 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252490#comment-15252490 ] Junping Du commented on YARN-4984: -- The exception swallowing happens at LogAggregationServ

[jira] [Commented] (YARN-3816) [Aggregation] App-level aggregation and accumulation for YARN system metrics

2016-04-21 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252492#comment-15252492 ] Sangjin Lee commented on YARN-3816: --- We're almost there... It appears that {{entityTypes

[jira] [Assigned] (YARN-4786) Enhance hbase coprocessor aggregation operations:GLOBAL_MIN, LATEST_MIN etc and FINAL attributes

2016-04-21 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C reassigned YARN-4786: Assignee: Vrushali C > Enhance hbase coprocessor aggregation operations:GLOBAL_MIN, LATEST_MIN etc

[jira] [Created] (YARN-4985) Refactor the coprocessor code & other definition classes into independent packages

2016-04-21 Thread Vrushali C (JIRA)
Vrushali C created YARN-4985: Summary: Refactor the coprocessor code & other definition classes into independent packages Key: YARN-4985 URL: https://issues.apache.org/jira/browse/YARN-4985 Project: Hadoo

[jira] [Created] (YARN-4986) Add a check in the coprocessor for table to operated on

2016-04-21 Thread Vrushali C (JIRA)
Vrushali C created YARN-4986: Summary: Add a check in the coprocessor for table to operated on Key: YARN-4986 URL: https://issues.apache.org/jira/browse/YARN-4986 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-4697) NM aggregation thread pool is not bound by limits

2016-04-21 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252503#comment-15252503 ] Junping Du commented on YARN-4697: -- After investigating on our cluster which hit the same

[jira] [Commented] (YARN-4954) TestYarnClient.testReservationAPIs fails on machines with less than 4 GB available memory

2016-04-21 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252523#comment-15252523 ] Junping Du commented on YARN-4954: -- Hi [~vinodkv], I saw you move this one into subtask of

[jira] [Commented] (YARN-4957) Add getNewReservation in ApplicationClientProtocol

2016-04-21 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252540#comment-15252540 ] Subru Krishnan commented on YARN-4957: -- Thanks [~seanpo03] for addressing my comments.

[jira] [Commented] (YARN-4556) TestFifoScheduler.testResourceOverCommit fails

2016-04-21 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252593#comment-15252593 ] Nathan Roberts commented on YARN-4556: -- Patch seems like a reasonable test improvement

[jira] [Commented] (YARN-4968) A couple of AM retry unit tests need to wait SchedulerApplicationAttempt stopped.

2016-04-21 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252594#comment-15252594 ] Li Lu commented on YARN-4968: - No further concerns raised. I'll commit this patch shortly. >

[jira] [Commented] (YARN-4968) A couple of AM retry unit tests need to wait SchedulerApplicationAttempt stopped.

2016-04-21 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252640#comment-15252640 ] Li Lu commented on YARN-4968: - Oh BTW, thanks [~wangda] for the work! > A couple of AM retry

[jira] [Updated] (YARN-4968) A couple of AM retry unit tests need to wait SchedulerApplicationAttempt stopped.

2016-04-21 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4968: Fix Version/s: (was: 3.0.0) > A couple of AM retry unit tests need to wait SchedulerApplicationAttempt > stopped

[jira] [Commented] (YARN-4846) Random failures for TestCapacitySchedulerPreemption#testPreemptionPolicyShouldRespectAlreadyMarkedKillableContainers

2016-04-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252689#comment-15252689 ] Hadoop QA commented on YARN-4846: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-4957) Add getNewReservation in ApplicationClientProtocol

2016-04-21 Thread Sean Po (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Po updated YARN-4957: -- Attachment: YARN-4957.v5.patch Thanks [~subru] for your comments. V5 of the patch addresses each of them. > Add

[jira] [Commented] (YARN-4968) A couple of AM retry unit tests need to wait SchedulerApplicationAttempt stopped.

2016-04-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252713#comment-15252713 ] Hudson commented on YARN-4968: -- FAILURE: Integrated in Hadoop-trunk-Commit #9648 (See [https:

[jira] [Commented] (YARN-3816) [Aggregation] App-level aggregation and accumulation for YARN system metrics

2016-04-21 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252716#comment-15252716 ] Li Lu commented on YARN-3816: - Thanks [~sjlee0]. Some quick note on the design: the goal here i

[jira] [Commented] (YARN-4556) TestFifoScheduler.testResourceOverCommit fails

2016-04-21 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252732#comment-15252732 ] Eric Payne commented on YARN-4556: -- +1 > TestFifoScheduler.testResourceOverCommit fails

[jira] [Commented] (YARN-3931) default-node-label-expression doesn’t apply when an application is submitted by RM rest api

2016-04-21 Thread Raul Gutierrez Segales (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252745#comment-15252745 ] Raul Gutierrez Segales commented on YARN-3931: -- [~wangda], [~kyungwan nam] - p

[jira] [Updated] (YARN-4983) JVM and UGI metrics disappear after RM is once transitioned to standby mode

2016-04-21 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4983: Attachment: YARN-4983-trunk.000.patch This is a patch to quickly fix the problem. I'm reattaching the JvmMetrics aft

[jira] [Commented] (YARN-4981) limit the max containers to assign to one application per heartbeart

2016-04-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252787#comment-15252787 ] Karthik Kambatla commented on YARN-4981: Does limiting to one application per heart

[jira] [Commented] (YARN-4390) Consider container request size during CS preemption

2016-04-21 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252803#comment-15252803 ] Eric Payne commented on YARN-4390: -- Thanks, [~leftnoteasy], for the detailed work on this

[jira] [Updated] (YARN-4676) Automatic and Asynchronous Decommissioning Nodes Status Tracking

2016-04-21 Thread Daniel Zhi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Zhi updated YARN-4676: - Attachment: YARN-4676.013.patch Review comments update: 1. Added GracefulDecommision link in hadoop-project

[jira] [Commented] (YARN-4556) TestFifoScheduler.testResourceOverCommit fails

2016-04-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252845#comment-15252845 ] Hudson commented on YARN-4556: -- FAILURE: Integrated in Hadoop-trunk-Commit #9649 (See [https:

[jira] [Commented] (YARN-3816) [Aggregation] App-level aggregation and accumulation for YARN system metrics

2016-04-21 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252880#comment-15252880 ] Sangjin Lee commented on YARN-3816: --- Understood. I commented because I thought that entit

[jira] [Commented] (YARN-3931) default-node-label-expression doesn’t apply when an application is submitted by RM rest api

2016-04-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252916#comment-15252916 ] Hadoop QA commented on YARN-3931: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Assigned] (YARN-4844) Upgrade fields of o.a.h.y.api.records.Resource from int32 to int64

2016-04-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-4844: Assignee: Wangda Tan > Upgrade fields of o.a.h.y.api.records.Resource from int32 to int64 >

[jira] [Updated] (YARN-4844) Upgrade fields of o.a.h.y.api.records.Resource from int32 to int64

2016-04-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4844: - Priority: Blocker (was: Critical) > Upgrade fields of o.a.h.y.api.records.Resource from int32 to int64 > -

[jira] [Updated] (YARN-4844) Upgrade fields of o.a.h.y.api.records.Resource from int32 to int64

2016-04-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4844: - Target Version/s: 2.8.0 > Upgrade fields of o.a.h.y.api.records.Resource from int32 to int64 >

[jira] [Updated] (YARN-4844) Upgrade fields of o.a.h.y.api.records.Resource from int32 to int64

2016-04-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4844: - Attachment: YARN-4844.1.patch > Upgrade fields of o.a.h.y.api.records.Resource from int32 to int64 > --

[jira] [Commented] (YARN-4844) Upgrade fields of o.a.h.y.api.records.Resource from int32 to int64

2016-04-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252976#comment-15252976 ] Wangda Tan commented on YARN-4844: -- Discussed with [~vinodkv], [~jianhe], [~hitesh] about

[jira] [Commented] (YARN-1297) Miscellaneous Fair Scheduler speedups

2016-04-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252984#comment-15252984 ] Karthik Kambatla commented on YARN-1297: Looks like the test failures are because o

[jira] [Updated] (YARN-4971) RM fails to re-bind to wildcard IP after failover in multi homed clusters

2016-04-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4971: --- Target Version/s: 2.9.0 > RM fails to re-bind to wildcard IP after failover in multi homed clus

[jira] [Updated] (YARN-4971) RM fails to re-bind to wildcard IP after failover in multi homed clusters

2016-04-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4971: --- Affects Version/s: (was: 3.0.0) 2.7.2 > RM fails to re-bind to wildc

[jira] [Commented] (YARN-4844) Upgrade fields of o.a.h.y.api.records.Resource from int32 to int64

2016-04-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15253004#comment-15253004 ] Wangda Tan commented on YARN-4844: -- An additional note about why it is a 2.8 blocker: Cur

[jira] [Commented] (YARN-4844) Upgrade fields of o.a.h.y.api.records.Resource from int32 to int64

2016-04-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15253005#comment-15253005 ] Hadoop QA commented on YARN-4844: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4556) TestFifoScheduler.testResourceOverCommit fails

2016-04-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15253011#comment-15253011 ] Hadoop QA commented on YARN-4556: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4862) Handle duplicate completed containers in RMNodeImpl

2016-04-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15253020#comment-15253020 ] Jian He commented on YARN-4862: --- I think the RMNodeImpl#completedContainers could be leaked

[jira] [Commented] (YARN-4844) Upgrade fields of o.a.h.y.api.records.Resource from int32 to int64

2016-04-21 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15253028#comment-15253028 ] Hitesh Shah commented on YARN-4844: --- getMemoryLong(), etc just seems messy. I can underst

[jira] [Commented] (YARN-4962) support filling up containers on node one by one

2016-04-21 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15253030#comment-15253030 ] sandflee commented on YARN-4962: Thanks [~templedf], node labels seems couldn't solve our

[jira] [Commented] (YARN-4390) Consider container request size during CS preemption

2016-04-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15253032#comment-15253032 ] Wangda Tan commented on YARN-4390: -- [~eepayne], Thanks for review! bq. I think this JIRA

[jira] [Updated] (YARN-4390) Consider container request size during CS preemption

2016-04-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4390: - Attachment: YARN-4390.4.patch > Consider container request size during CS preemption >

[jira] [Created] (YARN-4987) EntityGroupFS timeline store needs to handle null storage gracefully

2016-04-21 Thread Li Lu (JIRA)
Li Lu created YARN-4987: --- Summary: EntityGroupFS timeline store needs to handle null storage gracefully Key: YARN-4987 URL: https://issues.apache.org/jira/browse/YARN-4987 Project: Hadoop YARN Issue T

[jira] [Updated] (YARN-4987) EntityGroupFS timeline store needs to handle null storage gracefully

2016-04-21 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4987: Issue Type: Sub-task (was: Bug) Parent: YARN-4233 > EntityGroupFS timeline store needs to handle null storag

[jira] [Commented] (YARN-1297) Miscellaneous Fair Scheduler speedups

2016-04-21 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15253042#comment-15253042 ] Yufei Gu commented on YARN-1297: I agree. Let's me upload a new patch soon and reopen the Y

[jira] [Commented] (YARN-4844) Upgrade fields of o.a.h.y.api.records.Resource from int32 to int64

2016-04-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15253048#comment-15253048 ] Wangda Tan commented on YARN-4844: -- [~hitesh], Agree it is very messy but it seems there'

[jira] [Updated] (YARN-4844) Upgrade fields of o.a.h.y.api.records.Resource from int32 to int64

2016-04-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4844: - Attachment: YARN-4844.2.patch Rebased to latest trunk. (ver. 2) > Upgrade fields of o.a.h.y.api.records.Re

[jira] [Commented] (YARN-4846) Random failures for TestCapacitySchedulerPreemption#testPreemptionPolicyShouldRespectAlreadyMarkedKillableContainers

2016-04-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15253058#comment-15253058 ] Wangda Tan commented on YARN-4846: -- Looks good to me, thanks! Will commit the patch tomorr

[jira] [Updated] (YARN-1297) Miscellaneous Fair Scheduler speedups

2016-04-21 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-1297: --- Attachment: YARN-1297.006.patch > Miscellaneous Fair Scheduler speedups > -

[jira] [Reopened] (YARN-4090) Make Collections.sort() more efficient in FSParentQueue.java

2016-04-21 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reopened YARN-4090: > Make Collections.sort() more efficient in FSParentQueue.java >

[jira] [Commented] (YARN-4844) Upgrade fields of o.a.h.y.api.records.Resource from int32 to int64

2016-04-21 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15253084#comment-15253084 ] Hitesh Shah commented on YARN-4844: --- bq. It is not a very hard thing to drop it, we'd bet

[jira] [Commented] (YARN-4766) NM should not aggregate logs older than the retention policy

2016-04-21 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15253086#comment-15253086 ] Robert Kanter commented on YARN-4766: - Looks good overall. Here's a few things: # {{Ag

[jira] [Updated] (YARN-4987) EntityGroupFS timeline store needs to handle null storage gracefully

2016-04-21 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4987: Priority: Minor (was: Major) > EntityGroupFS timeline store needs to handle null storage gracefully > --

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

2016-04-21 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15253112#comment-15253112 ] Sangjin Lee commented on YARN-4577: --- Yes I think the POC patch is pretty close to what I

[jira] [Resolved] (YARN-4919) Yarn logs should support a option to output logs as compressed archive

2016-04-21 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved YARN-4919. --- Resolution: Duplicate This as a dup of YARN-1134, closing so. > Yarn logs shou

[jira] [Updated] (YARN-4982) Test timeout :TestAMRMProxy testcase timeout always

2016-04-21 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4982: --- Issue Type: Sub-task (was: Bug) Parent: YARN-4478 > Test timeout :TestAMRMProxy testca

[jira] [Updated] (YARN-4846) Random failures for TestCapacitySchedulerPreemption#testPreemptionPolicyShouldRespectAlreadyMarkedKillableContainers

2016-04-21 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4846: --- Attachment: 0004-YARN-4846.patch Uploading patch after fixing checkstyle issue > Random failur

  1   2   >