[jira] [Commented] (YARN-4277) containers would be leaked if nm crashed and rm failover

2015-11-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985294#comment-14985294 ] Jason Lowe commented on YARN-4277: -- There was some previous discussion of storing at least some state for

[jira] [Commented] (YARN-4051) ContainerKillEvent is lost when container is In New State and is recovering

2015-11-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985299#comment-14985299 ] Jason Lowe commented on YARN-4051: -- bq. For RM finish application or complete container request, let RM

[jira] [Created] (YARN-4325) purge app state from NM state-store should be independent of log aggregation

2015-11-02 Thread Junping Du (JIRA)
Junping Du created YARN-4325: Summary: purge app state from NM state-store should be independent of log aggregation Key: YARN-4325 URL: https://issues.apache.org/jira/browse/YARN-4325 Project: Hadoop

[jira] [Commented] (YARN-1510) Make NMClient support change container resources

2015-11-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985758#comment-14985758 ] Jian He commented on YARN-1510: --- +1, thanks Meng Ding ! > Make NMClient support change container resources >

[jira] [Updated] (YARN-3769) Preemption occurring unnecessarily because preemption doesn't consider user limit

2015-11-02 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-3769: - Attachment: YARN-3769.004.patch [~leftnoteasy], Thank you for your review, and sorry for the late reply.

[jira] [Commented] (YARN-4321) Incessant retries if NoAuthException is thrown by Zookeeper in non HA mode

2015-11-02 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986867#comment-14986867 ] Varun Saxena commented on YARN-4321: Thanks [~jianhe] for the review and commit > Incessant retries if

[jira] [Updated] (YARN-1480) RM web services getApps() accepts many more filters than ApplicationCLI "list" command

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1480: -- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2) > RM web services getApps() accepts many more filters than

[jira] [Updated] (YARN-3478) FairScheduler page not performed because different enum of YarnApplicationState and RMAppState

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3478: -- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2, 2.6.2) Targeting 2.6.3 now that 2.6.2 has shipped. >

[jira] [Updated] (YARN-3575) Job using 2.5 jars fails on a 2.6 cluster whose RM has been restarted

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3575: -- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2, 2.6.2) Targeting 2.6.3 now that 2.6.2 has shipped. > Job

[jira] [Updated] (YARN-4060) Revisit default retry config for connection with RM

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-4060: -- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2, 2.6.2) Targeting 2.6.3 now that 2.6.2 has shipped. >

[jira] [Updated] (YARN-1681) When "banned.users" is not set in LCE's container-executor.cfg, submit job with user in DEFAULT_BANNED_USERS will receive unclear error message

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1681: -- Target Version/s: (was: 2.7.2, 2.6.2) > When "banned.users" is not set in LCE's

[jira] [Updated] (YARN-1480) RM web services getApps() accepts many more filters than ApplicationCLI "list" command

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1480: -- Target Version/s: 2.7.2 (was: 2.7.2, 2.6.2) Targeting 2.6.3 now that 2.6.2 has shipped. > RM web

[jira] [Updated] (YARN-2038) Revisit how AMs learn of containers from previous attempts

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2038: -- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2, 2.6.2) Targeting 2.6.3 now that 2.6.2 has shipped. >

[jira] [Updated] (YARN-1856) cgroups based memory monitoring for containers

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1856: -- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2, 2.6.2) Targeting 2.6.3 now that 2.6.2 has shipped. >

[jira] [Updated] (YARN-4312) TestSubmitApplicationWithRMHA fails on branch-2.7 and branch-2.6 as some of the test cases time out

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-4312: -- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2) > TestSubmitApplicationWithRMHA fails on branch-2.7 and

[jira] [Updated] (YARN-2506) TimelineClient should NOT be in yarn-common project

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2506: -- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2, 2.6.2) Targeting 2.6.3 now that 2.6.2 has shipped. >

[jira] [Updated] (YARN-4325) purge app state from NM state-store should be independent of log aggregation

2015-11-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-4325: - Target Version/s: 2.7.2, 2.6.3 (was: 2.8.0) > purge app state from NM state-store should be independent

[jira] [Updated] (YARN-4312) TestSubmitApplicationWithRMHA fails on branch-2.7 and branch-2.6 as some of the test cases time out

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-4312: -- Target Version/s: 2.7.2 (was: 2.7.2, 2.6.2) Targeting 2.6.3 now that 2.6.2 has shipped. >

[jira] [Updated] (YARN-2746) YARNDelegationTokenID misses serializing version from the common abstract ID

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2746: -- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2, 2.6.2) Targeting 2.6.3 now that 2.6.2 has shipped. >

[jira] [Updated] (YARN-2657) MiniYARNCluster to (optionally) add MicroZookeeper service

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2657: -- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2, 2.6.2) Targeting 2.6.3 now that 2.6.2 has shipped. >

[jira] [Updated] (YARN-2457) FairScheduler: Handle preemption to help starved parent queues

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2457: -- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2, 2.6.2) Targeting 2.6.3 now that 2.6.2 has shipped. >

[jira] [Updated] (YARN-2055) Preemption: Jobs are failing due to AMs are getting launched and killed multiple times

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2055: -- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2, 2.6.2) Targeting 2.6.3 now that 2.6.2 has shipped. >

[jira] [Updated] (YARN-1848) Persist ClusterMetrics across RM HA transitions

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1848: -- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2, 2.6.2) Targeting 2.6.3 now that 2.6.2 has shipped. >

[jira] [Updated] (YARN-2037) Add restart support for Unmanaged AMs

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2037: -- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2, 2.6.2) Targeting 2.6.3 now that 2.6.2 has shipped. > Add

[jira] [Updated] (YARN-2599) Standby RM should also expose some jmx and metrics

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2599: -- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2, 2.6.2) Targeting 2.6.3 now that 2.6.2 has shipped. >

[jira] [Updated] (YARN-1767) Windows: Allow a way for users to augment classpath of YARN daemons

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1767: -- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2, 2.6.2) Targeting 2.6.3 now that 2.6.2 has shipped. >

[jira] [Updated] (YARN-2014) Performance: AM scaleability is 10% slower in 2.4 compared to 0.23.9

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2014: -- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2, 2.6.2) Targeting 2.6.3 now that 2.6.2 has shipped. >

[jira] [Commented] (YARN-4315) NaN in Queue percentage for cluster apps page

2015-11-02 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986699#comment-14986699 ] Bibin A Chundatt commented on YARN-4315: Only during switch and its temporary. > NaN in Queue

[jira] [Commented] (YARN-2513) Host framework UIs in YARN for use with the ATS

2015-11-02 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986731#comment-14986731 ] Hitesh Shah commented on YARN-2513: --- [~yeshavora] and I are trying to use this on a secure cluster. I can

[jira] [Commented] (YARN-2513) Host framework UIs in YARN for use with the ATS

2015-11-02 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986732#comment-14986732 ] Hitesh Shah commented on YARN-2513: --- The below patch seems to work but I am not sure what else I may be

[jira] [Updated] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

2015-11-02 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3136: - Labels: 2.7.2-candidate (was: ) > getTransferredContainers can be a bottleneck during AM registration >

[jira] [Updated] (YARN-3849) Too much of preemption activity causing continuos killing of containers across queues

2015-11-02 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3849: - Labels: 2.7.2-candidate (was: ) > Too much of preemption activity causing continuos killing of containers

[jira] [Updated] (YARN-4163) Audit getQueueInfo and getApplications calls

2015-11-02 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated YARN-4163: --- Attachment: YARN-4163.3.patch > Audit getQueueInfo and getApplications calls >

[jira] [Updated] (YARN-1510) Make NMClient support change container resources

2015-11-02 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1510: Attachment: YARN-1510.7.patch Thank you so much for catching this, [~jianhe]! Attaching latest patch that

[jira] [Updated] (YARN-2506) TimelineClient should NOT be in yarn-common project

2015-11-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2506: -- Target Version/s: 2.8.0 (was: 2.7.2, 2.6.3) It isn't worth doing this in

[jira] [Commented] (YARN-4163) Audit getQueueInfo and getApplications calls

2015-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986168#comment-14986168 ] Hadoop QA commented on YARN-4163: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-1510) Make NMClient support change container resources

2015-11-02 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986162#comment-14986162 ] MENG DING commented on YARN-1510: - The mvninstall error and failed tests should not be related to this

[jira] [Commented] (YARN-3769) Preemption occurring unnecessarily because preemption doesn't consider user limit

2015-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986219#comment-14986219 ] Hadoop QA commented on YARN-3769: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-4326) TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188

2015-11-02 Thread MENG DING (JIRA)
MENG DING created YARN-4326: --- Summary: TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188 Key: YARN-4326 URL: https://issues.apache.org/jira/browse/YARN-4326

[jira] [Commented] (YARN-1510) Make NMClient support change container resources

2015-11-02 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986336#comment-14986336 ] MENG DING commented on YARN-1510: - Logged YARN-4326 for the TestDistributedShell timeout issue. > Make

[jira] [Closed] (YARN-1705) Reset cluster-metrics on transition to standby

2015-11-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli closed YARN-1705. - > Reset cluster-metrics on transition to standby >

[jira] [Updated] (YARN-1705) Reset cluster-metrics on transition to standby

2015-11-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1705: -- Fix Version/s: 2.4.0 > Reset cluster-metrics on transition to standby >

[jira] [Commented] (YARN-2934) Improve handling of container's stderr

2015-11-02 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986197#comment-14986197 ] Naganarasimha G R commented on YARN-2934: - Hi [~jira.shegalov], [~ste...@apache.org] &

[jira] [Commented] (YARN-2014) Performance: AM scaleability is 10% slower in 2.4 compared to 0.23.9

2015-11-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986265#comment-14986265 ] Vinod Kumar Vavilapalli commented on YARN-2014: --- [~patwhitey2007] / [~jlowe], any ideas if

[jira] [Updated] (YARN-4326) TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188

2015-11-02 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-4326: Attachment: YARN-4326.patch Fix the problem by setting the {{TIMELINE_SERVICE_WEBAPP_ADDRESS}} after

[jira] [Commented] (YARN-2934) Improve handling of container's stderr

2015-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985026#comment-14985026 ] Hadoop QA commented on YARN-2934: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-2934) Improve handling of container's stderr

2015-11-02 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2934: Attachment: YARN-2934.v1.003.patch fixing checkstyle and test cases ! > Improve handling of

[jira] [Commented] (YARN-3862) Decide which contents to retrieve and send back in response in TimelineReader

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986444#comment-14986444 ] Sangjin Lee commented on YARN-3862: --- I just kicked off a jenkins run on the latest patch. Sorry

[jira] [Updated] (YARN-4127) RM fail with noAuth error if switched from failover mode to non-failover mode

2015-11-02 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-4127: --- Attachment: YARN-4127-branch-2.7.02.patch [~jianhe], updated branch-2.7 patch > RM fail with noAuth

[jira] [Commented] (YARN-2934) Improve handling of container's stderr

2015-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985118#comment-14985118 ] Hadoop QA commented on YARN-2934: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4326) TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188

2015-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986507#comment-14986507 ] Hadoop QA commented on YARN-4326: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3862) Decide which contents to retrieve and send back in response in TimelineReader

2015-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986522#comment-14986522 ] Hadoop QA commented on YARN-3862: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||