[jira] (YARN-3884) RMContainerImpl transition from RESERVED to KILL apphistory status not updated

2017-01-31 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15847154#comment-15847154 ] Bibin A Chundatt commented on YARN-3884: [~varun_saxena] Please do review > RMCont

[jira] (YARN-4423) Cleanup lint warnings in resource manager

2017-01-31 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-4423: --- Summary: Cleanup lint warnings in resource manager (was: Cleanup lint warnings in resource man

RM showing negative usage for few queues.

2017-01-31 Thread Achyuth Reddy
Hi Folks, Have you seen an instance where there is a negative usage shown by RM for few queues in a capacity scheduler. When I submit a job to the problem queues it goes up to positive usage value and then comes back down to negative usage value once the job is done. RM Version :2.7.1.2.3.4.7-4

[jira] (YARN-6061) Add a customized uncaughtexceptionhandler for critical threads in RM

2017-01-31 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15847477#comment-15847477 ] ASF GitHub Bot commented on YARN-6061: -- Github user flyrain commented on a diff in the

[jira] (YARN-6061) Add a customized uncaughtexceptionhandler for critical threads in RM

2017-01-31 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6061: --- Attachment: YARN-6061.004.patch > Add a customized uncaughtexceptionhandler for critical threads in RM > --

[jira] (YARN-6136) Registry should avoid scanning whole ZK tree for every container/application finish

2017-01-31 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-6136: Summary: Registry should avoid scanning whole ZK tree for every container/application finish Key: YARN-6136 URL: https://issues.apache.org/jira/browse/YARN-6136 Project: Hado

[jira] (YARN-6136) Registry should avoid scanning whole ZK tree for every container/application finish

2017-01-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15847601#comment-15847601 ] Wangda Tan commented on YARN-6136: -- Per my understanding, existing design of service regis

[jira] (YARN-6136) YARN registry service should avoid scanning whole ZK tree for every container/application finish

2017-01-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6136: - Summary: YARN registry service should avoid scanning whole ZK tree for every container/application finish

[jira] (YARN-6125) The application attempt's diagnostic message should have a maximum size

2017-01-31 Thread Andras Piros (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Piros updated YARN-6125: --- Attachment: YARN-6125.002.patch CheckStyle, Javadoc, and code format modifications. Note that the thre

[jira] (YARN-6125) The application attempt's diagnostic message should have a maximum size

2017-01-31 Thread Andras Piros (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15847607#comment-15847607 ] Andras Piros edited comment on YARN-6125 at 1/31/17 10:17 PM: --

[jira] [Commented] (YARN-6061) Add a customized uncaughtexceptionhandler for critical threads in RM

2017-01-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15847670#comment-15847670 ] Hadoop QA commented on YARN-6061: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5951) Changes to allow CapacityScheduler to use configuration store

2017-01-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15847684#comment-15847684 ] Wangda Tan commented on YARN-5951: -- Thanks [~jhung] for updating the patch, my comments/su

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

2017-01-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15847719#comment-15847719 ] Wangda Tan commented on YARN-5889: -- Major comments of UsersManager: 1) Remove UM#incResour

[jira] [Commented] (YARN-5902) yarn.scheduler.increment-allocation-mb and yarn.scheduler.increment-allocation-vcores are undocumented in yarn-default.xml

2017-01-31 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15847752#comment-15847752 ] Karthik Kambatla commented on YARN-5902: The right place would be [FairScheduler d

[jira] [Commented] (YARN-6125) The application attempt's diagnostic message should have a maximum size

2017-01-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15847763#comment-15847763 ] Hadoop QA commented on YARN-6125: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-6100) improve YARN webservice to output aggregated container logs

2017-01-31 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-6100: Attachment: YARN-6100.branch-2.v4.patch > improve YARN webservice to output aggregated container logs > -

[jira] [Updated] (YARN-6100) improve YARN webservice to output aggregated container logs

2017-01-31 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-6100: Attachment: YARN-6100.trunk.v4.patch > improve YARN webservice to output aggregated container logs >

[jira] [Commented] (YARN-6100) improve YARN webservice to output aggregated container logs

2017-01-31 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15847766#comment-15847766 ] Xuan Gong commented on YARN-6100: - Thanks for the review. [~djp] bq. I think that could be

[jira] [Resolved] (YARN-4658) Typo in o.a.h.yarn.server.resourcemanager.scheduler.fair.TestFairScheduler comment

2017-01-31 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton resolved YARN-4658. Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Commented] (YARN-6136) YARN registry service should avoid scanning whole ZK tree for every container/application finish

2017-01-31 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15847800#comment-15847800 ] Gour Saha commented on YARN-6136: - [~wangda] FYI, Slider today uses the following path - {c

[jira] [Commented] (YARN-6061) Add a customized uncaughtexceptionhandler for critical threads in RM

2017-01-31 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15847821#comment-15847821 ] ASF GitHub Bot commented on YARN-6061: -- Github user kambatla commented on a diff in th

[jira] [Commented] (YARN-6061) Add a customized uncaughtexceptionhandler for critical threads in RM

2017-01-31 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15847820#comment-15847820 ] ASF GitHub Bot commented on YARN-6061: -- Github user kambatla commented on a diff in th

[jira] [Commented] (YARN-4658) Typo in o.a.h.yarn.server.resourcemanager.scheduler.fair.TestFairScheduler comment

2017-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15847822#comment-15847822 ] Hudson commented on YARN-4658: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1119

[jira] [Updated] (YARN-4531) org.apache.hadoop.yarn.event.AsyncDispatcher: AsyncDispatcher thread interrupted java.lang.InterruptedException

2017-01-31 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4531: --- Priority: Critical (was: Trivial) > org.apache.hadoop.yarn.event.AsyncDispatcher: AsyncDispatc

[jira] [Commented] (YARN-6125) The application attempt's diagnostic message should have a maximum size

2017-01-31 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15847836#comment-15847836 ] Daniel Templeton commented on YARN-6125: Thanks for the patch. Some comments: * I

[jira] [Updated] (YARN-6061) Add a customized uncaughtexceptionhandler for critical threads in RM

2017-01-31 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6061: --- Attachment: YARN-6061.005.patch > Add a customized uncaughtexceptionhandler for critical threads in RM > --

[jira] [Commented] (YARN-4531) org.apache.hadoop.yarn.event.AsyncDispatcher: AsyncDispatcher thread interrupted java.lang.InterruptedException

2017-01-31 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15847867#comment-15847867 ] Miklos Szegedi commented on YARN-4531: -- I ran into a similar exception. The impact is

[jira] [Commented] (YARN-6100) improve YARN webservice to output aggregated container logs

2017-01-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15847878#comment-15847878 ] Hadoop QA commented on YARN-6100: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-5946) Create YarnConfigurationStore class

2017-01-31 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-5946: Attachment: YARN-5946-YARN-5734.002.patch > Create YarnConfigurationStore class > ---

[jira] [Commented] (YARN-5946) Create YarnConfigurationStore class

2017-01-31 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15847883#comment-15847883 ] Jonathan Hung commented on YARN-5946: - Attached 002 patch. {{initialize}}, {{retrieve}}

[jira] [Commented] (YARN-6061) Add a customized uncaughtexceptionhandler for critical threads in RM

2017-01-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15847909#comment-15847909 ] Hadoop QA commented on YARN-6061: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-6108) Improve AHS webservice to accept NM address as a parameter to get container logs

2017-01-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15847951#comment-15847951 ] Junping Du commented on YARN-6108: -- Thanks [~xgong] for working on this. A quick comment h

[jira] [Commented] (YARN-6100) improve YARN webservice to output aggregated container logs

2017-01-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15848004#comment-15848004 ] Junping Du commented on YARN-6100: -- Thanks [~xgong] for updating the patch! bq. Yes, we ha