[jira] [Created] (YARN-5897) using drainEvent to replace sleep-wait in MockRM#waitForState

2016-11-16 Thread sandflee (JIRA)
sandflee created YARN-5897: -- Summary: using drainEvent to replace sleep-wait in MockRM#waitForState Key: YARN-5897 URL: https://issues.apache.org/jira/browse/YARN-5897 Project: Hadoop YARN Issue Ty

[jira] [Created] (YARN-5896) add drainEvents to MockAM to reduce test failure

2016-11-16 Thread sandflee (JIRA)
sandflee created YARN-5896: -- Summary: add drainEvents to MockAM to reduce test failure Key: YARN-5896 URL: https://issues.apache.org/jira/browse/YARN-5896 Project: Hadoop YARN Issue Type: Improvemen

[jira] [Resolved] (YARN-5895) TestRMRestart#testFinishedAppRemovalAfterRMRestart is still flakey

2016-11-16 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sandflee resolved YARN-5895. Resolution: Duplicate > TestRMRestart#testFinishedAppRemovalAfterRMRestart is still flakey > ---

[VOTE] Merge feature branch YARN-4752. FairScheduler preemption overhaul

2016-11-16 Thread Karthik Kambatla
Hi folks, Based on the positive feedback on the DISCUSS thread [1], I would like to start a formal vote to merge feature branch YARN-4752 to trunk. The cumulative patch is posted to YARN-4752, and squashed into one commit here [2]. The changes include: 1. Preemption considers individual Resou

[jira] [Created] (YARN-5895) TestRMRestart#testFinishedAppRemovalAfterRMRestart is still flakey

2016-11-16 Thread Wilfred Spiegelenburg (JIRA)
Wilfred Spiegelenburg created YARN-5895: --- Summary: TestRMRestart#testFinishedAppRemovalAfterRMRestart is still flakey Key: YARN-5895 URL: https://issues.apache.org/jira/browse/YARN-5895 Project

[jira] [Created] (YARN-5894) license warning in de.ruedigermoeller:fst:jar:2.24

2016-11-16 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-5894: Summary: license warning in de.ruedigermoeller:fst:jar:2.24 Key: YARN-5894 URL: https://issues.apache.org/jira/browse/YARN-5894 Project: Hadoop YARN Issue Type: Bug

[jira] [Resolved] (YARN-5880) Add sanity check for FIFO scheduler

2016-11-16 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu resolved YARN-5880. Resolution: Invalid There is already sanity check for memory in FIFO scheduler. > Add sanity check for FIFO

Re: [DISCUSS] Merge FairScheduler preemption overhaul (YARN-4752) to trunk

2016-11-16 Thread Karthik Kambatla
Thanks Sangjin, Daniel, and Arun for your positive feedback. Sangjin - filed HADOOP-13821 to track the findbugs work. Arun - A synchronous approach would benefit with locking, but might lead to delay in processing apps that do not require a preemption to satisfy their request. Offline, you had al

[jira] [Created] (YARN-5893) Experiment with using PriorityQueue for storing starved applications

2016-11-16 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-5893: -- Summary: Experiment with using PriorityQueue for storing starved applications Key: YARN-5893 URL: https://issues.apache.org/jira/browse/YARN-5893 Project: Hadoop

[jira] [Created] (YARN-5891) yarn rmadmin -help contains a misspelled ResourceManager

2016-11-16 Thread Grant Sohn (JIRA)
Grant Sohn created YARN-5891: Summary: yarn rmadmin -help contains a misspelled ResourceManager Key: YARN-5891 URL: https://issues.apache.org/jira/browse/YARN-5891 Project: Hadoop YARN Issue Type

[jira] [Created] (YARN-5890) FairScheduler should log information about AM-resource-usage and max-AM-share for queues

2016-11-16 Thread Yufei Gu (JIRA)
Yufei Gu created YARN-5890: -- Summary: FairScheduler should log information about AM-resource-usage and max-AM-share for queues Key: YARN-5890 URL: https://issues.apache.org/jira/browse/YARN-5890 Project: Had

Re: [DISCUSS] Merge FairScheduler preemption overhaul (YARN-4752) to trunk

2016-11-16 Thread Arun Suresh
+1 from me too. minor nit: * In FSAppAttempt, maybe rename addPreemption(container) / removePreemption(container) to something better. Also, had an offline discussion with Karthik. Suggested to maybe experiment with replacing the PreemptionThread with a synchronous preemption approach. For eg. Ma

Apache Hadoop qbt Report: trunk+JDK8 on Linux/ppc64le

2016-11-16 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/157/ [Nov 15, 2016 3:56:25 PM] (Arun Suresh) YARN-4597. Introduce ContainerScheduler and a SCHEDULED state to [Nov 15, 2016 6:57:00 PM] (liuml07) HADOOP-13427. Eliminate needless uses of FileSystem#{exists(), i

[jira] [Created] (YARN-5889) Improve user-limit calculation in capacity scheduler

2016-11-16 Thread Sunil G (JIRA)
Sunil G created YARN-5889: - Summary: Improve user-limit calculation in capacity scheduler Key: YARN-5889 URL: https://issues.apache.org/jira/browse/YARN-5889 Project: Hadoop YARN Issue Type: Bug

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-11-16 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/227/ [Nov 15, 2016 7:57:37 AM] (naganarasimha_gr) Reverted due to issue YARN-5765. Revert "YARN-5287. [Nov 15, 2016 10:11:56 AM] (naganarasimha_gr) YARN-4355. NPE while processing localizer heartbeat. Contribut

[jira] [Resolved] (YARN-5108) TestFileSystemApplicationHistoryStore fails

2016-11-16 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S resolved YARN-5108. - Resolution: Duplicate After HADOOP-13140, this test is passing in all the build. Closing as

[jira] [Resolved] (YARN-5765) Revert CHMOD on the new dirs created-LinuxContainerExecutor creates appcache and its subdirectories with wrong group owner.

2016-11-16 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R resolved YARN-5765. - Resolution: Fixed Hadoop Flags: Reviewed Release Note: This change reverts YARN-52