Re: [DISCUSS] HADOOP-9122 Add power mock library for writing better unit tests

2017-10-02 Thread Eric Yang
Chris, Here is a patch that use powermock. https://issues.apache.org/jira/secure/attachment/12889144/YARN-7202.yarn-native-services.002.patch This was written to verify that when ServiceClient interacts with Hadoop, if it throws the possible Exception types declared by ServiceClient API, does t

Re: [DISCUSS] HADOOP-9122 Add power mock library for writing better unit tests

2017-10-02 Thread Chris Douglas
Eric/Steve- Please pick a test- any test- and demonstrate why Powermock would improve- by any metric- testing in Hadoop. -C On Mon, Oct 2, 2017 at 2:12 PM, Eric Yang wrote: > Mock provides tool chains to run simulation for a piece of code. It helps to > prevent null pointer exception, and re

Re: [VOTE] Merge feature branch YARN-5734 (API based scheduler configuration) to trunk, branch-3.0, branch-2

2017-10-02 Thread Wangda Tan
+1 (Binding), huge thanks to all the other folks spent time to design, development, test and review this feature. In addition to what Jonathan mentioned, all exposed APIs / CLIs are marked as unstable so there should not have backward-compatibility issues. Participated initial design and review a

Re: [DISCUSS] HADOOP-9122 Add power mock library for writing better unit tests

2017-10-02 Thread Eric Yang
Mock provides tool chains to run simulation for a piece of code. It helps to prevent null pointer exception, and reduce unexpected runtime exceptions. When a piece of code is finished with a well-defined unit test, it provides great insights to see author’s intention and reasoning to write the

[jira] [Created] (HADOOP-14921) Conflicts when starting daemons with the same name

2017-10-02 Thread JIRA
Íñigo Goiri created HADOOP-14921: Summary: Conflicts when starting daemons with the same name Key: HADOOP-14921 URL: https://issues.apache.org/jira/browse/HADOOP-14921 Project: Hadoop Common

Re: [VOTE] Merge feature branch YARN-5734 (API based scheduler configuration) to trunk, branch-3.0, branch-2

2017-10-02 Thread Zhe Zhang
+1 (binding) LinkedIn has been running an internal version of OrgQueue for almost 2 years. It is an essential feature for running YARN scheduler on clusters shared by multiple internal organizations. I have participated in the YARN-5734 design and have regularly synced with Jonathan on developmen

[VOTE] Merge feature branch YARN-5734 (API based scheduler configuration) to trunk, branch-3.0, branch-2

2017-10-02 Thread Jonathan Hung
Hi all, >From discussion at [1], I'd like to start a vote to merge feature branch YARN-5734 to trunk, branch-3.0, and branch-2. Vote will be 7 days, ending Monday Oct 9 at 11:00AM PDT. This branch adds a framework to the scheduler to allow scheduler configuration mutation on the fly, including a

[jira] [Created] (HADOOP-14920) KMSClientProvider won't work with KMS delegation token retrieved from non-Java client.

2017-10-02 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HADOOP-14920: --- Summary: KMSClientProvider won't work with KMS delegation token retrieved from non-Java client. Key: HADOOP-14920 URL: https://issues.apache.org/jira/browse/HADOOP-14920

Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0

2017-10-02 Thread Eric Payne
+1 (binding) Thanks Andrew for all of your very diligent efforts. Build from source, installed on a 6-node pseudo cluster, and successfully tested the following manual use cases: o MapReduce sleep job o MapReduce streaming jobœ o Cross-queue (inter-queue) preemption o In-queue (intra-queue) preem

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2017-10-02 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/545/ No changes -1 overall The following subsystems voted -1: unit The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shell

[jira] [Created] (HADOOP-14919) BZip2 drops records when reading data in splits

2017-10-02 Thread Aki Tanaka (JIRA)
Aki Tanaka created HADOOP-14919: --- Summary: BZip2 drops records when reading data in splits Key: HADOOP-14919 URL: https://issues.apache.org/jira/browse/HADOOP-14919 Project: Hadoop Common Issue

[jira] [Resolved] (HADOOP-14768) Honoring sticky bit during Deletion when authorization is enabled in WASB

2017-10-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14768. - Resolution: Fixed Fix Version/s: 2.9.0 Target Version/s: 2.9.0, 3.1.0 (