Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

+1 (binding) * Downloaded source, built from source with -Dhbase.profile=2.0. * Installed RM HA cluster integrated with ATSv2. Installed HBase-2.0-beta1 for ATSv2 back end. Scheduler is configured with 2 level queue hierarchy. * Ran sample jobs such as MR/Distributed shell and verified for ** ATS

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

Thanks Wangda for working on this! +1 (non-binding) - Downloaded the binary tarball and verified the checksum. - Started a pseudo cluster inside one docker container - Run Resource Manager with Fair Scheduler - Verified distributed shell - Verified mapreduce pi job - Sanity che

[VOTE] Release Apache Hadoop 3.1.0 (RC1)

Hi folks, Thanks to the many who helped with this release since Dec 2017 [1]. We've created RC1 for Apache Hadoop 3.1.0. The artifacts are available here: http://people.apache.org/~wangda/hadoop-3.1.0-RC1 The RC tag in git is release-3.1.0-RC1. Last git commit SHA is 16b70619a24cdcf5d3b0fcf4b58c

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/179/ [Mar 30, 2018 1:03:32 AM] (shv) HADOOP-12862. LDAP Group Mapping over SSL can not specify trust store. -1 overall The following subsystems voted -1: docker Powered by Apache Yetus 0.8.0-SNAPSH

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC0)

Arun helped me to figure this out. It was pushed to a wrong location. The correct one is: https://dist.apache.org/repos/dist/release/hadoop/common/

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC0)

Thanks Junping for reporting this, I did append my keys to https://svn.apache.org/repos/asf/hadoop/common/dist/KEYS, I'm not sure how to propagate it to https://dist.apache.org/repos/dist/release/hadoop/common/ KEYS, I couldn't find any guide about this. Could you share how you did this? - Wangda

[jira] [Created] (MAPREDUCE-7071) Bypass the Fetcher and read directly from the local filesystem if source Mapper ran on the same host

Prabhu Joseph created MAPREDUCE-7071: Summary: Bypass the Fetcher and read directly from the local filesystem if source Mapper ran on the same host Key: MAPREDUCE-7071 URL: https://issues.apache.org/jira/brows

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC0)

Hi Wanda, Thanks for the release effort on 3.1.0. Another reminder is I tried to verify the signature of RC0 bits but found there is no known key get uploaded to https://dist.apache.org/repos/dist/release/hadoop/common/KEYS. Would you please upload it there then we can go ahead to verify the s

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC0)

Thanks all for doing testing and reporting issues. YARN-8085 discovered by Weiwei/Tao is a blocker, we will roll an RC1 today. - Wangda On Thu, Mar 29, 2018 at 7:26 AM, Weiwei Yang wrote: > Hi Wangda > > While testing the build, we found a bug https://issues.apache.org/ > jira/browse/YARN-8085

[jira] [Created] (MAPREDUCE-7070) Batch calls to RackResolver from AM

Greg Phillips created MAPREDUCE-7070: Summary: Batch calls to RackResolver from AM Key: MAPREDUCE-7070 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7070 Project: Hadoop Map/Reduce

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC0)

Hi Wangda While testing the build, we found a bug https://issues.apache.org/jira/browse/YARN-8085, it might cause NPE during RM fail-over. I think that needs to be included in 3.1.0. We have run some other tests, and they look good so far. This includes - Some basic teragen/terasort/DS jobs - V

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/735/ [Mar 28, 2018 2:33:18 AM] (sunilg) YARN-8075. DShell does not fail when we ask more GPUs than available [Mar 28, 2018 3:00:08 AM] (yqlin) HDFS-13347. RBF: Cache datanode reports. Contributed by Inigo Goiri