Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

2018-03-18 Thread Akira Ajisaka
Hi Lei, Would you provide SHA checksum files instead of MD5? http://www.apache.org/dev/release-distribution#sigs-and-sums -Akira On 2018/03/18 13:11, Lei Xu wrote: Hi, all I've created release candidate RC-1 for Apache Hadoop 3.0.1 Apache Hadoop 3.0.1 will be the first bug fix release for Ap

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

2018-03-19 Thread Lei Xu
Sure, Akira .mds files are uploaded to http://home.apache.org/~lei/hadoop-3.0.1-RC1/ On Sun, Mar 18, 2018 at 6:04 PM, Akira Ajisaka wrote: > Hi Lei, > > Would you provide SHA checksum files instead of MD5? > http://www.apache.org/dev/release-distribution#sigs-and-sums > > -Akira > > > On 2018/03

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

2018-03-19 Thread Xiao Chen
Thanks Eddy for the effort! +1 (binding) - Downloaded src tarball and verified checksums - Built from src - Started a pseudo distributed hdfs cluster - Verified basic hdfs operations work - Verified hdfs encryption basic operations work - Sanity checked logs / webui -Xiao On

RE: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

2018-03-20 Thread Takanobu Asanuma
ure coding operations -Takanobu Asanuma -Original Message- From: Xiao Chen [mailto:x...@cloudera.com] Sent: Tuesday, March 20, 2018 1:15 PM To: Lei Xu Cc: Akira Ajisaka ; Hadoop Common ; Hdfs-dev ; mapreduce-...@hadoop.apache.org; yarn-...@hadoop.apache.org Subject: Re: [VOTE] Rele

RE: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

2018-03-20 Thread Chen, Sammi
Thanks Eddy for driving 3.0.1 release. I'm testing the release and will vote later. One thing I noticed that the JIRA links on page https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0+Release is linked to the page itself, not the individual JIRA. I'm not sure if it's the design.

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

2018-03-20 Thread Eric Payne
Thanks for working on this release! +1 (binding) I tested the following: - yarn distributed shell job - yarn streaming job - inter-queue preemption - compared behavior of fair and fifo ordering policy - both userlimit_first mode and priority_first mode of intra-queue preemption Eric Payne

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

2018-03-20 Thread Yufei Gu
Thanks Eddy! +1 (non-binding) - Downloaded the hadoop-3.0.1.tar.gz from http://home.apache.org/~lei/hadoop-3.0.1-RC1/ - Started a pseudo cluster inside one docker container - Verified distributed shell - Verified mapreduce pi job - Sanity check RM WebUI Best, Yufei On Tue, Mar 2

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

2018-03-20 Thread Gabor Bota
Thanks for working on this Eddy! +1 (non-binding) I've done the following: - checked out git tag release-3.0.1-RC1 - built from source on Mac OS X 10.13.3, openjdk 1.8.0_144 (zulu) - deployed on a 3 node cluster (HDFS HA, Non-HA YARN) - verified example pi job - ran teragen, teras

RE: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

2018-03-20 Thread Chen, Sammi
; Hdfs-dev ; mapreduce-...@hadoop.apache.org; yarn-...@hadoop.apache.org; Lei Xu Subject: Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1) Thanks for working on this Eddy! +1 (non-binding) I've done the following: - checked out git tag release-3.0.1-RC1 - built from source on Mac OS X 10

RE: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

2018-03-21 Thread Brahma Reddy Battula
Thanks Lei Xu for driving this. +1(binding) --Built from the source --Installed the HA Cluster --Verified hdfs operations --Ran sample jobs --Verified the UI's --Brahma Reddy Battula -Original Message- From: Lei Xu [mailto:l...@apache.org] Sent: 18 March 2018 12:11 To: Hadoop Commo

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

2018-03-21 Thread Robert Kanter
+1 (binding) - verified signatures and checksums - setup pseudo cluster using Fair Scheduler from binary tarball - ran some of the example jobs, clicked around the UI a bit By the way, ASF recommends using a 4096 bit key for signing, though 2048 is fine for now. https://www.apache.org/dev/release

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

2018-03-22 Thread Akira Ajisaka
+1 (binding) - verified signatures and checksums - built from source and setup 4 node cluster - ran some examples jobs - verified some HDFS operations Thanks, Akira On 2018/03/22 10:08, Robert Kanter wrote: +1 (binding) - verified signatures and checksums - setup pseudo cluster using Fair Sch

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

2018-03-22 Thread Ajay Kumar
+1 (non-binding) - verified signatures and checksums - built from source and setup single node cluster - ran basic hdfs operations - ran TestDFSIO(read/write), wordcount, pi jobs. - basic sanity check of NN UI Thanks, Ajay On 3/22/18, 4:20 AM, "Akira Ajisaka" wrote:

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

2018-03-22 Thread Bharat Viswanadham
+1 (non-binding) 1. verified md5 checksum. 2. Built from source and deployed a 5 node cluster. 3. Ran few basic commands of hdfs operations. 4. Deployed a federated cluster (2 namenodes) and ran few hdfs basic commands 5. Checked NN web UI. Thanks, Bharat On 3/22/18, 10:02 AM, "Ajay Kumar" wro

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

2018-03-22 Thread Elek, Marton
+1 (non binding) I did a full build from source code, created a docker container and did various basic level tests with robotframework based automation and docker-compose based pseudo clusters[1]. Including: * Hdfs federation smoke test * Basic ViewFS configuration * Yarn example jobs * Spa

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

2018-03-23 Thread Kuhu Shukla
+1 (non-binding) Built from source. Installed on a pseudo distributed cluster. Ran word count job and basic hdfs commands. Thank you for the effort on this release. Regards, Kuhu On Thu, Mar 22, 2018 at 5:25 PM, Elek, Marton wrote: > > +1 (non binding) > > I did a full build from source code,

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

2018-03-23 Thread Lei Xu
Hi, All Thanks everyone for voting! The vote passes successfully with 6 binding +1s, 7 non-binding +1s and no -1s. I will work on the staging and releases. Best, On Fri, Mar 23, 2018 at 5:10 AM, Kuhu Shukla wrote: > +1 (non-binding) > > Built from source. > Installed on a pseudo distributed c

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

2018-04-02 Thread Arpit Agarwal
Hi Lei, It looks like the release artefacts have dummy shaded jars. E.g. Repository Path: /org/apache/hadoop/hadoop-client-runtime/3.0.1/hadoop-client-runtime-3.0.1.jar Uploaded by: lei Size: 44.47 KB Uploaded Date:Fri Mar 16 2018 15:50:42 GMT-0700 (PDT) Last Modified:F

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

2018-04-02 Thread Lei Xu
Hi, Arpit I followed this instruction https://wiki.apache.org/hadoop/HowToRelease It instructs to use "mvn deploy -Psign -DskipTests -DskipShade". It seems wrong, given that 3.0.0 is a shaded jar. I will do another deploy to fix it. On Mon, Apr 2, 2018 at 5:31 PM, Arpit Agarwal wrote: > Hi Le

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

2018-04-02 Thread Wangda Tan
Thanks Arpit for reporting this and helping investigate the issue offline! I follow the same tutorial so the previously RC1 maven repo has the same issue. Just deployed jars by removing -DskipShade and shaded jars have correct sizes. Will post an update to RC1 voting thread. - Wangda On Mon, A

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

2018-04-04 Thread Lei Xu
Hi, All Thanks Arpit to find that 3.0.1 artifacts missed shaded jars. I will create a new 3.0.2 release with the same codebase as 3.0.1, but deploy it as shaded jars. A new vote thread will start later this week. After that, 3.0.3 release will be cut from branch-3.0 and includes the new bug fixe