Re: [RESULT] [VOTE] Release Apache Hadoop 2.8.0 (RC3)

t;j...@hortonworks.com> Sent: Friday, March 24, 2017 6:21 PM To: Allen Wittenauer Cc: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-dev@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [RESULT] [VOTE] Release Apache Hadoop 2.8.0 (RC3) Thanks Allen, I already add i

Re: [RESULT] [VOTE] Release Apache Hadoop 2.8.0 (RC3)

From: Allen Wittenauer <a...@effectivemachines.com> Sent: Thursday, March 23, 2017 5:27 PM To: Junping Du Cc: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-dev@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [RESULT] [VOTE] Release Apache Hadoop 2.8.0 (RC3)

Re: [RESULT] [VOTE] Release Apache Hadoop 2.8.0 (RC3)

Just a heads up. Looks like some removed the Finish Date off of 2.8.0 in JIRA. It needs to be put back to match what is in the artifacts that we voted on. - To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org For

[RESULT] [VOTE] Release Apache Hadoop 2.8.0 (RC3)

org Cc: Junping Du; common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-dev@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3) +1 (binding) * Built from source * Started a pseudo-distributed cluster with fairscheduler. * Ran sampl

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

.1. :) > > > > > > > > > Thanks, > > > > > > > > > Junping > > > > > > ________ > > > From: John Zhuge <jzh...@cloudera.com> > > > Sent: Monday, March 20, 2017 10:31 AM > >

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

___ > > From: John Zhuge <jzh...@cloudera.com> > > Sent: Monday, March 20, 2017 10:31 AM > > To: Junping Du > > Cc: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; > > yarn-dev@hadoop.apache.org; mapreduce-...@hadoop.apache.org > > Subject: Re

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

hould quickly come up with 2.8.1 release in next > 1 > > >> or 2 > > >>> month for production deployment. > > >>> > > >>> > > >>> We will close the vote in next 24 hours. For people who haven't vote, > > >&g

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

; >>> We will close the vote in next 24 hours. For people who haven't vote, > >>> please keep on verification work and report any issues if founded - I > >> will > >>> check if another round of RC is needed based on your findings. Thanks! > >>&g

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

ks! >>> >>> >>> Thanks, >>> >>> >>> Junping >>> >>> >>> >>> From: Kuhu Shukla <kshu...@yahoo-inc.com> >>> Sent: Tuesday, March 21, 2017 3:17 PM >>> Cc: Junping

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

> > From: Kuhu Shukla <kshu...@yahoo-inc.com> > > Sent: Tuesday, March 21, 2017 3:17 PM > > Cc: Junping Du; common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org > ; > > yarn-dev@hadoop.apache.org; mapreduce-...@hadoop.apache.org > >

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

ffect > ADL > > > (Azure Data Lake) which is a new feature for 2.8 rather than other > > existing > > > FS? If so, I think we can leave the fix to 2.8.1 to fix given this is > > not a > > > regression and just a new feature get broken.? > > > > > > &

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

he.org; yarn-dev@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3) +1 (non-binding) - Verified signatures. - Downloaded and built from source tar.gz. - Deployed a pseudo-distributed cluster on Mac Sierra. - Ran example Sleep job succes

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

Junping > > -- > > *From:* John Zhuge <jzh...@cloudera.com> > > *Sent:* Monday, March 20, 2017 9:07 AM > > *To:* Junping Du > > *Cc:* common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; > > yarn-dev@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

to fix given this is > not a > > regression and just a new feature get broken.​ > > > > > > Thanks, > > > > > > Junping > > -- > > *From:* John Zhuge <jzh...@cloudera.com> > > *Sent:* Monday, March 20

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

> On Mar 21, 2017, at 10:12 AM, Andrew Wang wrote: > > I poked around a bit. The 3.0.0-alpha2 binary tarball is only 246M and has > more changes than 2.8.0. Not to disclaim any other potential issues, but it's worth noting 3.x de-dupes jar files as part of the

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

t; FS? If so, I think we can leave the fix to 2.8.1 to fix given this is > not a > > regression and just a new feature get broken.​ > > > > > > Thanks, > > > > > > Junping > > -- > > *From:* John Zhuge <jzh...@cloudera.com> > > *Sent:* Mo

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

up to blocker in case we could miss this in releasing 2.8.1. :) > >> > >> > >> Thanks, > >> > >> > >> Junping > >> > >> > >> From: John Zhuge <jzh...@cloudera.com>

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

ocker in case we could miss this in releasing 2.8.1. :) >> >> >> Thanks, >> >> >> Junping >> >> >> From: John Zhuge <jzh...@cloudera.com> >> Sent: Monday, March 20, 2017 10:31 AM >> To: Junping Du >> Cc:

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

-...@hadoop.apache.org; > yarn-dev@hadoop.apache.org; mapreduce-...@hadoop.apache.org > Subject: Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3) > > Yes, it only affects ADL. There is a workaround of adding these 2 > properties to core-site.xml: > > > fs.adl.impl >

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

Thank Junping for working on this. I verified the following: 1. Verified the md5 of binary tar ball. 2. Deployed on a 4 node cluster with 3 node managers. 3. Configured fair scheduler 4. Ran Pi job and verified the results. 5. Ran SLS for fair scheduler and capacity scheduler. All good except

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

I poked around a bit. The 3.0.0-alpha2 binary tarball is only 246M and has more changes than 2.8.0. It looks like the 2.8.0 bin tarball has an extra 1.5GB of docs when extracted compared to 3.0.0-alpha2. I think it's from the extra src-html content: -> % find share/doc -name src-html | xargs du

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

Thanks Junping for taking on this huge effort! I found one tiny nit: the md5 files are not in conventional format That is to say, $ cat hadoop-2.8.0.tar.gz.md5 $ /usr/bin/md5sum /build/source/target/artifacts/hadoop-2.8.0.tar.gz c728a090b68d009070085367695ed507

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

Thanks Junping! +1 (binding) * Verified signatures and checksums * Built Hive 2.1.0 and Tez 0.8.5 with Hadoop 2.8.0 pom * Deployed a single node cluster and ran some Hive on Tez queries successfully * The document looks good. I found a trivial issue in the doc. It does not block the release.

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

Thanks for putting this up, Junping. +1(non-binding) * verified signature and mds. * built from source on centos 7 and openjdk 8 with native profile. * built docs and skimmed the contents. * deployed 3 nodes ha cluster and run some sample jobs with caller context enabled. Masatake Iwasaki

RE: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

] Sent: 17 March 2017 17:18 To: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-dev@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: [VOTE] Release Apache Hadoop 2.8.0 (RC3) Hi all, With fix of HDFS-11431 get in, I've created a new release candidate (RC3

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

jzh...@cloudera.com> Sent: Monday, March 20, 2017 10:31 AM To: Junping Du Cc: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-dev@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3) Yes, it only affects ADL. There is a work

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

> Thanks, > > > Junping > > > From: John Zhuge <jzh...@cloudera.com> > Sent: Monday, March 20, 2017 9:07 AM > To: Junping Du > Cc: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; > yarn-dev@hadoop.apache.org; mapreduce-...@hado

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

From: John Zhuge <jzh...@cloudera.com> Sent: Monday, March 20, 2017 9:07 AM To: Junping Du Cc: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-dev@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.8.

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

+1 (non-binding) Tested from the released binary package * 5 node cluster running from dockerized containers (every namenode/datanode/nodemanager, etc. are running in separated containers) * Bitcoin bockchain data (~100Gb) parsed and imported to HBase (1.2.4) * Spark (2.1.0 with included

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

On 19 Mar 2017, at 15:23, Steve Loughran > wrote: Thanks, testing in progress here's the windows native binaries to go with it, all signed https://github.com/steveloughran/winutils/releases/tag/hadoop-2.8.0-RC3 The gnu shell commands

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

+1 (non-binding). Thanks Junping for the effort. I have used release package and verified below cases - Ran MR sleep job and wordcount successfully in where nodes are configured with labels. - Verified application priority feature and I could see high priority apps are getting resource over lower

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

Thanks, testing in progress here's the windows native binaries to go with it, all signed https://github.com/steveloughran/winutils/releases/tag/hadoop-2.8.0-RC3 The gnu shell commands which came with git worked well here, and the build went through fast, nice to see Test results to follow

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

+1 (binding) - Verfied signatures and digests- Performed a native build from the release tag- Deployed to a single node cluster- Ran some sample jobs Jason On Friday, March 17, 2017 4:18 AM, Junping Du wrote: Hi all,     With fix of HDFS-11431 get in, I've

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

Thanks Junping for doing this. +1 (non-binding) 0. Download the src tar.gz file; checked the MD5 checksum 1. Build Hadoop from source successfully 2. Deploy a single node cluster and start the cluster successfully 3. Operate the HDFS from command line: ls, put, distcp, dfsadmin etc 4. Run hadoop

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

Thanks for the new RC, Junping. I built from source and tried it out on a 2-node cluster with HA enabled. I ran a pi job and some streaming jobs. I tested that localization and failover work correctly, and I played a little with the YARN and HDFS web UIs. I did encounter an old friend of

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

Hi Junping, Thank you for working on this. +1 (Non-Binding) I verified the following: 1. Deployed on a 3 node cluster with 2 node managers. 2. Configured linux container executor 3. Configured fair scheduler 4. Ran Pi job and verified the results 5. Ran multiple Yarn applications and verified

[VOTE] Release Apache Hadoop 2.8.0 (RC3)

Hi all, With fix of HDFS-11431 get in, I've created a new release candidate (RC3) for Apache Hadoop 2.8.0. This is the next minor release to follow up 2.7.0 which has been released for more than 1 year. It comprises 2,900+ fixes, improvements, and new features. Most of these commits