[RESULT] [VOTE] Release Apache Hadoop 2.8.3 (RC0)
Thanks to all who verified and voted! I give my binding +1 to conclude the vote for 2.8.3 RC0, based on: - Build from source and verify signatures - Deploy pseudo-distributed cluster and run some simple job, like: pi, sleep, etc. - Verify UI of daemons, like: NameNode, DataNode, ResourceManager, NodeManager, etc - Verify rolling upgrade features from 2.7.4, include MR over distributed cache, NM restart with work preserving, etc. Now, we have: 8 binding +1s, from: Eric Payne, Jason Lowe, Jian He, Wangda Tan, Rohith Sharma K S, Sunil G, Naganarasimha Garla, Junping Du 5 non-binding +1s, from: Brahma Reddy Battula, Kuhu Shukla, Ajay Kumar, Eric Badger, Chandni Singh and no -1s. So I am glad to announce that the vote of 2.8.3 RC0 passes. Thanks everyone listed above who tried the release candidate and vote and all who ever help with 2.8.3 release effort in all kinds of ways. I'll push the release bits and send out an announcement for 2.8.3 soon. Thanks, Junping From: Naganarasimha Garla Sent: Wednesday, December 13, 2017 9:39 AM To: Sunil G Cc: Junping Du; common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org; yarn-dev@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0) Thanks Junping for the release. +1 (binding) Tested on a single node pseudo cluster, I performed the following tests: - Downloaded the tars and verified the signatures, installed using the tar - Successfully ran few MR jobs - Verified few hdfs operations - Verified RM,NM and HDFS webui's - configured labels and submitted some apps Thanks and Regards, + Naga On Wed, Dec 13, 2017 at 8:14 PM, Sunil G mailto:sun...@apache.org>> wrote: +1 (binding) Thanks Junping for the effort. I have deployed a cluster built from source tar ball. - Ran few MR apps and verified UI. CLI commands are also fine related to app. - Tested below feature sanity - Application priority - Application timeout - Tested basic NodeLabel scenarios. - Added some labels to couple of nodes - Verified old UI for labels - Submitted apps to labelled cluster and it works fine. - Also performed few cli commands related to nodelabel - Test basic HA cases Thanks Sunil G On Tue, Dec 5, 2017 at 3:28 PM Junping Du mailto:j...@hortonworks.com>> wrote: > Hi all, > I've created the first release candidate (RC0) for Apache Hadoop > 2.8.3. This is our next maint release to follow up 2.8.2. It includes 79 > important fixes and improvements. > > The RC artifacts are available at: > http://home.apache.org/~junping_du/hadoop-2.8.3-RC0 > > The RC tag in git is: release-2.8.3-RC0 > > The maven artifacts are available via > repository.apache.org<http://repository.apache.org> at: > https://repository.apache.org/content/repositories/orgapachehadoop-1072 > > Please try the release and vote; the vote will run for the usual 5 > working days, ending on 12/12/2017 PST time. > > Thanks, > > Junping >
Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)
Thanks Junping for the release. +1 (binding) Tested on a single node pseudo cluster, I performed the following tests: - Downloaded the tars and verified the signatures, installed using the tar - Successfully ran few MR jobs - Verified few hdfs operations - Verified RM,NM and HDFS webui's - configured labels and submitted some apps Thanks and Regards, + Naga On Wed, Dec 13, 2017 at 8:14 PM, Sunil G wrote: > +1 (binding) > > Thanks Junping for the effort. > I have deployed a cluster built from source tar ball. > > >- Ran few MR apps and verified UI. CLI commands are also fine related to >app. >- Tested below feature sanity > - Application priority > - Application timeout >- Tested basic NodeLabel scenarios. > - Added some labels to couple of nodes > - Verified old UI for labels > - Submitted apps to labelled cluster and it works fine. > - Also performed few cli commands related to nodelabel >- Test basic HA cases > > > Thanks > Sunil G > > > On Tue, Dec 5, 2017 at 3:28 PM Junping Du wrote: > > > Hi all, > > I've created the first release candidate (RC0) for Apache Hadoop > > 2.8.3. This is our next maint release to follow up 2.8.2. It includes 79 > > important fixes and improvements. > > > > The RC artifacts are available at: > > http://home.apache.org/~junping_du/hadoop-2.8.3-RC0 > > > > The RC tag in git is: release-2.8.3-RC0 > > > > The maven artifacts are available via repository.apache.org at: > > https://repository.apache.org/content/repositories/orgapachehadoop-1072 > > > > Please try the release and vote; the vote will run for the usual 5 > > working days, ending on 12/12/2017 PST time. > > > > Thanks, > > > > Junping > > >
Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)
+1 (binding) Thanks Junping for the effort. I have deployed a cluster built from source tar ball. - Ran few MR apps and verified UI. CLI commands are also fine related to app. - Tested below feature sanity - Application priority - Application timeout - Tested basic NodeLabel scenarios. - Added some labels to couple of nodes - Verified old UI for labels - Submitted apps to labelled cluster and it works fine. - Also performed few cli commands related to nodelabel - Test basic HA cases Thanks Sunil G On Tue, Dec 5, 2017 at 3:28 PM Junping Du wrote: > Hi all, > I've created the first release candidate (RC0) for Apache Hadoop > 2.8.3. This is our next maint release to follow up 2.8.2. It includes 79 > important fixes and improvements. > > The RC artifacts are available at: > http://home.apache.org/~junping_du/hadoop-2.8.3-RC0 > > The RC tag in git is: release-2.8.3-RC0 > > The maven artifacts are available via repository.apache.org at: > https://repository.apache.org/content/repositories/orgapachehadoop-1072 > > Please try the release and vote; the vote will run for the usual 5 > working days, ending on 12/12/2017 PST time. > > Thanks, > > Junping >
Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)
+1 (Binding) Built from source and deployed non-secure 3 node cluster Verified for - RM HA/RM Restart/RM work preserving restart - NM work preserving restart - Ran sample MR and Distributed shell jobs. Thanks & Regards Rohith Sharma K S On 5 December 2017 at 15:28, Junping Du wrote: > Hi all, > I've created the first release candidate (RC0) for Apache Hadoop > 2.8.3. This is our next maint release to follow up 2.8.2. It includes 79 > important fixes and improvements. > > The RC artifacts are available at: http://home.apache.org/~ > junping_du/hadoop-2.8.3-RC0 > > The RC tag in git is: release-2.8.3-RC0 > > The maven artifacts are available via repository.apache.org at: > https://repository.apache.org/content/repositories/orgapachehadoop-1072 > > Please try the release and vote; the vote will run for the usual 5 > working days, ending on 12/12/2017 PST time. > > Thanks, > > Junping >
Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)
Oops, the vote was meant for 2.7.5. Sorry for the confusion. My 2.8.3 vote coming up shortly. On Tue, Dec 12, 2017 at 4:28 PM, John Zhuge wrote: > Thanks Junping for the great effort! > > >- Verified checksums and signatures of all tarballs >- Built source with native, Azul Java 1.7.0_161 on Mac OS X 10.13.2 >- Verified cloud connectors: > - All S3A integration tests >- Deployed both binary and built source to a pseudo cluster, passed >the following sanity tests in insecure and SSL mode: > - HDFS basic and ACL > - DistCp basic > - MapReduce wordcount > - KMS and HttpFS basic > - Balancer start/stop > > > Non-blockers > >- HADOOP-13030 Handle special characters in passwords in KMS startup >script. Fixed in 2.8+. >- NameNode servlets test failures: 403 User dr.who is unauthorized to >access this page. Researching. Could be just test configuration issue. > > John > > On Tue, Dec 12, 2017 at 1:10 PM, Eric Badger > wrote: > >> Thanks, Junping >> >> +1 (non-binding) looks good from my end >> >> - Verified all hashes and checksums >> - Built from source on macOS 10.12.6, Java 1.8.0u65 >> - Deployed a pseudo cluster >> - Ran some example jobs >> >> Eric >> >> On Tue, Dec 12, 2017 at 12:55 PM, Konstantin Shvachko < >> shv.had...@gmail.com> >> wrote: >> >> > Downloaded again, now the checksums look good. Sorry my fault >> > >> > Thanks, >> > --Konstantin >> > >> > On Mon, Dec 11, 2017 at 5:03 PM, Junping Du >> wrote: >> > >> > > Hi Konstantin, >> > > >> > > Thanks for verification and comments. I was verifying your >> example >> > > below but found it is actually matched: >> > > >> > > >> > > *jduMBP:hadoop-2.8.3 jdu$ md5 ~/Downloads/hadoop-2.8.3-src.tar.gz* >> > > *MD5 (/Users/jdu/Downloads/hadoop-2.8.3-src.tar.gz) = >> > > e53d04477b85e8b58ac0a26468f04736* >> > > >> > > What's your md5 checksum for given source tar ball? >> > > >> > > >> > > Thanks, >> > > >> > > >> > > Junping >> > > >> > > >> > > -- >> > > *From:* Konstantin Shvachko >> > > *Sent:* Saturday, December 9, 2017 11:06 AM >> > > *To:* Junping Du >> > > *Cc:* common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; >> > > mapreduce-...@hadoop.apache.org; yarn-dev@hadoop.apache.org >> > > *Subject:* Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0) >> > > >> > > Hey Junping, >> > > >> > > Could you pls upload mds relative to the tar.gz etc. files rather than >> > > their full path >> > > /build/source/target/artifacts/hadoop-2.8.3-src.tar.gz: >> > >MD5 = E5 3D 04 47 7B 85 E8 B5 8A C0 A2 64 68 F0 47 36 >> > > >> > > Otherwise mds don't match for me. >> > > >> > > Thanks, >> > > --Konstantin >> > > >> > > On Tue, Dec 5, 2017 at 1:58 AM, Junping Du >> wrote: >> > > >> > >> Hi all, >> > >> I've created the first release candidate (RC0) for Apache Hadoop >> > >> 2.8.3. This is our next maint release to follow up 2.8.2. It >> includes 79 >> > >> important fixes and improvements. >> > >> >> > >> The RC artifacts are available at: >> http://home.apache.org/~junpin >> > >> g_du/hadoop-2.8.3-RC0 >> > >> >> > >> The RC tag in git is: release-2.8.3-RC0 >> > >> >> > >> The maven artifacts are available via repository.apache.org >> at: >> > >> https://repository.apache.org/content/repositories/orgapache >> hadoop-1072 >> > >> >> > >> Please try the release and vote; the vote will run for the >> usual 5 >> > >> working days, ending on 12/12/2017 PST time. >> > >> >> > >> Thanks, >> > >> >> > >> Junping >> > >> >> > > >> > > >> > >> > > > > -- > John > -- John Zhuge
Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)
+1 (Binding). Built from source and deployed a cluster, jobs can run successfully. Thanks Junping for driving this. Best, Wangda On Tue, Dec 12, 2017 at 5:18 PM, Chandni Singh wrote: > +1 > Built the source code. > Deployed a single node cluster and ran example jobs. Also tested RM > recovery. > > Thanks, > Chandni > > On Tue, Dec 12, 2017 at 4:37 PM, Jian He wrote: > > > +1 > > I built from source code > > deployed a cluster > > and successfully ran jobs while restarting RM as well > > > > Jian > > > > > > > On Dec 12, 2017, at 4:28 PM, John Zhuge wrote: > > > > > > Thanks Junping for the great effort! > > > > > > > > > - Verified checksums and signatures of all tarballs > > > - Built source with native, Azul Java 1.7.0_161 on Mac OS X 10.13.2 > > > - Verified cloud connectors: > > > - All S3A integration tests > > > - Deployed both binary and built source to a pseudo cluster, passed > the > > > following sanity tests in insecure and SSL mode: > > > - HDFS basic and ACL > > > - DistCp basic > > > - MapReduce wordcount > > > - KMS and HttpFS basic > > > - Balancer start/stop > > > > > > > > > Non-blockers > > > > > > - HADOOP-13030 Handle special characters in passwords in KMS startup > > > script. Fixed in 2.8+. > > > - NameNode servlets test failures: 403 User dr.who is unauthorized to > > > access this page. Researching. Could be just test configuration > issue. > > > > > > John > > > > > > On Tue, Dec 12, 2017 at 1:10 PM, Eric Badger > > > > wrote: > > > > > >> Thanks, Junping > > >> > > >> +1 (non-binding) looks good from my end > > >> > > >> - Verified all hashes and checksums > > >> - Built from source on macOS 10.12.6, Java 1.8.0u65 > > >> - Deployed a pseudo cluster > > >> - Ran some example jobs > > >> > > >> Eric > > >> > > >> On Tue, Dec 12, 2017 at 12:55 PM, Konstantin Shvachko < > > >> shv.had...@gmail.com> > > >> wrote: > > >> > > >>> Downloaded again, now the checksums look good. Sorry my fault > > >>> > > >>> Thanks, > > >>> --Konstantin > > >>> > > >>> On Mon, Dec 11, 2017 at 5:03 PM, Junping Du > > wrote: > > >>> > > >>>> Hi Konstantin, > > >>>> > > >>>> Thanks for verification and comments. I was verifying your > example > > >>>> below but found it is actually matched: > > >>>> > > >>>> > > >>>> *jduMBP:hadoop-2.8.3 jdu$ md5 ~/Downloads/hadoop-2.8.3-src.tar.gz* > > >>>> *MD5 (/Users/jdu/Downloads/hadoop-2.8.3-src.tar.gz) = > > >>>> e53d04477b85e8b58ac0a26468f04736* > > >>>> > > >>>> What's your md5 checksum for given source tar ball? > > >>>> > > >>>> > > >>>> Thanks, > > >>>> > > >>>> > > >>>> Junping > > >>>> > > >>>> > > >>>> -- > > >>>> *From:* Konstantin Shvachko > > >>>> *Sent:* Saturday, December 9, 2017 11:06 AM > > >>>> *To:* Junping Du > > >>>> *Cc:* common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; > > >>>> mapreduce-...@hadoop.apache.org; yarn-dev@hadoop.apache.org > > >>>> *Subject:* Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0) > > >>>> > > >>>> Hey Junping, > > >>>> > > >>>> Could you pls upload mds relative to the tar.gz etc. files rather > than > > >>>> their full path > > >>>> /build/source/target/artifacts/hadoop-2.8.3-src.tar.gz: > > >>>> MD5 = E5 3D 04 47 7B 85 E8 B5 8A C0 A2 64 68 F0 47 36 > > >>>> > > >>>> Otherwise mds don't match for me. > > >>>> > > >>>> Thanks, > > >>>> --Konstantin > > >>>> > > >>>> On Tue, Dec 5, 2017 at 1:58 AM, Junping Du > > >> wrote: > > >>>> > > >>>>> Hi all, > > >>>>> I've created the first release candidate (RC0) for Apache > Hadoop > > >>>>> 2.8.3. This is our next maint release to follow up 2.8.2. It > includes > > >> 79 > > >>>>> important fixes and improvements. > > >>>>> > > >>>>> The RC artifacts are available at: > > >> http://home.apache.org/~junpin > > >>>>> g_du/hadoop-2.8.3-RC0 > > >>>>> > > >>>>> The RC tag in git is: release-2.8.3-RC0 > > >>>>> > > >>>>> The maven artifacts are available via repository.apache.org > at: > > >>>>> https://repository.apache.org/content/repositories/ > > >> orgapachehadoop-1072 > > >>>>> > > >>>>> Please try the release and vote; the vote will run for the > > >> usual 5 > > >>>>> working days, ending on 12/12/2017 PST time. > > >>>>> > > >>>>> Thanks, > > >>>>> > > >>>>> Junping > > >>>>> > > >>>> > > >>>> > > >>> > > >> > > > > > > > > > > > > -- > > > John > > > > > > - > > To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org > > For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org > > > > >
Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)
+1 Built the source code. Deployed a single node cluster and ran example jobs. Also tested RM recovery. Thanks, Chandni On Tue, Dec 12, 2017 at 4:37 PM, Jian He wrote: > +1 > I built from source code > deployed a cluster > and successfully ran jobs while restarting RM as well > > Jian > > > > On Dec 12, 2017, at 4:28 PM, John Zhuge wrote: > > > > Thanks Junping for the great effort! > > > > > > - Verified checksums and signatures of all tarballs > > - Built source with native, Azul Java 1.7.0_161 on Mac OS X 10.13.2 > > - Verified cloud connectors: > > - All S3A integration tests > > - Deployed both binary and built source to a pseudo cluster, passed the > > following sanity tests in insecure and SSL mode: > > - HDFS basic and ACL > > - DistCp basic > > - MapReduce wordcount > > - KMS and HttpFS basic > > - Balancer start/stop > > > > > > Non-blockers > > > > - HADOOP-13030 Handle special characters in passwords in KMS startup > > script. Fixed in 2.8+. > > - NameNode servlets test failures: 403 User dr.who is unauthorized to > > access this page. Researching. Could be just test configuration issue. > > > > John > > > > On Tue, Dec 12, 2017 at 1:10 PM, Eric Badger > > wrote: > > > >> Thanks, Junping > >> > >> +1 (non-binding) looks good from my end > >> > >> - Verified all hashes and checksums > >> - Built from source on macOS 10.12.6, Java 1.8.0u65 > >> - Deployed a pseudo cluster > >> - Ran some example jobs > >> > >> Eric > >> > >> On Tue, Dec 12, 2017 at 12:55 PM, Konstantin Shvachko < > >> shv.had...@gmail.com> > >> wrote: > >> > >>> Downloaded again, now the checksums look good. Sorry my fault > >>> > >>> Thanks, > >>> --Konstantin > >>> > >>> On Mon, Dec 11, 2017 at 5:03 PM, Junping Du > wrote: > >>> > >>>> Hi Konstantin, > >>>> > >>>> Thanks for verification and comments. I was verifying your example > >>>> below but found it is actually matched: > >>>> > >>>> > >>>> *jduMBP:hadoop-2.8.3 jdu$ md5 ~/Downloads/hadoop-2.8.3-src.tar.gz* > >>>> *MD5 (/Users/jdu/Downloads/hadoop-2.8.3-src.tar.gz) = > >>>> e53d04477b85e8b58ac0a26468f04736* > >>>> > >>>> What's your md5 checksum for given source tar ball? > >>>> > >>>> > >>>> Thanks, > >>>> > >>>> > >>>> Junping > >>>> > >>>> > >>>> -- > >>>> *From:* Konstantin Shvachko > >>>> *Sent:* Saturday, December 9, 2017 11:06 AM > >>>> *To:* Junping Du > >>>> *Cc:* common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; > >>>> mapreduce-...@hadoop.apache.org; yarn-dev@hadoop.apache.org > >>>> *Subject:* Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0) > >>>> > >>>> Hey Junping, > >>>> > >>>> Could you pls upload mds relative to the tar.gz etc. files rather than > >>>> their full path > >>>> /build/source/target/artifacts/hadoop-2.8.3-src.tar.gz: > >>>> MD5 = E5 3D 04 47 7B 85 E8 B5 8A C0 A2 64 68 F0 47 36 > >>>> > >>>> Otherwise mds don't match for me. > >>>> > >>>> Thanks, > >>>> --Konstantin > >>>> > >>>> On Tue, Dec 5, 2017 at 1:58 AM, Junping Du > >> wrote: > >>>> > >>>>> Hi all, > >>>>> I've created the first release candidate (RC0) for Apache Hadoop > >>>>> 2.8.3. This is our next maint release to follow up 2.8.2. It includes > >> 79 > >>>>> important fixes and improvements. > >>>>> > >>>>> The RC artifacts are available at: > >> http://home.apache.org/~junpin > >>>>> g_du/hadoop-2.8.3-RC0 > >>>>> > >>>>> The RC tag in git is: release-2.8.3-RC0 > >>>>> > >>>>> The maven artifacts are available via repository.apache.org at: > >>>>> https://repository.apache.org/content/repositories/ > >> orgapachehadoop-1072 > >>>>> > >>>>> Please try the release and vote; the vote will run for the > >> usual 5 > >>>>> working days, ending on 12/12/2017 PST time. > >>>>> > >>>>> Thanks, > >>>>> > >>>>> Junping > >>>>> > >>>> > >>>> > >>> > >> > > > > > > > > -- > > John > > > - > To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org > >
Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)
+1 I built from source code deployed a cluster and successfully ran jobs while restarting RM as well Jian > On Dec 12, 2017, at 4:28 PM, John Zhuge wrote: > > Thanks Junping for the great effort! > > > - Verified checksums and signatures of all tarballs > - Built source with native, Azul Java 1.7.0_161 on Mac OS X 10.13.2 > - Verified cloud connectors: > - All S3A integration tests > - Deployed both binary and built source to a pseudo cluster, passed the > following sanity tests in insecure and SSL mode: > - HDFS basic and ACL > - DistCp basic > - MapReduce wordcount > - KMS and HttpFS basic > - Balancer start/stop > > > Non-blockers > > - HADOOP-13030 Handle special characters in passwords in KMS startup > script. Fixed in 2.8+. > - NameNode servlets test failures: 403 User dr.who is unauthorized to > access this page. Researching. Could be just test configuration issue. > > John > > On Tue, Dec 12, 2017 at 1:10 PM, Eric Badger > wrote: > >> Thanks, Junping >> >> +1 (non-binding) looks good from my end >> >> - Verified all hashes and checksums >> - Built from source on macOS 10.12.6, Java 1.8.0u65 >> - Deployed a pseudo cluster >> - Ran some example jobs >> >> Eric >> >> On Tue, Dec 12, 2017 at 12:55 PM, Konstantin Shvachko < >> shv.had...@gmail.com> >> wrote: >> >>> Downloaded again, now the checksums look good. Sorry my fault >>> >>> Thanks, >>> --Konstantin >>> >>> On Mon, Dec 11, 2017 at 5:03 PM, Junping Du wrote: >>> >>>> Hi Konstantin, >>>> >>>> Thanks for verification and comments. I was verifying your example >>>> below but found it is actually matched: >>>> >>>> >>>> *jduMBP:hadoop-2.8.3 jdu$ md5 ~/Downloads/hadoop-2.8.3-src.tar.gz* >>>> *MD5 (/Users/jdu/Downloads/hadoop-2.8.3-src.tar.gz) = >>>> e53d04477b85e8b58ac0a26468f04736* >>>> >>>> What's your md5 checksum for given source tar ball? >>>> >>>> >>>> Thanks, >>>> >>>> >>>> Junping >>>> >>>> >>>> -- >>>> *From:* Konstantin Shvachko >>>> *Sent:* Saturday, December 9, 2017 11:06 AM >>>> *To:* Junping Du >>>> *Cc:* common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; >>>> mapreduce-...@hadoop.apache.org; yarn-dev@hadoop.apache.org >>>> *Subject:* Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0) >>>> >>>> Hey Junping, >>>> >>>> Could you pls upload mds relative to the tar.gz etc. files rather than >>>> their full path >>>> /build/source/target/artifacts/hadoop-2.8.3-src.tar.gz: >>>> MD5 = E5 3D 04 47 7B 85 E8 B5 8A C0 A2 64 68 F0 47 36 >>>> >>>> Otherwise mds don't match for me. >>>> >>>> Thanks, >>>> --Konstantin >>>> >>>> On Tue, Dec 5, 2017 at 1:58 AM, Junping Du >> wrote: >>>> >>>>> Hi all, >>>>> I've created the first release candidate (RC0) for Apache Hadoop >>>>> 2.8.3. This is our next maint release to follow up 2.8.2. It includes >> 79 >>>>> important fixes and improvements. >>>>> >>>>> The RC artifacts are available at: >> http://home.apache.org/~junpin >>>>> g_du/hadoop-2.8.3-RC0 >>>>> >>>>> The RC tag in git is: release-2.8.3-RC0 >>>>> >>>>> The maven artifacts are available via repository.apache.org at: >>>>> https://repository.apache.org/content/repositories/ >> orgapachehadoop-1072 >>>>> >>>>> Please try the release and vote; the vote will run for the >> usual 5 >>>>> working days, ending on 12/12/2017 PST time. >>>>> >>>>> Thanks, >>>>> >>>>> Junping >>>>> >>>> >>>> >>> >> > > > > -- > John - To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)
Thanks Junping for the great effort! - Verified checksums and signatures of all tarballs - Built source with native, Azul Java 1.7.0_161 on Mac OS X 10.13.2 - Verified cloud connectors: - All S3A integration tests - Deployed both binary and built source to a pseudo cluster, passed the following sanity tests in insecure and SSL mode: - HDFS basic and ACL - DistCp basic - MapReduce wordcount - KMS and HttpFS basic - Balancer start/stop Non-blockers - HADOOP-13030 Handle special characters in passwords in KMS startup script. Fixed in 2.8+. - NameNode servlets test failures: 403 User dr.who is unauthorized to access this page. Researching. Could be just test configuration issue. John On Tue, Dec 12, 2017 at 1:10 PM, Eric Badger wrote: > Thanks, Junping > > +1 (non-binding) looks good from my end > > - Verified all hashes and checksums > - Built from source on macOS 10.12.6, Java 1.8.0u65 > - Deployed a pseudo cluster > - Ran some example jobs > > Eric > > On Tue, Dec 12, 2017 at 12:55 PM, Konstantin Shvachko < > shv.had...@gmail.com> > wrote: > > > Downloaded again, now the checksums look good. Sorry my fault > > > > Thanks, > > --Konstantin > > > > On Mon, Dec 11, 2017 at 5:03 PM, Junping Du wrote: > > > > > Hi Konstantin, > > > > > > Thanks for verification and comments. I was verifying your example > > > below but found it is actually matched: > > > > > > > > > *jduMBP:hadoop-2.8.3 jdu$ md5 ~/Downloads/hadoop-2.8.3-src.tar.gz* > > > *MD5 (/Users/jdu/Downloads/hadoop-2.8.3-src.tar.gz) = > > > e53d04477b85e8b58ac0a26468f04736* > > > > > > What's your md5 checksum for given source tar ball? > > > > > > > > > Thanks, > > > > > > > > > Junping > > > > > > > > > ------ > > > *From:* Konstantin Shvachko > > > *Sent:* Saturday, December 9, 2017 11:06 AM > > > *To:* Junping Du > > > *Cc:* common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; > > > mapreduce-...@hadoop.apache.org; yarn-dev@hadoop.apache.org > > > *Subject:* Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0) > > > > > > Hey Junping, > > > > > > Could you pls upload mds relative to the tar.gz etc. files rather than > > > their full path > > > /build/source/target/artifacts/hadoop-2.8.3-src.tar.gz: > > >MD5 = E5 3D 04 47 7B 85 E8 B5 8A C0 A2 64 68 F0 47 36 > > > > > > Otherwise mds don't match for me. > > > > > > Thanks, > > > --Konstantin > > > > > > On Tue, Dec 5, 2017 at 1:58 AM, Junping Du > wrote: > > > > > >> Hi all, > > >> I've created the first release candidate (RC0) for Apache Hadoop > > >> 2.8.3. This is our next maint release to follow up 2.8.2. It includes > 79 > > >> important fixes and improvements. > > >> > > >> The RC artifacts are available at: > http://home.apache.org/~junpin > > >> g_du/hadoop-2.8.3-RC0 > > >> > > >> The RC tag in git is: release-2.8.3-RC0 > > >> > > >> The maven artifacts are available via repository.apache.org at: > > >> https://repository.apache.org/content/repositories/ > orgapachehadoop-1072 > > >> > > >> Please try the release and vote; the vote will run for the > usual 5 > > >> working days, ending on 12/12/2017 PST time. > > >> > > >> Thanks, > > >> > > >> Junping > > >> > > > > > > > > > -- John
Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)
Thanks, Junping +1 (non-binding) looks good from my end - Verified all hashes and checksums - Built from source on macOS 10.12.6, Java 1.8.0u65 - Deployed a pseudo cluster - Ran some example jobs Eric On Tue, Dec 12, 2017 at 12:55 PM, Konstantin Shvachko wrote: > Downloaded again, now the checksums look good. Sorry my fault > > Thanks, > --Konstantin > > On Mon, Dec 11, 2017 at 5:03 PM, Junping Du wrote: > > > Hi Konstantin, > > > > Thanks for verification and comments. I was verifying your example > > below but found it is actually matched: > > > > > > *jduMBP:hadoop-2.8.3 jdu$ md5 ~/Downloads/hadoop-2.8.3-src.tar.gz* > > *MD5 (/Users/jdu/Downloads/hadoop-2.8.3-src.tar.gz) = > > e53d04477b85e8b58ac0a26468f04736* > > > > What's your md5 checksum for given source tar ball? > > > > > > Thanks, > > > > > > Junping > > > > > > -- > > *From:* Konstantin Shvachko > > *Sent:* Saturday, December 9, 2017 11:06 AM > > *To:* Junping Du > > *Cc:* common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; > > mapreduce-...@hadoop.apache.org; yarn-dev@hadoop.apache.org > > *Subject:* Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0) > > > > Hey Junping, > > > > Could you pls upload mds relative to the tar.gz etc. files rather than > > their full path > > /build/source/target/artifacts/hadoop-2.8.3-src.tar.gz: > >MD5 = E5 3D 04 47 7B 85 E8 B5 8A C0 A2 64 68 F0 47 36 > > > > Otherwise mds don't match for me. > > > > Thanks, > > --Konstantin > > > > On Tue, Dec 5, 2017 at 1:58 AM, Junping Du wrote: > > > >> Hi all, > >> I've created the first release candidate (RC0) for Apache Hadoop > >> 2.8.3. This is our next maint release to follow up 2.8.2. It includes 79 > >> important fixes and improvements. > >> > >> The RC artifacts are available at: http://home.apache.org/~junpin > >> g_du/hadoop-2.8.3-RC0 > >> > >> The RC tag in git is: release-2.8.3-RC0 > >> > >> The maven artifacts are available via repository.apache.org at: > >> https://repository.apache.org/content/repositories/orgapachehadoop-1072 > >> > >> Please try the release and vote; the vote will run for the usual 5 > >> working days, ending on 12/12/2017 PST time. > >> > >> Thanks, > >> > >> Junping > >> > > > > >
Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)
Downloaded again, now the checksums look good. Sorry my fault Thanks, --Konstantin On Mon, Dec 11, 2017 at 5:03 PM, Junping Du wrote: > Hi Konstantin, > > Thanks for verification and comments. I was verifying your example > below but found it is actually matched: > > > *jduMBP:hadoop-2.8.3 jdu$ md5 ~/Downloads/hadoop-2.8.3-src.tar.gz* > *MD5 (/Users/jdu/Downloads/hadoop-2.8.3-src.tar.gz) = > e53d04477b85e8b58ac0a26468f04736* > > What's your md5 checksum for given source tar ball? > > > Thanks, > > > Junping > > > -- > *From:* Konstantin Shvachko > *Sent:* Saturday, December 9, 2017 11:06 AM > *To:* Junping Du > *Cc:* common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; > mapreduce-...@hadoop.apache.org; yarn-dev@hadoop.apache.org > *Subject:* Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0) > > Hey Junping, > > Could you pls upload mds relative to the tar.gz etc. files rather than > their full path > /build/source/target/artifacts/hadoop-2.8.3-src.tar.gz: >MD5 = E5 3D 04 47 7B 85 E8 B5 8A C0 A2 64 68 F0 47 36 > > Otherwise mds don't match for me. > > Thanks, > --Konstantin > > On Tue, Dec 5, 2017 at 1:58 AM, Junping Du wrote: > >> Hi all, >> I've created the first release candidate (RC0) for Apache Hadoop >> 2.8.3. This is our next maint release to follow up 2.8.2. It includes 79 >> important fixes and improvements. >> >> The RC artifacts are available at: http://home.apache.org/~junpin >> g_du/hadoop-2.8.3-RC0 >> >> The RC tag in git is: release-2.8.3-RC0 >> >> The maven artifacts are available via repository.apache.org at: >> https://repository.apache.org/content/repositories/orgapachehadoop-1072 >> >> Please try the release and vote; the vote will run for the usual 5 >> working days, ending on 12/12/2017 PST time. >> >> Thanks, >> >> Junping >> > >
Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)
Thanks for driving this release, Junping! +1 (binding) - Verified signatures and digests - Successfully performed native build from source - Deployed a single-node cluster - Ran some test jobs and examined the logs Jason On Tue, Dec 5, 2017 at 3:58 AM, Junping Du wrote: > Hi all, > I've created the first release candidate (RC0) for Apache Hadoop > 2.8.3. This is our next maint release to follow up 2.8.2. It includes 79 > important fixes and improvements. > > The RC artifacts are available at: http://home.apache.org/~ > junping_du/hadoop-2.8.3-RC0 > > The RC tag in git is: release-2.8.3-RC0 > > The maven artifacts are available via repository.apache.org at: > https://repository.apache.org/content/repositories/orgapachehadoop-1072 > > Please try the release and vote; the vote will run for the usual 5 > working days, ending on 12/12/2017 PST time. > > Thanks, > > Junping >
Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)
+1 non-binding. - Built and installed from source on a pseudo distributed cluster. - Ran sample jobs like wordcount, sleep etc. - Ran Tez 0.9 sample jobs. Regards, Kuhu On Mon, Dec 11, 2017 at 7:31 PM, Brahma Reddy Battula wrote: > +1 (non-binding), thanks Junping for driving this. > > > --Built from the source > --Installaed 3 Node HA cluster > --Verified Basic shell Commands > --Browsed the HDFS/YARN web UI > --Ran sample pi,wordcount jobs > > --Brahma Reddy Battula > > > On Tue, Dec 5, 2017 at 3:28 PM, Junping Du wrote: > > > Hi all, > > I've created the first release candidate (RC0) for Apache Hadoop > > 2.8.3. This is our next maint release to follow up 2.8.2. It includes 79 > > important fixes and improvements. > > > > The RC artifacts are available at: http://home.apache.org/~ > > junping_du/hadoop-2.8.3-RC0 > > > > The RC tag in git is: release-2.8.3-RC0 > > > > The maven artifacts are available via repository.apache.org at: > > https://repository.apache.org/content/repositories/orgapachehadoop-1072 > > > > Please try the release and vote; the vote will run for the usual 5 > > working days, ending on 12/12/2017 PST time. > > > > Thanks, > > > > Junping > > > > > > -- > > > > --Brahma Reddy Battula >
Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)
+1 (non-binding), thanks Junping for driving this. --Built from the source --Installaed 3 Node HA cluster --Verified Basic shell Commands --Browsed the HDFS/YARN web UI --Ran sample pi,wordcount jobs --Brahma Reddy Battula On Tue, Dec 5, 2017 at 3:28 PM, Junping Du wrote: > Hi all, > I've created the first release candidate (RC0) for Apache Hadoop > 2.8.3. This is our next maint release to follow up 2.8.2. It includes 79 > important fixes and improvements. > > The RC artifacts are available at: http://home.apache.org/~ > junping_du/hadoop-2.8.3-RC0 > > The RC tag in git is: release-2.8.3-RC0 > > The maven artifacts are available via repository.apache.org at: > https://repository.apache.org/content/repositories/orgapachehadoop-1072 > > Please try the release and vote; the vote will run for the usual 5 > working days, ending on 12/12/2017 PST time. > > Thanks, > > Junping > -- --Brahma Reddy Battula
Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)
Hi Konstantin, Thanks for verification and comments. I was verifying your example below but found it is actually matched: jduMBP:hadoop-2.8.3 jdu$ md5 ~/Downloads/hadoop-2.8.3-src.tar.gz MD5 (/Users/jdu/Downloads/hadoop-2.8.3-src.tar.gz) = e53d04477b85e8b58ac0a26468f04736 What's your md5 checksum for given source tar ball? Thanks, Junping From: Konstantin Shvachko Sent: Saturday, December 9, 2017 11:06 AM To: Junping Du Cc: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org; yarn-dev@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0) Hey Junping, Could you pls upload mds relative to the tar.gz etc. files rather than their full path /build/source/target/artifacts/hadoop-2.8.3-src.tar.gz: MD5 = E5 3D 04 47 7B 85 E8 B5 8A C0 A2 64 68 F0 47 36 Otherwise mds don't match for me. Thanks, --Konstantin On Tue, Dec 5, 2017 at 1:58 AM, Junping Du mailto:j...@hortonworks.com>> wrote: Hi all, I've created the first release candidate (RC0) for Apache Hadoop 2.8.3. This is our next maint release to follow up 2.8.2. It includes 79 important fixes and improvements. The RC artifacts are available at: http://home.apache.org/~junping_du/hadoop-2.8.3-RC0 The RC tag in git is: release-2.8.3-RC0 The maven artifacts are available via repository.apache.org<http://repository.apache.org> at: https://repository.apache.org/content/repositories/orgapachehadoop-1072 Please try the release and vote; the vote will run for the usual 5 working days, ending on 12/12/2017 PST time. Thanks, Junping
Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)
Thanks Eric for verification! A kindly reminder: The original due date for 2.8.3 voting is tomorrow but I only receive 1 binding vote so far - we have 76 PMCs and 127 Committers! I can understand the whole community are busy with 3 release RC voting (2.7.5, 2.8.3 and 3.0.0) and may be it is necessary to extend the voting period for a few more days. But please try as much as possible to verify our release bits. Thanks! Thanks, Junping? From: Eric Payne Sent: Monday, December 11, 2017 1:51 PM To: Junping Du; common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org; yarn-dev@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0) Thanks Junping for the hard work on this release. +1 (binding) On a 6 node pseudo cluster (4 NMs), I performed the following manual tests: - Built and installed from source - Successfully ran a stream job - Verified that user weights are honored by assigning the appropriate amount of resources to the weighted users. - Ensured that FiarOrderingPolicy and FifoOrderingPolicy worked in the Capacity Scheduler as expected - Applications with higher priorities are assigned containers as expected in the FifoOrderingPolicy of the Capacity Scheduler until the user reaches its user resource limit. Eric Payne From: Junping Du To: "common-...@hadoop.apache.org" ; "hdfs-...@hadoop.apache.org" ; "mapreduce-...@hadoop.apache.org" ; "yarn-dev@hadoop.apache.org" Sent: Tuesday, December 5, 2017 3:58 AM Subject: [VOTE] Release Apache Hadoop 2.8.3 (RC0) Hi all, I've created the first release candidate (RC0) for Apache Hadoop 2.8.3. This is our next maint release to follow up 2.8.2. It includes 79 important fixes and improvements. The RC artifacts are available at: http://home.apache.org/~junping_du/hadoop-2.8.3-RC0 The RC tag in git is: release-2.8.3-RC0 The maven artifacts are available via repository.apache.org at: https://repository.apache.org/content/repositories/orgapachehadoop-1072 Please try the release and vote; the vote will run for the usual 5 working days, ending on 12/12/2017 PST time. Thanks, Junping
Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)
Hey Junping, Could you pls upload mds relative to the tar.gz etc. files rather than their full path /build/source/target/artifacts/hadoop-2.8.3-src.tar.gz: MD5 = E5 3D 04 47 7B 85 E8 B5 8A C0 A2 64 68 F0 47 36 Otherwise mds don't match for me. Thanks, --Konstantin On Tue, Dec 5, 2017 at 1:58 AM, Junping Du wrote: > Hi all, > I've created the first release candidate (RC0) for Apache Hadoop > 2.8.3. This is our next maint release to follow up 2.8.2. It includes 79 > important fixes and improvements. > > The RC artifacts are available at: http://home.apache.org/~ > junping_du/hadoop-2.8.3-RC0 > > The RC tag in git is: release-2.8.3-RC0 > > The maven artifacts are available via repository.apache.org at: > https://repository.apache.org/content/repositories/orgapachehadoop-1072 > > Please try the release and vote; the vote will run for the usual 5 > working days, ending on 12/12/2017 PST time. > > Thanks, > > Junping >
[VOTE] Release Apache Hadoop 2.8.3 (RC0)
Hi all, I've created the first release candidate (RC0) for Apache Hadoop 2.8.3. This is our next maint release to follow up 2.8.2. It includes 79 important fixes and improvements. The RC artifacts are available at: http://home.apache.org/~junping_du/hadoop-2.8.3-RC0 The RC tag in git is: release-2.8.3-RC0 The maven artifacts are available via repository.apache.org at: https://repository.apache.org/content/repositories/orgapachehadoop-1072 Please try the release and vote; the vote will run for the usual 5 working days, ending on 12/12/2017 PST time. Thanks, Junping
