Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0
+1 (non-binding) Tested from building tar ball from binary. - Ran few MR jobs with node labels - Verified old and new YARN ui - Checked preemption as well Thanks Sunil On Fri, Jun 30, 2017 at 8:11 AM Andrew Wang wrote: > Hi all, > > As always, thanks to the many, many contributors who helped with this > release! I've prepared an RC0 for 3.0.0-alpha4: > > http://home.apache.org/~wang/3.0.0-alpha4-RC0/ > > The standard 5-day vote would run until midnight on Tuesday, July 4th. > Given that July 4th is a holiday in the US, I expect this vote might have > to be extended, but I'd like to close the vote relatively soon after. > > I've done my traditional testing of a pseudo-distributed cluster with a > single task pi job, which was successful. > > Normally my testing would end there, but I'm slightly more confident this > time. At Cloudera, we've successfully packaged and deployed a snapshot from > a few days ago, and run basic smoke tests. Some bugs found from this > include HDFS-11956, which fixes backwards compat with Hadoop 2 clients, and > the revert of HDFS-11696, which broke NN QJM HA setup. > > Vijay is working on a test run with a fuller test suite (the results of > which we can hopefully post soon). > > My +1 to start, > > Best, > Andrew >
Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0
Thanks again everyone for voting! I'm going to close this vote. With 4 binding +1s and 8 non-binding +1s, the vote passes. I'll go ahead and push out the release. Best, Andrew On Fri, Jul 7, 2017 at 10:35 AM, Andrew Wang wrote: > Hi Mike, the artifacts are staged on Nexus: > > https://repository.apache.org/content/repositories/orgapachehadoop-1060/ > > Best, > Andrew > > On Fri, Jul 7, 2017 at 1:34 AM, Mike Drob wrote: > >> Hi Andrew, >> >> Are there maven artifacts available for this RC? >> >> Thanks, >> Mike >> >> On 2017-06-29 19:40 (-0700), Andrew Wang >> wrote: >> > Hi all, >> > >> > As always, thanks to the many, many contributors who helped with this >> > release! I've prepared an RC0 for 3.0.0-alpha4: >> > >> > http://home.apache.org/~wang/3.0.0-alpha4-RC0/ >> > >> > The standard 5-day vote would run until midnight on Tuesday, July 4th. >> > Given that July 4th is a holiday in the US, I expect this vote might >> have >> > to be extended, but I'd like to close the vote relatively soon after. >> > >> > I've done my traditional testing of a pseudo-distributed cluster with a >> > single task pi job, which was successful. >> > >> > Normally my testing would end there, but I'm slightly more confident >> this >> > time. At Cloudera, we've successfully packaged and deployed a snapshot >> from >> > a few days ago, and run basic smoke tests. Some bugs found from this >> > include HDFS-11956, which fixes backwards compat with Hadoop 2 clients, >> and >> > the revert of HDFS-11696, which broke NN QJM HA setup. >> > >> > Vijay is working on a test run with a fuller test suite (the results of >> > which we can hopefully post soon). >> > >> > My 1 to start, >> > >> > Best, >> > Andrew >> > >> > >
Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0
Hi Mike, the artifacts are staged on Nexus: https://repository.apache.org/content/repositories/orgapachehadoop-1060/ Best, Andrew On Fri, Jul 7, 2017 at 1:34 AM, Mike Drob wrote: > Hi Andrew, > > Are there maven artifacts available for this RC? > > Thanks, > Mike > > On 2017-06-29 19:40 (-0700), Andrew Wang wrote: > > Hi all, > > > > As always, thanks to the many, many contributors who helped with this > > release! I've prepared an RC0 for 3.0.0-alpha4: > > > > http://home.apache.org/~wang/3.0.0-alpha4-RC0/ > > > > The standard 5-day vote would run until midnight on Tuesday, July 4th. > > Given that July 4th is a holiday in the US, I expect this vote might have > > to be extended, but I'd like to close the vote relatively soon after. > > > > I've done my traditional testing of a pseudo-distributed cluster with a > > single task pi job, which was successful. > > > > Normally my testing would end there, but I'm slightly more confident this > > time. At Cloudera, we've successfully packaged and deployed a snapshot > from > > a few days ago, and run basic smoke tests. Some bugs found from this > > include HDFS-11956, which fixes backwards compat with Hadoop 2 clients, > and > > the revert of HDFS-11696, which broke NN QJM HA setup. > > > > Vijay is working on a test run with a fuller test suite (the results of > > which we can hopefully post soon). > > > > My 1 to start, > > > > Best, > > Andrew > > >
Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0
Hi Andrew, Are there maven artifacts available for this RC? Thanks, Mike On 2017-06-29 19:40 (-0700), Andrew Wang wrote: > Hi all, > > As always, thanks to the many, many contributors who helped with this > release! I've prepared an RC0 for 3.0.0-alpha4: > > http://home.apache.org/~wang/3.0.0-alpha4-RC0/ > > The standard 5-day vote would run until midnight on Tuesday, July 4th. > Given that July 4th is a holiday in the US, I expect this vote might have > to be extended, but I'd like to close the vote relatively soon after. > > I've done my traditional testing of a pseudo-distributed cluster with a > single task pi job, which was successful. > > Normally my testing would end there, but I'm slightly more confident this > time. At Cloudera, we've successfully packaged and deployed a snapshot from > a few days ago, and run basic smoke tests. Some bugs found from this > include HDFS-11956, which fixes backwards compat with Hadoop 2 clients, and > the revert of HDFS-11696, which broke NN QJM HA setup. > > Vijay is working on a test run with a fuller test suite (the results of > which we can hopefully post soon). > > My 1 to start, > > Best, > Andrew >
Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0
Thanks Andrew! +1 (binding) * Verified signatures and checksums * Built from source on CentOS 7.2 with OpenJDK 1.8.0_131 with -Pnative * Deployed pseudo-distributed cluster and ran some example job * The change log and the release notes look good. Regards, Akira On 2017/06/30 11:40, Andrew Wang wrote: Hi all, As always, thanks to the many, many contributors who helped with this release! I've prepared an RC0 for 3.0.0-alpha4: http://home.apache.org/~wang/3.0.0-alpha4-RC0/ The standard 5-day vote would run until midnight on Tuesday, July 4th. Given that July 4th is a holiday in the US, I expect this vote might have to be extended, but I'd like to close the vote relatively soon after. I've done my traditional testing of a pseudo-distributed cluster with a single task pi job, which was successful. Normally my testing would end there, but I'm slightly more confident this time. At Cloudera, we've successfully packaged and deployed a snapshot from a few days ago, and run basic smoke tests. Some bugs found from this include HDFS-11956, which fixes backwards compat with Hadoop 2 clients, and the revert of HDFS-11696, which broke NN QJM HA setup. Vijay is working on a test run with a fuller test suite (the results of which we can hopefully post soon). My +1 to start, Best, Andrew - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
RE: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0
+1 (non-binding) -Verified checksums and signatures -Built from source and installed HA cluster -Ran basic shell operations -Ran sample jobs. -Verified the HttpFSServerWebServer. -Brahma Reddy Battula -Original Message- From: Andrew Wang [mailto:andrew.w...@cloudera.com] Sent: 30 June 2017 10:41 To: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org; yarn-...@hadoop.apache.org Subject: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0 Hi all, As always, thanks to the many, many contributors who helped with this release! I've prepared an RC0 for 3.0.0-alpha4: http://home.apache.org/~wang/3.0.0-alpha4-RC0/ The standard 5-day vote would run until midnight on Tuesday, July 4th. Given that July 4th is a holiday in the US, I expect this vote might have to be extended, but I'd like to close the vote relatively soon after. I've done my traditional testing of a pseudo-distributed cluster with a single task pi job, which was successful. Normally my testing would end there, but I'm slightly more confident this time. At Cloudera, we've successfully packaged and deployed a snapshot from a few days ago, and run basic smoke tests. Some bugs found from this include HDFS-11956, which fixes backwards compat with Hadoop 2 clients, and the revert of HDFS-11696, which broke NN QJM HA setup. Vijay is working on a test run with a fuller test suite (the results of which we can hopefully post soon). My +1 to start, Best, Andrew
Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0
Thanks Andrew! - Deployed binary artifacts in a pseudo-distributed cluster (MacOS Sierra, Java 1.8.0_91) - Ran pi job - Clicked around the web UIs - Tried log aggregation - Played a bit with HDFS - Tried yarn top +1 (binding) - Robert On Thu, Jul 6, 2017 at 4:21 PM, Hanisha Koneru wrote: > Thanks for the hard work Andrew! > > - Built from source on Mac OS X 10.11.6 with Java 1.8.0_91 > - Built from source on CentOS Linux 7.3.161, with Java 1.8.0_92, with and > without native > - Deployed a 10 node cluster on docker containers > - Tested basic dfs operations > - Tested basic erasure coding (adding files, recovering corrupted > files) > - Tested some dfsadmin operations : report, triggerblockreport > > +1 (non-binding) > > > > Thanks, > Hanisha > > > > > > > > > On 7/6/17, 3:57 PM, "Lei Xu" wrote: > > >+1 (binding) > > > >Ran the following tests: > >* Deploy a pesudo cluster using tar ball, run pi. > >* Verified MD5 of tar balls for both src and dist. > >* Build src tarball with -Pdist,tar > > > >Thanks Andrew for the efforts! > > > >On Thu, Jul 6, 2017 at 3:44 PM, Andrew Wang > wrote: > >> Thanks all for the votes so far! > >> > >> I think we're still at a single binding +1 from myself, so I'll leave > this > >> vote open until we reach the minimum threshold of 3. I'm still hoping to > >> can push the release out before the weekend. > >> > >> On Thu, Jul 6, 2017 at 2:58 PM, Vijaya Krishna Kalluru Subbarao < > >> vij...@cloudera.com> wrote: > >> > >>> Ran Smokes and BVTs covering basic sanity testing(10+ tests ran) for > all > >>> these components: > >>> > >>>- Mapreduce(compression, archives, pipes, JHS), > >>>- Avro(AvroMapreduce, HadoopAvro, HiveAvro, SqoopAvro), > >>>- HBase(Balancer, compression, ImportExport, Snapshots, Schema > >>>change), > >>>- Oozie(Hive, Pig, Spark), > >>>- Pig(PigAvro, PigParquet, PigCompression), > >>>- Search(SolrCtlBasic, SolrRequestForwading, SolrSSLConfiguration). > >>> > >>> +1 non-binding. > >>> > >>> Regards, > >>> Vijay > >>> > >>> On Thu, Jul 6, 2017 at 2:39 PM, Eric Badger > >>> > wrote: > >>> > >>>> - Verified all checksums signatures > >>>> - Built from src on macOS 10.12.5 with Java 1.8.0u65 > >>>> - Deployed single node pseudo cluster > >>>> - Successfully ran sleep and pi jobs > >>>> - Navigated the various UIs > >>>> > >>>> +1 (non-binding) > >>>> > >>>> Thanks, > >>>> > >>>> Eric > >>>> > >>>> On Thursday, July 6, 2017 3:31 PM, Aaron Fabbri > >>>> wrote: > >>>> > >>>> > >>>> > >>>> Thanks for the hard work on this! +1 (non-binding) > >>>> > >>>> - Built from source tarball on OS X w/ Java 1.8.0_45. > >>>> - Deployed mini/pseudo cluster. > >>>> - Ran grep and wordcount examples. > >>>> - Poked around ResourceManager and JobHistory UIs. > >>>> - Ran all s3a integration tests in US West 2. > >>>> > >>>> > >>>> > >>>> On Thu, Jul 6, 2017 at 10:20 AM, Xiao Chen wrote: > >>>> > >>>> > Thanks Andrew! > >>>> > +1 (non-binding) > >>>> > > >>>> >- Verified md5's, checked tarball sizes are reasonable > >>>> >- Built source tarball and deployed a pseudo-distributed cluster > with > >>>> >hdfs/kms > >>>> >- Tested basic hdfs/kms operations > >>>> >- Sanity checked webuis/logs > >>>> > > >>>> > > >>>> > -Xiao > >>>> > > >>>> > On Wed, Jul 5, 2017 at 10:33 PM, John Zhuge > >>>> wrote: > >>>> > > >>>> > > +1 (non-binding) > >>>> > > > >>>> > > > >>>> > >- Verified checksums and signatures of the tarballs > >>>> > >- Built source with native, Java 1.8.0_131 on Mac OS X 10.12.5 > >>>> > > - Cloud connectors: > >>>> > > - A few S3A integration tests > >>&
Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0
Thanks for the hard work Andrew! - Built from source on Mac OS X 10.11.6 with Java 1.8.0_91 - Built from source on CentOS Linux 7.3.161, with Java 1.8.0_92, with and without native - Deployed a 10 node cluster on docker containers - Tested basic dfs operations - Tested basic erasure coding (adding files, recovering corrupted files) - Tested some dfsadmin operations : report, triggerblockreport +1 (non-binding) Thanks, Hanisha On 7/6/17, 3:57 PM, "Lei Xu" wrote: >+1 (binding) > >Ran the following tests: >* Deploy a pesudo cluster using tar ball, run pi. >* Verified MD5 of tar balls for both src and dist. >* Build src tarball with -Pdist,tar > >Thanks Andrew for the efforts! > >On Thu, Jul 6, 2017 at 3:44 PM, Andrew Wang wrote: >> Thanks all for the votes so far! >> >> I think we're still at a single binding +1 from myself, so I'll leave this >> vote open until we reach the minimum threshold of 3. I'm still hoping to >> can push the release out before the weekend. >> >> On Thu, Jul 6, 2017 at 2:58 PM, Vijaya Krishna Kalluru Subbarao < >> vij...@cloudera.com> wrote: >> >>> Ran Smokes and BVTs covering basic sanity testing(10+ tests ran) for all >>> these components: >>> >>>- Mapreduce(compression, archives, pipes, JHS), >>>- Avro(AvroMapreduce, HadoopAvro, HiveAvro, SqoopAvro), >>>- HBase(Balancer, compression, ImportExport, Snapshots, Schema >>>change), >>>- Oozie(Hive, Pig, Spark), >>>- Pig(PigAvro, PigParquet, PigCompression), >>>- Search(SolrCtlBasic, SolrRequestForwading, SolrSSLConfiguration). >>> >>> +1 non-binding. >>> >>> Regards, >>> Vijay >>> >>> On Thu, Jul 6, 2017 at 2:39 PM, Eric Badger >> > wrote: >>> >>>> - Verified all checksums signatures >>>> - Built from src on macOS 10.12.5 with Java 1.8.0u65 >>>> - Deployed single node pseudo cluster >>>> - Successfully ran sleep and pi jobs >>>> - Navigated the various UIs >>>> >>>> +1 (non-binding) >>>> >>>> Thanks, >>>> >>>> Eric >>>> >>>> On Thursday, July 6, 2017 3:31 PM, Aaron Fabbri >>>> wrote: >>>> >>>> >>>> >>>> Thanks for the hard work on this! +1 (non-binding) >>>> >>>> - Built from source tarball on OS X w/ Java 1.8.0_45. >>>> - Deployed mini/pseudo cluster. >>>> - Ran grep and wordcount examples. >>>> - Poked around ResourceManager and JobHistory UIs. >>>> - Ran all s3a integration tests in US West 2. >>>> >>>> >>>> >>>> On Thu, Jul 6, 2017 at 10:20 AM, Xiao Chen wrote: >>>> >>>> > Thanks Andrew! >>>> > +1 (non-binding) >>>> > >>>> >- Verified md5's, checked tarball sizes are reasonable >>>> >- Built source tarball and deployed a pseudo-distributed cluster with >>>> >hdfs/kms >>>> >- Tested basic hdfs/kms operations >>>> >- Sanity checked webuis/logs >>>> > >>>> > >>>> > -Xiao >>>> > >>>> > On Wed, Jul 5, 2017 at 10:33 PM, John Zhuge >>>> wrote: >>>> > >>>> > > +1 (non-binding) >>>> > > >>>> > > >>>> > >- Verified checksums and signatures of the tarballs >>>> > >- Built source with native, Java 1.8.0_131 on Mac OS X 10.12.5 >>>> > >- Cloud connectors: >>>> > > - A few S3A integration tests >>>> > > - A few ADL live unit tests >>>> > >- Deployed both binary and built source to a pseudo cluster, passed >>>> > the >>>> > >following sanity tests in insecure, SSL, and SSL+Kerberos mode: >>>> > > - HDFS basic and ACL >>>> > > - DistCp basic >>>> > > - WordCount (skipped in Kerberos mode) >>>> > > - KMS and HttpFS basic >>>> > > >>>> > > Thanks Andrew for the great effort! >>>> > > >>>> > > On Wed, Jul 5, 2017 at 1:33 PM, Eric Payne >>> > > invalid> >>>> > > wrote: >>>> > > >>>> > > > Thanks Andrew. >>>> > > > I downloaded the source, built
Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0
+1 (binding) Ran the following tests: * Deploy a pesudo cluster using tar ball, run pi. * Verified MD5 of tar balls for both src and dist. * Build src tarball with -Pdist,tar Thanks Andrew for the efforts! On Thu, Jul 6, 2017 at 3:44 PM, Andrew Wang wrote: > Thanks all for the votes so far! > > I think we're still at a single binding +1 from myself, so I'll leave this > vote open until we reach the minimum threshold of 3. I'm still hoping to > can push the release out before the weekend. > > On Thu, Jul 6, 2017 at 2:58 PM, Vijaya Krishna Kalluru Subbarao < > vij...@cloudera.com> wrote: > >> Ran Smokes and BVTs covering basic sanity testing(10+ tests ran) for all >> these components: >> >>- Mapreduce(compression, archives, pipes, JHS), >>- Avro(AvroMapreduce, HadoopAvro, HiveAvro, SqoopAvro), >>- HBase(Balancer, compression, ImportExport, Snapshots, Schema >>change), >>- Oozie(Hive, Pig, Spark), >>- Pig(PigAvro, PigParquet, PigCompression), >>- Search(SolrCtlBasic, SolrRequestForwading, SolrSSLConfiguration). >> >> +1 non-binding. >> >> Regards, >> Vijay >> >> On Thu, Jul 6, 2017 at 2:39 PM, Eric Badger > > wrote: >> >>> - Verified all checksums signatures >>> - Built from src on macOS 10.12.5 with Java 1.8.0u65 >>> - Deployed single node pseudo cluster >>> - Successfully ran sleep and pi jobs >>> - Navigated the various UIs >>> >>> +1 (non-binding) >>> >>> Thanks, >>> >>> Eric >>> >>> On Thursday, July 6, 2017 3:31 PM, Aaron Fabbri >>> wrote: >>> >>> >>> >>> Thanks for the hard work on this! +1 (non-binding) >>> >>> - Built from source tarball on OS X w/ Java 1.8.0_45. >>> - Deployed mini/pseudo cluster. >>> - Ran grep and wordcount examples. >>> - Poked around ResourceManager and JobHistory UIs. >>> - Ran all s3a integration tests in US West 2. >>> >>> >>> >>> On Thu, Jul 6, 2017 at 10:20 AM, Xiao Chen wrote: >>> >>> > Thanks Andrew! >>> > +1 (non-binding) >>> > >>> >- Verified md5's, checked tarball sizes are reasonable >>> >- Built source tarball and deployed a pseudo-distributed cluster with >>> >hdfs/kms >>> >- Tested basic hdfs/kms operations >>> >- Sanity checked webuis/logs >>> > >>> > >>> > -Xiao >>> > >>> > On Wed, Jul 5, 2017 at 10:33 PM, John Zhuge >>> wrote: >>> > >>> > > +1 (non-binding) >>> > > >>> > > >>> > >- Verified checksums and signatures of the tarballs >>> > >- Built source with native, Java 1.8.0_131 on Mac OS X 10.12.5 >>> > >- Cloud connectors: >>> > > - A few S3A integration tests >>> > > - A few ADL live unit tests >>> > >- Deployed both binary and built source to a pseudo cluster, passed >>> > the >>> > >following sanity tests in insecure, SSL, and SSL+Kerberos mode: >>> > > - HDFS basic and ACL >>> > > - DistCp basic >>> > > - WordCount (skipped in Kerberos mode) >>> > > - KMS and HttpFS basic >>> > > >>> > > Thanks Andrew for the great effort! >>> > > >>> > > On Wed, Jul 5, 2017 at 1:33 PM, Eric Payne >> > > invalid> >>> > > wrote: >>> > > >>> > > > Thanks Andrew. >>> > > > I downloaded the source, built it, and installed it onto a pseudo >>> > > > distributed 4-node cluster. >>> > > > >>> > > > I ran mapred and streaming test cases, including sleep and >>> wordcount. >>> > > > +1 (non-binding) >>> > > > -Eric >>> > > > >>> > > > From: Andrew Wang >>> > > > To: "common-dev@hadoop.apache.org" ; >>> " >>> > > > hdfs-...@hadoop.apache.org" ; " >>> > > > mapreduce-...@hadoop.apache.org" ; >>> " >>> > > > yarn-...@hadoop.apache.org" >>> > > > Sent: Thursday, June 29, 2017 9:41 PM >>> > > > Subject: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0 >>> > > > >>> > > >
Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0
Thanks all for the votes so far! I think we're still at a single binding +1 from myself, so I'll leave this vote open until we reach the minimum threshold of 3. I'm still hoping to can push the release out before the weekend. On Thu, Jul 6, 2017 at 2:58 PM, Vijaya Krishna Kalluru Subbarao < vij...@cloudera.com> wrote: > Ran Smokes and BVTs covering basic sanity testing(10+ tests ran) for all > these components: > >- Mapreduce(compression, archives, pipes, JHS), >- Avro(AvroMapreduce, HadoopAvro, HiveAvro, SqoopAvro), >- HBase(Balancer, compression, ImportExport, Snapshots, Schema >change), >- Oozie(Hive, Pig, Spark), >- Pig(PigAvro, PigParquet, PigCompression), >- Search(SolrCtlBasic, SolrRequestForwading, SolrSSLConfiguration). > > +1 non-binding. > > Regards, > Vijay > > On Thu, Jul 6, 2017 at 2:39 PM, Eric Badger > wrote: > >> - Verified all checksums signatures >> - Built from src on macOS 10.12.5 with Java 1.8.0u65 >> - Deployed single node pseudo cluster >> - Successfully ran sleep and pi jobs >> - Navigated the various UIs >> >> +1 (non-binding) >> >> Thanks, >> >> Eric >> >> On Thursday, July 6, 2017 3:31 PM, Aaron Fabbri >> wrote: >> >> >> >> Thanks for the hard work on this! +1 (non-binding) >> >> - Built from source tarball on OS X w/ Java 1.8.0_45. >> - Deployed mini/pseudo cluster. >> - Ran grep and wordcount examples. >> - Poked around ResourceManager and JobHistory UIs. >> - Ran all s3a integration tests in US West 2. >> >> >> >> On Thu, Jul 6, 2017 at 10:20 AM, Xiao Chen wrote: >> >> > Thanks Andrew! >> > +1 (non-binding) >> > >> >- Verified md5's, checked tarball sizes are reasonable >> >- Built source tarball and deployed a pseudo-distributed cluster with >> >hdfs/kms >> >- Tested basic hdfs/kms operations >> >- Sanity checked webuis/logs >> > >> > >> > -Xiao >> > >> > On Wed, Jul 5, 2017 at 10:33 PM, John Zhuge >> wrote: >> > >> > > +1 (non-binding) >> > > >> > > >> > >- Verified checksums and signatures of the tarballs >> > >- Built source with native, Java 1.8.0_131 on Mac OS X 10.12.5 >> > >- Cloud connectors: >> > > - A few S3A integration tests >> > > - A few ADL live unit tests >> > >- Deployed both binary and built source to a pseudo cluster, passed >> > the >> > >following sanity tests in insecure, SSL, and SSL+Kerberos mode: >> > > - HDFS basic and ACL >> > > - DistCp basic >> > > - WordCount (skipped in Kerberos mode) >> > > - KMS and HttpFS basic >> > > >> > > Thanks Andrew for the great effort! >> > > >> > > On Wed, Jul 5, 2017 at 1:33 PM, Eric Payne > > > invalid> >> > > wrote: >> > > >> > > > Thanks Andrew. >> > > > I downloaded the source, built it, and installed it onto a pseudo >> > > > distributed 4-node cluster. >> > > > >> > > > I ran mapred and streaming test cases, including sleep and >> wordcount. >> > > > +1 (non-binding) >> > > > -Eric >> > > > >> > > > From: Andrew Wang >> > > > To: "common-dev@hadoop.apache.org" ; >> " >> > > > hdfs-...@hadoop.apache.org" ; " >> > > > mapreduce-...@hadoop.apache.org" ; >> " >> > > > yarn-...@hadoop.apache.org" >> > > > Sent: Thursday, June 29, 2017 9:41 PM >> > > > Subject: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0 >> > > > >> > > > Hi all, >> > > > >> > > > As always, thanks to the many, many contributors who helped with >> this >> > > > release! I've prepared an RC0 for 3.0.0-alpha4: >> > > > >> > > > http://home.apache.org/~wang/3.0.0-alpha4-RC0/ >> > > > >> > > > The standard 5-day vote would run until midnight on Tuesday, July >> 4th. >> > > > Given that July 4th is a holiday in the US, I expect this vote might >> > have >> > > > to be extended, but I'd like to close the vote relatively soon >> after. >> > > > >> > > > I've done my traditional testing of a pseudo-distributed cluster >> with a >> > > > single task pi job, which was successful. >> > > > >> > > > Normally my testing would end there, but I'm slightly more confident >> > this >> > > > time. At Cloudera, we've successfully packaged and deployed a >> snapshot >> > > from >> > > > a few days ago, and run basic smoke tests. Some bugs found from this >> > > > include HDFS-11956, which fixes backwards compat with Hadoop 2 >> clients, >> > > and >> > > > the revert of HDFS-11696, which broke NN QJM HA setup. >> > > > >> > > > Vijay is working on a test run with a fuller test suite (the >> results of >> > > > which we can hopefully post soon). >> > > > >> > > > My +1 to start, >> > > > >> > > > Best, >> > > > Andrew >> > > > >> > > > >> > > > >> > > > >> > > >> > > >> > > >> > > -- >> > > John >> > > >> > >> >> - >> To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org >> For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org >> >> > > > -- > Thanks, > Vijay >
Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0
- Verified all checksums signatures - Built from src on macOS 10.12.5 with Java 1.8.0u65 - Deployed single node pseudo cluster - Successfully ran sleep and pi jobs - Navigated the various UIs +1 (non-binding) Thanks, Eric On Thursday, July 6, 2017 3:31 PM, Aaron Fabbri wrote: Thanks for the hard work on this! +1 (non-binding) - Built from source tarball on OS X w/ Java 1.8.0_45. - Deployed mini/pseudo cluster. - Ran grep and wordcount examples. - Poked around ResourceManager and JobHistory UIs. - Ran all s3a integration tests in US West 2. On Thu, Jul 6, 2017 at 10:20 AM, Xiao Chen wrote: > Thanks Andrew! > +1 (non-binding) > >- Verified md5's, checked tarball sizes are reasonable >- Built source tarball and deployed a pseudo-distributed cluster with >hdfs/kms >- Tested basic hdfs/kms operations >- Sanity checked webuis/logs > > > -Xiao > > On Wed, Jul 5, 2017 at 10:33 PM, John Zhuge wrote: > > > +1 (non-binding) > > > > > >- Verified checksums and signatures of the tarballs > >- Built source with native, Java 1.8.0_131 on Mac OS X 10.12.5 > >- Cloud connectors: > > - A few S3A integration tests > > - A few ADL live unit tests > >- Deployed both binary and built source to a pseudo cluster, passed > the > >following sanity tests in insecure, SSL, and SSL+Kerberos mode: > > - HDFS basic and ACL > > - DistCp basic > > - WordCount (skipped in Kerberos mode) > > - KMS and HttpFS basic > > > > Thanks Andrew for the great effort! > > > > On Wed, Jul 5, 2017 at 1:33 PM, Eric Payne > invalid> > > wrote: > > > > > Thanks Andrew. > > > I downloaded the source, built it, and installed it onto a pseudo > > > distributed 4-node cluster. > > > > > > I ran mapred and streaming test cases, including sleep and wordcount. > > > +1 (non-binding) > > > -Eric > > > > > > From: Andrew Wang > > > To: "common-dev@hadoop.apache.org" ; " > > > hdfs-...@hadoop.apache.org" ; " > > > mapreduce-...@hadoop.apache.org" ; " > > > yarn-...@hadoop.apache.org" > > > Sent: Thursday, June 29, 2017 9:41 PM > > > Subject: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0 > > > > > > Hi all, > > > > > > As always, thanks to the many, many contributors who helped with this > > > release! I've prepared an RC0 for 3.0.0-alpha4: > > > > > > http://home.apache.org/~wang/3.0.0-alpha4-RC0/ > > > > > > The standard 5-day vote would run until midnight on Tuesday, July 4th. > > > Given that July 4th is a holiday in the US, I expect this vote might > have > > > to be extended, but I'd like to close the vote relatively soon after. > > > > > > I've done my traditional testing of a pseudo-distributed cluster with a > > > single task pi job, which was successful. > > > > > > Normally my testing would end there, but I'm slightly more confident > this > > > time. At Cloudera, we've successfully packaged and deployed a snapshot > > from > > > a few days ago, and run basic smoke tests. Some bugs found from this > > > include HDFS-11956, which fixes backwards compat with Hadoop 2 clients, > > and > > > the revert of HDFS-11696, which broke NN QJM HA setup. > > > > > > Vijay is working on a test run with a fuller test suite (the results of > > > which we can hopefully post soon). > > > > > > My +1 to start, > > > > > > Best, > > > Andrew > > > > > > > > > > > > > > > > > > > > -- > > John > > > - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0
Thanks for the hard work on this! +1 (non-binding) - Built from source tarball on OS X w/ Java 1.8.0_45. - Deployed mini/pseudo cluster. - Ran grep and wordcount examples. - Poked around ResourceManager and JobHistory UIs. - Ran all s3a integration tests in US West 2. On Thu, Jul 6, 2017 at 10:20 AM, Xiao Chen wrote: > Thanks Andrew! > +1 (non-binding) > >- Verified md5's, checked tarball sizes are reasonable >- Built source tarball and deployed a pseudo-distributed cluster with >hdfs/kms >- Tested basic hdfs/kms operations >- Sanity checked webuis/logs > > > -Xiao > > On Wed, Jul 5, 2017 at 10:33 PM, John Zhuge wrote: > > > +1 (non-binding) > > > > > >- Verified checksums and signatures of the tarballs > >- Built source with native, Java 1.8.0_131 on Mac OS X 10.12.5 > >- Cloud connectors: > > - A few S3A integration tests > > - A few ADL live unit tests > >- Deployed both binary and built source to a pseudo cluster, passed > the > >following sanity tests in insecure, SSL, and SSL+Kerberos mode: > > - HDFS basic and ACL > > - DistCp basic > > - WordCount (skipped in Kerberos mode) > > - KMS and HttpFS basic > > > > Thanks Andrew for the great effort! > > > > On Wed, Jul 5, 2017 at 1:33 PM, Eric Payne > invalid> > > wrote: > > > > > Thanks Andrew. > > > I downloaded the source, built it, and installed it onto a pseudo > > > distributed 4-node cluster. > > > > > > I ran mapred and streaming test cases, including sleep and wordcount. > > > +1 (non-binding) > > > -Eric > > > > > > From: Andrew Wang > > > To: "common-dev@hadoop.apache.org" ; " > > > hdfs-...@hadoop.apache.org" ; " > > > mapreduce-...@hadoop.apache.org" ; " > > > yarn-...@hadoop.apache.org" > > > Sent: Thursday, June 29, 2017 9:41 PM > > > Subject: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0 > > > > > > Hi all, > > > > > > As always, thanks to the many, many contributors who helped with this > > > release! I've prepared an RC0 for 3.0.0-alpha4: > > > > > > http://home.apache.org/~wang/3.0.0-alpha4-RC0/ > > > > > > The standard 5-day vote would run until midnight on Tuesday, July 4th. > > > Given that July 4th is a holiday in the US, I expect this vote might > have > > > to be extended, but I'd like to close the vote relatively soon after. > > > > > > I've done my traditional testing of a pseudo-distributed cluster with a > > > single task pi job, which was successful. > > > > > > Normally my testing would end there, but I'm slightly more confident > this > > > time. At Cloudera, we've successfully packaged and deployed a snapshot > > from > > > a few days ago, and run basic smoke tests. Some bugs found from this > > > include HDFS-11956, which fixes backwards compat with Hadoop 2 clients, > > and > > > the revert of HDFS-11696, which broke NN QJM HA setup. > > > > > > Vijay is working on a test run with a fuller test suite (the results of > > > which we can hopefully post soon). > > > > > > My +1 to start, > > > > > > Best, > > > Andrew > > > > > > > > > > > > > > > > > > > > -- > > John > > >
Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0
Thanks Andrew! +1 (non-binding) - Verified md5's, checked tarball sizes are reasonable - Built source tarball and deployed a pseudo-distributed cluster with hdfs/kms - Tested basic hdfs/kms operations - Sanity checked webuis/logs -Xiao On Wed, Jul 5, 2017 at 10:33 PM, John Zhuge wrote: > +1 (non-binding) > > >- Verified checksums and signatures of the tarballs >- Built source with native, Java 1.8.0_131 on Mac OS X 10.12.5 >- Cloud connectors: > - A few S3A integration tests > - A few ADL live unit tests >- Deployed both binary and built source to a pseudo cluster, passed the >following sanity tests in insecure, SSL, and SSL+Kerberos mode: > - HDFS basic and ACL > - DistCp basic > - WordCount (skipped in Kerberos mode) > - KMS and HttpFS basic > > Thanks Andrew for the great effort! > > On Wed, Jul 5, 2017 at 1:33 PM, Eric Payne invalid> > wrote: > > > Thanks Andrew. > > I downloaded the source, built it, and installed it onto a pseudo > > distributed 4-node cluster. > > > > I ran mapred and streaming test cases, including sleep and wordcount. > > +1 (non-binding) > > -Eric > > > > From: Andrew Wang > > To: "common-dev@hadoop.apache.org" ; " > > hdfs-...@hadoop.apache.org" ; " > > mapreduce-...@hadoop.apache.org" ; " > > yarn-...@hadoop.apache.org" > > Sent: Thursday, June 29, 2017 9:41 PM > > Subject: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0 > > > > Hi all, > > > > As always, thanks to the many, many contributors who helped with this > > release! I've prepared an RC0 for 3.0.0-alpha4: > > > > http://home.apache.org/~wang/3.0.0-alpha4-RC0/ > > > > The standard 5-day vote would run until midnight on Tuesday, July 4th. > > Given that July 4th is a holiday in the US, I expect this vote might have > > to be extended, but I'd like to close the vote relatively soon after. > > > > I've done my traditional testing of a pseudo-distributed cluster with a > > single task pi job, which was successful. > > > > Normally my testing would end there, but I'm slightly more confident this > > time. At Cloudera, we've successfully packaged and deployed a snapshot > from > > a few days ago, and run basic smoke tests. Some bugs found from this > > include HDFS-11956, which fixes backwards compat with Hadoop 2 clients, > and > > the revert of HDFS-11696, which broke NN QJM HA setup. > > > > Vijay is working on a test run with a fuller test suite (the results of > > which we can hopefully post soon). > > > > My +1 to start, > > > > Best, > > Andrew > > > > > > > > > > > > -- > John >
Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0
+1 (non-binding) - Verified checksums and signatures of the tarballs - Built source with native, Java 1.8.0_131 on Mac OS X 10.12.5 - Cloud connectors: - A few S3A integration tests - A few ADL live unit tests - Deployed both binary and built source to a pseudo cluster, passed the following sanity tests in insecure, SSL, and SSL+Kerberos mode: - HDFS basic and ACL - DistCp basic - WordCount (skipped in Kerberos mode) - KMS and HttpFS basic Thanks Andrew for the great effort! On Wed, Jul 5, 2017 at 1:33 PM, Eric Payne wrote: > Thanks Andrew. > I downloaded the source, built it, and installed it onto a pseudo > distributed 4-node cluster. > > I ran mapred and streaming test cases, including sleep and wordcount. > +1 (non-binding) > -Eric > > From: Andrew Wang > To: "common-dev@hadoop.apache.org" ; " > hdfs-...@hadoop.apache.org" ; " > mapreduce-...@hadoop.apache.org" ; " > yarn-...@hadoop.apache.org" > Sent: Thursday, June 29, 2017 9:41 PM > Subject: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0 > > Hi all, > > As always, thanks to the many, many contributors who helped with this > release! I've prepared an RC0 for 3.0.0-alpha4: > > http://home.apache.org/~wang/3.0.0-alpha4-RC0/ > > The standard 5-day vote would run until midnight on Tuesday, July 4th. > Given that July 4th is a holiday in the US, I expect this vote might have > to be extended, but I'd like to close the vote relatively soon after. > > I've done my traditional testing of a pseudo-distributed cluster with a > single task pi job, which was successful. > > Normally my testing would end there, but I'm slightly more confident this > time. At Cloudera, we've successfully packaged and deployed a snapshot from > a few days ago, and run basic smoke tests. Some bugs found from this > include HDFS-11956, which fixes backwards compat with Hadoop 2 clients, and > the revert of HDFS-11696, which broke NN QJM HA setup. > > Vijay is working on a test run with a fuller test suite (the results of > which we can hopefully post soon). > > My +1 to start, > > Best, > Andrew > > > > -- John
Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0
False alarm, fixed the build issue with "mvn -U clean install". On Wed, Jul 5, 2017 at 6:08 PM, John Zhuge wrote: > For some reason, I can't build the source. > > Got this when running "mvn install -U" inside directory > "hadoop-maven-plugins": > > [ERROR] Failed to execute goal org.apache.maven.plugins: > maven-remote-resources-plugin:1.5:process (default) on project > hadoop-maven-plugins: Execution default of goal org.apache.maven.plugins: > maven-remote-resources-plugin:1.5:process failed: Plugin > org.apache.maven.plugins:maven-remote-resources-plugin:1.5 or one of its > dependencies could not be resolved: Failed to collect dependencies at > org.apache.maven.plugins:maven-remote-resources-plugin:jar:1.5 -> > org.apache.hadoop:hadoop-build-tools:jar:3.0.0-alpha4: Failed to read > artifact descriptor for org.apache.hadoop:hadoop-build-tools:jar:3.0.0-alpha4: > Failure to find org.apache.hadoop:hadoop-main:pom:3.0.0-alpha4 in > https://repo.maven.apache.org/maven2 was cached in the local repository, > resolution will not be reattempted until the update interval of central has > elapsed or updates are forced -> [Help 1] > > > On Thu, Jun 29, 2017 at 7:40 PM, Andrew Wang > wrote: > >> Hi all, >> >> As always, thanks to the many, many contributors who helped with this >> release! I've prepared an RC0 for 3.0.0-alpha4: >> >> http://home.apache.org/~wang/3.0.0-alpha4-RC0/ >> >> The standard 5-day vote would run until midnight on Tuesday, July 4th. >> Given that July 4th is a holiday in the US, I expect this vote might have >> to be extended, but I'd like to close the vote relatively soon after. >> >> I've done my traditional testing of a pseudo-distributed cluster with a >> single task pi job, which was successful. >> >> Normally my testing would end there, but I'm slightly more confident this >> time. At Cloudera, we've successfully packaged and deployed a snapshot >> from >> a few days ago, and run basic smoke tests. Some bugs found from this >> include HDFS-11956, which fixes backwards compat with Hadoop 2 clients, >> and >> the revert of HDFS-11696, which broke NN QJM HA setup. >> >> Vijay is working on a test run with a fuller test suite (the results of >> which we can hopefully post soon). >> >> My +1 to start, >> >> Best, >> Andrew >> > > > > -- > John > -- John
Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0
For some reason, I can't build the source. Got this when running "mvn install -U" inside directory "hadoop-maven-plugins": [ERROR] Failed to execute goal org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process (default) on project hadoop-maven-plugins: Execution default of goal org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process failed: Plugin org.apache.maven.plugins:maven-remote-resources-plugin:1.5 or one of its dependencies could not be resolved: Failed to collect dependencies at org.apache.maven.plugins:maven-remote-resources-plugin:jar:1.5 -> org.apache.hadoop:hadoop-build-tools:jar:3.0.0-alpha4: Failed to read artifact descriptor for org.apache.hadoop:hadoop-build-tools:jar:3.0.0-alpha4: Failure to find org.apache.hadoop:hadoop-main:pom:3.0.0-alpha4 in https://repo.maven.apache.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of central has elapsed or updates are forced -> [Help 1] On Thu, Jun 29, 2017 at 7:40 PM, Andrew Wang wrote: > Hi all, > > As always, thanks to the many, many contributors who helped with this > release! I've prepared an RC0 for 3.0.0-alpha4: > > http://home.apache.org/~wang/3.0.0-alpha4-RC0/ > > The standard 5-day vote would run until midnight on Tuesday, July 4th. > Given that July 4th is a holiday in the US, I expect this vote might have > to be extended, but I'd like to close the vote relatively soon after. > > I've done my traditional testing of a pseudo-distributed cluster with a > single task pi job, which was successful. > > Normally my testing would end there, but I'm slightly more confident this > time. At Cloudera, we've successfully packaged and deployed a snapshot from > a few days ago, and run basic smoke tests. Some bugs found from this > include HDFS-11956, which fixes backwards compat with Hadoop 2 clients, and > the revert of HDFS-11696, which broke NN QJM HA setup. > > Vijay is working on a test run with a fuller test suite (the results of > which we can hopefully post soon). > > My +1 to start, > > Best, > Andrew > -- John
Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0
Thanks Andrew. I downloaded the source, built it, and installed it onto a pseudo distributed 4-node cluster. I ran mapred and streaming test cases, including sleep and wordcount. +1 (non-binding) -Eric From: Andrew Wang To: "common-dev@hadoop.apache.org" ; "hdfs-...@hadoop.apache.org" ; "mapreduce-...@hadoop.apache.org" ; "yarn-...@hadoop.apache.org" Sent: Thursday, June 29, 2017 9:41 PM Subject: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0 Hi all, As always, thanks to the many, many contributors who helped with this release! I've prepared an RC0 for 3.0.0-alpha4: http://home.apache.org/~wang/3.0.0-alpha4-RC0/ The standard 5-day vote would run until midnight on Tuesday, July 4th. Given that July 4th is a holiday in the US, I expect this vote might have to be extended, but I'd like to close the vote relatively soon after. I've done my traditional testing of a pseudo-distributed cluster with a single task pi job, which was successful. Normally my testing would end there, but I'm slightly more confident this time. At Cloudera, we've successfully packaged and deployed a snapshot from a few days ago, and run basic smoke tests. Some bugs found from this include HDFS-11956, which fixes backwards compat with Hadoop 2 clients, and the revert of HDFS-11696, which broke NN QJM HA setup. Vijay is working on a test run with a fuller test suite (the results of which we can hopefully post soon). My +1 to start, Best, Andrew
Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0
Thanks for testing Shane! Given that the Docker work is experimental (YARN-6622 will fully document this), I think we're okay shipping with some known issues. On Wed, Jul 5, 2017 at 8:50 AM, Shane Kumpf wrote: > Thanks for putting this together. I was able to build the RC, setup a > pseudo distributed cluster, and run pi and dshell tests. > > There is an outstanding issue in YARN that impacts obtaining the network > details and signal handling when running with the Docker container runtime. > These will be addressed in YARN-5670. I'm not sure this is a blocker, as > docker containers can still be run, but with degraded functionality. I'm +1 > if others feel this isn't a blocker. > > Thanks, > -Shane > > On Fri, Jun 30, 2017 at 10:29 AM, Andrew Wang > wrote: > >> Thanks for taking a look Steve, >> >> On Fri, Jun 30, 2017 at 4:59 AM, Steve Loughran >> wrote: >> >> > >> > On 30 Jun 2017, at 03:40, Andrew Wang wrote: >> > >> > Hi all, >> > >> > As always, thanks to the many, many contributors who helped with this >> > release! I've prepared an RC0 for 3.0.0-alpha4: >> > >> > http://home.apache.org/~wang/3.0.0-alpha4-RC0/ >> > >> > >> > whats the git commit ID? or signed tag? >> > >> >> I'd already pushed a signed tag per the HowToRelease instructions, LMK if >> it's not right. >> >> > >> > >> > The standard 5-day vote would run until midnight on Tuesday, July 4th. >> > Given that July 4th is a holiday in the US, I expect this vote might >> have >> > to be extended, but I'd like to close the vote relatively soon after. >> > >> > I've done my traditional testing of a pseudo-distributed cluster with a >> > single task pi job, which was successful. >> > >> > Normally my testing would end there, but I'm slightly more confident >> this >> > time. At Cloudera, we've successfully packaged and deployed a snapshot >> from >> > a few days ago, and run basic smoke tests. Some bugs found from this >> > include HDFS-11956, which fixes backwards compat with Hadoop 2 clients, >> and >> > the revert of HDFS-11696, which broke NN QJM HA setup. >> > >> > Vijay is working on a test run with a fuller test suite (the results of >> > which we can hopefully post soon). >> > >> > My +1 to start, >> > >> > Best, >> > Andrew >> > >> > >> > >> > I haven't tested with this alpha, but spark 2.2+ can't read files on >> > Azure: https://issues.apache.org/jira/browse/HADOOP-14598 >> > >> > Cause: https://issues.apache.org/jira/browse/HADOOP-14383 >> > >> > I can see how to do a test we can put into hadoop-common (for >> trunk/2.9); >> > if the bug exists in this RC then I think we'll need to revert the >> > HADOOP-14598 patch for now & then work on a fix >> > >> > Sorry —only discovered it this week...an unexpected combination of >> > features which only become visible when you take the latest bits of two >> > projects and then run some blobstore tests downstream ( >> https://github.com/ >> > hortonworks-spark/cloud-integration/tree/master/cloud-examples/) >> > >> > Ick, I somehow didn't see this blocker on the release dashboard for >> alpha4, but seems like it's targeted now. >> >> If it only affects WASB, then I think we can get by without it for the >> alpha, fix it in beta1. WDYT? >> >> Best, >> Andrew >> > >
Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0
Thanks for putting this together. I was able to build the RC, setup a pseudo distributed cluster, and run pi and dshell tests. There is an outstanding issue in YARN that impacts obtaining the network details and signal handling when running with the Docker container runtime. These will be addressed in YARN-5670. I'm not sure this is a blocker, as docker containers can still be run, but with degraded functionality. I'm +1 if others feel this isn't a blocker. Thanks, -Shane On Fri, Jun 30, 2017 at 10:29 AM, Andrew Wang wrote: > Thanks for taking a look Steve, > > On Fri, Jun 30, 2017 at 4:59 AM, Steve Loughran > wrote: > > > > > On 30 Jun 2017, at 03:40, Andrew Wang wrote: > > > > Hi all, > > > > As always, thanks to the many, many contributors who helped with this > > release! I've prepared an RC0 for 3.0.0-alpha4: > > > > http://home.apache.org/~wang/3.0.0-alpha4-RC0/ > > > > > > whats the git commit ID? or signed tag? > > > > I'd already pushed a signed tag per the HowToRelease instructions, LMK if > it's not right. > > > > > > > The standard 5-day vote would run until midnight on Tuesday, July 4th. > > Given that July 4th is a holiday in the US, I expect this vote might have > > to be extended, but I'd like to close the vote relatively soon after. > > > > I've done my traditional testing of a pseudo-distributed cluster with a > > single task pi job, which was successful. > > > > Normally my testing would end there, but I'm slightly more confident this > > time. At Cloudera, we've successfully packaged and deployed a snapshot > from > > a few days ago, and run basic smoke tests. Some bugs found from this > > include HDFS-11956, which fixes backwards compat with Hadoop 2 clients, > and > > the revert of HDFS-11696, which broke NN QJM HA setup. > > > > Vijay is working on a test run with a fuller test suite (the results of > > which we can hopefully post soon). > > > > My +1 to start, > > > > Best, > > Andrew > > > > > > > > I haven't tested with this alpha, but spark 2.2+ can't read files on > > Azure: https://issues.apache.org/jira/browse/HADOOP-14598 > > > > Cause: https://issues.apache.org/jira/browse/HADOOP-14383 > > > > I can see how to do a test we can put into hadoop-common (for trunk/2.9); > > if the bug exists in this RC then I think we'll need to revert the > > HADOOP-14598 patch for now & then work on a fix > > > > Sorry —only discovered it this week...an unexpected combination of > > features which only become visible when you take the latest bits of two > > projects and then run some blobstore tests downstream ( > https://github.com/ > > hortonworks-spark/cloud-integration/tree/master/cloud-examples/) > > > > Ick, I somehow didn't see this blocker on the release dashboard for > alpha4, but seems like it's targeted now. > > If it only affects WASB, then I think we can get by without it for the > alpha, fix it in beta1. WDYT? > > Best, > Andrew >
Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0
Thanks for taking a look Steve, On Fri, Jun 30, 2017 at 4:59 AM, Steve Loughran wrote: > > On 30 Jun 2017, at 03:40, Andrew Wang wrote: > > Hi all, > > As always, thanks to the many, many contributors who helped with this > release! I've prepared an RC0 for 3.0.0-alpha4: > > http://home.apache.org/~wang/3.0.0-alpha4-RC0/ > > > whats the git commit ID? or signed tag? > I'd already pushed a signed tag per the HowToRelease instructions, LMK if it's not right. > > > The standard 5-day vote would run until midnight on Tuesday, July 4th. > Given that July 4th is a holiday in the US, I expect this vote might have > to be extended, but I'd like to close the vote relatively soon after. > > I've done my traditional testing of a pseudo-distributed cluster with a > single task pi job, which was successful. > > Normally my testing would end there, but I'm slightly more confident this > time. At Cloudera, we've successfully packaged and deployed a snapshot from > a few days ago, and run basic smoke tests. Some bugs found from this > include HDFS-11956, which fixes backwards compat with Hadoop 2 clients, and > the revert of HDFS-11696, which broke NN QJM HA setup. > > Vijay is working on a test run with a fuller test suite (the results of > which we can hopefully post soon). > > My +1 to start, > > Best, > Andrew > > > > I haven't tested with this alpha, but spark 2.2+ can't read files on > Azure: https://issues.apache.org/jira/browse/HADOOP-14598 > > Cause: https://issues.apache.org/jira/browse/HADOOP-14383 > > I can see how to do a test we can put into hadoop-common (for trunk/2.9); > if the bug exists in this RC then I think we'll need to revert the > HADOOP-14598 patch for now & then work on a fix > > Sorry —only discovered it this week...an unexpected combination of > features which only become visible when you take the latest bits of two > projects and then run some blobstore tests downstream (https://github.com/ > hortonworks-spark/cloud-integration/tree/master/cloud-examples/) > > Ick, I somehow didn't see this blocker on the release dashboard for alpha4, but seems like it's targeted now. If it only affects WASB, then I think we can get by without it for the alpha, fix it in beta1. WDYT? Best, Andrew
Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0
On 30 Jun 2017, at 03:40, Andrew Wang mailto:andrew.w...@cloudera.com>> wrote: Hi all, As always, thanks to the many, many contributors who helped with this release! I've prepared an RC0 for 3.0.0-alpha4: http://home.apache.org/~wang/3.0.0-alpha4-RC0/ whats the git commit ID? or signed tag? The standard 5-day vote would run until midnight on Tuesday, July 4th. Given that July 4th is a holiday in the US, I expect this vote might have to be extended, but I'd like to close the vote relatively soon after. I've done my traditional testing of a pseudo-distributed cluster with a single task pi job, which was successful. Normally my testing would end there, but I'm slightly more confident this time. At Cloudera, we've successfully packaged and deployed a snapshot from a few days ago, and run basic smoke tests. Some bugs found from this include HDFS-11956, which fixes backwards compat with Hadoop 2 clients, and the revert of HDFS-11696, which broke NN QJM HA setup. Vijay is working on a test run with a fuller test suite (the results of which we can hopefully post soon). My +1 to start, Best, Andrew I haven't tested with this alpha, but spark 2.2+ can't read files on Azure: https://issues.apache.org/jira/browse/HADOOP-14598 Cause: https://issues.apache.org/jira/browse/HADOOP-14383 I can see how to do a test we can put into hadoop-common (for trunk/2.9); if the bug exists in this RC then I think we'll need to revert the HADOOP-14598 patch for now & then work on a fix Sorry —only discovered it this week...an unexpected combination of features which only become visible when you take the latest bits of two projects and then run some blobstore tests downstream (https://github.com/hortonworks-spark/cloud-integration/tree/master/cloud-examples/)
[VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0
Hi all, As always, thanks to the many, many contributors who helped with this release! I've prepared an RC0 for 3.0.0-alpha4: http://home.apache.org/~wang/3.0.0-alpha4-RC0/ The standard 5-day vote would run until midnight on Tuesday, July 4th. Given that July 4th is a holiday in the US, I expect this vote might have to be extended, but I'd like to close the vote relatively soon after. I've done my traditional testing of a pseudo-distributed cluster with a single task pi job, which was successful. Normally my testing would end there, but I'm slightly more confident this time. At Cloudera, we've successfully packaged and deployed a snapshot from a few days ago, and run basic smoke tests. Some bugs found from this include HDFS-11956, which fixes backwards compat with Hadoop 2 clients, and the revert of HDFS-11696, which broke NN QJM HA setup. Vijay is working on a test run with a fuller test suite (the results of which we can hopefully post soon). My +1 to start, Best, Andrew