go ahead and cut it...I'd forgotten about it. thanks,
steve On Fri, 31 Mar 2023 at 06:44, Ayush Saxena <ayush...@gmail.com> wrote: > We have a daily build running for 3.3.5: > https://ci-hadoop.apache.org/job/hadoop-qbt-3.3.5-java8-linux-x86_64/ > > We have already released it, so I feel we can disable it. Will do it > tomorrow, if nobody objects. In case the one who configured it wants > to do it early, feel free to do so. > > We already have one for branch-3.3 which runs weekly which most > probably most of us don't follow :) > > -Ayush > > On Wed, 22 Mar 2023 at 00:20, Steve Loughran > <ste...@cloudera.com.invalid> wrote: > > > > ok, here's my summary, even though most of the binding voters forgot to > > declare they were on the PMC. > > > > +1 binding > > > > Steve Loughran > > Chris Nauroth > > Masatake Iwasaki > > Ayush Saxena > > Xiaoqiao He > > > > +1 non-binding > > > > Viraj Jasani > > > > > > 0 or -1 votes: none. > > > > > > Accordingly: the release is good! > > > > I will send the formal announcement out tomorrow > > > > A big thank you to everyone who qualified the RC, I know its a lot of > work. > > We can now get this out and *someone else* can plan the followup. > > > > > > steve > > > > On Mon, 20 Mar 2023 at 16:01, Chris Nauroth <cnaur...@apache.org> wrote: > > > > > +1 > > > > > > Thank you for the release candidate, Steve! > > > > > > * Verified all checksums. > > > * Verified all signatures. > > > * Built from source, including native code on Linux. > > > * mvn clean package -Pnative -Psrc -Drequire.openssl > -Drequire.snappy > > > -Drequire.zstd -DskipTests > > > * Tests passed. > > > * mvn --fail-never clean test -Pnative -Dparallel-tests > > > -Drequire.snappy -Drequire.zstd -Drequire.openssl > > > -Dsurefire.rerunFailingTestsCount=3 -DtestsThreadCount=8 > > > * Checked dependency tree to make sure we have all of the expected > library > > > updates that are mentioned in the release notes. > > > * mvn -o dependency:tree > > > * Confirmed that hadoop-openstack is now just a stub placeholder > artifact > > > with no code. > > > * For ARM verification: > > > * Ran "file <X>" on all native binaries in the ARM tarball to > confirm > > > they actually came out with ARM as the architecture. > > > * Output of hadoop checknative -a on ARM looks good. > > > * Ran a MapReduce job with the native bzip2 codec for compression, > and > > > it worked fine. > > > * Ran a MapReduce job with YARN configured to use > > > LinuxContainerExecutor and verified launching the containers through > > > container-executor worked. > > > > > > Chris Nauroth > > > > > > > > > On Mon, Mar 20, 2023 at 3:45 AM Ayush Saxena <ayush...@gmail.com> > wrote: > > > > > > > +1(Binding) > > > > > > > > * Built from source (x86 & ARM) > > > > * Successful Native Build (x86 & ARM) > > > > * Verified Checksums (x86 & ARM) > > > > * Verified Signature (x86 & ARM) > > > > * Checked the output of hadoop version (x86 & ARM) > > > > * Verified the output of hadoop checknative (x86 & ARM) > > > > * Ran some basic HDFS shell commands. > > > > * Ran some basic Yarn shell commands. > > > > * Played a bit with HDFS Erasure Coding. > > > > * Ran TeraGen & TeraSort > > > > * Browed through NN, DN, RM & NM UI > > > > * Skimmed over the contents of website. > > > > * Skimmed over the contents of maven repo. > > > > * Selectively ran some HDFS & CloudStore tests > > > > > > > > Thanx Steve for driving the release. Good Luck!!! > > > > > > > > -Ayush > > > > > > > > > On 20-Mar-2023, at 12:54 PM, Xiaoqiao He <hexiaoq...@apache.org> > > > wrote: > > > > > > > > > > +1 > > > > > > > > > > * Verified signature and checksum of the source tarball. > > > > > * Built the source code on Ubuntu and OpenJDK 11 by `mvn clean > package > > > > > -DskipTests -Pnative -Pdist -Dtar`. > > > > > * Setup pseudo cluster with HDFS and YARN. > > > > > * Run simple FsShell - mkdir/put/get/mv/rm (include EC) and check > the > > > > > result. > > > > > * Run example mr applications and check the result - Pi & > wordcount. > > > > > * Check the Web UI of NameNode/DataNode/Resourcemanager/NodeManager > > > etc. > > > > > > > > > > Thanks Steve for your work. > > > > > > > > > > Best Regards, > > > > > - He Xiaoqiao > > > > > > > > > >> On Mon, Mar 20, 2023 at 12:04 PM Masatake Iwasaki < > > > > iwasak...@oss.nttdata.com> > > > > >> wrote: > > > > >> > > > > >> +1 > > > > >> > > > > >> + verified the signature and checksum of the source tarball. > > > > >> > > > > >> + built from the source tarball on Rocky Linux 8 (x86_64) and > OpenJDK > > > 8 > > > > >> with native profile enabled. > > > > >> + launched pseudo distributed cluster including kms and httpfs > with > > > > >> Kerberos and SSL enabled. > > > > >> + created encryption zone, put and read files via httpfs. > > > > >> + ran example MR wordcount over encryption zone. > > > > >> + checked the binary of container-executor. > > > > >> > > > > >> + built rpm packages by Bigtop (with trivial modifications) on > Rocky > > > > Linux > > > > >> 8 (aarch64). > > > > >> + ran smoke-tests of hdfs, yarn and mapreduce. > > > > >> + built site documentation and skimmed the contents. > > > > >> + Javadocs are contained. > > > > >> > > > > >> Thanks, > > > > >> Masatake Iwasaki > > > > >> > > > > >>> On 2023/03/16 4:47, Steve Loughran wrote: > > > > >>> Apache Hadoop 3.3.5 > > > > >>> > > > > >>> Mukund and I have put together a release candidate (RC3) for > Hadoop > > > > >> 3.3.5. > > > > >>> > > > > >>> What we would like is for anyone who can to verify the tarballs, > > > > >> especially > > > > >>> anyone who can try the arm64 binaries as we want to include them > too. > > > > >>> > > > > >>> The RC is available at: > > > > >>> https://dist.apache.org/repos/dist/dev/hadoop/hadoop-3.3.5-RC3/ > > > > >>> > > > > >>> The git tag is release-3.3.5-RC3, commit 706d88266ab > > > > >>> > > > > >>> The maven artifacts are staged at > > > > >>> > > > > > https://repository.apache.org/content/repositories/orgapachehadoop-1369/ > > > > >>> > > > > >>> You can find my public key at: > > > > >>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS > > > > >>> > > > > >>> Change log > > > > >>> > > > > >> > > > > > > > > https://dist.apache.org/repos/dist/dev/hadoop/hadoop-3.3.5-RC3/CHANGELOG.md > > > > >>> > > > > >>> Release notes > > > > >>> > > > > >> > > > > > > > > https://dist.apache.org/repos/dist/dev/hadoop/hadoop-3.3.5-RC3/RELEASENOTES.md > > > > >>> > > > > >>> This is off branch-3.3 and is the first big release since 3.3.2. > > > > >>> > > > > >>> Key changes include > > > > >>> > > > > >>> * Big update of dependencies to try and keep those reports of > > > > >>> transitive CVEs under control -both genuine and false > positives. > > > > >>> * HDFS RBF enhancements > > > > >>> * Critical fix to ABFS input stream prefetching for correct > reading. > > > > >>> * Vectored IO API for all FSDataInputStream implementations, with > > > > >>> high-performance versions for file:// and s3a:// filesystems. > > > > >>> file:// through java native io > > > > >>> s3a:// parallel GET requests. > > > > >>> * This release includes Arm64 binaries. Please can anyone with > > > > >>> compatible systems validate these. > > > > >>> * and compared to the previous RC, all the major changes are > > > > >>> HDFS issues. > > > > >>> > > > > >>> Note, because the arm64 binaries are built separately on a > different > > > > >>> platform and JVM, their jar files may not match those of the x86 > > > > >>> release -and therefore the maven artifacts. I don't think this is > > > > >>> an issue (the ASF actually releases source tarballs, the > binaries are > > > > >>> there for help only, though with the maven repo that's a bit > > > blurred). > > > > >>> > > > > >>> The only way to be consistent would actually untar the > x86.tar.gz, > > > > >>> overwrite its binaries with the arm stuff, retar, sign and push > out > > > > >>> for the vote. Even automating that would be risky. > > > > >>> > > > > >>> Please try the release and vote. The vote will run for 5 days. > > > > >>> > > > > >>> -Steve > > > > >>> > > > > >> > > > > >> > --------------------------------------------------------------------- > > > > >> To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org > > > > >> For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org > > > > >> > > > > >> > > > > > > > > --------------------------------------------------------------------- > > > > To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org > > > > For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org > > > > > > > > > > > >
