Re: [VOTE] Release Apache Hadoop 3.3.3 (RC1)
Here are the result of the vote. Binding PMC members +1 Stack +1 Masatake Iwasaki +1 Xiaoqiao He +1 Chao Sun +1 Chris Nauroth Non binding votes +1 Ayush Saxena +1 Viraj Jasani +1 Mukund Thakur There were no negative votes, and maven is happy. I'm pleased to announce therefore, that this release candidate has been approved to become the final release. I'm going to go through the next steps of the process: publishing the artifacts, site docs, maven artifacts, announcements etc. Thank you to all who reviewed this! -Steve PS: I'm going to start some discussion on correcting/tuning the release process, once I've got through it. On Mon, 16 May 2022 at 19:16, Chris Nauroth wrote: > +1 (binding) > > - Verified all checksums. > - Verified all signatures. > - Built from source, including native code on Linux. > - Ran several examples successfully. > > Chris Nauroth > > > On Mon, May 16, 2022 at 10:06 AM Chao Sun wrote: > > > +1 > > > > - Compiled from source > > - Verified checksums & signatures > > - Launched a pseudo HDFS cluster and ran some simple commands > > - Ran full Spark tests with the RC > > > > Thanks Steve! > > > > Chao > > > > On Mon, May 16, 2022 at 2:19 AM Ayush Saxena wrote: > > > > > > +1, > > > * Built from source. > > > * Successful native build on Ubuntu 18.04 > > > * Verified Checksums. > > > > > > (CHANGELOG.md,RELEASENOTES.md,hadoop-3.3.3-rat.txt,hadoop-3.3.3-site.tar.gz,hadoop-3.3.3-src.tar.gz,hadoop-3.3.3.tar.gz) > > > * Verified Signature. > > > * Successful RAT check > > > * Ran basic HDFS shell commands. > > > * Ran basic YARN shell commands. > > > * Verified version in hadoop version command and UI > > > * Ran some MR example Jobs. > > > * Browsed > UI(Namenode/Datanode/ResourceManager/NodeManager/HistoryServer) > > > * Browsed the contents of Maven Artifacts. > > > * Browsed the contents of the website. > > > > > > Thanx Steve for driving the release, Good Luck!!! > > > > > > -Ayush > > > > > > On Mon, 16 May 2022 at 08:20, Xiaoqiao He > wrote: > > > > > > > +1(binding) > > > > > > > > * Verified signature and checksum of the source tarball. > > > > * Built the source code on Ubuntu and OpenJDK 11 by `mvn clean > package > > > > -DskipTests -Pnative -Pdist -Dtar`. > > > > * Setup pseudo cluster with HDFS and YARN. > > > > * Run simple FsShell - mkdir/put/get/mv/rm and check the result. > > > > * Run example mr applications and check the result - Pi & wordcount. > > > > * Check the Web UI of NameNode/DataNode/Resourcemanager/NodeManager > > etc. > > > > > > > > Thanks Steve for your work. > > > > > > > > - He Xiaoqiao > > > > > > > > On Mon, May 16, 2022 at 4:25 AM Viraj Jasani > > wrote: > > > > > > > > > > +1 (non-binding) > > > > > > > > > > * Signature: ok > > > > > * Checksum : ok > > > > > * Rat check (1.8.0_301): ok > > > > > - mvn clean apache-rat:check > > > > > * Built from source (1.8.0_301): ok > > > > > - mvn clean install -DskipTests > > > > > * Built tar from source (1.8.0_301): ok > > > > > - mvn clean package -Pdist -DskipTests -Dtar > > -Dmaven.javadoc.skip=true > > > > > > > > > > HDFS, MapReduce and HBase (2.5) CRUD functional testing on > > > > > pseudo-distributed mode looks good. > > > > > > > > > > > > > > > On Wed, May 11, 2022 at 10:26 AM Steve Loughran > > > > > > > > > wrote: > > > > > > > > > > > I have put together a release candidate (RC1) for Hadoop 3.3.3 > > > > > > > > > > > > The RC is available at: > > > > > > https://dist.apache.org/repos/dist/dev/hadoop/3.3.3-RC1/ > > > > > > > > > > > > The git tag is release-3.3.3-RC1, commit d37586cbda3 > > > > > > > > > > > > The maven artifacts are staged at > > > > > > > > > > > > https://repository.apache.org/content/repositories/orgapachehadoop-1349/ > > > > > > > > > > > > You can find my public key at: > > > > > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS > > > > > > > > > > > > Change log > > > > > > > > https://dist.apache.org/repos/dist/dev/hadoop/3.3.3-RC1/CHANGELOG.md > > > > > > > > > > > > Release notes > > > > > > > > > > > > https://dist.apache.org/repos/dist/dev/hadoop/3.3.3-RC1/RELEASENOTES.md > > > > > > > > > > > > There's a very small number of changes, primarily critical > > > > code/packaging > > > > > > issues and security fixes. > > > > > > > > > > > > * The critical fixes which shipped in the 3.2.3 release. > > > > > > * CVEs in our code and dependencies > > > > > > * Shaded client packaging issues. > > > > > > * A switch from log4j to reload4j > > > > > > > > > > > > reload4j is an active fork of the log4j 1.17 library with the > > classes > > > > > > which contain CVEs removed. Even though hadoop never used those > > > > classes, > > > > > > they regularly raised alerts on security scans and concen from > > users. > > > > > > Switching to the forked project allows us to ship a secure > logging > > > > > > framework. It will complicate the builds of downstream > > > > > > maven/ivy/gradle projects which exclude our log4j artifacts, as > >
Re: [VOTE] Release Apache Hadoop 3.3.3 (RC1)
+1 (binding) - Verified all checksums. - Verified all signatures. - Built from source, including native code on Linux. - Ran several examples successfully. Chris Nauroth On Mon, May 16, 2022 at 10:06 AM Chao Sun wrote: > +1 > > - Compiled from source > - Verified checksums & signatures > - Launched a pseudo HDFS cluster and ran some simple commands > - Ran full Spark tests with the RC > > Thanks Steve! > > Chao > > On Mon, May 16, 2022 at 2:19 AM Ayush Saxena wrote: > > > > +1, > > * Built from source. > > * Successful native build on Ubuntu 18.04 > > * Verified Checksums. > > > (CHANGELOG.md,RELEASENOTES.md,hadoop-3.3.3-rat.txt,hadoop-3.3.3-site.tar.gz,hadoop-3.3.3-src.tar.gz,hadoop-3.3.3.tar.gz) > > * Verified Signature. > > * Successful RAT check > > * Ran basic HDFS shell commands. > > * Ran basic YARN shell commands. > > * Verified version in hadoop version command and UI > > * Ran some MR example Jobs. > > * Browsed UI(Namenode/Datanode/ResourceManager/NodeManager/HistoryServer) > > * Browsed the contents of Maven Artifacts. > > * Browsed the contents of the website. > > > > Thanx Steve for driving the release, Good Luck!!! > > > > -Ayush > > > > On Mon, 16 May 2022 at 08:20, Xiaoqiao He wrote: > > > > > +1(binding) > > > > > > * Verified signature and checksum of the source tarball. > > > * Built the source code on Ubuntu and OpenJDK 11 by `mvn clean package > > > -DskipTests -Pnative -Pdist -Dtar`. > > > * Setup pseudo cluster with HDFS and YARN. > > > * Run simple FsShell - mkdir/put/get/mv/rm and check the result. > > > * Run example mr applications and check the result - Pi & wordcount. > > > * Check the Web UI of NameNode/DataNode/Resourcemanager/NodeManager > etc. > > > > > > Thanks Steve for your work. > > > > > > - He Xiaoqiao > > > > > > On Mon, May 16, 2022 at 4:25 AM Viraj Jasani > wrote: > > > > > > > > +1 (non-binding) > > > > > > > > * Signature: ok > > > > * Checksum : ok > > > > * Rat check (1.8.0_301): ok > > > > - mvn clean apache-rat:check > > > > * Built from source (1.8.0_301): ok > > > > - mvn clean install -DskipTests > > > > * Built tar from source (1.8.0_301): ok > > > > - mvn clean package -Pdist -DskipTests -Dtar > -Dmaven.javadoc.skip=true > > > > > > > > HDFS, MapReduce and HBase (2.5) CRUD functional testing on > > > > pseudo-distributed mode looks good. > > > > > > > > > > > > On Wed, May 11, 2022 at 10:26 AM Steve Loughran > > > > > > > wrote: > > > > > > > > > I have put together a release candidate (RC1) for Hadoop 3.3.3 > > > > > > > > > > The RC is available at: > > > > > https://dist.apache.org/repos/dist/dev/hadoop/3.3.3-RC1/ > > > > > > > > > > The git tag is release-3.3.3-RC1, commit d37586cbda3 > > > > > > > > > > The maven artifacts are staged at > > > > > > > > > https://repository.apache.org/content/repositories/orgapachehadoop-1349/ > > > > > > > > > > You can find my public key at: > > > > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS > > > > > > > > > > Change log > > > > > > https://dist.apache.org/repos/dist/dev/hadoop/3.3.3-RC1/CHANGELOG.md > > > > > > > > > > Release notes > > > > > > > > > https://dist.apache.org/repos/dist/dev/hadoop/3.3.3-RC1/RELEASENOTES.md > > > > > > > > > > There's a very small number of changes, primarily critical > > > code/packaging > > > > > issues and security fixes. > > > > > > > > > > * The critical fixes which shipped in the 3.2.3 release. > > > > > * CVEs in our code and dependencies > > > > > * Shaded client packaging issues. > > > > > * A switch from log4j to reload4j > > > > > > > > > > reload4j is an active fork of the log4j 1.17 library with the > classes > > > > > which contain CVEs removed. Even though hadoop never used those > > > classes, > > > > > they regularly raised alerts on security scans and concen from > users. > > > > > Switching to the forked project allows us to ship a secure logging > > > > > framework. It will complicate the builds of downstream > > > > > maven/ivy/gradle projects which exclude our log4j artifacts, as > they > > > > > need to cut the new dependency instead/as well. > > > > > > > > > > See the release notes for details. > > > > > > > > > > This is the second release attempt. It is the same git commit as > > > before, > > > > > but > > > > > fully recompiled with another republish to maven staging, which > has bee > > > > > verified by building spark, as well as a minimal test project. > > > > > > > > > > Please try the release and vote. The vote will run for 5 days. > > > > > > > > > > -Steve > > > > > > > > > > > - > > > To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org > > > For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org > > > > > > > > - > To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org >
Re: [VOTE] Release Apache Hadoop 3.3.3 (RC1)
+1 - Compiled from source - Verified checksums & signatures - Launched a pseudo HDFS cluster and ran some simple commands - Ran full Spark tests with the RC Thanks Steve! Chao On Mon, May 16, 2022 at 2:19 AM Ayush Saxena wrote: > > +1, > * Built from source. > * Successful native build on Ubuntu 18.04 > * Verified Checksums. > (CHANGELOG.md,RELEASENOTES.md,hadoop-3.3.3-rat.txt,hadoop-3.3.3-site.tar.gz,hadoop-3.3.3-src.tar.gz,hadoop-3.3.3.tar.gz) > * Verified Signature. > * Successful RAT check > * Ran basic HDFS shell commands. > * Ran basic YARN shell commands. > * Verified version in hadoop version command and UI > * Ran some MR example Jobs. > * Browsed UI(Namenode/Datanode/ResourceManager/NodeManager/HistoryServer) > * Browsed the contents of Maven Artifacts. > * Browsed the contents of the website. > > Thanx Steve for driving the release, Good Luck!!! > > -Ayush > > On Mon, 16 May 2022 at 08:20, Xiaoqiao He wrote: > > > +1(binding) > > > > * Verified signature and checksum of the source tarball. > > * Built the source code on Ubuntu and OpenJDK 11 by `mvn clean package > > -DskipTests -Pnative -Pdist -Dtar`. > > * Setup pseudo cluster with HDFS and YARN. > > * Run simple FsShell - mkdir/put/get/mv/rm and check the result. > > * Run example mr applications and check the result - Pi & wordcount. > > * Check the Web UI of NameNode/DataNode/Resourcemanager/NodeManager etc. > > > > Thanks Steve for your work. > > > > - He Xiaoqiao > > > > On Mon, May 16, 2022 at 4:25 AM Viraj Jasani wrote: > > > > > > +1 (non-binding) > > > > > > * Signature: ok > > > * Checksum : ok > > > * Rat check (1.8.0_301): ok > > > - mvn clean apache-rat:check > > > * Built from source (1.8.0_301): ok > > > - mvn clean install -DskipTests > > > * Built tar from source (1.8.0_301): ok > > > - mvn clean package -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true > > > > > > HDFS, MapReduce and HBase (2.5) CRUD functional testing on > > > pseudo-distributed mode looks good. > > > > > > > > > On Wed, May 11, 2022 at 10:26 AM Steve Loughran > > > > > wrote: > > > > > > > I have put together a release candidate (RC1) for Hadoop 3.3.3 > > > > > > > > The RC is available at: > > > > https://dist.apache.org/repos/dist/dev/hadoop/3.3.3-RC1/ > > > > > > > > The git tag is release-3.3.3-RC1, commit d37586cbda3 > > > > > > > > The maven artifacts are staged at > > > > > > https://repository.apache.org/content/repositories/orgapachehadoop-1349/ > > > > > > > > You can find my public key at: > > > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS > > > > > > > > Change log > > > > https://dist.apache.org/repos/dist/dev/hadoop/3.3.3-RC1/CHANGELOG.md > > > > > > > > Release notes > > > > > > https://dist.apache.org/repos/dist/dev/hadoop/3.3.3-RC1/RELEASENOTES.md > > > > > > > > There's a very small number of changes, primarily critical > > code/packaging > > > > issues and security fixes. > > > > > > > > * The critical fixes which shipped in the 3.2.3 release. > > > > * CVEs in our code and dependencies > > > > * Shaded client packaging issues. > > > > * A switch from log4j to reload4j > > > > > > > > reload4j is an active fork of the log4j 1.17 library with the classes > > > > which contain CVEs removed. Even though hadoop never used those > > classes, > > > > they regularly raised alerts on security scans and concen from users. > > > > Switching to the forked project allows us to ship a secure logging > > > > framework. It will complicate the builds of downstream > > > > maven/ivy/gradle projects which exclude our log4j artifacts, as they > > > > need to cut the new dependency instead/as well. > > > > > > > > See the release notes for details. > > > > > > > > This is the second release attempt. It is the same git commit as > > before, > > > > but > > > > fully recompiled with another republish to maven staging, which has bee > > > > verified by building spark, as well as a minimal test project. > > > > > > > > Please try the release and vote. The vote will run for 5 days. > > > > > > > > -Steve > > > > > > > > - > > To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org > > For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org > > > > - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.3.3 (RC1)
+1, * Built from source. * Successful native build on Ubuntu 18.04 * Verified Checksums. (CHANGELOG.md,RELEASENOTES.md,hadoop-3.3.3-rat.txt,hadoop-3.3.3-site.tar.gz,hadoop-3.3.3-src.tar.gz,hadoop-3.3.3.tar.gz) * Verified Signature. * Successful RAT check * Ran basic HDFS shell commands. * Ran basic YARN shell commands. * Verified version in hadoop version command and UI * Ran some MR example Jobs. * Browsed UI(Namenode/Datanode/ResourceManager/NodeManager/HistoryServer) * Browsed the contents of Maven Artifacts. * Browsed the contents of the website. Thanx Steve for driving the release, Good Luck!!! -Ayush On Mon, 16 May 2022 at 08:20, Xiaoqiao He wrote: > +1(binding) > > * Verified signature and checksum of the source tarball. > * Built the source code on Ubuntu and OpenJDK 11 by `mvn clean package > -DskipTests -Pnative -Pdist -Dtar`. > * Setup pseudo cluster with HDFS and YARN. > * Run simple FsShell - mkdir/put/get/mv/rm and check the result. > * Run example mr applications and check the result - Pi & wordcount. > * Check the Web UI of NameNode/DataNode/Resourcemanager/NodeManager etc. > > Thanks Steve for your work. > > - He Xiaoqiao > > On Mon, May 16, 2022 at 4:25 AM Viraj Jasani wrote: > > > > +1 (non-binding) > > > > * Signature: ok > > * Checksum : ok > > * Rat check (1.8.0_301): ok > > - mvn clean apache-rat:check > > * Built from source (1.8.0_301): ok > > - mvn clean install -DskipTests > > * Built tar from source (1.8.0_301): ok > > - mvn clean package -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true > > > > HDFS, MapReduce and HBase (2.5) CRUD functional testing on > > pseudo-distributed mode looks good. > > > > > > On Wed, May 11, 2022 at 10:26 AM Steve Loughran > > > wrote: > > > > > I have put together a release candidate (RC1) for Hadoop 3.3.3 > > > > > > The RC is available at: > > > https://dist.apache.org/repos/dist/dev/hadoop/3.3.3-RC1/ > > > > > > The git tag is release-3.3.3-RC1, commit d37586cbda3 > > > > > > The maven artifacts are staged at > > > > https://repository.apache.org/content/repositories/orgapachehadoop-1349/ > > > > > > You can find my public key at: > > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS > > > > > > Change log > > > https://dist.apache.org/repos/dist/dev/hadoop/3.3.3-RC1/CHANGELOG.md > > > > > > Release notes > > > > https://dist.apache.org/repos/dist/dev/hadoop/3.3.3-RC1/RELEASENOTES.md > > > > > > There's a very small number of changes, primarily critical > code/packaging > > > issues and security fixes. > > > > > > * The critical fixes which shipped in the 3.2.3 release. > > > * CVEs in our code and dependencies > > > * Shaded client packaging issues. > > > * A switch from log4j to reload4j > > > > > > reload4j is an active fork of the log4j 1.17 library with the classes > > > which contain CVEs removed. Even though hadoop never used those > classes, > > > they regularly raised alerts on security scans and concen from users. > > > Switching to the forked project allows us to ship a secure logging > > > framework. It will complicate the builds of downstream > > > maven/ivy/gradle projects which exclude our log4j artifacts, as they > > > need to cut the new dependency instead/as well. > > > > > > See the release notes for details. > > > > > > This is the second release attempt. It is the same git commit as > before, > > > but > > > fully recompiled with another republish to maven staging, which has bee > > > verified by building spark, as well as a minimal test project. > > > > > > Please try the release and vote. The vote will run for 5 days. > > > > > > -Steve > > > > > - > To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org > >
Re: [VOTE] Release Apache Hadoop 3.3.3 (RC1)
+1(binding) * Verified signature and checksum of the source tarball. * Built the source code on Ubuntu and OpenJDK 11 by `mvn clean package -DskipTests -Pnative -Pdist -Dtar`. * Setup pseudo cluster with HDFS and YARN. * Run simple FsShell - mkdir/put/get/mv/rm and check the result. * Run example mr applications and check the result - Pi & wordcount. * Check the Web UI of NameNode/DataNode/Resourcemanager/NodeManager etc. Thanks Steve for your work. - He Xiaoqiao On Mon, May 16, 2022 at 4:25 AM Viraj Jasani wrote: > > +1 (non-binding) > > * Signature: ok > * Checksum : ok > * Rat check (1.8.0_301): ok > - mvn clean apache-rat:check > * Built from source (1.8.0_301): ok > - mvn clean install -DskipTests > * Built tar from source (1.8.0_301): ok > - mvn clean package -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true > > HDFS, MapReduce and HBase (2.5) CRUD functional testing on > pseudo-distributed mode looks good. > > > On Wed, May 11, 2022 at 10:26 AM Steve Loughran > wrote: > > > I have put together a release candidate (RC1) for Hadoop 3.3.3 > > > > The RC is available at: > > https://dist.apache.org/repos/dist/dev/hadoop/3.3.3-RC1/ > > > > The git tag is release-3.3.3-RC1, commit d37586cbda3 > > > > The maven artifacts are staged at > > https://repository.apache.org/content/repositories/orgapachehadoop-1349/ > > > > You can find my public key at: > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS > > > > Change log > > https://dist.apache.org/repos/dist/dev/hadoop/3.3.3-RC1/CHANGELOG.md > > > > Release notes > > https://dist.apache.org/repos/dist/dev/hadoop/3.3.3-RC1/RELEASENOTES.md > > > > There's a very small number of changes, primarily critical code/packaging > > issues and security fixes. > > > > * The critical fixes which shipped in the 3.2.3 release. > > * CVEs in our code and dependencies > > * Shaded client packaging issues. > > * A switch from log4j to reload4j > > > > reload4j is an active fork of the log4j 1.17 library with the classes > > which contain CVEs removed. Even though hadoop never used those classes, > > they regularly raised alerts on security scans and concen from users. > > Switching to the forked project allows us to ship a secure logging > > framework. It will complicate the builds of downstream > > maven/ivy/gradle projects which exclude our log4j artifacts, as they > > need to cut the new dependency instead/as well. > > > > See the release notes for details. > > > > This is the second release attempt. It is the same git commit as before, > > but > > fully recompiled with another republish to maven staging, which has bee > > verified by building spark, as well as a minimal test project. > > > > Please try the release and vote. The vote will run for 5 days. > > > > -Steve > > - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.3.3 (RC1)
+1 (non-binding) * Signature: ok * Checksum : ok * Rat check (1.8.0_301): ok - mvn clean apache-rat:check * Built from source (1.8.0_301): ok - mvn clean install -DskipTests * Built tar from source (1.8.0_301): ok - mvn clean package -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true HDFS, MapReduce and HBase (2.5) CRUD functional testing on pseudo-distributed mode looks good. On Wed, May 11, 2022 at 10:26 AM Steve Loughran wrote: > I have put together a release candidate (RC1) for Hadoop 3.3.3 > > The RC is available at: > https://dist.apache.org/repos/dist/dev/hadoop/3.3.3-RC1/ > > The git tag is release-3.3.3-RC1, commit d37586cbda3 > > The maven artifacts are staged at > https://repository.apache.org/content/repositories/orgapachehadoop-1349/ > > You can find my public key at: > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS > > Change log > https://dist.apache.org/repos/dist/dev/hadoop/3.3.3-RC1/CHANGELOG.md > > Release notes > https://dist.apache.org/repos/dist/dev/hadoop/3.3.3-RC1/RELEASENOTES.md > > There's a very small number of changes, primarily critical code/packaging > issues and security fixes. > > * The critical fixes which shipped in the 3.2.3 release. > * CVEs in our code and dependencies > * Shaded client packaging issues. > * A switch from log4j to reload4j > > reload4j is an active fork of the log4j 1.17 library with the classes > which contain CVEs removed. Even though hadoop never used those classes, > they regularly raised alerts on security scans and concen from users. > Switching to the forked project allows us to ship a secure logging > framework. It will complicate the builds of downstream > maven/ivy/gradle projects which exclude our log4j artifacts, as they > need to cut the new dependency instead/as well. > > See the release notes for details. > > This is the second release attempt. It is the same git commit as before, > but > fully recompiled with another republish to maven staging, which has bee > verified by building spark, as well as a minimal test project. > > Please try the release and vote. The vote will run for 5 days. > > -Steve >
Re: [VOTE] Release Apache Hadoop 3.3.3 (RC1)
+1 (binding) * verified signature and checksum of the source tarball. * built the source code on Rocky Linux 8 (x86_64) and OpenJDK 8 by `mvn install -DskipTests -Pnative -Pdist`. * launched pseudo distributed cluster with Kerberos security enabled and ran sample MR jobs. * launched HA enabled 3-nodes docker cluster and ran sample MR jobs. * built site documentation by `mvn site site:stage -Preleasedocs` and skimmed the contents. * built Spark 3.2.1 against 3.3.3 RC1 using the staging repository (after `rm -rf ~/.m2/repository/org/apache/hadoop`). Thanks, Masatake Iwasaki On 2022/05/12 2:25, Steve Loughran wrote: I have put together a release candidate (RC1) for Hadoop 3.3.3 The RC is available at: https://dist.apache.org/repos/dist/dev/hadoop/3.3.3-RC1/ The git tag is release-3.3.3-RC1, commit d37586cbda3 The maven artifacts are staged at https://repository.apache.org/content/repositories/orgapachehadoop-1349/ You can find my public key at: https://dist.apache.org/repos/dist/release/hadoop/common/KEYS Change log https://dist.apache.org/repos/dist/dev/hadoop/3.3.3-RC1/CHANGELOG.md Release notes https://dist.apache.org/repos/dist/dev/hadoop/3.3.3-RC1/RELEASENOTES.md There's a very small number of changes, primarily critical code/packaging issues and security fixes. * The critical fixes which shipped in the 3.2.3 release. * CVEs in our code and dependencies * Shaded client packaging issues. * A switch from log4j to reload4j reload4j is an active fork of the log4j 1.17 library with the classes which contain CVEs removed. Even though hadoop never used those classes, they regularly raised alerts on security scans and concen from users. Switching to the forked project allows us to ship a secure logging framework. It will complicate the builds of downstream maven/ivy/gradle projects which exclude our log4j artifacts, as they need to cut the new dependency instead/as well. See the release notes for details. This is the second release attempt. It is the same git commit as before, but fully recompiled with another republish to maven staging, which has bee verified by building spark, as well as a minimal test project. Please try the release and vote. The vote will run for 5 days. -Steve - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.3.3 (RC1)
+1 (binding) Signature : good Checksum : good. Compiled from source , good mvn clean install -DskipTests Ran aws integration tests, good. mvn -Dparallel-tests -DtestsThreadCount=8 clean verify Compiled gcs using staging repo with version 3.3.3, successful. mvn clean install -DskipTests -Dhadoop.version=3.3.3 -Psnapshots-and-staging On Thu, May 12, 2022 at 7:56 PM Stack wrote: > +1 (binding) > > * Signature: ok > * Checksum : ok > * Rat check (10.0.2): ok > - mvn clean apache-rat:check > * Built from source (10.0.2): ok > - mvn clean install -DskipTests > * Unit tests pass (10.0.2): ok > - mvn package -P runAllTests -Dsurefire.rerunFailingTestsCount=3 > > > [INFO] Apache Hadoop Cloud Storage Project SUCCESS [ > 0.026 s] > [INFO] > > [INFO] BUILD SUCCESS > [INFO] > > [INFO] Total time: 12:51 h > [INFO] Finished at: 2022-05-12T06:25:19-07:00 > [INFO] > > [WARNING] The requested profile "runAllTests" could not be activated > because it does not exist. > > Built a downstreamer against this RC and ran it in-the-small. Seemed fine. > > S > > > On Wed, May 11, 2022 at 10:25 AM Steve Loughran > > wrote: > > > I have put together a release candidate (RC1) for Hadoop 3.3.3 > > > > The RC is available at: > > https://dist.apache.org/repos/dist/dev/hadoop/3.3.3-RC1/ > > > > The git tag is release-3.3.3-RC1, commit d37586cbda3 > > > > The maven artifacts are staged at > > https://repository.apache.org/content/repositories/orgapachehadoop-1349/ > > > > You can find my public key at: > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS > > > > Change log > > https://dist.apache.org/repos/dist/dev/hadoop/3.3.3-RC1/CHANGELOG.md > > > > Release notes > > https://dist.apache.org/repos/dist/dev/hadoop/3.3.3-RC1/RELEASENOTES.md > > > > There's a very small number of changes, primarily critical code/packaging > > issues and security fixes. > > > > * The critical fixes which shipped in the 3.2.3 release. > > * CVEs in our code and dependencies > > * Shaded client packaging issues. > > * A switch from log4j to reload4j > > > > reload4j is an active fork of the log4j 1.17 library with the classes > > which contain CVEs removed. Even though hadoop never used those classes, > > they regularly raised alerts on security scans and concen from users. > > Switching to the forked project allows us to ship a secure logging > > framework. It will complicate the builds of downstream > > maven/ivy/gradle projects which exclude our log4j artifacts, as they > > need to cut the new dependency instead/as well. > > > > See the release notes for details. > > > > This is the second release attempt. It is the same git commit as before, > > but > > fully recompiled with another republish to maven staging, which has bee > > verified by building spark, as well as a minimal test project. > > > > Please try the release and vote. The vote will run for 5 days. > > > > -Steve > > >
Re: [VOTE] Release Apache Hadoop 3.3.3 (RC1)
+1 (binding) * Signature: ok * Checksum : ok * Rat check (10.0.2): ok - mvn clean apache-rat:check * Built from source (10.0.2): ok - mvn clean install -DskipTests * Unit tests pass (10.0.2): ok - mvn package -P runAllTests -Dsurefire.rerunFailingTestsCount=3 [INFO] Apache Hadoop Cloud Storage Project SUCCESS [ 0.026 s] [INFO] [INFO] BUILD SUCCESS [INFO] [INFO] Total time: 12:51 h [INFO] Finished at: 2022-05-12T06:25:19-07:00 [INFO] [WARNING] The requested profile "runAllTests" could not be activated because it does not exist. Built a downstreamer against this RC and ran it in-the-small. Seemed fine. S On Wed, May 11, 2022 at 10:25 AM Steve Loughran wrote: > I have put together a release candidate (RC1) for Hadoop 3.3.3 > > The RC is available at: > https://dist.apache.org/repos/dist/dev/hadoop/3.3.3-RC1/ > > The git tag is release-3.3.3-RC1, commit d37586cbda3 > > The maven artifacts are staged at > https://repository.apache.org/content/repositories/orgapachehadoop-1349/ > > You can find my public key at: > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS > > Change log > https://dist.apache.org/repos/dist/dev/hadoop/3.3.3-RC1/CHANGELOG.md > > Release notes > https://dist.apache.org/repos/dist/dev/hadoop/3.3.3-RC1/RELEASENOTES.md > > There's a very small number of changes, primarily critical code/packaging > issues and security fixes. > > * The critical fixes which shipped in the 3.2.3 release. > * CVEs in our code and dependencies > * Shaded client packaging issues. > * A switch from log4j to reload4j > > reload4j is an active fork of the log4j 1.17 library with the classes > which contain CVEs removed. Even though hadoop never used those classes, > they regularly raised alerts on security scans and concen from users. > Switching to the forked project allows us to ship a secure logging > framework. It will complicate the builds of downstream > maven/ivy/gradle projects which exclude our log4j artifacts, as they > need to cut the new dependency instead/as well. > > See the release notes for details. > > This is the second release attempt. It is the same git commit as before, > but > fully recompiled with another republish to maven staging, which has bee > verified by building spark, as well as a minimal test project. > > Please try the release and vote. The vote will run for 5 days. > > -Steve >
[VOTE] Release Apache Hadoop 3.3.3 (RC1)
I have put together a release candidate (RC1) for Hadoop 3.3.3 The RC is available at: https://dist.apache.org/repos/dist/dev/hadoop/3.3.3-RC1/ The git tag is release-3.3.3-RC1, commit d37586cbda3 The maven artifacts are staged at https://repository.apache.org/content/repositories/orgapachehadoop-1349/ You can find my public key at: https://dist.apache.org/repos/dist/release/hadoop/common/KEYS Change log https://dist.apache.org/repos/dist/dev/hadoop/3.3.3-RC1/CHANGELOG.md Release notes https://dist.apache.org/repos/dist/dev/hadoop/3.3.3-RC1/RELEASENOTES.md There's a very small number of changes, primarily critical code/packaging issues and security fixes. * The critical fixes which shipped in the 3.2.3 release. * CVEs in our code and dependencies * Shaded client packaging issues. * A switch from log4j to reload4j reload4j is an active fork of the log4j 1.17 library with the classes which contain CVEs removed. Even though hadoop never used those classes, they regularly raised alerts on security scans and concen from users. Switching to the forked project allows us to ship a secure logging framework. It will complicate the builds of downstream maven/ivy/gradle projects which exclude our log4j artifacts, as they need to cut the new dependency instead/as well. See the release notes for details. This is the second release attempt. It is the same git commit as before, but fully recompiled with another republish to maven staging, which has bee verified by building spark, as well as a minimal test project. Please try the release and vote. The vote will run for 5 days. -Steve
