+1(non-binding) * Builds from source look good. * Checksums and signatures are correct. * Running basic HDFS and MapReduce commands looks good.
> * TestAMRMProxy - Not able to reproduce in local > * TestFsck - I can see failure only I can see is TestFsck.testFsckListCorruptSnapshotFiles which passed after applying HDFS-15038 > * TestSLSStreamAMSynth - Not able to reproduce in local > * TestServiceAM - Not able to reproduce in local Thanks Masatake for driving this release. On Thu, Jul 21, 2022 at 5:51 AM Masatake Iwasaki <iwasak...@oss.nttdata.com> wrote: > Hi developers, > > I'm still waiting for your vote. > I'm considering the intermittent test failures mentioned by Chris are not > blocker. > Please file a JIRA and let me know if you find a blocker issue. > > I will appreciate your help for the release process. > > Regards, > Masatake Iwasaki > > On 2022/07/20 14:50, Masatake Iwasaki wrote: > >> TestServiceAM > > > > I can see the reported failure of TestServiceAM in some "Apache Hadoop > qbt Report: branch-3.2+JDK8 on Linux/x86_64". > > 3.3.0 and above might be fixed by YARN-8867 which added guard using > GenericTestUtils#waitFor for stabilizing the > testContainersReleasedWhenPreLaunchFails. > > YARN 8867 did not modified other code under hadoop-yarn-services. > > If it is the case, TestServiceAM can be tagged as flaky in branch-3.2. > > > > > > On 2022/07/20 14:21, Masatake Iwasaki wrote: > >> Thanks for testing the RC0, Chris. > >> > >>> The following are new test failures for me on 3.2.4: > >>> * TestAMRMProxy > >>> * TestFsck > >>> * TestSLSStreamAMSynth > >>> * TestServiceAM > >> > >> I could not reproduce the test failures on my local. > >> > >> For TestFsck, if the failed test case is > testFsckListCorruptSnapshotFiles, > >> cherry-picking HDFS-15038 (fixing only test code) could be the fix. > >> > >> The failure of TestSLSStreamAMSynth looks frequently reported by > >> "Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64". > >> It could be tagged as known flaky test. > >> > >> On 2022/07/20 9:15, Chris Nauroth wrote: > >>> -0 (binding) > >>> > >>> * Verified all checksums. > >>> * Verified all signatures. > >>> * Built from source, including native code on Linux. > >>> * mvn clean package -Pnative -Psrc -Drequire.openssl > -Drequire.snappy > >>> -Drequire.zstd -DskipTests > >>> * Tests mostly passed, but see below. > >>> * mvn --fail-never clean test -Pnative -Dparallel-tests > >>> -Drequire.snappy -Drequire.zstd -Drequire.openssl > >>> -Dsurefire.rerunFailingTestsCount=3 -DtestsThreadCount=8 > >>> > >>> The following are new test failures for me on 3.2.4: > >>> * TestAMRMProxy > >>> * TestFsck > >>> * TestSLSStreamAMSynth > >>> * TestServiceAM > >>> > >>> The following tests also failed, but they also fail for me on 3.2.3, so > >>> they aren't likely to be related to this release candidate: > >>> * TestCapacitySchedulerNodeLabelUpdate > >>> * TestFrameworkUploader > >>> * TestSLSGenericSynth > >>> * TestSLSRunner > >>> * test_libhdfs_threaded_hdfspp_test_shim_static > >>> > >>> I'm not voting a full -1, because I haven't done any root cause > analysis on > >>> these new test failures. I don't know if it's a quirk to my > environment, > >>> though I'm using the start-build-env.sh Docker container, so any build > >>> dependencies should be consistent. I'd be comfortable moving ahead if > >>> others are seeing these tests pass. > >>> > >>> Chris Nauroth > >>> > >>> > >>> On Thu, Jul 14, 2022 at 7:57 AM Masatake Iwasaki < > iwasak...@oss.nttdata.com> > >>> wrote: > >>> > >>>> +1 from myself. > >>>> > >>>> * skimmed the contents of site documentation. > >>>> > >>>> * built the source tarball on Rocky Linux 8 (x86_64) by OpenJDK 8 with > >>>> `-Pnative`. > >>>> > >>>> * launched pseudo distributed cluster including kms and httpfs with > >>>> Kerberos and SSL enabled. > >>>> > >>>> * created encryption zone, put and read files via httpfs. > >>>> * ran example MR wordcount over encryption zone. > >>>> > >>>> * launched 3-node docker cluster with NN-HA and RM-HA enabled and ran > some > >>>> example MR jobs. > >>>> > >>>> * built HBase 2.4.11, Hive 3.1.2 and Spark 3.1.2 against Hadoop 3.2.4 > RC0 > >>>> on CentOS 7 (x86_64) by using Bigtop branch-3.1 and ran > smoke-tests. > >>>> https://github.com/apache/bigtop/pull/942 > >>>> > >>>> * Hive needs updating exclusion rule to address HADOOP-18088 > (migration > >>>> to reload4j). > >>>> > >>>> * built Spark 3.3.0 against Hadoop 3.2.4 RC0 using the staging > repository:: > >>>> > >>>> <repository> > >>>> <id>staged</id> > >>>> <name>staged-releases</name> > >>>> <url> > >>>> > https://repository.apache.org/content/repositories/orgapachehadoop-1354 > >>>> </url> > >>>> <releases> > >>>> <enabled>true</enabled> > >>>> </releases> > >>>> <snapshots> > >>>> <enabled>true</enabled> > >>>> </snapshots> > >>>> </repository> > >>>> > >>>> Thanks, > >>>> Masatake Iwasaki > >>>> > >>>> On 2022/07/13 1:14, Masatake Iwasaki wrote: > >>>>> Hi all, > >>>>> > >>>>> Here's Hadoop 3.2.4 release candidate #0: > >>>>> > >>>>> The RC is available at: > >>>>> https://home.apache.org/~iwasakims/hadoop-3.2.4-RC0/ > >>>>> > >>>>> The RC tag is at: > >>>>> https://github.com/apache/hadoop/releases/tag/release-3.2.4-RC0 > >>>>> > >>>>> The Maven artifacts are staged at: > >>>>> > >>>> > https://repository.apache.org/content/repositories/orgapachehadoop-1354 > >>>>> > >>>>> You can find my public key at: > >>>>> https://downloads.apache.org/hadoop/common/KEYS > >>>>> > >>>>> Please evaluate the RC and vote. > >>>>> The vote will be open for (at least) 5 days. > >>>>> > >>>>> Thanks, > >>>>> Masatake Iwasaki > >>>>> > >>>>> --------------------------------------------------------------------- > >>>>> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > >>>>> For additional commands, e-mail: common-dev-h...@hadoop.apache.org > >>>>> > >>>> > >>>> --------------------------------------------------------------------- > >>>> To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org > >>>> For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org > >>>> > >>>> > >>> > >> > >> --------------------------------------------------------------------- > >> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > >> For additional commands, e-mail: common-dev-h...@hadoop.apache.org > >> > > > > --------------------------------------------------------------------- > > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > > For additional commands, e-mail: common-dev-h...@hadoop.apache.org > > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org > >
