Mostly or may be all of those failures are due to HADOOP-18324 <https://issues.apache.org/jira/browse/HADOOP-18324>, there is a Jira tracking issues with TestLeaseRecovery2 linked to that as well HDFS-16853 <https://issues.apache.org/jira/browse/HDFS-16853>
-Ayush On Wed, 28 Dec 2022 at 09:13, Viraj Jasani <vjas...@apache.org> wrote: > -0 (non-binding) > > Output of hadoop-vote.sh: > > * Signature: ok > * Checksum : ok > * Rat check (1.8.0_341): ok > - mvn clean apache-rat:check > * Built from source (1.8.0_341): ok > - mvn clean install -DskipTests > * Built tar from source (1.8.0_341): ok > - mvn clean package -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true > > Manual testing on local mini cluster: > * Basic CRUD tests on Hdfs looks good > * Sample MapReduce job looks good > * S3A tests look good with scale profile (ITestS3AContractUnbuffer is > flaky, but when run individually, it passes) > > Full build with all modules UT results for branch-3.3.5 latest HEAD are > available on > > https://ci-hadoop.apache.org/view/Hadoop/job/hadoop-qbt-3.3.5-java8-linux-x86_64/ > > From the above build, there are some consistently failing tests, out of > which only TestDataNodeRollingUpgrade passed locally, whereas rest of the > tests are consistently failing locally as well, we might want to fix (or > ignore, if required) them: > > > org.apache.hadoop.hdfs.TestErasureCodingPolicyWithSnapshot#testSnapshotsOnErasureCodingDirAfterNNRestart > > org.apache.hadoop.hdfs.TestFileLengthOnClusterRestart#testFileLengthWithHSyncAndClusterRestartWithOutDNsRegister > > org.apache.hadoop.hdfs.TestLeaseRecovery2#testHardLeaseRecoveryAfterNameNodeRestart > > org.apache.hadoop.hdfs.TestLeaseRecovery2#testHardLeaseRecoveryAfterNameNodeRestart2 > > org.apache.hadoop.hdfs.TestLeaseRecovery2#testHardLeaseRecoveryWithRenameAfterNameNodeRestart > > org.apache.hadoop.hdfs.server.datanode.TestDataNodeRollingUpgrade#testWithLayoutChangeAndFinalize > > org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshot#testSnapshotOpsOnRootReservedPath > > org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotBlocksMap#testReadRenamedSnapshotFileWithCheckpoint > > org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotDeletion#testApplyEditLogForDeletion > > > > On Wed, Dec 21, 2022 at 11:29 AM Steve Loughran > <ste...@cloudera.com.invalid> > wrote: > > > Mukund and I have put together a release candidate (RC0) for Hadoop > 3.3.5. > > > > Given the time of year it's a bit unrealistic to run a 5 day vote and > > expect people to be able to test it thoroughly enough to make this the > one > > we can ship. > > > > What we would like is for anyone who can to verify the tarballs, and test > > the binaries, especially anyone who can try the arm64 binaries. We've got > > the building of those done and now the build file will incorporate them > > into the release -but neither of us have actually tested it yet. Maybe I > > should try it on my pi400 over xmas. > > > > The maven artifacts are up on the apache staging repo -they are the ones > > from x86 build. Building and testing downstream apps will be incredibly > > helpful. > > > > The RC is available at: > > https://dist.apache.org/repos/dist/dev/hadoop/hadoop-3.3.5-RC0/ > > > > The git tag is release-3.3.5-RC0, commit 3262495904d > > > > The maven artifacts are staged at > > https://repository.apache.org/content/repositories/orgapachehadoop-1365/ > > > > You can find my public key at: > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS > > > > Change log > > > https://dist.apache.org/repos/dist/dev/hadoop/hadoop-3.3.5-RC0/CHANGELOG.md > > > > Release notes > > > > > https://dist.apache.org/repos/dist/dev/hadoop/hadoop-3.3.5-RC0/RELEASENOTES.md > > > > This is off branch-3.3 and is the first big release since 3.3.2. > > > > Key changes include > > > > * Big update of dependencies to try and keep those reports of > > transitive CVEs under control -both genuine and false positive. > > * HDFS RBF enhancements > > * Critical fix to ABFS input stream prefetching for correct reading. > > * Vectored IO API for all FSDataInputStream implementations, with > > high-performance versions for file:// and s3a:// filesystems. > > file:// through java native io > > s3a:// parallel GET requests. > > * This release includes Arm64 binaries. Please can anyone with > > compatible systems validate these. > > > > > > Please try the release and vote on it, even though i don't know what is a > > good timeline here...i'm actually going on holiday in early jan. Mukund > is > > around and so can drive the process while I'm offline. > > > > Assuming we do have another iteration, the RC1 will not be before mid jan > > for that reason > > > > Steve (and mukund) > > >
