Updating commons-configuration from 1.6 to 1.10 did the trick I think. Versions 1.7, 1.8, and 1.9 had compilation issues. I'm not veto-ing because other people have built with the hadoop3 profile even though more than one of us have had an issue. Here are the changes I made to get me past the CredentialProviderFactoryShimTest test failure in conf using the hadoop3 profile.
diff --git a/core/pom.xml b/core/pom.xml index 163a1c062f..2aad10486a 100644 --- a/core/pom.xml +++ b/core/pom.xml @@ -201,6 +201,8 @@ <allow>org[.]apache[.]hadoop[.]mapred[.](FileAlreadyExistsException|InvalidJobConfException)</allow> <!-- allow lexicoders to throw iterator exceptions --> <allow>org[.]apache[.]accumulo[.]core[.]iterators[.]ValueFormatException</allow> + <!-- allow commons-configuration for deprecated ClientConfiguration constructor --> + <allow>org[.]apache[.]commons[.]configuration[.]Configuration</allow> </allows> </configuration> </execution> diff --git a/pom.xml b/pom.xml index 854443da2d..2193b46b54 100644 --- a/pom.xml +++ b/pom.xml @@ -212,7 +212,7 @@ <dependency> <groupId>commons-configuration</groupId> <artifactId>commons-configuration</artifactId> - <version>1.6</version> + <version>1.10</version> </dependency> <dependency> <groupId>commons-io</groupId> On Mon, Apr 10, 2023 at 12:16 PM Dave Marion <dmario...@gmail.com> wrote: > From what I can tell: > > 1. commons-configuration:1.6 has a commons-beanutils:1.7.0 dependency > 2. hadoop-common:3.0.3 has a commons-beanutils:1.9.3 dependency, > hadoop-common:2.6.5 has no such dependency > > Hadoop 3.0.3 is failing because the commons-beanutils:1.9.3 dependency > must not be on the classpath for the test. I have no idea why this is > failing on my machine and not for others. I'm also seeing general slowness > building 1.10.3 on my machine, but not building other git branches. > > On Mon, Apr 10, 2023 at 8:24 AM Dave Marion <dmario...@gmail.com> wrote: > >> I built the source tarball using the hadoop3 profile again and >> encountered the issue below. The version of hadoop (3.0.3) has not changed, >> so I assume that this is related to a change in our dependencies. >> >> [ERROR] Tests run: 10, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: >> 3.856 s <<< FAILURE! - in >> org.apache.accumulo.core.conf.CredentialProviderFactoryShimTest >> [ERROR] >> org.apache.accumulo.core.conf.CredentialProviderFactoryShimTest.extractFromHdfs >> Time elapsed: 1.186 s <<< ERROR! >> java.lang.NoClassDefFoundError: >> org/apache/commons/beanutils/BeanIntrospector >> at >> org.apache.accumulo.core.conf.CredentialProviderFactoryShimTest.extractFromHdfs(CredentialProviderFactoryShimTest.java:185) >> Caused by: java.lang.ClassNotFoundException: >> org.apache.commons.beanutils.BeanIntrospector >> at >> org.apache.accumulo.core.conf.CredentialProviderFactoryShimTest.extractFromHdfs(CredentialProviderFactoryShimTest.java:185) >> >> On Sun, Apr 9, 2023 at 11:41 AM Jeffrey Manno <jeffreymann...@gmail.com> >> wrote: >> >>> +1 >>> >>> I did run into a few flaky tests but none seem to warrant a stoppage to >>> this release candidate. Two common ones are SuspendTabletsIT and >>> DeleteTableDuringSplitIT. >>> >>> Other checks I did: >>> >>> - Ran the entire test suite, along with sunny day tests. >>> - Verified checksums. >>> - Did some small ingest testing with agitation. >>> >>> >>> On Sat, Apr 8, 2023 at 9:18 AM Christopher Shannon < >>> christopher.l.shan...@gmail.com> wrote: >>> >>> > +1 (binding), LGTM >>> > >>> > Some of the things I did for verification/testing locally: >>> > >>> > * Validated signatures and checksums >>> > * Verified license and notice files in archives >>> > * Verified source license headers with 'mvn apache-rat:check' >>> > * Built and ran all the sunny integration tests >>> > * Started up using Uno to make sure everything started correctly (also >>> ran >>> > a couple scans, etc) >>> > >>> > On Fri, Apr 7, 2023 at 4:23 PM Christopher <ctubb...@apache.org> >>> wrote: >>> > >>> > > Accumulo Developers, >>> > > >>> > > Please consider the following candidate for Apache Accumulo 1.10.3. >>> > > >>> > > Git Commit: >>> > > 733863638d85d0109d217da7ea5f36f5e483e207 >>> > > Branch: >>> > > 1.10.3-rc1 >>> > > >>> > > If this vote passes, a gpg-signed tag will be created using: >>> > > git tag -f -s -m 'Apache Accumulo 1.10.3' rel/1.10.3 \ >>> > > 733863638d85d0109d217da7ea5f36f5e483e207 >>> > > >>> > > Staging repo: >>> > > >>> > >>> https://repository.apache.org/content/repositories/orgapacheaccumulo-1100 >>> > > Source (official release artifact): >>> > > >>> > > >>> > >>> https://repository.apache.org/content/repositories/orgapacheaccumulo-1100/org/apache/accumulo/accumulo/1.10.3/accumulo-1.10.3-src.tar.gz >>> > > Binary: >>> > > >>> > >>> https://repository.apache.org/content/repositories/orgapacheaccumulo-1100/org/apache/accumulo/accumulo/1.10.3/accumulo-1.10.3-bin.tar.gz >>> > > >>> > > Append ".asc" to download the cryptographic signature for a given >>> > artifact. >>> > > (You can also append ".sha1" or ".md5" instead in order to verify the >>> > > checksums >>> > > generated by Maven to verify the integrity of the Nexus repository >>> > > staging area.) >>> > > >>> > > Signing keys are available at >>> https://www.apache.org/dist/accumulo/KEYS >>> > > (Expected fingerprint: 8CC4F8A2B29C2B040F2B835D6F0CDAE700B6899D) >>> > > >>> > > In addition to the tarballs and their signatures, the following >>> checksum >>> > > files will be added to the dist/release SVN area after release: >>> > > accumulo-1.10.3-src.tar.gz.sha512 will contain: >>> > > SHA512 (accumulo-1.10.3-src.tar.gz) = >>> > > >>> > > >>> > >>> 436707da7424ea1b7993355d70747068264276234a4772f9da3866a638ad7860a754436f34ab2108e54801cced67f00ca2cfe0f46dfb80f2d7609b7b7112045e >>> > > accumulo-1.10.3-bin.tar.gz.sha512 will contain: >>> > > SHA512 (accumulo-1.10.3-bin.tar.gz) = >>> > > >>> > > >>> > >>> 36e6795ad3720ba72fc9f4ddabf45f6d67cdc77658a181733fa2c47bfd3799f123b8840a79b538b8504a7b4bdc97fd0b52efab790395a5e022a897bc18405d0c >>> > > >>> > > Release notes (in progress) can be found at: >>> > > https://accumulo.staged.apache.org/release/accumulo-1.10.3 >>> > > >>> > > Release testing instructions: >>> > > https://accumulo.apache.org/contributor/verifying-release >>> > > >>> > > Please vote one of: >>> > > [ ] +1 - I have verified and accept... >>> > > [ ] +0 - I have reservations, but not strong enough to vote >>> against... >>> > > [ ] -1 - Because..., I do not accept... >>> > > ... these artifacts as the 1.10.3 release of Apache Accumulo. >>> > > >>> > > This vote will remain open until at least Mon Apr 10 08:30:00 PM UTC >>> > 2023. >>> > > (Mon Apr 10 04:30:00 PM EDT 2023 / Mon Apr 10 01:30:00 PM PDT 2023) >>> > > Voting can continue after this deadline until the release manager >>> > > sends an email ending the vote. >>> > > >>> > > Thanks! >>> > > >>> > > P.S. Hint: download the whole staging repo with >>> > > wget -erobots=off -r -l inf -np -nH \ >>> > > >>> > > >>> > >>> https://repository.apache.org/content/repositories/orgapacheaccumulo-1100/ >>> > > # note the trailing slash is needed >>> > > >>> > >>> >>