sure
On Thu, Apr 6, 2023 at 3:33 PM Christopher <ctubb...@apache.org> wrote:
> Mark, I'm having trouble trying to parse the unformatted text dump in
> the email thread. Would you mind creating issues for the bugs you saw?
> That way, you can put output in markdown blocks with triple backticks.
>
> On Thu, Apr 6, 2023 at 3:27 PM Mark Owens <jmoapa...@gmail.com> wrote:
> >
> > After downloading the artifacts, I ran the following:
> >
> > tar szf accumulo-1.10.3-src.tar.gz
> > cd accumulo-1.10.3/
> > mvn clean package
> >
> > The output in the surefire-reports directory doesn't provide too much
> info.
> >
> > Test set:
> > org.apache.accumulo.start.classloader.vfs.providers.VfsClassLoaderTest
> >
> -------------------------------------------------------------------------------
> > Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.716 s
> <<<
> > FAILURE! - in
> > org.apache.accumulo.start.classloader.vfs.providers.VfsClassLoaderTest
> > org.apache.accumulo.start.classloader.vfs.providers.VfsClassLoaderTest
> > Time elapsed: 1.698 s <<< ERROR!
> > java.lang.ExceptionInInitializerError
> > Caused by: java.lang.StringIndexOutOfBoundsException: begin 0, end 3,
> > length 2
> >
> >
> > [main} INFO org.apache.hadoop.hdfs.MiniDFSCluster - starting cluster:
> > numNameNodes=1, numDataNodes=1
> > [main} INFO org.apache.hadoop.hdfs.MiniDFSCluster - Shutting down the
> > Mini HDFS Cluster
> >
> > No additional stacktrace info provided just from running the tests. I
> then
> > attempted to install Accumulo using fluo-uno. ZooKeeper throws the
> > following stacktrace (which I remember the out of bounds being related to
> > in the past):
> >
> > > uno setup accumulo
> > > uno status
> > This display accumulo and haoop running but no ZK. Attempts to start
> again
> > reveals the stacktrace info below.
> > > uno start accumulo
> >
> > ZooKeeper JMX enabled by default
> >
> >
> > Using config:
> > ${HOME}/dev/fluo-uno/install/zookeeper-3.4.14/bin/../conf/zoo.cfg
> >
> > Starting zookeeper ... STARTED
> >
> >
> > Exception in thread "main" java.lang.ExceptionInInitializerError
> >
> >
> > at
> >
> org.apache.hadoop.util.GenericOptionsParser.preProcessForWindows(GenericOptionsParser.java:438)
> > at
> >
> org.apache.hadoop.util.GenericOptionsParser.parseGeneralOptions(GenericOptionsParser.java:484)
> >
> > at
> >
> org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:170)
> >
> > at
> >
> org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:153)
> >
> > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:64)
> >
> >
> > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
> >
> > at org.apache.hadoop.hdfs.tools.GetConf.main(GetConf.java:331)
> >
> >
> > Caused by: java.lang.StringIndexOutOfBoundsException: begin 0, end 3,
> > length 2
> >
> > at
> java.base/java.lang.String.checkBoundsBeginEnd(String.java:3319)
> >
> >
> > at java.base/java.lang.String.substring(String.java:1874)
> >
> >
> > at org.apache.hadoop.util.Shell.<clinit>(Shell.java:50)
> >
> >
> > ... 7 more
> >
> >
> > Starting namenodes on []
> >
> >
> > localhost: starting namenode, logging to
> >
> /home/mark/dev/fluo-uno/install/logs/hadoop/hadoop-mark-namenode-devlap.out
> >
> > localhost: starting datanode, logging to
> >
> /home/mark/dev/fluo-uno/install/logs/hadoop/hadoop-mark-datanode-devlap.out
> >
> > Exception in thread "main" java.lang.ExceptionInInitializerError
> >
> >
> > at
> >
> org.apache.hadoop.util.GenericOptionsParser.preProcessForWindows(GenericOptionsParser.java:438)
> > at
> >
> org.apache.hadoop.util.GenericOptionsParser.parseGeneralOptions(GenericOptionsParser.java:484)
> > at
> >
> org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:170)
> > at
> >
> org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:153)
> > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:64)
> >
> > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
> >
> > at org.apache.hadoop.hdfs.tools.GetConf.main(GetConf.java:331)
> >
> > Caused by: java.lang.StringIndexOutOfBoundsException: begin 0, end 3,
> > length 2
> >
> > at
> java.base/java.lang.String.checkBoundsBeginEnd(String.java:3319)
> >
> >
> > at java.base/java.lang.String.substring(String.java:1874)
> >
> >
> > at org.apache.hadoop.util.Shell.<clinit>(Shell.java:50)
> >
> >
> > ... 7 more
> >
> >
> > starting yarn daemons
> >
> >
> > starting resourcemanager, logging to
> >
> /home/mark/dev/fluo-uno/install/logs/hadoop/yarn-mark-resourcemanager-devlap.out
> >
> > localhost: starting nodemanager, logging to
> >
> /home/mark/dev/fluo-uno/install/logs/hadoop/yarn-mark-nodemanager-devlap.out
> >
> > Starting monitor on localhost
> >
> >
> > Starting tablet servers .... done
> >
> >
> > OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was
> deprecated
> > in version 9.0 and will likely be removed in a future release.
> >
> > Starting tserver on localhost
> >
> >
> > WARNING: An illegal reflective access operation has occurred
> >
> >
> > WARNING: Illegal reflective access by
> > org.apache.hadoop.security.authentication.util.KerberosUtil
> > (file:/home/mark/dev/fluo-uno/install/hadoop-2.6.5/share/hadoop/common
> > /lib/hadoop-auth-2.6.5.jar) to method
> > sun.security.krb5.Config.getInstance()
> >
> > WARNING: Please consider reporting this to the maintainers of
> > org.apache.hadoop.security.authentication.util.KerberosUtil
> >
> > WARNING: Use --illegal-access=warn to enable warnings of further illegal
> > reflective access operations
> >
> > WARNING: All illegal access operations will be denied in a future release
> >
> >
> > 2023-04-06 15:21:02,511 [start.Main] ERROR: Thread
> > 'org.apache.accumulo.master.state.SetGoalState' died.
> > java.lang.ExceptionInInitializerError
> >
> > at
> org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:79)
> >
> > at
> > org.apache.hadoop.security.Groups.parseStaticMapping(Groups.java:116)
> > at org.apache.hadoop.security.Groups.<init>(Groups.java:93)
> > at org.apache.hadoop.security.Groups.<init>(Groups.java:73)
> > at
> >
> org.apache.hadoop.security.Groups.getUserToGroupsMappingService(Groups.java:293)
> > at
> >
> org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:283)
> > at
> >
> org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:260)
> > at
> >
> org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:789)
> > at
> >
> org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:774)
> > at
> >
> org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:647)
> > at
> > org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2755)
> > at
> > org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2747)
> > at
> org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2613)
> > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:370)
> > at org.apache.hadoop.fs.Path.getFileSystem(Path.java:296)
> > at
> > org.apache.accumulo.core.volume.VolumeImpl.<init>(VolumeImpl.java:45)
> > at
> >
> org.apache.accumulo.core.volume.VolumeConfiguration.create(VolumeConfiguration.java:161)
> > at
> >
> org.apache.accumulo.server.fs.VolumeManagerImpl.get(VolumeManagerImpl.java:357)
> > at
> >
> org.apache.accumulo.server.fs.VolumeManagerImpl.get(VolumeManagerImpl.java:339)
> > at
> >
> org.apache.accumulo.server.fs.VolumeManagerImpl.get(VolumeManagerImpl.java:333)
> > at
> > org.apache.accumulo.master.state.SetGoalState.main(SetGoalState.java:46)
> > at
> > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
> > Method)
> > at
> >
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> > at
> >
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > at java.base/java.lang.reflect.Method.invoke(Method.java:566)
> > at org.apache.accumulo.start.Main$2.run(Main.java:170)
> > at java.base/java.lang.Thread.run(Thread.java:834)
> > Caused by: java.lang.StringIndexOutOfBoundsException: begin 0, end 3,
> > length 2
> > at
> java.base/java.lang.String.checkBoundsBeginEnd(String.java:3319)
> > at java.base/java.lang.String.substring(String.java:1874)
> > at org.apache.hadoop.util.Shell.<clinit>(Shell.java:50)
> > ... 27 more
> >
> >
> >
> > On Thu, Apr 6, 2023 at 3:09 PM Christopher <ctubb...@apache.org> wrote:
> >
> > > I think we need more of that stack trace to be able to interpret it at
> all.
> > >
> > > On Thu, Apr 6, 2023, 13:57 Mark Owens <jmoapa...@gmail.com> wrote:
> > >
> > > > I'm also running into an issue with the VfsClassLoaderTest.
> > > >
> > > > java.lang.ExceptionInInitializerError
> > > >
> > > >
> > > > Caused by: java.lang.StringIndexOutOfBoundsException: begin 0, end 3,
> > > > length 2
> > > >
> > > > I've seen this error message before but can't recall the details.
> May be
> > > > some misconfiguration on my machine perhaps, but I'm not sure.
> > > >
> > > > On Thu, Apr 6, 2023 at 1:48 PM Dave Marion <dmario...@gmail.com>
> wrote:
> > > >
> > > > > `mvn -Dtimeout.factor=2 clean package -Psunny` works, but `mvn
> > > > > -Dtimeout.factor=2 clean package -Psunny,hadoop3` fails with:
> > > > >
> > > > > [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time
> elapsed:
> > > > > 1.153 s <<< FAILURE! - in
> > > > >
> org.apache.accumulo.start.classloader.vfs.providers.VfsClassLoaderTest
> > > > > [ERROR]
> > > > >
> org.apache.accumulo.start.classloader.vfs.providers.VfsClassLoaderTest
> > > > > Time elapsed: 1.15 s <<< ERROR!
> > > > > java.lang.NoSuchMethodError: 'boolean
> > > > >
> > > > >
> > > >
> > >
> org.eclipse.jetty.servlet.ServletMapping.containsPathSpec(java.lang.String)'
> > > > >
> > > > > On Thu, Apr 6, 2023 at 1:36 PM Dave Marion <dmario...@gmail.com>
> > > wrote:
> > > > >
> > > > > > `mvn -Dtimeout.factor=2 clean package` worked. Thanks!
> > > > > >
> > > > > > On Thu, Apr 6, 2023 at 1:19 PM Christopher <ctubb...@apache.org>
> > > > wrote:
> > > > > >
> > > > > >> Might just be a coincidence. If it's still failing with a higher
> > > > > timeout,
> > > > > >> I
> > > > > >> can look into it.
> > > > > >>
> > > > > >> On Thu, Apr 6, 2023, 12:51 Dave Marion <dmario...@gmail.com>
> wrote:
> > > > > >>
> > > > > >> > I just thought it was odd that it was working in one place
> (git
> > > > > >> workspace),
> > > > > >> > but not from the source tarball.
> > > > > >> >
> > > > > >> > On Thu, Apr 6, 2023 at 12:48 PM Christopher <
> ctubb...@apache.org>
> > > > > >> wrote:
> > > > > >> >
> > > > > >> > > Those are timeouts. The tests are passing in Jenkins. I
> suspect
> > > > your
> > > > > >> > > machine is a little slower, but would finish with more
> time. You
> > > > can
> > > > > >> set
> > > > > >> > > -Dtimeout.factor=2 to try to work around it for a local
> build
> > > on a
> > > > > >> > machine
> > > > > >> > > with more constrained resources. I wouldn't be surprised if
> 1.10
> > > > > tests
> > > > > >> > were
> > > > > >> > > a bit more flaky than newer branches, also, just because of
> test
> > > > > >> > > improvements over time, but timeouts can happen for any of
> our
> > > > > >> branches.
> > > > > >> > So
> > > > > >> > > overriding the arbitrary timeout by some factor can help.
> > > > > >> > >
> > > > > >> > > On Thu, Apr 6, 2023, 12:41 Dave Marion <dmario...@gmail.com
> >
> > > > wrote:
> > > > > >> > >
> > > > > >> > > > Verified sha1 & md5 signatures
> > > > > >> > > > Verified signing key
> > > > > >> > > >
> > > > > >> > > > Ran into an issue trying to build from the source
> tarball. I
> > > > > tried 3
> > > > > >> > > times
> > > > > >> > > > with the command `mvn clean package` and the build failed
> in
> > > the
> > > > > >> same
> > > > > >> > > spot
> > > > > >> > > > every time (see below). Note that on the same machine I
> ran
> > > `mvn
> > > > > >> clean
> > > > > >> > > > package` on my local git workspace copy of the 1.10
> branch (at
> > > > > >> > > > commit fb09e7e2594c451317ce6294b9dd27bd0c5e6c05) with no
> > > issues.
> > > > > >> > > >
> > > > > >> > > > [ERROR] Tests run: 6, Failures: 0, Errors: 2, Skipped: 0,
> Time
> > > > > >> elapsed:
> > > > > >> > > > 96.173 s <<< FAILURE! - in
> > > > > >> > > > org.apache.accumulo.minicluster.MiniAccumuloClusterTest
> > > > > >> > > > [ERROR]
> > > > > >> > > >
> > > > > >> > > >
> > > > > >> > >
> > > > > >> >
> > > > > >>
> > > > >
> > > >
> > >
> org.apache.accumulo.minicluster.MiniAccumuloClusterTest.testPerTableClasspath
> > > > > >> > > > Time elapsed: 60.009 s <<< ERROR!
> > > > > >> > > > org.junit.runners.model.TestTimedOutException: test timed
> out
> > > > > after
> > > > > >> > 60000
> > > > > >> > > > milliseconds
> > > > > >> > > > at
> > > > > >> > > >
> > > > > >> > > >
> > > > > >> > >
> > > > > >> >
> > > > > >>
> > > > >
> > > >
> > >
> app//org.apache.accumulo.minicluster.MiniAccumuloClusterTest.testPerTableClasspath(MiniAccumuloClusterTest.java:169)
> > > > > >> > > >
> > > > > >> > > > [ERROR]
> > > > > org.apache.accumulo.minicluster.MiniAccumuloClusterTest.test
> > > > > >> > > Time
> > > > > >> > > > elapsed: 30.001 s <<< ERROR!
> > > > > >> > > > org.junit.runners.model.TestTimedOutException: test timed
> out
> > > > > after
> > > > > >> > 30000
> > > > > >> > > > milliseconds
> > > > > >> > > > at
> > > > > >> > > >
> > > > > >> > > >
> > > > > >> > >
> > > > > >> >
> > > > > >>
> > > > >
> > > >
> > >
> app//org.apache.accumulo.minicluster.MiniAccumuloClusterTest.test(MiniAccumuloClusterTest.java:157)
> > > > > >> > > >
> > > > > >> > > > On Wed, Apr 5, 2023 at 7:24 PM dev1 <d...@etcoleman.com>
> > > wrote:
> > > > > >> > > >
> > > > > >> > > > > I did some quick checks and all looks good.
> > > > > >> > > > >
> > > > > >> > > > > - verified sha512 signatures
> > > > > >> > > > > - verified signing key
> > > > > >> > > > > - sunny tests pass.
> > > > > >> > > > >
> > > > > >> > > > > Ed Coleman
> > > > > >> > > > >
> > > > > >> > > > > -----Original Message-----
> > > > > >> > > > > From: Christopher <ctubb...@apache.org>
> > > > > >> > > > > Sent: Wednesday, April 5, 2023 4:25 PM
> > > > > >> > > > > To: accumulo-dev <dev@accumulo.apache.org>
> > > > > >> > > > > Subject: [TEST][VOTE] Apache Accumulo 1.10.3-rc0
> > > > > >> > > > >
> > > > > >> > > > > Accumulo Developers,
> > > > > >> > > > >
> > > > > >> > > > > This is not an actual vote.
> > > > > >> > > > > I have prepared the following release candidate as a
> test
> > > > build
> > > > > >> for
> > > > > >> > > > > 1.10.3. If there are no immediate objections or issues,
> I
> > > > intend
> > > > > >> to
> > > > > >> > > > create
> > > > > >> > > > > an RC1 release candidate in the next day or so, to vote
> on.
> > > > > >> > > > >
> > > > > >> > > > > Git Commit:
> > > > > >> > > > > ed75b4521094faa6f6e1037a444747390a120068
> > > > > >> > > > > Branch:
> > > > > >> > > > > 1.10.3-rc0
> > > > > >> > > > >
> > > > > >> > > > > If this vote passes, a gpg-signed tag will be created
> using:
> > > > > >> > > > > git tag -f -s -m 'Apache Accumulo 1.10.3'
> rel/1.10.3 \
> > > > > >> > > > > ed75b4521094faa6f6e1037a444747390a120068
> > > > > >> > > > >
> > > > > >> > > > > Staging repo:
> > > > > >> > > > >
> > > > > >> > > >
> > > > > >> > >
> > > > > >> >
> > > > > >>
> > > > >
> > > >
> > >
> https://repository.apache.org/content/repositories/orgapacheaccumulo-1099
> > > > > >> > > > > Source (official release artifact):
> > > > > >> > > > >
> > > > > >> > > > >
> > > > > >> > > >
> > > > > >> > >
> > > > > >> >
> > > > > >>
> > > > >
> > > >
> > >
> https://repository.apache.org/content/repositories/orgapacheaccumulo-1099/org/apache/accumulo/accumulo/1.10.3/accumulo-1.10.3-src.tar.gz
> > > > > >> > > > > Binary:
> > > > > >> > > > >
> > > > > >> > > >
> > > > > >> > >
> > > > > >> >
> > > > > >>
> > > > >
> > > >
> > >
> https://repository.apache.org/content/repositories/orgapacheaccumulo-1099/org/apache/accumulo/accumulo/1.10.3/accumulo-1.10.3-bin.tar.gz
> > > > > >> > > > >
> > > > > >> > > > > Append ".asc" to download the cryptographic signature
> for a
> > > > > given
> > > > > >> > > > artifact.
> > > > > >> > > > > (You can also append ".sha1" or ".md5" instead in order
> to
> > > > > verify
> > > > > >> the
> > > > > >> > > > > checksums generated by Maven to verify the integrity of
> the
> > > > > Nexus
> > > > > >> > > > > repository staging area.)
> > > > > >> > > > >
> > > > > >> > > > > Signing keys are available at
> > > > > >> > > https://www.apache.org/dist/accumulo/KEYS
> > > > > >> > > > > (Expected fingerprint:
> > > > 8CC4F8A2B29C2B040F2B835D6F0CDAE700B6899D)
> > > > > >> > > > >
> > > > > >> > > > > In addition to the tarballs and their signatures, the
> > > > following
> > > > > >> > > checksum
> > > > > >> > > > > files will be added to the dist/release SVN area after
> > > > release:
> > > > > >> > > > > accumulo-1.10.3-src.tar.gz.sha512 will contain:
> > > > > >> > > > > SHA512 (accumulo-1.10.3-src.tar.gz) =
> > > > > >> > > > >
> > > > > >> > > > >
> > > > > >> > > >
> > > > > >> > >
> > > > > >> >
> > > > > >>
> > > > >
> > > >
> > >
> 5ec3baab85a0338b273fb5bd79bf2146c855077333f8a170c9e7093810f8591c458479bcebb5d57a4134a00f02b1c060db159e6ff086241aac6532d0e3e033f2
> > > > > >> > > > > accumulo-1.10.3-bin.tar.gz.sha512 will contain:
> > > > > >> > > > > SHA512 (accumulo-1.10.3-bin.tar.gz) =
> > > > > >> > > > >
> > > > > >> > > > >
> > > > > >> > > >
> > > > > >> > >
> > > > > >> >
> > > > > >>
> > > > >
> > > >
> > >
> f8465b81c37067001b31ee109648760d51b78d91cff7ac93735af1735c2b6ee4f37e58cbd64253e257590fdc03fe784ef85782cc5b5039a8db170ca965c8628c
> > > > > >> > > > >
> > > > > >> > > > > Release notes (in progress) can be found at:
> > > > > >> > > > >
> https://accumulo.staged.apache.org/release/accumulo-1.10.3
> > > > > >> > > > >
> > > > > >> > > > > Release testing instructions:
> > > > > >> > > > >
> https://accumulo.apache.org/contributor/verifying-release
> > > > > >> > > > >
> > > > > >> > > > > Please vote one of:
> > > > > >> > > > > [ ] +1 - I have verified and accept...
> > > > > >> > > > > [ ] +0 - I have reservations, but not strong enough to
> vote
> > > > > >> > against...
> > > > > >> > > > > [ ] -1 - Because..., I do not accept...
> > > > > >> > > > > ... these artifacts as the 1.10.3 release of Apache
> > > Accumulo.
> > > > > >> > > > >
> > > > > >> > > > > This vote will remain open until at least Sat Apr 8
> > > 08:30:00
> > > > PM
> > > > > >> UTC
> > > > > >> > > > 2023.
> > > > > >> > > > > (Sat Apr 8 04:30:00 PM EDT 2023 / Sat Apr 8 01:30:00
> PM
> > > PDT
> > > > > >> 2023)
> > > > > >> > > > Voting
> > > > > >> > > > > can continue after this deadline until the release
> manager
> > > > sends
> > > > > >> an
> > > > > >> > > email
> > > > > >> > > > > ending the vote.
> > > > > >> > > > >
> > > > > >> > > > > Thanks!
> > > > > >> > > > >
> > > > > >> > > > > P.S. Hint: download the whole staging repo with
> > > > > >> > > > > wget -erobots=off -r -l inf -np -nH \
> > > > > >> > > > >
> > > > > >> > > > >
> > > > > >> > > >
> > > > > >> > >
> > > > > >> >
> > > > > >>
> > > > >
> > > >
> > >
> https://repository.apache.org/content/repositories/orgapacheaccumulo-1099/
> > > > > >> > > > > # note the trailing slash is needed
> > > > > >> > > > >
> > > > > >> > > >
> > > > > >> > >
> > > > > >> >
> > > > > >>
> > > > > >
> > > > >
> > > >
> > >
>
