There's a TODO in the code for that issue, too. The issue just needs
somebody to work on it. It might be a simple matter of ensuring the
VolumeChooserEnvironment created in the init code has an appropriate
service environment object which contains the site configuration (but
not the system config
Good news: after fixing up the classpath to:
$HADOOP_PREFIX/share/hadoop/client/[^.].*.jar,
$HADOOP_PREFIX/share/hadoop/common/lib/(?!slf4j)[^.].*.jar,
$HADOOP_PREFIX/share/hadoop/hdfs/[^.].*.jar,
$HADOOP_PREFIX/share/hadoop/mapreduce/[^.].*.jar,
swap out Guava 27.0-jre with 27.0-android
On Wed, Nov 20, 2019 at 9:51 PM Arvind Shyamsundar
wrote:
>
> Hello!
> Per this issue(https://github.com/apache/accumulo/issues/569) building 1.9.x
> with Hadoop 3 support needs hadoop.profile=3. So I checked out current 1.9
> branch and built with
Thanks, Keith for all your inputs. FYI this cluster was deployed via. Muchos
and that accumulo-site template has:
$HADOOP_PREFIX/share/hadoop/common/[^.].*.jar,
$HADOOP_PREFIX/share/hadoop/common/lib/(?!slf4j)[^.].*.jar,
$HADOOP_PREFIX/share/hadoop/hdfs/[^.].*.jar,
Can you check that your accumulo-site.xml only adds
$HADOOP_PREFIX/share/hadoop/client/[^.].*.jar for hadoop deps for the
setting general.classpaths? Not completely sure, but I think this
will use the hadoop shaded jars.
Do not want the non-shaded hadoop jars like
Another possible path to solve this is with a different classpath and
dependency for hadoop 3. In Accumulo 2.0 we depend on the hadoop
client shaded jar, which has its own shaded and relocated version of
Guava internally. Using the Hadoop shaded jar would solve this
problem. Not sure what that
I looked at the history[1] of the hadoop project pom and found that
HADOOP-16213[2] seems to be the cause of this change. So it seems like
we need to bump the guava version if we want to work with newer
versions of Hadoop 3.
One of the goals of 1.9 (and I think 1.10) is to be a bridge version
Hi Keith,
Thanks for clarifying.
For now, it make sense to go with the init approach & look at the fix in
2.1 when released.
Cheers,
Karthick
-Original Message-
From: Keith Turner
Sent: Wednesday, November 20, 2019 7:28 AM
To: Accumulo Dev List
Subject: Re:
