: Arvind Shyamsundar
Sent: Thursday, November 21, 2019 10:29 AM
To: dev@accumulo.apache.org
Subject: RE: Issues building 1.9-snapshot and Hadoop 3.1.3
Thanks, Keith for all your inputs. FYI this cluster was deployed via. Muchos
and that accumulo-site template has:
$HADOOP_PREFIX/share
swap out Guava 27.0-jre with 27.0-android
On Wed, Nov 20, 2019 at 9:51 PM Arvind Shyamsundar
wrote:
>
> Hello!
> Per this issue(https://github.com/apache/accumulo/issues/569) building 1.9.x
> with Hadoop 3 support needs hadoop.profile=3. So I checked out current 1.9
> branch and built with
To: Accumulo Dev List
Subject: Re: Issues building 1.9-snapshot and Hadoop 3.1.3
Can you check that your accumulo-site.xml only adds
$HADOOP_PREFIX/share/hadoop/client/[^.].*.jar for hadoop deps for the setting
general.classpaths? Not completely sure, but I think this will use the hadoop
shaded
Can you check that your accumulo-site.xml only adds
$HADOOP_PREFIX/share/hadoop/client/[^.].*.jar for hadoop deps for the
setting general.classpaths? Not completely sure, but I think this
will use the hadoop shaded jars.
Do not want the non-shaded hadoop jars like
Another possible path to solve this is with a different classpath and
dependency for hadoop 3. In Accumulo 2.0 we depend on the hadoop
client shaded jar, which has its own shaded and relocated version of
Guava internally. Using the Hadoop shaded jar would solve this
problem. Not sure what that
I looked at the history[1] of the hadoop project pom and found that
HADOOP-16213[2] seems to be the cause of this change. So it seems like
we need to bump the guava version if we want to work with newer
versions of Hadoop 3.
One of the goals of 1.9 (and I think 1.10) is to be a bridge version
