Thanks Kalyan. I don't think we need the hadoop jars to be deployed to Sentry as it uses the ones available in the namenode classpath. Actually, I tested Sentry that depends on hadoop3 in a Hadoop2 environment without putting the hadoop jars in the Namenode classpath. That made me think that those hadoop jars in the .tar.gz were useless.
On Fri, Oct 26, 2018 at 12:45 PM Kalyan Kumar Kalvagadda <kkal...@cloudera.com.invalid> wrote: > Sergio, > > Some of these hadoop jars are needed for sentry namenode plug-in. > > Sentry currently uses "compile" as dependency scope for all the hadoop > dependencies. If we use "provided" as scope, sentry will not be > distributing this jars but it expects they are made available are runtime. > we could stop distributing these jars if we can assume that sentry runs one > of the hdfs nodes and these jars are made available to it. > > > *Thanks,Kalyan Kumar Kalvagadda* | Software Engineer > t. (469) 279- <0000000000>5732 > cloudera.com <https://www.cloudera.com> > > [image: Cloudera] <https://www.cloudera.com/> > > [image: Cloudera on Twitter] <https://twitter.com/cloudera> [image: > Cloudera on Facebook] <https://www.facebook.com/cloudera> [image: Cloudera > on LinkedIn] <https://www.linkedin.com/company/cloudera> > ------------------------------ > > > On Fri, Oct 26, 2018 at 12:23 PM Sergio Pena > <sergio.p...@cloudera.com.invalid> wrote: > > > > > > sentry-dist/target/apache-sentry-2.2.0-SNAPSHOT-bin/apache-sentry-2.2.0-SNAPSHOT-bin/lib/hadoop-annotations-3.1.1.jar > > > > > sentry-dist/target/apache-sentry-2.2.0-SNAPSHOT-bin/apache-sentry-2.2.0-SNAPSHOT-bin/lib/hadoop-auth-3.1.1.jar > > > > > sentry-dist/target/apache-sentry-2.2.0-SNAPSHOT-bin/apache-sentry-2.2.0-SNAPSHOT-bin/lib/hadoop-client-3.1.1.jar > > > > > sentry-dist/target/apache-sentry-2.2.0-SNAPSHOT-bin/apache-sentry-2.2.0-SNAPSHOT-bin/lib/hadoop-common-3.1.1.jar > > > > > sentry-dist/target/apache-sentry-2.2.0-SNAPSHOT-bin/apache-sentry-2.2.0-SNAPSHOT-bin/lib/hadoop-hdfs-3.1.1.jar > > > > > sentry-dist/target/apache-sentry-2.2.0-SNAPSHOT-bin/apache-sentry-2.2.0-SNAPSHOT-bin/lib/hadoop-hdfs-client-3.1.1.jar > > > > > sentry-dist/target/apache-sentry-2.2.0-SNAPSHOT-bin/apache-sentry-2.2.0-SNAPSHOT-bin/lib/hadoop-mapreduce-client-common-3.1.1.jar > > > > > sentry-dist/target/apache-sentry-2.2.0-SNAPSHOT-bin/apache-sentry-2.2.0-SNAPSHOT-bin/lib/hadoop-mapreduce-client-core-3.1.1.jar > > > > > sentry-dist/target/apache-sentry-2.2.0-SNAPSHOT-bin/apache-sentry-2.2.0-SNAPSHOT-bin/lib/hadoop-mapreduce-client-jobclient-3.1.1.jar > > > > > sentry-dist/target/apache-sentry-2.2.0-SNAPSHOT-bin/apache-sentry-2.2.0-SNAPSHOT-bin/lib/hadoop-yarn-api-3.1.1.jar > > > > > sentry-dist/target/apache-sentry-2.2.0-SNAPSHOT-bin/apache-sentry-2.2.0-SNAPSHOT-bin/lib/hadoop-yarn-client-3.1.1.jar > > > > > sentry-dist/target/apache-sentry-2.2.0-SNAPSHOT-bin/apache-sentry-2.2.0-SNAPSHOT-bin/lib/hadoop-yarn-common-3.1.1.jar > > > > On Fri, Oct 26, 2018 at 10:27 AM Stephen Moist > <mo...@cloudera.com.invalid > > > > > wrote: > > > > > Which Hadoop jars are they? > > > > > > > On Oct 26, 2018, at 9:43 AM, Sergio Pena <sergio.p...@cloudera.com > > .INVALID> > > > wrote: > > > > > > > > I see several hadoop jars in the final Sentry package. > > > > > > > > Do we really need those jars be available in the final Sentry > .tar.gz? > > > > Should we exclude them? > > > > > > > > - Sergio > > > > > > > > >
