+1 Flink and Spark shade a lot of their dependencies to avoid problems like this, they both even shade guava. Don't see any down side to doing it.
On Fri, Jul 8, 2016 at 11:31 AM, Pramod Immaneni <[email protected]> wrote: > Forgot to add that 4.3.5 is a later version that what newer versions of > hadoop are using (4.2.5) and we need it for kerberos SPNEGO security > related functionality. > > Thanks > > On Fri, Jul 8, 2016 at 11:28 AM, Pramod Immaneni <[email protected]> > wrote: > > > Hi, > > > > We have seen an issue with different versions of > > org.apache.httpcomponents:httpclient jar getting included in classpath > when > > apps are launched on newer versions of Hadoop. This is because we have an > > explicit dependency in Apex to version 4.3.5, the version of hadoop we > > build against (2.2 for backward compatibility) does not have a dependency > > to this artifact but newer versions of hadoop have this dependency. To > get > > around this problem we are thinking of shading this dependency internally > > in apex. Any other ideas or suggestions? > > > > Thanks > > >
