You shouldn't get dependencies you need from Spark, right? you declare direct dependencies. Are we talking about re-scoping or excluding this dep from Hadoop transitively?
On Wed, Jul 15, 2015 at 7:33 PM, Gil Vernik <[email protected]> wrote: > Right, it's not currently dependence in Spark. > If we already mention it, is it possible to make it part of current > dependence, but only for Hadoop profiles 2.4 and up? > This will solve a lot of headache to those who use Spark + OpenStack Swift > and need every time to manually edit pom.xml to add dependence of it. > > > > From: Ted Yu <[email protected]> > To: Josh Rosen <[email protected]> > Cc: Steve Loughran <[email protected]>, Gil > Vernik/Haifa/IBM@IBMIL, Dev <[email protected]> > Date: 15/07/2015 18:28 > Subject: Re: problems with build of latest the master > ________________________________ > > > > If I understand correctly, hadoop-openstack is not currently dependence in > Spark. > > > > On Jul 15, 2015, at 8:21 AM, Josh Rosen <[email protected]> wrote: > > We may be able to fix this from the Spark side by adding appropriate > exclusions in our Hadoop dependencies, right? If possible, I think that we > should do this. > > On Wed, Jul 15, 2015 at 7:10 AM, Ted Yu <[email protected]> wrote: > I attached a patch for HADOOP-12235 > > BTW openstack was not mentioned in the first email from Gil. > My email and Gil's second email were sent around the same moment. > > Cheers > > On Wed, Jul 15, 2015 at 2:06 AM, Steve Loughran <[email protected]> > wrote: > > On 14 Jul 2015, at 12:22, Ted Yu <[email protected]> wrote: > > Looking at Jenkins, master branch compiles. > > Can you try the following command ? > > mvn -Phive -Phadoop-2.6 -DskipTests clean package > > What version of Java are you using ? > > Ted, Giles has stuck in hadoop-openstack, it's that which is creating the > problem > > Giles, I don't know why hadoop-openstack has a mockito dependency as it > should be test time only > > Looking at the POM it's tag > > in hadoop-2.7 tis scoped to compile, which > <dependency> > <groupId>org.mockito</groupId> > <artifactId>mockito-all</artifactId> > <scope>compile</scope> > </dependency> > > it should be "provided", shouldn't it? > > Created https://issues.apache.org/jira/browse/HADOOP-12235 : if someone > supplies a patch I'll get it in. > > -steve > > > --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
