Re: Duplicated UnusedStubClass in assembly

2015-07-13 Thread Luis Ángel Vicente Sánchez
Hi! I was just raising this issue, I already solved it by excluding that transitive dependency. Thanks for your help anyway :) 2015-07-13 14:43 GMT+01:00 Cody Koeninger : > Yeah, I had brought that up a while back, but didn't get agreement on > removing the stub. Seems to be an intermittent prob

Re: Duplicated UnusedStubClass in assembly

2015-07-13 Thread Cody Koeninger
Yeah, I had brought that up a while back, but didn't get agreement on removing the stub. Seems to be an intermittent problem. You can just add an exclude: mergeStrategy in assembly := { case PathList("org", "apache", "spark", "unused", "UnusedStubClass.class") => MergeStrategy.first case

Duplicated UnusedStubClass in assembly

2015-07-13 Thread Luis Ángel Vicente Sánchez
I have just upgraded to spark 1.4.0 and it seems that spark-streaming-kafka has a dependency on org.spark-project.spark unused 1.0.0 but it also embeds that jar in its artifact, causing a problem while creating a fatjar. This is the error: [Step 1/1] (*:assembly) deduplicate: different file conte