Hi! I was just raising this issue, I already solved it by excluding that
transitive dependency. Thanks for your help anyway :)
2015-07-13 14:43 GMT+01:00 Cody Koeninger :
> Yeah, I had brought that up a while back, but didn't get agreement on
> removing the stub. Seems to be an intermittent prob
Yeah, I had brought that up a while back, but didn't get agreement on
removing the stub. Seems to be an intermittent problem. You can just add
an exclude:
mergeStrategy in assembly := {
case PathList("org", "apache", "spark", "unused", "UnusedStubClass.class")
=> MergeStrategy.first
case
I have just upgraded to spark 1.4.0 and it seems that spark-streaming-kafka
has a dependency on org.spark-project.spark unused 1.0.0 but it also embeds
that jar in its artifact, causing a problem while creating a fatjar.
This is the error:
[Step 1/1] (*:assembly) deduplicate: different file conte