Re: Unresolved dependencies while creating spark application Jar

Adding this to build.sbt worked. Thanks Jacek assemblyMergeStrategy in assembly := { case PathList("javax", "servlet", xs @ _*) => MergeStrategy.first case PathList(ps @ _*) if ps.last endsWith ".html" => MergeStrategy.first case "application.conf"=>

Re: Unresolved dependencies while creating spark application Jar

See https://github.com/sbt/sbt-assembly#merge-strategy Pozdrawiam, Jacek Laskowski https://medium.com/@jaceklaskowski/ Mastering Apache Spark http://bit.ly/mastering-apache-spark Follow me at https://twitter.com/jaceklaskowski On Fri, Jul 22, 2016 at 4:23 PM, janardhan shetty

Re: Unresolved dependencies while creating spark application Jar

Changed to sbt.0.14.3 and it gave : [info] Packaging /Users/jshetty/sparkApplications/MainTemplate/target/scala-2.11/maintemplate_2.11-1.0.jar ... java.util.zip.ZipException: duplicate entry: META-INF/MANIFEST.MF at java.util.zip.ZipOutputStream.putNextEntry(ZipOutputStream.java:233) Do we

Re: Unresolved dependencies while creating spark application Jar

Is scala version also the culprit? 2.10 and 2.11.8 Also Can you give the steps to create sbt package command just like maven install from within intellij to create jar file in target directory ? On Jul 22, 2016 5:16 AM, "Jacek Laskowski" wrote: > Hi, > > There has never been

Re: Unresolved dependencies while creating spark application Jar

Hi, There has never been 0.13.8 for sbt-assembly AFAIK. Use 0.14.3 and start over. See https://github.com/jaceklaskowski/spark-workshop/tree/master/solutions/spark-external-cluster-manager for a sample Scala/sbt project with Spark 2.0 RC5. Pozdrawiam, Jacek Laskowski

Unresolved dependencies while creating spark application Jar

Hi, I was setting up my development environment. Local Mac laptop setup IntelliJ IDEA 14CE Scala Sbt (Not maven) Error: $ sbt package [warn] :: [warn] :: UNRESOLVED DEPENDENCIES :: [warn]