Can you try this command ? sbt/sbt -Pyarn -Phadoop-2.4 -Dhadoop.version=2.6.0 -Phive assembly
On Fri, Dec 26, 2014 at 6:15 PM, Alessandro Baretta <alexbare...@gmail.com> wrote: > I am building spark with sbt off of branch 1.2. I'm using the following > command: > > sbt/sbt -Pyarn -Phadoop-2.3 assembly > > (http://spark.apache.org/docs/latest/building-spark.html#building-with-sbt > ) > > Although the jar file I obtain does contain the proper version of the > hadoop libraries (v. 2.4), the assembly jar file name refers to hadoop > v.1.0.4: > > ./assembly/target/scala-2.10/spark-assembly-1.3.0-SNAPSHOT-hadoop1.0.4.jar > > Any idea why? > > > Alex >