Hello all, I'm trying to build the sample application on the spark 1.2.0 quickstart page (https://spark.apache.org/docs/latest/quick-start.html) using the following build.sbt file:
name := "Simple Project" version := "1.0" scalaVersion := "2.10.4" libraryDependencies += "org.apache.spark" %% "spark-core" % "1.2.0" Upon calling sbt package, it downloaded a lot of dependencies but eventually failed with some warnings and errors. Here's the snippet: [warn] :::::::::::::::::::::::::::::::::::::::::::::: [warn] :: UNRESOLVED DEPENDENCIES :: [warn] :::::::::::::::::::::::::::::::::::::::::::::: [warn] :: org.apache.hadoop#hadoop-yarn-common;1.0.4: not found [warn] :: org.apache.hadoop#hadoop-yarn-client;1.0.4: not found [warn] :: org.apache.hadoop#hadoop-yarn-api;1.0.4: not found [warn] :::::::::::::::::::::::::::::::::::::::::::::: [warn] :::::::::::::::::::::::::::::::::::::::::::::: [warn] :: FAILED DOWNLOADS :: [warn] :: ^ see resolution messages for details ^ :: [warn] :::::::::::::::::::::::::::::::::::::::::::::: [warn] :: org.eclipse.jetty.orbit#javax.transaction;1.1.1.v201105210645!javax.transaction.orbit [warn] :: org.eclipse.jetty.orbit#javax.servlet;3.0.0.v201112011016!javax.servlet.orbit [warn] :: org.eclipse.jetty.orbit#javax.mail.glassfish;1.4.1.v201005082020!javax.mail.glassfish.orbit [warn] :: org.eclipse.jetty.orbit#javax.activation;1.1.0.v201105071233!javax.activation.orbit [warn] :::::::::::::::::::::::::::::::::::::::::::::: Upon checking the maven repositories there doesn't seem to be any hadoop-yarn-common 1.0.4. I've tried explicitly setting a dependency to hadoop-yarn-common 2.4.0 for example but to no avail. I've also tried setting a number of different repositories to see if maybe one of them might have that dependency. Still no dice. What's the best way to resolve this for a quickstart situation? Do I have to set some sort of profile or environment variable which doesn't try to bring the 1.0.4 yarn version? Any help would be greatly appreciated. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Dependency-unresolved-hadoop-yarn-common-1-0-4-when-running-quickstart-example-tp21411.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
