Brilliant... On Wed, Jan 28, 2015 at 10:21 PM, Robert Munteanu <romb...@apache.org> wrote:
> Hi Sarwar, > > On Thu, Jan 29, 2015 at 12:08 AM, Sarwar Bhuiyan > <sarwar.bhui...@gmail.com> wrote: > > Hello all, > > > > I'm trying to build the sample application on the spark 1.2.0 quickstart > > page (https://spark.apache.org/docs/latest/quick-start.html) using the > > following build.sbt file: > > You reached the Sling user's list. You probably want the Spark one :-) > > Robert > > > > > name := "Simple Project" > > > > version := "1.0" > > > > scalaVersion := "2.10.4" > > > > libraryDependencies += "org.apache.spark" %% "spark-core" % "1.2.0" > > > > Upon calling sbt package, it downloaded a lot of dependencies but > > eventually failed with some warnings and errors. Here's the snippet: > > > > [warn] :::::::::::::::::::::::::::::::::::::::::::::: > > [warn] :: UNRESOLVED DEPENDENCIES :: > > [warn] :::::::::::::::::::::::::::::::::::::::::::::: > > [warn] :: org.apache.hadoop#hadoop-yarn-common;1.0.4: not found > > [warn] :: org.apache.hadoop#hadoop-yarn-client;1.0.4: not found > > [warn] :: org.apache.hadoop#hadoop-yarn-api;1.0.4: not found > > [warn] :::::::::::::::::::::::::::::::::::::::::::::: > > [warn] :::::::::::::::::::::::::::::::::::::::::::::: > > [warn] :: FAILED DOWNLOADS :: > > [warn] :: ^ see resolution messages for details ^ :: > > [warn] :::::::::::::::::::::::::::::::::::::::::::::: > > [warn] :: > > > org.eclipse.jetty.orbit#javax.transaction;1.1.1.v201105210645!javax.transaction.orbit > > [warn] :: > > > org.eclipse.jetty.orbit#javax.servlet;3.0.0.v201112011016!javax.servlet.orbit > > [warn] :: > > > org.eclipse.jetty.orbit#javax.mail.glassfish;1.4.1.v201005082020!javax.mail.glassfish.orbit > > [warn] :: > > > org.eclipse.jetty.orbit#javax.activation;1.1.0.v201105071233!javax.activation.orbit > > [warn] :::::::::::::::::::::::::::::::::::::::::::::: > > > > > > > > Upon checking the maven repositories there doesn't seem to be any > > hadoop-yarn-common 1.0.4. I've tried explicitly setting a dependency to > > hadoop-yarn-common 2.4.0 for example but to no avail. I've also tried > > setting a number of different repositories to see if maybe one of them > > might have that dependency. Still no dice. > > > > What's the best way to resolve this for a quickstart situation? Do I have > > to set some sort of profile or environment variable which doesn't try to > > bring the 1.0.4 yarn version? > > > > Any help would be greatly appreciated. > > > > Sarwar >
