Spark has moved to build using Scala 2.11 by default in master/trunk. As for the 2.0.0-SNAPSHOT, it is actually the version of master/trunk and you might be missing some modules/profiles for your build. What command did you use to build ?
On Thu, May 12, 2016 at 9:01 PM, Raghava Mutharaju < m.vijayaragh...@gmail.com> wrote: > Hello All, > > I built Spark from the source code available at > https://github.com/apache/spark/. Although I haven't specified the > "-Dscala-2.11" option (to build with Scala 2.11), from the build messages I > see that it ended up using Scala 2.11. Now, for my application sbt, what > should be the spark version? I tried the following > > val spark = "org.apache.spark" %% "spark-core" % "2.0.0-SNAPSHOT" > val sparksql = "org.apache.spark" % "spark-sql_2.11" % "2.0.0-SNAPSHOT" > > and scalaVersion := "2.11.8" > > But this setting of spark version gives sbt error > > unresolved dependency: org.apache.spark#spark-core_2.11;2.0.0-SNAPSHOT > > I guess this is because the repository doesn't contain 2.0.0-SNAPSHOT. > Does this mean, the only option is to put all the required jars in the lib > folder (unmanaged dependencies)? > > Regards, > Raghava. > -- Luciano Resende http://twitter.com/lresende1975 http://lresende.blogspot.com/
