akka.version error

[Mohit Anchlia]

I am facing the same issue as listed here:

http://apache-spark-user-list.1001560.n3.nabble.com/Packaging-a-spark-job-using-maven-td5615.html

Solution mentioned is here:

https://gist.github.com/prb/d776a47bd164f704eecb

However, I think I don't understand few things:

1) Why are jars being split into worker and driver?
2) Does it mean I now need to create 2 jars?
3) I am assuming I still need both jars in the path when I run this job?

I am simply trying to execute a basic word count example.

Running Spark from an Intellij worksheet - akka.version error

[adrian]

I have an SBT Spark project compiling fine in Intellij.
However when I try to create a SparkContext from a worksheet:

import org.apache.spark.SparkContext
val sc1 = new SparkContext(local[8], sc1)

I get this error:

com.typesafe.config.ConfigException$Missing: No configuration setting found
for key 'akka.version'

build.sbt contains these dependencies:
libraryDependencies ++= Seq((
  org.apache.spark %% spark-core % 1.0.2 % provided withSources()
withJavadoc())
  com.typesafe.akka % akka-actor_2.10  % 2.1.2,
...)

What am I missing?



--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/Running-Spark-from-an-Intellij-worksheet-akka-version-error-tp14941.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org