I'm trying to run Spark on Mesos and I'm getting this error:
java.lang.ClassNotFoundException: org/apache/spark/serializer/JavaSerializer
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:270)
at org.apache.spark.SparkEnv$.instantiateClass$1(SparkEnv.scala:151)
at org.apache.spark.SparkEnv$.create(SparkEnv.scala:162)
at org.apache.spark.executor.Executor.<init>(Executor.scala:105)
at
org.apache.spark.executor.MesosExecutorBackend.registered(MesosExecutorBackend.scala:56)
Exception in thread "Thread-0"
the Spark command is following:
java -cp
/usr/share/spark/examples/target/scala-2.10/spark-examples-assembly-1.0.0-SNAPSHOT.jar::/usr/share/spark/conf:/usr/share/spark/jars/spark-assembly-1.0.0-SNAPSHOT-hadoop1.0.4.jar
-Djava.library.path=/usr/share/spark/jars/spark-assembly-1.0.0-SNAPSHOT-hadoop1.0.4.jar
org.apache.spark.examples.SparkPi zk://zookeeper:2181/mesos
There might be a problem with jar path on executors, is there a way how to
debug this?
Thanks,
Tomas
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-executor-paths-tp3003.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
