I have opened a PR for discussion on the apache/spark repository
https://github.com/apache/spark/pull/620
There is certainly a classLoader problem in the way Mesos and Spark operate,
I'm not sure what caused it to suddenly stop working so I'd like to open the
discussion there
--
View this
I am facing different kinds of java.lang.ClassNotFoundException when trying to
run spark on mesos. One error has to do with
org.apache.spark.executor.MesosExecutorBackend. Another has to do with
org.apache.spark.serializer.JavaSerializer. I see other people complaining
about similar issues.
I
: java.lang.ClassNotFoundException - spark on mesos
I am facing different kinds of java.lang.ClassNotFoundException when trying
to run spark on mesos. One error has to do with
org.apache.spark.executor.MesosExecutorBackend. Another has to do with
org.apache.spark.serializer.JavaSerializer. I see other people complaining
,
Tim
- Original Message -
From: Bharath Bhushan manku.ti...@outlook.com
To: user@spark.apache.org
Sent: Monday, March 31, 2014 8:16:19 AM
Subject: java.lang.ClassNotFoundException - spark on mesos
I am facing different kinds of java.lang.ClassNotFoundException when trying
to run
9:46:32 AM
Subject: Re: java.lang.ClassNotFoundException - spark on mesos
I tried 0.9.0 and the latest git tree of spark. For mesos, I tried 0.17.0 and
the latest git tree.
Thanks
On 31-Mar-2014, at 7:24 pm, Tim St Clair tstcl...@redhat.com wrote:
What versions are you running
manku.ti...@outlook.com
To: user@spark.apache.org
Sent: Monday, March 31, 2014 9:46:32 AM
Subject: Re: java.lang.ClassNotFoundException - spark on mesos
I tried 0.9.0 and the latest git tree of spark. For mesos, I tried 0.17.0 and
the latest git tree.
Thanks
On 31-Mar-2014, at 7:24 pm
I was talking about the protobuf version issue as not fixed. I could not find
any reference to the problem or the fix.
Reg. SPARK-1052, I could pull in the fix into my 0.9.0 tree (from the tar ball
on the website) and I see the fix in the latest git.
Thanks
On 01-Apr-2014, at 3:28 am, deric
Another problem I noticed is that the current 1.0.0 git tree still gives me the
ClassNotFoundException. I see that the SPARK-1052 is already fixed there. I
then modified the pom.xml for mesos and protobuf and that still gave the
ClassNotFoundException. I also tried modifying pom.xml only for
