Your suggestion took me past the ClassNotFoundException. I then hit akka.actor.ActorNotFound exception. I patched in PR 568 into my 0.9.0 spark codebase and everything worked.
So thanks a lot, Tim. Is there a JIRA/PR for the protobuf issue? Why is it not fixed in the latest git tree? Thanks. On 31-Mar-2014, at 11:30 pm, Tim St Clair <tstcl...@redhat.com> wrote: > It sounds like the protobuf issue. > > So FWIW, You might want to try updating the 0.9.0 w/pom mods for mesos & > protobuf. > > mesos 0.17.0 & protobuf 2.5 > > Cheers, > Tim > > ----- Original Message ----- >> From: "Bharath Bhushan" <manku.ti...@outlook.com> >> To: user@spark.apache.org >> Sent: Monday, March 31, 2014 9:46:32 AM >> Subject: Re: java.lang.ClassNotFoundException - spark on mesos >> >> I tried 0.9.0 and the latest git tree of spark. For mesos, I tried 0.17.0 and >> the latest git tree. >> >> Thanks >> >> >> On 31-Mar-2014, at 7:24 pm, Tim St Clair <tstcl...@redhat.com> wrote: >> >>> What versions are you running? >>> >>> There is a known protobuf 2.5 mismatch, depending on your versions. >>> >>> Cheers, >>> Tim >>> >>> ----- Original Message ----- >>>> From: "Bharath Bhushan" <manku.ti...@outlook.com> >>>> To: user@spark.apache.org >>>> Sent: Monday, March 31, 2014 8:16:19 AM >>>> Subject: java.lang.ClassNotFoundException - spark on mesos >>>> >>>> I am facing different kinds of java.lang.ClassNotFoundException when >>>> trying >>>> to run spark on mesos. One error has to do with >>>> org.apache.spark.executor.MesosExecutorBackend. Another has to do with >>>> org.apache.spark.serializer.JavaSerializer. I see other people complaining >>>> about similar issues. >>>> >>>> I tried with different version of spark distribution - 0.9.0 and >>>> 1.0.0-SNAPSHOT and faced the same problem. I think the reason for this is >>>> is >>>> related to the error below. >>>> >>>> $ jar -xf spark-assembly_2.10-0.9.0-incubating-hadoop2.2.0.jar >>>> java.io.IOException: META-INF/license : could not create directory >>>> at sun.tools.jar.Main.extractFile(Main.java:907) >>>> at sun.tools.jar.Main.extract(Main.java:850) >>>> at sun.tools.jar.Main.run(Main.java:240) >>>> at sun.tools.jar.Main.main(Main.java:1147) >>>> >>>> This error happens with all the jars that I created. But the classes that >>>> are >>>> already generated is different in the different cases. If JavaSerializer >>>> is >>>> not already extracted before encountering META-INF/license, then that >>>> class >>>> is not found during execution. If MesosExecutorBackend is not found, then >>>> that class shows up in the mesos slave error logs. Can someone confirm if >>>> this is a valid cause for the problem I am seeing? Any way I can debug >>>> this >>>> further? >>>> >>>> — Bharath >>> >>> -- >>> Cheers, >>> Tim >>> Freedom, Features, Friends, First -> Fedora >>> https://fedoraproject.org/wiki/SIGs/bigdata >> >> > > -- > Cheers, > Tim > Freedom, Features, Friends, First -> Fedora > https://fedoraproject.org/wiki/SIGs/bigdata
