Re: ClassNotFoundException even if class is present in Jarfile

2015-11-03 Thread hveiga
It turned out to be a problem with `SerializationUtils` from Apache Commons Lang. There is an open issue where the class will throw a `ClassNotFoundException` even if the class is in the classpath in a multiple-classloader environment: https://issues.apache.org/jira/browse/LANG-1049 We moved away

Re: ClassNotFoundException even if class is present in Jarfile

2015-11-03 Thread Iulian DragoČ™
Where is the exception thrown (full stack trace)? How are you running your application, via spark-submit or spark-shell? On Tue, Nov 3, 2015 at 1:43 AM, hveiga wrote: > Hello, > > I am facing an issue where I cannot run my Spark job in a cluster > environment (standalone or

ClassNotFoundException even if class is present in Jarfile

2015-11-02 Thread hveiga
Hello, I am facing an issue where I cannot run my Spark job in a cluster environment (standalone or EMR) but it works successfully if I run it locally using local[*] as master. I am getting ClassNotFoundException: com.mycompany.folder.MyObject on the slave executors. I don't really understand