Re: Unable to submit spark job to mesos cluster

2015-03-04 Thread Sarath Chandra
From the lines pointed in the exception log, I figured out that my code is unable to get the spark context. To isolate the problem, I've written a small code as below - *import org.apache.spark.SparkConf;* *import org.apache.spark.SparkContext;* *public class Test {* *public static void

Unable to submit spark job to mesos cluster

2015-03-04 Thread Sarath Chandra
Hi, I have a cluster running on CDH5.2.1 and I have a Mesos cluster (version 0.18.1). Through a Oozie java action I'm want to submit a Spark job to mesos cluster. Before configuring it as Oozie job I'm testing the java action from command line and getting exception as below. While running I'm

Re: Unable to submit spark job to mesos cluster

2015-03-04 Thread Akhil Das
Looks like you are having 2 netty jars in the classpath. Thanks Best Regards On Wed, Mar 4, 2015 at 5:14 PM, Sarath Chandra sarathchandra.jos...@algofusiontech.com wrote: From the lines pointed in the exception log, I figured out that my code is unable to get the spark context. To isolate

Re: Unable to submit spark job to mesos cluster

2015-03-04 Thread Arush Kharbanda
You can try increasing the Akka time out in the config, you can set the following in your config. spark.core.connection.ack.wait.timeout: 600 spark.akka.timeout: 1000 (In secs) spark.akka.frameSize:50 On Wed, Mar 4, 2015 at 5:14 PM, Sarath Chandra sarathchandra.jos...@algofusiontech.com wrote: