Spark 1.1.0 - spark-submit failed

2015-01-20 Thread ey-chih chow
Hi, I issued the following command in a ec2 cluster launched using spark-ec2: ~/spark/bin/spark-submit --class com.crowdstar.cluster.etl.ParseAndClean --master spark://ec2-54-185-107-113.us-west-2.compute.amazonaws.com:7077 --deploy-mode cluster --total-executor-cores 4 file:///tmp/etl-admin/jar/

Re: Spark 1.1.0 - spark-submit failed

2015-01-20 Thread Ted Yu
Please check which netty jar(s) are on the classpath. NioWorkerPool(Executor workerExecutor, int workerCount) was added in netty 3.5.4 Cheers On Tue, Jan 20, 2015 at 4:15 PM, ey-chih chow wrote: > Hi, > > I issued the following command in a ec2 cluster launched using spark-ec2: > > ~/spark/bin

RE: Spark 1.1.0 - spark-submit failed

2015-01-21 Thread ey-chih chow
Thanks for help. I added the following dependency in my pom file and the problem went away. io.netty netty 3.6.6.Final Ey-Chih Date: Tue, 20 Jan 2015 16:57:20 -0800 Subject: Re: Spark