Re: Docker configuration for akka spark streaming

The issue is related to this https://issues.apache.org/jira/browse/SPARK-13906 .set("spark.rpc.netty.dispatcher.numThreads","2") seem to fix the problem On Tue, Mar 15, 2016 at 6:45 AM, David Gomez Saavedra wrote: > I have updated the config since I realized the actor

Re: Docker configuration for akka spark streaming

I have updated the config since I realized the actor system was listening on driver port + 1. So changed the ports in my program + the docker images val conf = new SparkConf() .setMaster(sparkMaster) //.setMaster("local[2]") .setAppName(sparkApp) .set("spark.cassandra.connection.host",

Re: Docker configuration for akka spark streaming

Could you use netstat to show the ports that the driver is listening? On Mon, Mar 14, 2016 at 1:45 PM, David Gomez Saavedra wrote: > hi everyone, > > I'm trying to set up spark streaming using akka with a similar example of > the word count provided. When using spark master

Docker configuration for akka spark streaming

hi everyone, I'm trying to set up spark streaming using akka with a similar example of the word count provided. When using spark master in local mode everything works but when I try to run it the driver and executors using docker I get the following exception 16/03/14 20:32:03 WARN