You have a connection refuse error. You need to check: -That the master is listening on specified host&port. -No firewall blocking access. -Make sure that config is pointing to the master host&port. Check the host name from the web console.
Send more details about cluster layout for more details.. Hope it helps.. Jorge. On Sun, Oct 12, 2014 at 10:07 PM, Morbious <knowledgefromgro...@gmail.com> wrote: > Hi, > > Can anyone point me how spark works ? > Why is it trying to connect from master port A to master port ABCD in > cluster mode with 6 workers ? > > 14/10/09 19:37:19 ERROR remote.EndpointWriter: AssociationError > [akka.tcp://sparkWorker@...:7078] -> [akka.tcp://sparkExecutor@...:53757]: > Error [Association failed with [akka.tcp://sparkExecutor@...:53757]] [ > akka.remote.EndpointAssociationException: Association failed with > [akka.tcp://sparkExecutor@...:53757] > Caused by: > akka.remote.transport.netty.NettyTransport$$anonfun$associate$1$$anon$2: > Connection refused: spark-master1.domain.org/10.0.6.228:53757 > ] > 14/10/09 19:37:19 ERROR remote.EndpointWriter: AssociationError > [akka.tcp://sparkWorker@...:7078] -> [akka.tcp://sparkExecutor@...:53757]: > Error [Association failed with [akka.tcp://sparkExecutor@...:53757]] [ > akka.remote.EndpointAssociationException: Association failed with > [akka.tcp://sparkExecutor@...:53757] > Caused by: > akka.remote.transport.netty.NettyTransport$$anonfun$associate$1$$anon$2: > Connection refused: spark-master1.domain.org/10.0.6.228:53757 > ] > > I've spent almost a week trying to find solution and the more I dag the > more > same problems I found. > > Best regards, > > Morbious > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Spark-in-cluster-and-errors-tp16249.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
