pankaj created SPARK-6035:
-----------------------------
Summary: Unable to launch spark stream driver in cluster mode
Key: SPARK-6035
URL: https://issues.apache.org/jira/browse/SPARK-6035
Project: Spark
Issue Type: Bug
Reporter: pankaj
Spark version : spark-1.2.1-bin-hadoop2.4
Geting error while launching driver from master node in cluster mode and it
gets launched on one of slave node in cluster.
Issue: while launching from master it launches driver on one of slave and tries
to connect to the Master on 0 port. in this case i am launching it from master
even if i tries to launch it from some other slave node it tries to connect to
the slave node from where i launched it.
Exception
2015-02-26 07:36:05 INFO SecurityManager:59 - Changing view acls to: root
2015-02-26 07:36:05 INFO SecurityManager:59 - Changing modify acls to: root
2015-02-26 07:36:05 INFO SecurityManager:59 - SecurityManager: authentication
disabled; ui acls disabled; users with view permissions: Set(root); users with
modify permissions: Set(root)
2015-02-26 07:36:05 DEBUG AkkaUtils:63 - In createActorSystem, requireCookie
is: off
2015-02-26 07:36:06 INFO Slf4jLogger:80 - Slf4jLogger started
2015-02-26 07:36:06 ERROR NettyTransport:65 - failed to bind to ec-node -where
i run submit command-.compute-1.amazonaws.com/xx.xx.xx.xx:0, shutting down
Netty transport
2015-02-26 07:36:06 ERROR Remoting:65 - Remoting error: [Startup failed] [
akka.remote.RemoteTransportException: Startup failed
at
akka.remote.Remoting.akka$remote$Remoting$$notifyError(Remoting.scala:136)
at akka.remote.Remoting.start(Remoting.scala:201)
at
akka.remote.RemoteActorRefProvider.init(RemoteActorRefProvider.scala:184)
at akka.actor.ActorSystemImpl.liftedTree2$1(ActorSystem.scala:618)
at akka.actor.ActorSystemImpl._start$lzycompute(ActorSystem.scala:615)
at akka.actor.ActorSystemImpl._start(ActorSystem.scala:615)
at akka.actor.ActorSystemImpl.start(ActorSystem.scala:632)
at akka.actor.ActorSystem$.apply(ActorSystem.scala:141)
at akka.actor.ActorSystem$.apply(ActorSystem.scala:118)
at
org.apache.spark.util.AkkaUtils$.org$apache$spark$util$AkkaUtils$$doCreateActorSystem(AkkaUtils.scala:121)
at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:54)
Thanks
Pankaj
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
