I have the following in spark-env.sh SPARK_MASTER_IP=master
SPARK_MASTER_port=7077 Best Regards ....................................................... Amin Mohebbi PhD candidate in Software Engineering at university of Malaysia H/P : +60 18 2040 017 E-Mail : tp025...@ex.apiit.edu.my amin_...@me.com On Wednesday, July 9, 2014 2:32 PM, Akhil Das <ak...@sigmoidanalytics.com> wrote: Can you try setting SPARK_MASTER_IP in the spark-env.sh file? Thanks Best Regards On Wed, Jul 9, 2014 at 10:58 AM, amin mohebbi <aminn_...@yahoo.com> wrote: > > Hi all, >I have one master and two slave node, I did not set any ip for spark driver >because I thought it uses its default ( localhost). In my etc/hosts I got the >following : 192.168.0.1 master, 192.168.0.2 slave, 192.168.03 slave2 127.0.0.0 >local host and 127.0.1.1 virtualbox . Should I do something in hosts? or >should I set a ip to spark-local-ip? I got the following in my stderr: > > >Spark Executor Command: "java" "-cp" ":: /usr/local/spark-1.0.0/conf: /usr/local/spark-1.0.0 /assembly/target/scala-2.10/spark-assembly-1.0.0-hadoop1.2.1.jar:/usr/local/hadoop/conf" " -XX:MaxPermSize=128m" "-Xms512M" "-Xmx512M" "org.apache.spark.executor.CoarseGrainedExecutorBackend " "akka.tcp://spark@master:54477/user/CoarseGrainedScheduler" "0" "slave2" "1 " "akka.tcp://sparkWorker@slave2:41483/user/Worker" "app-20140704174955-0002" ======================================== 14/07/04 17:50:14 ERROR CoarseGrainedExecutorBackend: Driver Disassociated [akka.tcp://sparkExecutor@slave2:33758] -> [akka.tcp://spark@master:54477] disassociated! Shutting down. > > > > > >Best Regards > >....................................................... > >Amin Mohebbi > >PhD candidate in Software Engineering > at university of Malaysia > >H/P : +60 18 2040 017 > > > >E-Mail : tp025...@ex.apiit.edu.my > > amin_...@me.com
