Hi All,I am having the following issue -- may be fqdn/ip resolution issue, but 
not sure, any help with this will be great!
On the master node I get the following error:I start master using 
./start-master.shstarting org.apache.spark.deploy.master.Master, logging to 
/apps/software/spark-1.0.0-bin-hadoop1/sbin/../logs/spark-p529444-org.apache.spark.deploy.master.Master-1-pzxnvm2018.out
bash-4.1$ tail 
/apps/software/spark-1.0.0-bin-hadoop1/sbin/../logs/spark-p529444-org.apache.spark.deploy.master.Master-1-pzxnvm2018.out
14/07/07 11:03:16 INFO SecurityManager: Using Spark's default log4j profile: 
org/apache/spark/log4j-defaults.properties14/07/07 11:03:16 INFO 
SecurityManager: Changing view acls to: userid14/07/07 11:03:16 INFO 
SecurityManager: SecurityManager: authentication disabled; ui acls disabled; 
users with view permissions: Set(userid)14/07/07 11:03:16 INFO Slf4jLogger: 
Slf4jLogger started14/07/07 11:03:16 INFO Remoting: Starting remoting14/07/07 
11:03:17 INFO Remoting: Remoting started; listening on addresses 
:[akka.tcp://sparkMaster@pzxnvm2018:7077]14/07/07 11:03:17 INFO Master: 
Starting Spark master at spark://pzxnvm2018:707714/07/07 11:03:17 INFO 
MasterWebUI: Started MasterWebUI at 
http://pzxnvm2018.a.b.org(masterfqdn):808014/07/07 11:03:17 INFO Master: I have 
been elected leader! New state: ALIVE
14/07/07 11:07:53 INFO SparkDeploySchedulerBackend: Granted executor ID 
app-20140707110744-0000/10 on hostPort worker3fqdn:54921 with 4 cores, 512.0 MB 
RAM14/07/07 11:07:53 INFO AppClient$ClientActor: Executor updated: 
app-20140707110744-0000/10 is now RUNNING14/07/07 11:07:54 INFO 
AppClient$ClientActor: Executor updated: app-20140707110744-0000/8 is now 
FAILED (Command exited with code 1)14/07/07 11:07:54 INFO 
SparkDeploySchedulerBackend: Executor app-20140707110744-0000/8 removed: 
Command exited with code 114/07/07 11:07:54 INFO AppClient$ClientActor: 
Executor added: app-20140707110744-0000/11 on 
worker-20140707110701-worker3fqdn-49287 (worker3fqdn:49287) with 4 cores
On the worker node I get the following errorI start the workers node with the 
following command:
./bin/spark-class org.apache.spark.deploy.worker.Worker spark://pzxnvm2018:7077
worker4ip" "4" "akka.tcp://sparkWorker@worker4ip:49287/user/Worker" 
"app-20140707110744-0000"14/07/07 11:07:49 INFO Worker: Executor 
app-20140707110744-0000/3 finished with state FAILED message Command exited 
with code 1 exitStatus 114/07/07 11:07:49 INFO Worker: Asked to launch executor 
app-20140707110744-0000/6 for ApproxStrMatch14/07/07 11:07:49 INFO 
ExecutorRunner: Launch command: 
"/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.9.x86_64/jre/bin/java" "-cp" 
"::/apps/software/spark-1.0.0-bin-hadoop1/conf:/apps/software/spark-1.0.0-bin-hadoop1/lib/spark-assembly-1.0.0-hadoop1.0.4.jar:/apps/hadoop/hadoop-conf"
 "-XX:MaxPermSize=128m" "-Xms512M" "-Xmx512M" 
"org.apache.spark.executor.CoarseGrainedExecutorBackend" 
"akka.tcp://spark@localhost:59792/user/CoarseGrainedScheduler" "6" 
"pzxnvm2024.dcld.pldc.kp.org" "4" 
"akka.tcp://sparkwor...@pzxnvm2024.dcld.pldc.kp.org:49287/user/Worker" 
"app-20140707110744-0000"14/07/07 11:07:51 INFO Worker: Executor 
app-20140707110744-0000/6 finished with state FAILED message Command exited 
with code 1 exitStatus 1                                          

Reply via email to