Dear All,
When I look inside the following directory on my worker
node:$SPARK_HOME/work/app-20140708110707-0001/3
I see the following error message:
log4j:WARN No appenders could be found for logger
(org.apache.hadoop.conf.Configuration).log4j:WARN Please initialize the log4j
system properly.log4j:WARN See
http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.14/07/08
11:07:11 INFO SparkHadoopUtil: Using Spark's default log4j profile:
org/apache/spark/log4j-defaults.properties14/07/08 11:07:11 INFO
SecurityManager: Changing view acls to: p52944414/07/08 11:07:11 INFO
SecurityManager: SecurityManager: authentication disabled; ui acls disabled;
users with view permissions: Set(p529444)14/07/08 11:07:12 INFO Slf4jLogger:
Slf4jLogger started14/07/08 11:07:12 INFO Remoting: Starting remoting14/07/08
11:07:13 INFO Remoting: Remoting started; listening on addresses
:[akka.tcp://[email protected]:34679]14/07/08 11:07:13
INFO Remoting: Remoting now listens on addresses:
[akka.tcp://[email protected]:34679]14/07/08 11:07:13 INFO
CoarseGrainedExecutorBackend: Connecting to driver:
akka.tcp://spark@localhost:39701/user/CoarseGrainedScheduler14/07/08 11:07:13
INFO WorkerWatcher: Connecting to worker
akka.tcp://[email protected]:37054/user/Worker14/07/08
11:07:13 ERROR CoarseGrainedExecutorBackend: Driver Disassociated
[akka.tcp://[email protected]:34679] -> [akka
I am not sure what the problem is but it is preventing me to get the 4 node
test cluster up and running.