Hello Ted, Some progress, now it seems that the spark job does get submitted,
In the spark web UI, I do see this under finished drivers. However, it seems
to not go past this step, JavaPairReceiverInputDStreamString, String
messages = KafkaUtils.createStream(jsc, localhost:2181, aa,
bq. Cause was: akka.remote.InvalidAssociation: Invalid address:
akka.tcp://sparkMaster@localhost:7077
There should be some more output following the above line.
Can you post them ?
Cheers
On Mon, Mar 2, 2015 at 2:06 PM, Krishnanand Khambadkone
kkhambadk...@yahoo.com.invalid wrote:
Hi, I am
Hi, I am running spark on my mac. It is reading from a kafka topic and then
writes the data to a hbase table. When I do a spark submit, I get this error,
Error connecting to master spark://localhost:7077
(akka.tcp://sparkMaster@localhost:7077), exiting.
Cause was:
This is the line,
Error connecting to master spark://localhost:7077
(akka.tcp://sparkMaster@localhost:7077), exiting.
On Monday, March 2, 2015 2:42 PM, Ted Yu yuzhih...@gmail.com wrote:
bq. Cause was: akka.remote.InvalidAssociation: Invalid address:
I ran it with the --verbose option and I see this output
Using properties file: null
Parsed arguments:
master spark://localhost:7077
deployMode cluster
executorMemory 1g
executorCores null
totalExecutorCores null
propertiesFile
There is no output after this line
Sent from my iPhone
On Mar 2, 2015, at 2:40 PM, Ted Yu yuzhih...@gmail.com wrote:
bq. Cause was: akka.remote.InvalidAssociation: Invalid address:
akka.tcp://sparkMaster@localhost:7077
There should be some more output following the above line.
Can
In AkkaUtils.scala:
val akkaLogLifecycleEvents =
conf.getBoolean(spark.akka.logLifecycleEvents, false)
Can you turn on life cycle event logging to see if you would get some more
clue ?
Cheers
On Mon, Mar 2, 2015 at 3:56 PM, Krishnanand Khambadkone
kkhambadk...@yahoo.com wrote:
I see
I see these messages now,
spark.master - spark://krishs-mbp:7077
Classpath elements:
Sending launch command to spark://krishs-mbp:7077
Driver successfully submitted as driver-20150302155433-
... waiting before polling master for driver state
... polling master for driver state
State of
