no luck :(! Still observing the same behavior!
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/CANNOT-FIND-ADDRESS-tp17637p17988.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
Tr this
spark.storage.memoryFraction0.9
On 31 Oct 2014 20:27, akhandeshi ami.khande...@gmail.com wrote:
Thanks for the pointers! I did tried but didn't seem to help...
In my latest try, I am doing spark-submit local
But see the same message in spark App ui (4040)
localhost
Thanks for the pointers! I did tried but didn't seem to help...
In my latest try, I am doing spark-submit local
But see the same message in spark App ui (4040)
localhost CANNOT FIND ADDRESS
In the logs, I see a lot of in-memory map to disk. I don't understand why
that is the case.
CANNOT FIND ADDRESS occurs when your executor has crashed. I'll look
further down where it shows each task and see if you see any tasks failed.
Then you can examine the error log of that executor and see why it died.
On Wed, Oct 29, 2014 at 9:35 AM, akhandeshi ami.khande...@gmail.com wrote:
Thanks...hmm It is seems to be a timeout issue perhaps?? Not sure what
is causing it? or how to debug?
I see following error message...
4/10/29 13:26:04 ERROR ContextCleaner: Error cleaning broadcast 9
akka.pattern.AskTimeoutException: Timed out
at
Can you try setting the following while creating the sparkContext and see
if the issue still exists?
.set(spark.core.connection.ack.wait.timeout,900)
.set(spark.akka.frameSize,50)
.set(spark.akka.timeout,900)
Looks like your executor is stuck on GC Pause.
Thanks
Best Regards
On
