I have a spark stage that has 8 tasks. 7/8 have completed. However 1 task
is failing with Cannot find address
Aggregated Metrics by ExecutorExecutor IDAddressTask TimeTotal TasksFailed
TasksSucceeded TasksShuffle Read Size / RecordsShuffle Write Size /
RecordsShuffle
Spill (Memory)Shuffle Spill
have completed. However 1 task
is failing with Cannot find address
Aggregated Metrics by ExecutorExecutor IDAddressTask TimeTotal TasksFailed
TasksSucceeded TasksShuffle Read Size / RecordsShuffle Write Size /
RecordsShuffle Spill (Memory)Shuffle Spill (Disk)19CANNOT FIND ADDRESS24
min1101248.9
no luck :(! Still observing the same behavior!
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/CANNOT-FIND-ADDRESS-tp17637p17988.html
Sent from the Apache Spark User List mailing list archive at Nabble.com
CANNOT FIND ADDRESS
In the logs, I see a lot of in-memory map to disk. I don't understand why
that is the case. There should be over 35 gb ram available for input that
is not significantly large. It may be link to the performance issues that
I
am seeing. I have another post for seeing advice
Thanks for the pointers! I did tried but didn't seem to help...
In my latest try, I am doing spark-submit local
But see the same message in spark App ui (4040)
localhost CANNOT FIND ADDRESS
In the logs, I see a lot of in-memory map to disk. I don't understand why
that is the case
Write Shuffle Spill (Memory) Shuffle Spill (Disk)
0 mddworker1.c.fi-mdd-poc.internal:42197 0 ms0 0 0
0.0 B 136.1 MB184.9 MB
146.8 GB135.4 MB
1 CANNOT FIND ADDRESS 0 ms0 0 0 0.0 B 87.4 MB
142.0 MB61.4 GB 81.4
CANNOT FIND ADDRESS occurs when your executor has crashed. I'll look
further down where it shows each task and see if you see any tasks failed.
Then you can examine the error log of that executor and see why it died.
On Wed, Oct 29, 2014 at 9:35 AM, akhandeshi ami.khande...@gmail.com wrote
in context:
http://apache-spark-user-list.1001560.n3.nabble.com/CANNOT-FIND-ADDRESS-tp17637p17646.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
to remove broadcast 9
with
removeFromMaster = true - Timed o
ut}
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/CANNOT-FIND-ADDRESS-tp17637p17646.html
Sent from the Apache Spark User List mailing list archive at Nabble.com
Hi,
One of the executors in my spark cluster shows a CANNOT FIND ADDRESS
address, for one of the stages which failed. After that stages, I got
cascading failures for all my stages :/ (stages that seem complete but still
appears as active stage in the dashboard; incomplete or failed stages
10 matches
Mail list logo