Hi Yana,
As per my custom split code, only three splits submit to the system. So
three executors are sufficient for that. but it had run 8 executors. First
three executors logs show the exact output what I want(i did put some syso
in console to debug the code), but next five are have some other
It looks to me like your executor actually crashed and didn't just finish
properly.
Can you check the executor log?
It is available in the UI, or on the worker machine, under $SPARK_HOME/work/
app-20150123155114-/6/stderr (unless you manually changed the work
directory location but in that