GitHub user tsdeng opened a pull request:
https://github.com/apache/incubator-spark/pull/597
add event listener when executors are stopped, for sending back final stats
add onExecutorStopped event handler.
So when master command a shutdown, the executors can send the final message
reporting its statuses by replying ExecutorFinalState message(currently only
hdfsRead is reported, more can be added later).
And the master will wait for all response to comeback within the timeout
window.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/apache/incubator-spark
on_executors_stopped_master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-spark/pull/597.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #597
----
commit 7a45209600017bf9e8b89ff79d23bc245358429f
Author: Tianshuo Deng <[email protected]>
Date: 2014-02-13T21:02:54Z
add event listener when executors are stopped, for sending back final
executor state
----
