Repository: spark Updated Branches: refs/heads/master 199541769 -> f8e0f0f47
[SPARK-20788][CORE] Fix the Executor task reaper's false alarm warning logs ## What changes were proposed in this pull request? Executor task reaper may fail to detect if a task is finished or not when a task is finishing but being killed at the same time. The fix is pretty easy, just flip the "finished" flag when a task is successful. ## How was this patch tested? Jenkins Author: Shixiong Zhu <shixi...@databricks.com> Closes #18021 from zsxwing/SPARK-20788. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/f8e0f0f4 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/f8e0f0f4 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/f8e0f0f4 Branch: refs/heads/master Commit: f8e0f0f47c15ddd646b9f295b91d6748583fe011 Parents: 1995417 Author: Shixiong Zhu <shixi...@databricks.com> Authored: Wed May 17 14:13:49 2017 -0700 Committer: Shixiong Zhu <shixi...@databricks.com> Committed: Wed May 17 14:13:49 2017 -0700 ---------------------------------------------------------------------- core/src/main/scala/org/apache/spark/executor/Executor.scala | 1 + 1 file changed, 1 insertion(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/f8e0f0f4/core/src/main/scala/org/apache/spark/executor/Executor.scala ---------------------------------------------------------------------- diff --git a/core/src/main/scala/org/apache/spark/executor/Executor.scala b/core/src/main/scala/org/apache/spark/executor/Executor.scala index 3bc47b6..5b39668 100644 --- a/core/src/main/scala/org/apache/spark/executor/Executor.scala +++ b/core/src/main/scala/org/apache/spark/executor/Executor.scala @@ -425,6 +425,7 @@ private[spark] class Executor( } } + setTaskFinishedAndClearInterruptStatus() execBackend.statusUpdate(taskId, TaskState.FINISHED, serializedResult) } catch { --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
