Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/19287#discussion_r141677782
--- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskInfo.scala ---
@@ -66,6 +66,13 @@ class TaskInfo(
*/
var finishTime: Long = 0
+ /**
+ * Set this var when the current task killed by other attempt tasks,
this happened while we
+ * set the `spark.speculation` to true. The task killed by others should
not resubmit
+ * while executor lost.
+ */
+ var killedByOtherAttempt = false
--- End diff --
actually, I had another thought -- rather than putting this info in
`TaskInfo`, I think its more natural to add something totally private to
`TaskSetManager`:
`private val killedByOtherAttempt: Array[Boolean]`
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
