[
https://issues.apache.org/jira/browse/SPARK-26614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16743569#comment-16743569
]
liupengcheng commented on SPARK-26614:
--------------------------------------
Already resolved by https://github.com/apache/spark/pull/20987
> Speculation kill might cause job failure
> ----------------------------------------
>
> Key: SPARK-26614
> URL: https://issues.apache.org/jira/browse/SPARK-26614
> Project: Spark
> Issue Type: Bug
> Components: Scheduler, Spark Core
> Affects Versions: 2.1.0
> Reporter: liupengcheng
> Priority: Major
> Fix For: 2.2.2
>
>
> This issue is similar to SPARK-26612
> Some odd exceptions might be thrown in speculation kill, however, currently
> spark does not handle this case and will report failure to Driver. This
> exception will be counting towards MAX_TASK_FAILURES, and might result in the
> job failure.
>
> I think we can check state of task to tell if we report failure or killed.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
