[
https://issues.apache.org/jira/browse/SPARK-26614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liupengcheng updated SPARK-26614:
---------------------------------
Description:
This issue is similar to SPARK-26612
Some odd exceptions might be thrown in speculation kill, however, currently
spark does not handle this case and will report failure to Driver. This
exception will be counting towards MAX_TASK_FAILURES, and might result in the
job failure.
I think we can check state of task to tell if we report failure or killed.
was:
This issue is similar
to[SPARK-26612|[http://issues.apache.org/jira/browse/SPARK-26612]]
Some odd exceptions might be thrown in speculation kill, however, currently
spark does not handle this case and will report failure to Driver. This
exception will be counting towards MAX_TASK_FAILURES, and might result in the
job failure.
I think we can check state of task to tell if we report failure or killed.
> Speculation kill might cause job failure
> ----------------------------------------
>
> Key: SPARK-26614
> URL: https://issues.apache.org/jira/browse/SPARK-26614
> Project: Spark
> Issue Type: Bug
> Components: Scheduler, Spark Core
> Affects Versions: 2.1.0
> Reporter: liupengcheng
> Priority: Major
>
> This issue is similar to SPARK-26612
> Some odd exceptions might be thrown in speculation kill, however, currently
> spark does not handle this case and will report failure to Driver. This
> exception will be counting towards MAX_TASK_FAILURES, and might result in the
> job failure.
>
> I think we can check state of task to tell if we report failure or killed.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
