Attila Zsolt Piros created SPARK-27819:
------------------------------------------
Summary: Retry cleanup of disk persisted RDD via external shuffle
service when it failed via executor
Key: SPARK-27819
URL: https://issues.apache.org/jira/browse/SPARK-27819
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 3.0.0
Reporter: Attila Zsolt Piros
This issue is created for not losing the idea came up during SPARK-27677 (at
org.apache.spark.storage.BlockManagerMasterEndpoint#removeRdd):
{noformat}
In certain situations (e.g. executor death) it would make sense to retry this
through the shuffle service. But I'm not sure how to safely detect those
situations (or whether it makes sense to always retry through the shuffle
service).
{noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
