chenjiwei created SPARK-54661:
---------------------------------
Summary: The deletion of the temporary directory for Spark task
execution failed, resulting in incomplete data
Key: SPARK-54661
URL: https://issues.apache.org/jira/browse/SPARK-54661
Project: Spark
Issue Type: Bug
Components: PySpark
Affects Versions: 3.2.1
Reporter: chenjiwei
Fix For: 3.2.1
Spark task execution failed to delete temporary directory, with a warn error in
the log. The task continues to execute, resulting in incomplete data results.
Can you modify it to report an error if the temporary directory deletion fails
for Spark task
The error message is as follows：
!image-2025-12-10-15-36-12-619.png!
org.apache.spark.storage.DiskBlockManager
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
