[ https://issues.apache.org/jira/browse/SPARK-41313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Xing Lin updated SPARK-41313: ----------------------------- Description: spark-3900 fixed the illegalStateException in cleanupStagingDir in ApplicationMaster's shutdownhook. However, spark-21138 reverted that fix for fixing "Wrong FS" bug. We need both fixes. (was: spark-3900 fixed the illegalStateException in ApplicationMaster's shutdownhook. However, spark-21138 reverted that fix for fixing "Wrong FS" bug. We need both fixes. ) > Combine fixes for SPARK-3900 and SPARK-21138 > -------------------------------------------- > > Key: SPARK-41313 > URL: https://issues.apache.org/jira/browse/SPARK-41313 > Project: Spark > Issue Type: Bug > Components: Spark Core, YARN > Affects Versions: 3.4.0 > Reporter: Xing Lin > Priority: Major > > spark-3900 fixed the illegalStateException in cleanupStagingDir in > ApplicationMaster's shutdownhook. However, spark-21138 reverted that fix for > fixing "Wrong FS" bug. We need both fixes. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org