Yang Jie created SPARK-41694: -------------------------------- Summary: Add new config to clean up `spark.ui.store.path` directory when SparkContext.stop() Key: SPARK-41694 URL: https://issues.apache.org/jira/browse/SPARK-41694 Project: Spark Issue Type: Sub-task Components: Spark Core Affects Versions: 3.4.0 Reporter: Yang Jie
{{spark.ui.store.path}} directory not clean up when {{SparkContext.stop() now:}} # {{{}{}}}The disk space occupied by the {{spark.ui.store.path}} directory will continue to grow. # When submitting new App and reusing the {{spark.ui.store.path}} directory, we will see the content related to the previous App, which is a bit strange -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org