[
https://issues.apache.org/jira/browse/SPARK-27014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16783811#comment-16783811
]
Martin Loncaric commented on SPARK-27014:
-----------------------------------------
Sure, will keep that in mind.
> Support removal of jars and Spark binaries from Mesos driver and executor
> sandboxes
> -----------------------------------------------------------------------------------
>
> Key: SPARK-27014
> URL: https://issues.apache.org/jira/browse/SPARK-27014
> Project: Spark
> Issue Type: New Feature
> Components: Mesos
> Affects Versions: 3.0.0
> Reporter: Martin Loncaric
> Priority: Minor
>
> Currently, each Spark application run on Mesos leaves behind at least 500MB
> of data in sandbox directories, coming from Spark binaries and copied URIs.
> These can build up as a disk leak, causing major issues on Mesos clusters
> unless their grace period for sandbox directories is very short.
> Spark should have a feature to delete these (from both driver and executor
> sandboxes) on teardown.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
