[
https://issues.apache.org/jira/browse/SPARK-24585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-24585.
----------------------------------
Resolution: Incomplete
> Adding ability to audit file system before and after test to ensure all files
> are cleaned up.
> ---------------------------------------------------------------------------------------------
>
> Key: SPARK-24585
> URL: https://issues.apache.org/jira/browse/SPARK-24585
> Project: Spark
> Issue Type: Test
> Components: Build
> Affects Versions: 2.3.1
> Reporter: David Lewis
> Priority: Minor
> Labels: bulk-closed
>
> Some spark tests use temporary files and folders on the file system. This
> proposal is to audit the file system before and after to ensure that all
> files created are cleaned up.
> This proposal is to add two flags to SparkFunSuite. One to enable the
> auditing, which will log a warning if there is a discrepancy, and one to
> throw an exception if there is a discrepancy.
> This is intended to help prevent file leakage in spark.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
