[ https://issues.apache.org/jira/browse/SPARK-24585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hyukjin Kwon resolved SPARK-24585. ---------------------------------- Resolution: Incomplete > Adding ability to audit file system before and after test to ensure all files > are cleaned up. > --------------------------------------------------------------------------------------------- > > Key: SPARK-24585 > URL: https://issues.apache.org/jira/browse/SPARK-24585 > Project: Spark > Issue Type: Test > Components: Build > Affects Versions: 2.3.1 > Reporter: David Lewis > Priority: Minor > Labels: bulk-closed > > Some spark tests use temporary files and folders on the file system. This > proposal is to audit the file system before and after to ensure that all > files created are cleaned up. > This proposal is to add two flags to SparkFunSuite. One to enable the > auditing, which will log a warning if there is a discrepancy, and one to > throw an exception if there is a discrepancy. > This is intended to help prevent file leakage in spark. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org