GitHub user ericl opened a pull request: https://github.com/apache/spark/pull/21058
[SPARK-23971] Should not leak Spark sessions across test suites ## What changes were proposed in this pull request? Many suites currently leak Spark sessions (sometimes with stopped SparkContexts) via the thread-local active Spark session and default Spark session. We should attempt to clean these up and detect when this happens to improve the reproducibility of tests. ## How was this patch tested? Existing tests You can merge this pull request into a Git repository by running: $ git pull https://github.com/ericl/spark clear-session Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/21058.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #21058 ---- commit 92afcc2f7a5dfb2bc5aa94e009ef1787f42a83ab Author: Eric Liang <ekl@...> Date: 2018-04-12T19:43:48Z clear session ---- --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org