Github user li-zhihui commented on the pull request: https://github.com/apache/spark/pull/1616#issuecomment-54914557 @andrewor14 In yarn mode, these cache files will be clean up automatically, and in standalone mode, it's not handled. Now in standalone mode, application work directory <code>SPARK_HOME/work/APPLICATION_ID</code> in slave nodes is not clean up too. I think if this issue (cleaning up application work directory) was resolved, we could use the application work directory as cache directory.
--- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org