[jira] [Commented] (SPARK-5830) Don't create unnecessary directory for local root dir
[ https://issues.apache.org/jira/browse/SPARK-5830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14334773#comment-14334773 ] Sean Owen commented on SPARK-5830: -- So, the 'too many nested dirs' issue is already covered by https://issues.apache.org/jira/browse/SPARK-5830. 'Should clean up on JVM exit' is now covered by https://issues.apache.org/jira/browse/SPARK-5970. So yes this is resolved as a Duplicate on both counts. I will suggest that the PR be closed and be reimagined as related to SPARK-5801, and solely to focus on excess nested directories. Don't create unnecessary directory for local root dir - Key: SPARK-5830 URL: https://issues.apache.org/jira/browse/SPARK-5830 Project: Spark Issue Type: Improvement Components: Spark Core Reporter: Weizhong Priority: Minor Now will create an unnecessary directory for local root directory, and this directory will not be deleted after application exit. For example: before will create tmp dir like /tmp/spark-UUID now will create tmp dir like /tmp/spark-UUID/spark-UUID so the dir /tmp/spark-UUID will not be deleted as a local root directory. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-5830) Don't create unnecessary directory for local root dir
[ https://issues.apache.org/jira/browse/SPARK-5830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14326342#comment-14326342 ] Marcelo Vanzin commented on SPARK-5830: --- Just to clarify, that directory is not unnecessary. It's needed for client mode, to create a safe directory where the driver can store temporary files. So maybe the bug is that it should be deleted when the JVM exits, but not that the directory shoudn't exist in the first place. Don't create unnecessary directory for local root dir - Key: SPARK-5830 URL: https://issues.apache.org/jira/browse/SPARK-5830 Project: Spark Issue Type: Improvement Components: Spark Core Reporter: Weizhong Priority: Minor Now will create an unnecessary directory for local root directory, and this directory will not be deleted after application exit. For example: before will create tmp dir like /tmp/spark-UUID now will create tmp dir like /tmp/spark-UUID/spark-UUID so the dir /tmp/spark-UUID will not be deleted as a local root directory. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-5830) Don't create unnecessary directory for local root dir
[ https://issues.apache.org/jira/browse/SPARK-5830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14322428#comment-14322428 ] Apache Spark commented on SPARK-5830: - User 'Sephiroth-Lin' has created a pull request for this issue: https://github.com/apache/spark/pull/4620 Don't create unnecessary directory for local root dir - Key: SPARK-5830 URL: https://issues.apache.org/jira/browse/SPARK-5830 Project: Spark Issue Type: Improvement Components: Spark Core Reporter: Weizhong Priority: Minor Now will create an unnecessary directory for local root directory, and this directory will not be deleted after application exit. For example: before will create tmp dir like /tmp/spark-UUID now will create tmp dir like /tmp/spark-UUID/spark-UUID so the dir /tmp/spark-UUID will not be deleted as a local root directory. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
