[
https://issues.apache.org/jira/browse/SPARK-32172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151679#comment-17151679
]
Dongjoon Hyun commented on SPARK-32172:
---------------------------------------
Hi, [~ZuoDao]. Thank you for filing a JIRA. However, the proposed idea (PR)
seems to have a regression because it throws `FileAlreadyExistsException` when
the directory exists. I left a few comment on the PR.
> Use createDirectory instead of mkdir
> ------------------------------------
>
> Key: SPARK-32172
> URL: https://issues.apache.org/jira/browse/SPARK-32172
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 2.3.0, 2.4.0, 3.0.0
> Reporter: Zuo Dao
> Priority: Major
>
> Use Files.createDirectory() to create local directory instead of File.mkdir()
> in DiskBlockManager.
> Many times, we will see such error log information like "Failed to create
> local dir in xxxxxx". But there is no clear information indicating why the
> directory creation failed.
> When Files.createDirectory() fails to create a local directory, it can give
> specific error information for subsequent troubleshooting(also throws
> IOException).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
