[ 
https://issues.apache.org/jira/browse/SPARK-32172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Zuo Dao updated SPARK-32172:
----------------------------
    Description: 
Use Files.createDirectory() to create local directory instead of File.mkdir() 
in DiskBlockManager.
Many times, we will see such error log information like "Failed to create local 
dir in xxxxxx". But there is no clear information indicating why the directory 
creation failed.
When Files.createDirectory() fails to create a local directory, it can give 
specific error information for subsequent troubleshooting(also throws 
IOException).

> Use createDirectory instead of mkdir
> ------------------------------------
>
>                 Key: SPARK-32172
>                 URL: https://issues.apache.org/jira/browse/SPARK-32172
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 2.3.0, 2.4.0, 3.0.0
>            Reporter: Zuo Dao
>            Priority: Major
>
> Use Files.createDirectory() to create local directory instead of File.mkdir() 
> in DiskBlockManager.
> Many times, we will see such error log information like "Failed to create 
> local dir in xxxxxx". But there is no clear information indicating why the 
> directory creation failed.
> When Files.createDirectory() fails to create a local directory, it can give 
> specific error information for subsequent troubleshooting(also throws 
> IOException).



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to