[
https://issues.apache.org/jira/browse/HDFS-17926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
KWON BYUNGCHANG updated HDFS-17926:
-----------------------------------
Description:
Currently, HDFS does not automatically create a user's home directory (e.g.,
`/user/<user>`). This requires administrators to manually create home
directories, which adds operational overhead and can cause failures for
user-facing tools (e.g., MapReduce job submission, Hive, Spark) that assume the
home directory exists.
This JIRA tracks the development of automatic home directory creation so that
when a user's home directory does not yet exist, HDFS creates it automatically
with appropriate ownership (`<username>:<supergroup>`) and permissions
(`drwx------`).
*Motivation:*
- Reduces administrative burden for large multi-tenant clusters
- Prevents job failures caused by missing home directories
- Aligns with the behavior expected by higher-level ecosystem tools
*Background:*
This feature was originally developed and added to an internal fork of Apache
Hadoop 3.1.2, and has been running in production for over a year.
We plan to port the implementation to 3.5.0 and share the patch here.
was:
Currently, HDFS does not automatically create a user's home directory (e.g.,
`/user/<user>`). This requires administrators to manually create home
directories, which adds operational overhead and can cause failures for
user-facing tools (e.g., MapReduce job submission, Hive, Spark) that assume the
home directory exists.
This JIRA tracks the development of automatic home directory creation so that
when a user's home directory does not yet exist, HDFS creates it automatically
with appropriate ownership (`<username>:<supergroup>`) and permissions
(`drwx------`).
**Motivation:**
- Reduces administrative burden for large multi-tenant clusters
- Prevents job failures caused by missing home directories
- Aligns with the behavior expected by higher-level ecosystem tools
> Automatically create home directory for users
> ---------------------------------------------
>
> Key: HDFS-17926
> URL: https://issues.apache.org/jira/browse/HDFS-17926
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: namenode
> Reporter: KWON BYUNGCHANG
> Priority: Major
>
> Currently, HDFS does not automatically create a user's home directory (e.g.,
> `/user/<user>`). This requires administrators to manually create home
> directories, which adds operational overhead and can cause failures for
> user-facing tools (e.g., MapReduce job submission, Hive, Spark) that assume
> the home directory exists.
> This JIRA tracks the development of automatic home directory creation so that
> when a user's home directory does not yet exist, HDFS creates it
> automatically with appropriate ownership (`<username>:<supergroup>`) and
> permissions (`drwx------`).
> *Motivation:*
> - Reduces administrative burden for large multi-tenant clusters
> - Prevents job failures caused by missing home directories
> - Aligns with the behavior expected by higher-level ecosystem tools
>
> *Background:*
> This feature was originally developed and added to an internal fork of Apache
> Hadoop 3.1.2, and has been running in production for over a year.
> We plan to port the implementation to 3.5.0 and share the patch here.
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
