Daryn Sharp created HADOOP-8772:
-----------------------------------
Summary: RawLocalFileStatus shells out for permission info
Key: HADOOP-8772
URL: https://issues.apache.org/jira/browse/HADOOP-8772
Project: Hadoop Common
Issue Type: Bug
Components: fs
Affects Versions: 0.23.3, 3.0.0, 2.2.0-alpha
Reporter: Daryn Sharp
Priority: Critical
{{RawLocalFileStatus}} shells out to run "ls" to get permissions info. This
very inefficient.
More importantly, mixing mulithreading and forking is risky. Some version of
glibc in RHEL will deadlock things such as "__GI__IO_list_lock" and
"malloc_atfork". All this unnecessary shelling out to access the local
filesystem greatly increases the risk of deadlock.
Namely, the NM's user localizer is seen to jam more frequently than the TT & NM.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
