[jira] [Commented] (HADOOP-15337) RawLocalFileSystem file status permissions can avoid shelling out in some cases
[ https://issues.apache.org/jira/browse/HADOOP-15337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106708#comment-17106708 ] Jonathan Turner Eagles commented on HADOOP-15337: - There is still a gap in the patch as sticky bit needs to be figured out. > RawLocalFileSystem file status permissions can avoid shelling out in some > cases > --- > > Key: HADOOP-15337 > URL: https://issues.apache.org/jira/browse/HADOOP-15337 > Project: Hadoop Common > Issue Type: Bug >Reporter: Jonathan Turner Eagles >Assignee: Jonathan Turner Eagles >Priority: Major > Attachments: HADOOP-15337.001.patch, HADOOP-15337.002.patch > > > While investigating YARN-8054, it was noticed that getting file permissions > for RawLocalFileSystem can fail by having too many files open. Upon > inspection this happens when getting permissions by launching a shell program > (ls -ld on linux) and parsing the results. With the introduction of java 7 > posix file systems can accurately get file permissions without launching a > shell program. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-15337) RawLocalFileSystem file status permissions can avoid shelling out in some cases
[ https://issues.apache.org/jira/browse/HADOOP-15337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16410558#comment-16410558 ] Jonathan Eagles commented on HADOOP-15337: -- Now I see HADOOP-14600 is related, but only available in 3.1.0 > RawLocalFileSystem file status permissions can avoid shelling out in some > cases > --- > > Key: HADOOP-15337 > URL: https://issues.apache.org/jira/browse/HADOOP-15337 > Project: Hadoop Common > Issue Type: Bug >Reporter: Jonathan Eagles >Assignee: Jonathan Eagles >Priority: Major > > While investigating YARN-8054, it was noticed that getting file permissions > for RawLocalFileSystem can fail by having too many files open. Upon > inspection this happens when getting permissions by launching a shell program > (ls -ld on linux) and parsing the results. With the introduction of java 7 > posix file systems can accurately get file permissions without launching a > shell program. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-15337) RawLocalFileSystem file status permissions can avoid shelling out in some cases
[ https://issues.apache.org/jira/browse/HADOOP-15337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16410553#comment-16410553 ] Jonathan Eagles commented on HADOOP-15337: -- It tested the nio implementation and found that in addition to not shelling out, it also was 5 times faster to get file permissions on linux. > RawLocalFileSystem file status permissions can avoid shelling out in some > cases > --- > > Key: HADOOP-15337 > URL: https://issues.apache.org/jira/browse/HADOOP-15337 > Project: Hadoop Common > Issue Type: Bug >Reporter: Jonathan Eagles >Assignee: Jonathan Eagles >Priority: Major > > While investigating YARN-8054, it was noticed that getting file permissions > for RawLocalFileSystem can fail by having too many files open. Upon > inspection this happens when getting permissions by launching a shell program > (ls -ld on linux) and parsing the results. With the introduction of java 7 > posix file systems can accurately get file permissions without launching a > shell program. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
