[ https://issues.apache.org/jira/browse/HADOOP-7754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433783#comment-13433783 ]
Ahmed Radwan commented on HADOOP-7754: -------------------------------------- I have tried the four tests reports by Jenkins above: org.apache.hadoop.fs.TestS3_LocalFileContextURI org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract org.apache.hadoop.fs.TestLocal_S3FileContextURI org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract All of them run successfully on my local machine. > Expose file descriptors from Hadoop-wrapped local FileSystems > ------------------------------------------------------------- > > Key: HADOOP-7754 > URL: https://issues.apache.org/jira/browse/HADOOP-7754 > Project: Hadoop Common > Issue Type: Sub-task > Components: native, performance > Affects Versions: 0.23.0 > Reporter: Todd Lipcon > Assignee: Todd Lipcon > Attachments: hadoop-7754-0.23.0-hasfd.txt, > HADOOP-7754_branch-1_rev2.patch, HADOOP-7754_branch-1_rev3.patch, > HADOOP-7754_branch-1_rev4.patch, HADOOP-7754_trunk.patch, > HADOOP-7754_trunk_rev2.patch, HADOOP-7754_trunk_rev2.patch, > HADOOP-7754_trunk_rev3.patch, HADOOP-7754_trunk_rev4.patch, > HADOOP-7754_trunk_rev4.patch, hasfd.txt > > > In HADOOP-7714, we determined that using fadvise inside of the MapReduce > shuffle can yield very good performance improvements. But many parts of the > shuffle are FileSystem-agnostic and thus operate on FSDataInputStreams and > RawLocalFileSystems. This JIRA is to figure out how to allow > RawLocalFileSystem to expose its FileDescriptor object without unnecessarily > polluting the public APIs. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira