James Yu created HADOOP-9377: -------------------------------- Summary: FTPFileSystem.listStatus() runs very slow, due to inappropriate call of filePath.makeQualified Key: HADOOP-9377 URL: https://issues.apache.org/jira/browse/HADOOP-9377 Project: Hadoop Common Issue Type: Bug Components: fs Affects Versions: 2.0.3-alpha Reporter: James Yu
FTPFileSystem.listStatus() calls getFileStatus(ftpFiles[i], absolute) calls new FileStatus(....) calls filePath.makeQualified(...) calls fs.getWorkingDirectory() calls getHomeDirectory() which creates new FTP connection every time, to get the workdingDirectory. this caused the FTPFileSystem.listStatus() takes long time to run (on average 3-6 seconds per file in my test). I attach a suggestion of fix in FTPFileSystem.java, only 4 lines of change. after the fix, there's no slowness issue anymore. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira