[jira] Updated: (HDFS-1338) Improve TestDFSIO
[ https://issues.apache.org/jira/browse/HDFS-1338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-1338: - Component/s: test > Improve TestDFSIO > - > > Key: HDFS-1338 > URL: https://issues.apache.org/jira/browse/HDFS-1338 > Project: Hadoop HDFS > Issue Type: Improvement > Components: test >Reporter: Arun C Murthy > Attachments: TestDFSIOparser_y0.20.patch > > > Currently the read test in TestDFSIO benchmark just opens a large side file > and measures the read performance. The MR scheduler has no opportunity to do > *any* optimization for the TestDFSIO MR application. The side-effect of this > is that it is *very* hard to do any meaningful analysis of the results of the > benchmark i.e. to check if node-local or rack-local or off-switch read > performance improved/degraded. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-1338) Improve TestDFSIO
[ https://issues.apache.org/jira/browse/HDFS-1338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-1338: - Attachment: TestDFSIOparser_y0.20.patch TestDFSIOparser_y0.20.patch: a small program to parse TestDFSIO output. > Improve TestDFSIO > - > > Key: HDFS-1338 > URL: https://issues.apache.org/jira/browse/HDFS-1338 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: Arun C Murthy > Attachments: TestDFSIOparser_y0.20.patch > > > Currently the read test in TestDFSIO benchmark just opens a large side file > and measures the read performance. The MR scheduler has no opportunity to do > *any* optimization for the TestDFSIO MR application. The side-effect of this > is that it is *very* hard to do any meaningful analysis of the results of the > benchmark i.e. to check if node-local or rack-local or off-switch read > performance improved/degraded. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
