[ https://issues.apache.org/jira/browse/MAPREDUCE-3628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13181391#comment-13181391 ]
Kihwal Lee commented on MAPREDUCE-3628: --------------------------------------- I believe it was TestDFSIO. {noformat} 12/01/05 07:50:01 INFO fs.TestDFSIO: TestDFSIO.0.0.6 12/01/05 07:50:01 INFO fs.TestDFSIO: nrFiles = 2037 12/01/05 07:50:01 INFO fs.TestDFSIO: fileSize (MB) = 1024.0 12/01/05 07:50:01 INFO fs.TestDFSIO: bufferSize = 10485760 12/01/05 07:50:01 INFO fs.TestDFSIO: baseDir = /benchmarks/TestDFSIO 12/01/05 07:50:02 INFO fs.TestDFSIO: creating control file: 1073741824 bytes, 2037 files 12/01/05 07:50:36 INFO fs.TestDFSIO: created control files for: 2037 files {noformat} The input data set wasn't that big. So many factors external to DFS and disk I/O could have caused this. I asked Vinay who ran the test for more details. > DFSIO read throughput is decreased by 16% in 0.23 than Hadoop-0.20.204 on 350 > nodes size cluster. > ------------------------------------------------------------------------------------------------- > > Key: MAPREDUCE-3628 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-3628 > Project: Hadoop Map/Reduce > Issue Type: Task > Components: mrv2 > Affects Versions: 0.23.0 > Reporter: Amol Kekre > Priority: Blocker > Fix For: 0.23.1 > > > DFSIO read throughput is decreased by 16% in 0.23 than Hadoop-0.20.204 on 350 > nodes size cluster. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira