Reducer's pass merger should utilize temporary directories on different disks
------------------------------------------------------------------------------
Key: HADOOP-590
URL: http://issues.apache.org/jira/browse/HADOOP-590
Project: Hadoop
Issue Type: Improvement
Components: mapred
Reporter: Runping Qi
The current implementation of pass merge of SequenceFile class uses the same
temp directory for the in/out files of the pass merger class, even though when
multiple temp dirs are available. Thus, it cannot fully utlize the advantage of
multiple disks during sort.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira