Out of Memory error in reduce shuffling phase when compression is turned on
---------------------------------------------------------------------------
Key: HADOOP-4915
URL: https://issues.apache.org/jira/browse/HADOOP-4915
Project: Hadoop Core
Issue Type: Bug
Components: mapred
Affects Versions: 0.17.2
Reporter: Zheng Shao
mapred.compress.map.output is set to true, and the job has 6860 mappers and 300
reducers.
Several reducers failed because:out of memory error in the shuffling phase.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.