Fairshare scheduler always waits for 5% of maps to finish before scheduling
reduces.
------------------------------------------------------------------------------------
Key: HADOOP-5563
URL: https://issues.apache.org/jira/browse/HADOOP-5563
Project: Hadoop Core
Issue Type: Bug
Components: contrib/fair-share
Reporter: Vinod K V
The FairScheduler.enoughMapsFinishedToRunReduces() method has a hard-coded 5%
limit of number of maps to finish before reduces can be scheduled, and this
behaviour cannot be changed by users/admins. This should in the minimum be
configurable, perhaps using the same config property that the framework uses -
mapred.reduce.slowstart.completed.maps. Or better it should use the
JobInProgress.scheduleReduce() method itself directly.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
