[
https://issues.apache.org/jira/browse/HADOOP-4788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matei Zaharia updated HADOOP-4788:
----------------------------------
Resolution: Fixed
Fix Version/s: 0.21.0
Release Note: Fair scheduler assigns both a map and a reduce on each
heartbeat by default (HADOOP-4788).
Status: Resolved (was: Patch Available)
I committed this. Also changed the documentation about assignmultiple to say
it's true by default.
> Set mapred.fairscheduler.assignmultiple to true by default
> ----------------------------------------------------------
>
> Key: HADOOP-4788
> URL: https://issues.apache.org/jira/browse/HADOOP-4788
> Project: Hadoop Core
> Issue Type: Improvement
> Components: contrib/fair-share
> Reporter: Matei Zaharia
> Assignee: Matei Zaharia
> Priority: Trivial
> Fix For: 0.21.0
>
> Attachments: hadoop-4788-v0.patch
>
>
> Pretty much all users of the fair scheduler are using the "assignmultiple"
> feature which lets it launch reduce tasks at the same time as map tasks (on
> the same heartbeats), leading to reduces starting faster. This is also going
> to happen in Hadoop by default in HADOOP-3136. So we should set it to true by
> default and perhaps even remove the config parameter.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
