[
https://issues.apache.org/jira/browse/HADOOP-5090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinod K V updated HADOOP-5090:
------------------------------
Attachment: HADOOP-5090-20090504.txt
Attaching patch. With this patch, CapacityTaskScheduler assigns multiple tasks
in a single heartbeat. It assigns multiple maps just like the default scheduler
- multiple local tasks and at-most one off-switch tasks; and multiple reduces.
It also keeps track of the tasks decided to be assigned in a particular
scheduling iteration so as that high memory jobs are blocked for scheduling and
user-limits are respected while giving away multiple tasks.
The patch also has test-cases. Benchmarking is in progress.
> The capacity-scheduler should assign multiple tasks per heartbeat
> -----------------------------------------------------------------
>
> Key: HADOOP-5090
> URL: https://issues.apache.org/jira/browse/HADOOP-5090
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Reporter: Arun C Murthy
> Priority: Critical
> Attachments: HADOOP-5090-20090504.txt
>
>
> HADOOP-3136 changed the default o.a.h.mapred.JobQueueTaskScheduler to assign
> multiple tasks per TaskTracker heartbeat, the capacity-scheduler should do
> the same.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
