As it seems that the capacity and fair schedulers in hadoop 0.20.2 do
not allow a hard upper limit in number of concurrent tasks, do anybody
know any other solutions to achieve this ?
--
Renaud Delbru
On 25/01/11 11:49, Renaud Delbru wrote:
Hi,
we would like to limit the number of maximum tasks per job on our
hadoop 0.20.2 cluster.
Is the Capacity Scheduler [1] will allow to do this ? Is it correctly
working on hadoop 0.20.2 (I remember a few months ago, we were
looking at it, but it seemed incompatible with hadoop 0.20.2).
[1] http://hadoop.apache.org/common/docs/r0.20.2/capacity_scheduler.html
Regards,