Perhaps you can have a look at the available Job schedulers - Capacity Scheduler and Fair Scheduler? I think they ought to fit into your requirements pretty well.
On Fri, Apr 1, 2011 at 3:33 PM, Nitin Khandelwal <nitin.khandel...@germinait.com> wrote: > Hi, > > > I am right now stuck on the issue of division of tasks among slaves for a > job. Currently, as far as I know, hadoop does not allow us to fix/determine > in advance how many tasks of a job would run on each slave. I am trying to > design a system, where I want a slave to execute only one task of one job > type , > however at the same time , be able to accept/execute task of jobs of other > types. Is this kind of scheduling possible in hadoop. > > Thanks in advance > > > -- > > > Nitin Khandelwal > -- Harsh J http://harshj.com
