Hi Erik, With four priority levels like this, you should just be able to use Hadoop's priorities, because it has five of them (very high, high, normal, low and very low). You can just use the default scheduler for this (i.e. don't enable either the fair or the capacity scheduler). Or am I missing something about your question?
Matei On Jan 25, 2010, at 11:25 PM, Erik Forsberg wrote: > Hi! > > Simplifying my question: Can I configure Hadoop so that: > > *) I have four scheduling pools: highprio-daily, highprio-monthly, > lowprio-daily, lowprio-monthly. > > *) Tasks for jobs that are put in highprio-daily always get priority > before tasks in highprio-monthly. Highprio-monthly always get > priority before lowprio-daily, and lowprio-daily always get priority > before lowprio-monthly? > > If there are several jobs in the same pool, run them in order of > submission. A job should finish as quickly as possible, so if the > currently most highly prioritized job needs all task slots, it > should get them. > > Thanks! > \EF > -- > Erik Forsberg <forsb...@opera.com> > Developer, Opera Software - http://www.opera.com/
