On Thu, 28 Jan 2010 11:12:07 -0800
Matei Zaharia ma...@eecs.berkeley.edu wrote:
Hi Erik,
With four priority levels like this, you should just be able to use
Hadoop's priorities, because it has five of them (very high, high,
normal, low and very low). You can just use the default scheduler
Hi Erik,
With four priority levels like this, you should just be able to use Hadoop's
priorities, because it has five of them (very high, high, normal, low and very
low). You can just use the default scheduler for this (i.e. don't enable either
the fair or the capacity scheduler). Or am I
Hi!
Simplifying my question: Can I configure Hadoop so that:
*) I have four scheduling pools: highprio-daily, highprio-monthly,
lowprio-daily, lowprio-monthly.
*) Tasks for jobs that are put in highprio-daily always get priority
before tasks in highprio-monthly. Highprio-monthly always
Hi!
I'm currently trying to wrap my head around the different schedulers
available. Running Cloudera 0.18.3, there's both the Fair Scheduler and
the Capacity Scheduler for me to play with.
I have a number of jobs that are run nightly. Some of them have tighter
deadlines than other, so if there
