Hadoop job scheduling issue

2008-09-24 Thread Bryan Duxbury
I encountered an interesting situation today. I'm running Hadoop 0.17.1. What happened was that 3 jobs started simultaneously, which is expected in my workflow, but then resources got very mixed up. One of the jobs grabbed all the available reducers (5) and got one map task in before the

Re: Hadoop job scheduling issue

2008-09-24 Thread omalley
On 9/24/08, Bryan Duxbury [EMAIL PROTECTED] wrote: Does Hadoop not schedule jobs first-come-first served? Yes, Hadoop 0.17 schedules jobs fifo. If it isn't, that is a bug. -- Owen