Re: Job scheduling

2011-06-06 Thread Harsh J
Ian, The reducer needn't run on the same TaskTracker as it does not work on local data. The mapper 21, however, should've run on node:/rack1/rack1node1.local. On Tue, Jun 7, 2011 at 5:09 AM, Ian Halperin wrote: > Hi, > > I might be misunderstanding how scheduling is supposed to work, or I mi

Job scheduling

2011-06-06 Thread Ian Halperin
Hi, I might be misunderstanding how scheduling is supposed to work, or I might have something misconfigured, but my Map/Reduce jobs don't seem to run where my data is located. I get a bunch of these messages: INFO org.apache.hadoop.mapred.JobInProgress: tip:task_201106062049_0001_ m_21 has sp

Re: concurrent job execution

2011-06-06 Thread Allen Wittenauer
On Jun 3, 2011, at 1:11 AM, Felix Sprick wrote: > Hi, > > We are running MapReduce on Hbase tables and are trying to implement a > scenario with MapReduce where tasks are submitted from a GUI application. > This means that several users (currently 5-10) may use the system in > parallel.