Re: Multiple reduce task retries running at same time

2013-01-29 Thread Harsh J
Hi Ben, Take a look at the Speculative Execution feature of MR which should answer your question. See its section under 'Fault Tolerance' here: http://developer.yahoo.com/hadoop/tutorial/module4.html#tolerence. On Tue, Jan 29, 2013 at 1:08 PM, Ben Kim benkimkim...@gmail.com wrote: Attached a

Re: Multiple reduce task retries running at same time

2013-01-28 Thread Ben Kim
Attached a screenshot showing the retries On Tue, Jan 29, 2013 at 4:35 PM, Ben Kim benkimkim...@gmail.com wrote: Hi! I have come across the situation where i found a single reducer task executing with multiple retries simultaneously. Which is potent for slowing down the whole reduce process