Hi Ben,
Take a look at the Speculative Execution feature of MR which should
answer your question. See its section under 'Fault Tolerance' here:
http://developer.yahoo.com/hadoop/tutorial/module4.html#tolerence.
On Tue, Jan 29, 2013 at 1:08 PM, Ben Kim benkimkim...@gmail.com wrote:
Attached a
Attached a screenshot showing the retries
On Tue, Jan 29, 2013 at 4:35 PM, Ben Kim benkimkim...@gmail.com wrote:
Hi!
I have come across the situation where i found a single reducer task
executing with multiple retries simultaneously.
Which is potent for slowing down the whole reduce process