[ http://issues.apache.org/jira/browse/HADOOP-846?page=all ]
Devaraj Das updated HADOOP-846:
-------------------------------
Attachment: 846.patch
Attached is the patch - this starts a single thread that does progress
reporting for the entire map phase. Also made taskProgress as volatile since
that is read/updated by multiple threads.
> Progress report is not sent during the intermediate sorts in the map phase
> --------------------------------------------------------------------------
>
> Key: HADOOP-846
> URL: http://issues.apache.org/jira/browse/HADOOP-846
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Reporter: Devaraj Das
> Assigned To: Devaraj Das
> Attachments: 846.patch
>
>
> Have seen tasks getting lost at the TaskTracker's end due to MapTask's
> progress not getting reported for a long time (the configured timeout). The
> progress report is currently not sent in the intermediate sort phases in the
> MapTask. But, if for some reason, the sort takes a long time, the TaskTracker
> might kill the task.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira