[
https://issues.apache.org/jira/browse/HADOOP-4714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12650117#action_12650117
]
Jothi Padmanabhan commented on HADOOP-4714:
-------------------------------------------
Progress is reported back in Merger.writeFile. It reports back progress for
every 10000 records. Might be we should report back every 5000 records ?
{code}
if ((++recordCtr % PROGRESS_BAR) == 0) {
progressable.progress();
}
{code}
> map tasks timing out during merge phase
> ---------------------------------------
>
> Key: HADOOP-4714
> URL: https://issues.apache.org/jira/browse/HADOOP-4714
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.18.1
> Reporter: Christian Kunz
>
> With compression of transient data turned on some parts of the merge phase
> seem to not report progress enough.
> We see a lot of task failures during the merge phase, most of them timing out
> (even with a 20 min timeout)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
