DISTCP mapper should report progress more often
-----------------------------------------------
Key: HADOOP-2048
URL: https://issues.apache.org/jira/browse/HADOOP-2048
Project: Hadoop
Issue Type: Bug
Reporter: Runping Qi
When I ran DISTCP to copy files from one dfs to another, I noticed that some
mappers got killed due to failing to report status for 606 seconds.
I noticed that the mappers try to make a progress report for every 32MB copied.
A better way to ensure progress is to use a time interval since last report.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.