Reduce tasks do not report their status and are killed by jobtracker
--------------------------------------------------------------------
Key: NUTCH-675
URL: https://issues.apache.org/jira/browse/NUTCH-675
Project: Nutch
Issue Type: Bug
Components: fetcher
Affects Versions: 0.9.0
Environment: OS : Linux
Reporter: sha feng
Fix For: 0.9.0
We choose Fetcher2 as our fetcher. Map tasks of Fetcher2 fetches about
2,000,000 urls, but at reduce stage, all reduce tasks can not report their
status and be killed by jobtracker. Although we change mapred.task.timeout from
60,000 to 1,800,000, it does not work. So, who can tell us why? By the way, the
version of Nutch we use is 0.9 and the version of Hadoop is 0.12.
Thanks for your help!
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
