Sean Dean wrote: > Hello, > > In an attempt to run my regular scheduled fetch, and to also see if I could > reproduce your error it seems I may have found another one. The following > procedure was done with the most recent trunk version, including the > Hadoop-0.9 update. > > bin/nutch generate crawl/crawldb crawl/segments -topN 1000000 > > This command was successful, fetch list was generated without error. > > bin/nutch fetch crawl/segments/20061211105651 > > Actual fetch was successful, but the reduce stage failed. Error output was: > > Fetcher: java.io.IOException: Job failed! > at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:393) > at org.apache.nutch.fetcher.Fetcher.fetch(Fetcher.java:445) > at org.apache.nutch.fetcher.Fetcher.run(Fetcher.java:480) > at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:187) > at org.apache.nutch.fetcher.Fetcher.main(Fetcher.java:452) > >
This stacktrace doesn't tell anything except that the job failed ... Please find the corresponding entries in tasktracker's log, they should provide more details regarding the reason for this failure. You may also wish to increase the log level to get more details in logs. -- Best regards, Andrzej Bialecki <>< ___. ___ ___ ___ _ _ __________________________________ [__ || __|__/|__||\/| Information Retrieval, Semantic Web ___|||__|| \| || | Embedded Unix, System Integration http://www.sigram.com Contact: info at sigram dot com ------------------------------------------------------------------------- Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV _______________________________________________ Nutch-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-general
