When I try to merge the Segments of two crawls, 2Gb and 1Gb each. I get a
very bizarre eror:
Exception in thread "main" java.io.IOException: Job failed!
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1232)
at
org.apache.nutch.segment.SegmentMerger.merge(SegmentMerger.java:620)
at
org.apache.nutch.segment.SegmentMerger.main(SegmentMerger.java:665)
I was wondering why Its happened cuz I've already merged segments before. So
I noticed two missbehaviour
First odd thing: 24h of merging!!!!!!
Second (and the reason to get the Job Failed): /tmp/hadoop-<user> got ALL my
Free Storage Space (100Gb)
Any clue how to fix this ?
--
Armando Gonçalves
C.C 2005-2
