define follwoing prop in $nutch_home/conf/hodoop-site.xml in order to change
the tmp folder path.
<property>
<name>hadoop.tmp.dir</name>
<value><any-path>/hadoop-${user.name}</value>
<description>Hadoop temp directory</description> </property>
2009/3/19 Armando Gonçalves <mandinho...@gmail.com>
> When I try to merge the Segments of two crawls, 2Gb and 1Gb each. I get a
> very bizarre eror:
> Exception in thread "main" java.io.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1232)
> at
> org.apache.nutch.segment.SegmentMerger.merge(SegmentMerger.java:620)
> at
> org.apache.nutch.segment.SegmentMerger.main(SegmentMerger.java:665)
>
> I was wondering why Its happened cuz I've already merged segments before.
> So
> I noticed two missbehaviour
> First odd thing: 24h of merging!!!!!!
> Second (and the reason to get the Job Failed): /tmp/hadoop-<user> got ALL
> my
> Free Storage Space (100Gb)
> Any clue how to fix this ?
>
> --
> Armando Gonçalves
> C.C 2005-2
>
