if you use hadoop run nutch

please add

<property>
  <name>hadoop.tmp.dir</name>
  <value>/youtempfs/hadoop-${user.name}</value>
  <description>A base for other temporary directories.</description>
</property>

to you hadoop-site.xml

2009/7/13 Jake Jacobson <[email protected]>

> Hi,
>
> I have tried to run nutch 1.0 several times and it fails due to lack
> of disk space.  I have defined the crawl to place all files on a disk
> that has plenty of space but when it starts building the linkdb it
> wants to put temp files in the home dir which doesn't have enough
> space.  How can I force Nutch not to do this?
>
> Jake Jacobson
>
> http://www.linkedin.com/in/jakejacobson
> http://www.facebook.com/jakecjacobson
> http://twitter.com/jakejacobson
>
> Our greatest fear should not be of failure,
> but of succeeding at something that doesn't really matter.
>   -- ANONYMOUS
>

Reply via email to