- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Maxime
Subject: Re: scrapping a website
With the latest snapshot
http://www.dataparksearch.org/dpsearch-4.51-2008.tar.bz2
you can specify MirrorRoot and MirrorHeadersRoot on per server basis, i.e.
MirrorRoot /path/to/mirror
Sever
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: alextan
Subject: Re: scrapping a website
Hi Maxime
I only want one (1) site to be downloaded to the local directory, and the rest
of the sites to the database, how do i do this?
thanks
marlo
> At 09:10:31 23/10/08, Maxime wrote:
>
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Maxime
Subject: Re: scrapping a website
Perhaps you would be interested in mirroring feature of DataparkSearch:
http://www.dataparksearch.org/dpsearch-extended-indexing.en.html#mirror
- - - - - - - - - - - - - - - - - - - - - - - - - -
