On Thu, 22 Jun 2000 15:46:20 -0300 (ADT)
The Hermit Hacker <[EMAIL PROTECTED]> wrote:
> Try setting your Period higher and using the -n option to restrict
> the number of pages it does in an invocation ...
> for instance, set Period to 1week, and -n option to 20k ...
> this way it only processes 20k expired pages, and they will only
> expire again in a week ...
This creates a different problem, and is why I have the Period set
low:
There are certain pages that must be spidered every index.
Specifically, most of my site consists of mailing list archives.
The various index pages for the messages in those archives need to
be spidered every time to pick up the new messages.
Summary:
I need a long period to prevent everything being indexed every
time, but I also need certain pages to be spidered for new URLs
every single time the indexer runs. How to do?
--
J C Lawrence Home: [EMAIL PROTECTED]
----------(*) Other: [EMAIL PROTECTED]
--=| A man is as sane as he is dangerous to his environment |=--
______________
If you want to unsubscribe send "unsubscribe udmsearch"
to [EMAIL PROTECTED]
