thought of that. Thanks! I'll try that.
_____
From: Jerry Johnson [mailto:[EMAIL PROTECTED]
Sent: Thursday, May 06, 2004 1:52 PM
To: CF-Talk
Subject: Re: Verity options
I know very little about the vspider, but...
Doesn't it respect robots.txt files? If you properly build your robots.txt
files, you should be able to automatically exclude the files and folders you
don't want indexed.
Just a thought,
Jerry Johnson
_____
[Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
