Author: costas
Email: [EMAIL PROTECTED]
Message:
I want to index a site without indexing any external urls that are linked fro within
the site.
Whenever i index a site though it tries to index the links too and puts an entry in
the database even though i get this message for external links when indexing:
indexer[7460]: [1] URL: http://www.worldbookdealers.com/robots.txt
indexer[7460]: [1] No 'Server' command for url... deleted.
I have tried indexing with
follow path
follow site
but neither prevent this.
Reply: <http://www.mnogosearch.org/board/message.php?id=3158>
___________________________________________
If you want to unsubscribe send "unsubscribe general"
to [EMAIL PROTECTED]
