Author: Alexander Barkov
Email: [EMAIL PROTECTED]
Message:
It seems that robots.txt still hasn't been indexed.
Run
indexer -amu http://servername/robots.txt
then run indexer in usual manner.
> I created a robots.txt file and placed it in the root of my web site. The contents
>of the robots.txt are as follows:
>
> User-agent: *
> Disallow: /
>
> This should keep all search engines from indexing my site. When I run mnoGoSearch,
>it still indexes all the pages. I have the robots.txt option checked in the servers
>tab. Any ideas? Thanks.
Reply: <http://search.mnogo.ru/board/message.php?id=2057>
___________________________________________
If you want to unsubscribe send "unsubscribe general"
to [EMAIL PROTECTED]
