Author: Michael Martí Email: [EMAIL PROTECTED] Message: Some time ago I posted a message regarding this problem.
I'm using version 3.1.19, MySQL 3.22 and SunOS 5.6. Indexer ignores my robots.txt file, which is in the document root directory of my site. Alex Barkov asked me whether I had generated a 'core' file. I don't know what is. Any help regarding the "robots.txt" problem or the 'core' file would be appreciated. I have tried with allow/disallow, but this is quite confusing. For instance I want to disallow certain directories. I do: Allow NoMatch \/comm\/foros\/$ \/comm\/i\/$ Allow NoMatch String \/wsm*\/$ Allow \.html$ \.html.en$ \.html.es$ \.php$ Disallow .* It is still parsing the files inside /comm/foros/, even .txt files, which I think I have disallowed with ".*". There are so many possible combinations of Allow / Disallow and Match / NoMatch, that it becomes very difficult for newbies to find out the right one. Thanks for any help. Michael Reply: <http://www.mnogosearch.org/board/message.php?id=3615> ___________________________________________ If you want to unsubscribe send "unsubscribe general" to [EMAIL PROTECTED]
