- - - - - - - - - - - - - - - - - - - - - - - - - - - - Name: alex Subject: Re: bugs in indexer (crawling)
if I feed the urls via URL will it complain about the missing server for them? Server world url seems to allow indexing of additional/imported urls. Anyway, there are 2 bugs more: 1. in the indexer.conf, * in string matches or regex is greedy, meaning it won't match as desired. one should use .*?SMTH instead of .*SMTH in regexp to match <anything>SMTH otherwise will just match anything 2. Realm seems to be ignored (doesn't work as advertised). disallow will do the job instead - - - - - - - - - - - - - - - - - - - - - - - - - - - - Read the full topic here: http://www.dataparksearch.org/cgi-bin/simpleforum.cgi?fid=03;topic_id=1228476957
