- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Maxime
Subject: Re: bugs in indexer (crawling)
If you feed the urls with URL command, you should have appropriate
Server/Realm/Subnet command defined to have these urls accepted for indexing.
Otherwise, you may feed these urls with "S
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: alex
Subject: Re: bugs in indexer (crawling)
if I feed the urls via URL will it complain about the missing server for them?
Server world url
seems to allow indexing of additional/imported urls.
Anyway, there are 2 bugs more:
1. in t
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Maxime
Subject: Re: bugs in indexer (crawling)
To seed some URLs use URL command:
URL url1
URL url2
URL command only add an URL into database.
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Read the full topic here:
http://ww
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: alex
Subject: Re: bugs in indexer (crawling)
well, with this config I want to seed some urls to the indexer, limit the range
with Realm, let the indexer to jump out of the initial urls but maintain itself
inside the realm.
how can it
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Maxime
Subject: Re: bugs in indexer (crawling)
"Server world" command means any URL in the world. Probably you shouldn't use
"world" option with your Server commands. What do you expect to get with your
config ?
robots.txt are specia
