>Did you clear the database and start from scratch? Changing MaxHops >count without clearing the database first will have little effect on
No, I had not. >Bear in mind also that if you have MinDelay set >it will be honored even if all URLs for a given site are to be I think that's still default. I went and started a huge job before I got to know the software is what the problem is. More than anything, it's because I didn't/don't have the luxury of time, I've been promising this search site for many months now. Aspseek looked like everything I wanted htdig to be but never was and certainly, not looking like it ever will be either after so many years now. After compiling, installing and testing on a small search, I went ahead with my big one. What a mistake, weeks of waiting now because I seem to make small errors from not knowing the software yet :). >due to exceeding MaxHops. Actually, I've made a number of changes >which I'm testing at present that fix most of this behavior but they're not >ready to be committed to CVS yet. Um, how about a web based config interface, with pop up help boxes and stuff :). Thanks much. It sounds like I can just let it run then and not worry about the number's of URL's. One question though, you say they are being removed but, will the queue number only go down quickly near the end of the job or should it be as it goes? Mike
