>>>>> "Bill" == Bill Moseley <[EMAIL PROTECTED]> writes:
Bill> It takes a while (on my machine instead of indexing the site in Bill> less then a minute it takes about 18 minutes to check all the Bill> links. Bill> Some don't make much sense, check out the www.modperl.com Bill> error?? -- I'll look into it next week. Again, it's just doing Bill> simple HEAD requests with LWP. Clearly a lot of those work in Bill> browsers, but they are returning errors here. If you need a decent spidering linkchecker with more tweaking configuration settings and parallel processing power than is reasonable (:-), check <http://www.stonehenge.com/merlyn/LinuxMag/col16.html>, downloadable from <http://www.stonehenge.com/merlyn/LinuxMag/col16.listing.txt>. It retries bad "HEAD" requests as "GET", for example. -- Randal L. Schwartz - Stonehenge Consulting Services, Inc. - +1 503 777 0095 <[email protected]> <URL:http://www.stonehenge.com/merlyn/> Perl/Unix/security consulting, Technical writing, Comedy, etc. etc. See PerlTraining.Stonehenge.com for onsite and open-enrollment Perl training! --------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
