Re: [Robots] Safe parameters for spidering Yahoo message headerpages?

their routers (or firewalls) were upgraded/configured to stop numerous connections. Maybe the spider can be slowed way down (and behave like a normal human browsing). Jeremy C. Reed echo 'G014AE824B0-07CC?/JJFFFI?D64CB>D=3C427=>;>6HI2>http://www.mccmedia.com/mailman/listinfo/robots

[Robots] Who is "Rumours-Agent"?

I've been crawled a lot by Rumours-Agent of 202.214.69.189 the past few days. Does anyone know what they crawl for? Thanks, Jeremy C. Reed echo '9,J8HD,fDGG8B@?:536FC5=8@I;C5?@H5B0D@5GBIELD54DL>@8L?:5GDEJ8LDG1' |\ sed ss,s50EBsg | tr 0-M 'p.wBt SgiIlxmLhan:o,erDsduv/cyP'

Re: Programmatically controlling a web form

on't know if it is available online. If you use perl (it is available for numerous operating systems), you can use several perl modules to help you. Have a look at http://www.cpan.org/. Jeremy C. Reed http://www.reedmedia.net/ http://bsd.reedmedia.net/ -- BSD news and resources http://www.isp-faq.com/-- find answers to your questions

Re: URLs with "?"s in them

in just a few minutes. (Of course, it may take hours to run and to verify the results.) Plus you could automate the routine to run weekly to convert new dynamic webpages to static. Jeremy C. Reed http://www.reedmedia.net http://bsd.reedmedia.net