>On Wed, 31 Mar 1999, Bart@Web3 wrote:
>
>> Is there one simple command?
>>
>
>No. There's no way for analog to guess which are spiders. You'll have to
use
>some BROWEXCLUDE and HOSTEXCLUDE commands after examining your logfiles.
>
>--
>Stephen Turner [EMAIL PROTECTED] http://www.statslab.cam.ac.uk/~sret1/
> Statistical Laboratory, 16 Mill Lane, Cambridge CB2 1SB, England
> "Ad infinitum, if not ad nauseam." (Interviewee, BBC Radio 4)
Here are a few I have and what I call them:
sunkcost.netmind.com NetMind, URL-Minder (robot) - East Meadow, NY.
sunkcoast.netmind.com NetMind, URL-Minder (robot) - East Meadow, NY.
marvin.netmind.com NetMind, URL-Minder (robot) - East Meadow, NY.
.green.alexa.com ALEXA, The Crawl (robot)
.info.webcrawler.com WebCrawler (robot)
.webcrawler.com WebCrawler (robot)
.inktomisearch.com Slurp -- Inktomi's Web Robot - San Mateo, CA
.inktomi.com Slurp -- Inktomi's Web Robot - San Mateo, CA
ww2.altavista.digital.com Alta Vistsa, Scooter (robot)
add-url.altavista.digital.com Alta Vistsa, Scooter (robot)
scooter.pa-x.dec.com Digital Research, Scooter (robot)
alcorak.x-echo.com X-Echo (robot) - Sophia Antipolis, FR.
mace.netdoor.com Netdoor Robot - Jackson, MS.
crawl1.atext.com Excite - Spider
.wisewire.com WiseWire - Spider
interpix.com Image Surfer - Excalibur Internet Spider
.spider7.srv.pgh.lycos.com Lycos - (Spider)
.lycos.com Lycos - (Spider)
George Girard, Programmer/FiddlerArounder
I See All.. I Know All.. I Am The Wizard...
http://www.magnolia.net/~georgegg/The.Wizard's.Mysterious.Page
[EMAIL PROTECTED]
--------------------------------------------------------------------
This is the analog-help mailing list. To unsubscribe from this
mailing list, send mail to [EMAIL PROTECTED]
with "unsubscribe analog-help" in the main BODY OF THE MESSAGE.
--------------------------------------------------------------------
