Title: Couple of ?'s regarding Spiders, Crawlers, Search Engines and Logging
Perhaps a bit of a side topic - but trying to see what people are doing relating to Spiders, Crawlers and Search Engines and the logging, blocking, tracking of them, etc.
Specifically wondering if it's possible to
For information about analyzing search engines requests,
you might want to look at SEARCHENGINE commands
in the Configuration Files section of the Helper Applications
page (http://www.analog.cx/helpers/index.html#conffiles) and
at the SEARCHENGINE command itself in the Analog docs
