I'm relatively new to Analog so I apologize if this too basic.

Is there a way of excluding the activity of spiders on our site? Looks like 
Google and others search our site many times a day.
Thank you
Ariel



At 04:29 PM 9/27/2002 +0200, you wrote:
>Hi Aengus,
>
>At 15:21 27-9-2002, you wrote:
>>Henk Schrik <[EMAIL PROTECTED]> wrote:
>>
>> > F:   Detect that it's in common log format
>> >
>> > C: 193.194.161.41 - - [08/Mar/2002:02:35:01 +0100] "GET /nod-i...
>> > nu.gif HTTP/1.1" 200 174 `Mozilla/4.0 (compatible; MSIE 5.0; M...
>> > ndows 98; Compaq; DigExt)` `http://ruapehu.uci.kun.nl/nod/plsq...
>> > onproj?v_klant_id=UWURMhFPM&v_taal=en`
>> > C:
>> >                           *
>>
>>That * is under "`Mozilla/4.0 (compatible; MSIE "
>>
>>It looks like your server is using ` to indicate the beginning and end
>>of fields like the browser and referrer strings, which is unusual, and
>>not something that Analog would recognize.
>>
>>Try something like this:
>>LOGFORMAT (%S - %u [%d/%M/%Y:%h:%n:%j %j] "%j %r %j" %c %b `%B` `%f`)
>>
>>(Or better yet, fix your server to use the more usual " as a field
>>separator).
>>
>>http://analog.cx/docs/logfmt.html
>
>Thanks for the assistance, it's running smoothly now of course.
>Didn't read / find about the difference between "  and ' .
>
>Nice suggestion though, but you know how it is, some logfiles
>that are not initiated/defined by oneself can be looking different.
>Then it costs sometimes a lot of time to convince people that it might
>be better to define there logfiles differently.
>
>Thanks again,
>greets,
>
>+------------------------------------------------------------------------
>|  This is the analog-help mailing list. To unsubscribe from this
>|  mailing list, go to
>|    http://lists.isite.net/listgate/analog-help/unsubscribe.html
>|
>|  List archives are available at
>|    http://www.mail-archive.com/analog-help@lists.isite.net/
>|    http://lists.isite.net/listgate/analog-help/archives/
>|    http://www.tallylist.com/archives/index.cfm/mlist.7
>+------------------------------------------------------------------------

Ariel B. Power
University of California,  Forest Products Laboratory
1301 South 46th Street Bldg. 478. Richmond, CA 94804-4698 USA
Ph:  510-215-4211 Fax: 510-215-4299
http://www.ucfpl.ucop.edu/      [EMAIL PROTECTED]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~


+------------------------------------------------------------------------
|  This is the analog-help mailing list. To unsubscribe from this
|  mailing list, go to
|    http://lists.isite.net/listgate/analog-help/unsubscribe.html
|
|  List archives are available at
|    http://www.mail-archive.com/analog-help@lists.isite.net/
|    http://lists.isite.net/listgate/analog-help/archives/
|    http://www.tallylist.com/archives/index.cfm/mlist.7
+------------------------------------------------------------------------

Reply via email to