If it comes every X time, it could be WhatsUp or IMail monitoring the
service. Both have default period of 1 minute for checking the service.
My log shows:
20000929 174810 156.21.3.207, , , GET HTTP/1.0
20000929 174831 156.21.3.207, , , GET HTTP/1.0
20000929 174851 156.21.3.207, , , GET HTTP/1.0
when checked by IMonitor, and I have it set to check every 20 seconds.
WhatsUp (not Gold) used to look for robots.txt. Not sure it still does in
the most current versions, but it could. Are you or someone else at your
site, using that to check the status of the Web MSG service?
Daniel Donnelly
________________________________________________________
See the Knowledge Base at http://support.ipswitch.com/kb
----- Original Message -----
From: <[EMAIL PROTECTED]>
To: <[EMAIL PROTECTED]>
Sent: Friday, September 29, 2000 4:50 PM
Subject: Re: [IMail Forum] robots.txt lines in log file
> > I have 6.0.4 new install with no activity to speak of (still learning)
> > anyway, I am reviewing the logfiles (W21000929.log) and there are a
> > ton of log messages that include the following lines
>
> > HEAD /robots.txt HTTP/1.0
>
> "/robots.txt" is a file that you can have on your web server (but you
likely do not) that instructs search engines as to what they can and can not
do on your site. It just means that a search engine (or possibly something
else -- such as someone harvesting E-mail addresses) found you.
>
> If you check the logs, you can see the IP address they are coming from.
> -Scott
>
>
>
> Please visit http://www.ipswitch.com/support/mailing-lists.html
> to be removed from this list.
>
> An Archive of this list is available at:
> http://www.mail-archive.com/imail_forum%40list.ipswitch.com/
>
Please visit http://www.ipswitch.com/support/mailing-lists.html
to be removed from this list.
An Archive of this list is available at:
http://www.mail-archive.com/imail_forum%40list.ipswitch.com/
