I noticed that one of the sqlite contrib files had 1500 downloads in a single
day this past week, which is around 100X normal. I'm guessing it was a robot.
I see that Google and many other websites' robots.txt prefer this form:
Disallow: /contrib/download/
over this form:
Disallow:
Why are you surprised? No doubt they are trying to do the job with
Microsoft quality control and software.
[EMAIL PROTECTED] wrote:
I was looking into the server logs and I discovered a
curious difference between MSN and Google. Over the past
7 days, the MSN bot has visited www.sqlite.org
I think you should disalow MSN bot... nobody use that... if there is top in
google when you search "Embedded SQL database", what else could sqlite
needs?... MSN is not used (at least here in south America and the rest of
the world)
Another question... your robots.txt is this
User-agent: *
[EMAIL PROTECTED] wrote:
Another 59115 hits from the MSN bot contain the name "luggle.com"
in the URL.
This usually happens if people put broken links in their pages on their
site. It can be due to just plain getting the URLs wrong or the more
usual making some broken relative link instead
Regarding: Does anybody know what "luggle.com" is?
FWIW, I see that Luggle.com appears to be a small site run off a linux
pentium by a few developers.
It does contain mention of sqlite:
http://luggle.com/~sean/Articles/sqlitePV.php
Excerpt from page:
>> I consider the behavior of the MSN bot to be abusive. I'm
>> sorely tempted to ban the MSN bot from the entire sqlite.org
>> website.
Absolutely agree.
>> If SQLite ceased to be indexed by MSN, would that
>> seriously inconvenience any users?
IMHO none at all
A.J.Millan
ZATOR Systems
Just out of curiosity, enter "attach_get" into google. The #1 hit is
from SQLite:
www.sqlite.org/cvstrac/attach_get/293/fx2lite.prg
Go figure.
regards,
Markus
Quoting [EMAIL PROTECTED]:
I was looking into the server logs and I discovered a
curious difference between MSN and Google. Over
I was looking into the server logs and I discovered a
curious difference between MSN and Google. Over the past
7 days, the MSN bot has visited www.sqlite.org 114550 times.
The Google bot, on the other hand, has only visited 4070
times.
In spite of this, when I type "Embedded SQL database" into
8 matches
Mail list logo
