Thank you very much for your information Mr. Hipp!

I will update my blog.




On 26/06/07, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote:

"Cesar D. Rodas" <[EMAIL PROTECTED]> wrote:
>
> I was surfing  and I saw that sqlite website is very busy with a hight
band
> width traffic (
http://alexa.com/data/details/traffic_details?url=sqlite.org)
> and I was reading about the SQLite has an Server which is not the normal
> apache or other known webserver, is that right?
>
> I am interesting to know more about this server, and configurations
about
> know more about the SQLite server configuration, what do you do Mr. Hipp
for
> handle a great quantity of traffic (server configuration, your wserver
code
> (if you can give it away) and a network connection)? If you can give
that
> information will be great, coz I think is better the Practice (and your
site
> is very very busy) than theory.
>

I was surfing and I found your article:

http://cesarodas.com/2007/06/how-to-manage-thousands-visitors-part-ii-wwwsqliteorg.html

Let me give you slightly more up-to-date statistics on the
www.sqlite.org website.  Traffic has been on a steady rise
for some time now, and for the past week we've seen in excess
of 10000 unique IPs per day.  The total number of hits is
still running around 70000/day.  Bandwidth is over 3GB per
day. CPU utilization is running about 4%.  (It is unclear to
me if that is 4% of the total CPU available on the physical
host or 4% of my 1/20th slice of that host.  Probably the
former....)

I made a change to the althttpd.c server a couple of months
ago where it automatically drops any connection from the msnbot
or IE5 running on windows95 (as determined by the USER-AGENT
parameter in the HTTP header.)  Kicking off the msnbot resulted
in a huge reduction in hits but with no reduction in the number
of unique IPs.  This means, of course, that SQLite is no longer
listed on the MSN search, but nobody seems to use MSN so that
is no big loss.  And the MSN bot is downright abusive in the
way it hammers a site.  The load presented by the msnbot far
exceeds the combined load of all other search engines on the
internet combined.  Go figure....

I used to get lots of hung win95/IE5 clients that would do
things like download 50000 copies of the tarball over the
course of 8 hours.  I would be getting 2 or 3 download
requests per second.  This was chewing through a lot of
bandwidth so I just made the decision to ban win95/IE5 from
the site.  So far, no complaints have reached me.

Perhaps someday my humble little website will be overwhelmed
and I will have to switch to something like Apache which is
designed to handle a heavy load.  But for now, everything
seems to be going along peachy.  If it ain't broke, don't
fix it....

--
D. Richard Hipp <[EMAIL PROTECTED]>



-----------------------------------------------------------------------------
To unsubscribe, send email to [EMAIL PROTECTED]

-----------------------------------------------------------------------------




--
Cesar D. Rodas
http://www.cesarodas.com/
Mobile Phone: 595 961 974165
Phone: 595 21 645590
[EMAIL PROTECTED]
[EMAIL PROTECTED]

Reply via email to