It's a common problem in the typical internet world,using Linux+Apache+Perl+mySQL+qmail
I suggest you read perl.apache.org(assume ya using perl:-)
there is a powerful module of Apache,mod_perl which using perl as a function module of
Apache then use persist connection to mySql,say,thousands db queries using a single
connection to mySQL server.
the same way used before is FASTCGI but mod_perl is much more better.
----- Original Message -----
From: Michael Boman <[EMAIL PROTECTED]>
To: Eric Peters <[EMAIL PROTECTED]>
Cc: <[EMAIL PROTECTED]>; <[EMAIL PROTECTED]>
Sent: Tuesday, December 21, 1999 5:21 PM
Subject: Re: Qmail is killing my mySQL server!
> On Tue, Dec 21, 1999 at 01:10:06AM -0800, Eric Peters wrote:
> > ever consider gigaethernet? : )
> >
> > its possible to come up with a schema for persistant connections via the perl
> > scripts/ named pipes and etc al as well so you don't have to create a new
> > tcp/ip connection for each request/query etc but woudl rather use a connection
> > that is already open - which would probably reduce alot of the load
> >
> > Eric
>
> Okey. Has anyone done a such application or know someone who has done it?
> Please advice.
>
> And you guys who is having tons of users, what are you running?
>
> Best regards
>
> Michael Boman
>
> >
> > On Tue, 21 Dec 1999, Michael Boman wrote:
> > > On Tue, Dec 21, 1999 at 12:23:18AM -0800, Eric Peters wrote:
> > > > makes you think about that doesn't it <grin>
> > > >
> > > > you probably want to consult the mysql mailing list for perf tuning
> > > >
> > > > Eric
> > >
> > > The problem isnt either the database server, it's fine tuned to the maximum. The
> > > problem is that SMTP/POP3 is causing ALLOT of traffic to the database server.
> > >
> > > It wouldn't matter if we put Oracle or MS Sql instead, 'cause the traffic will
>still
> > > be there. What I am looking for is a way to slow down the queries, limit them
>some how,
> > > to the database server.
> > >
> > > > On Tue, 21 Dec 1999, Michael Boman wrote:
> > > > > On Mon, Dec 20, 1999 at 11:55:25PM -0800, Eric Peters wrote:
> > > > > > its probably rather simple - your probably using the decaprecated
>mysql_connect
> > > > > > in the CGI possibly - rather than the mysql_real_connect api -
> > >
> > > The CGI is written in Perl and uses the DBI modules. Each CGI script is running
>as
> > > a daemon. Nothing special about them that could cause this load, as the only
>thing
> > > is does is to do a POP3 connect to check if you have mail...
> > >
> > > > > > well to be simpler than that make sure your majority of the connections are
> > > > > > connecting through teh mysql named pipe (the socket) rather than tcp/ip
> > > > > > connections
> > > > > >
> > > > > > Eric
> > > > > >
> > > > >
> > > > > Err.. It's on three different computers: Webserver, Mailserver, mySQL server.
> > > > >
> > > > > /Mike
> > > > >
> > > > > > On Mon, 20 Dec 1999, Michael Boman wrote:
> > > > > > > I am running following setup:
> > > > > > >
> > > > > > > qmail 1.03 + mysql patch
> > > > > > > tcpserver etc.
> > > > > > >
> > > > > > > Right now qmail is killing the mySQL database server with requests. I've
> > > > > > > seen ppl here on the list with 30k-50k users and I wonder how you manage
> > > > > > > to keep the mySQL server alive.
> > > > > > >
> > > > > > > We have about 10k clients. On our homepage there is a CGI program that
> > > > > > > checks your email the moment you login.
> > > > > > >
> > > > > > > Problems so far:
> > > > > > >
> > > > > > > The maximum connections to the mySQL server exceeds the limit, causing
> > > > > > > downtime on our mail- and web server as it depends on the same mySQL
> > > > > > > server.
> > > > > > >
> > > > > > > So, is there any way to keep the mySQL connections down while keeping
> > > > > > > a high uptime of web- and mail server? Anyone written a proxy/wrapper
> > > > > > > for mySQL to limit the number of connections to the real mySQL server?
> > > > > > >
> > > > > > > Future setup: qmail + vpopmail with even higher number of users.
> > > > > > >
> > > > > > > Please advice
> > > > > > >
> > > > > > > Michael Boman
> > > > > > >
> > > > > > > PS
> > > > > > > Having a separate mySQL servers for mail and web is not a option, as
> > > > > > > it would give our CGI programs more to do and by that making
> > > > > > > the web-server load too high... Plus it would be another server
> > > > > > > to manage.
> > > > > > > DS
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > W I Z O F F I C E . C O M - Your Online Wizard
> > > > > > > 16 Tannery Lane, Cristal Time Building, #06-00, Singapore 347778
> > > > > > > Ring : (65) 844 3228 [ext 118] Fax : (65) 842 7228
> > > > > > > email : [EMAIL PROTECTED] URL : http://www.wizoffice.com
> > > > > > --
> > > > > >
> > > > > > ----------------------------------------------------------------------
> > > > > > Eric Peters
> > > > > > I Do: http://www.tekmetrics.com/transcript.jsp?pid=143745
> > > > > > [EMAIL PROTECTED] - [EMAIL PROTECTED] - [EMAIL PROTECTED]
> > > > > > ----------------------------------------------------------------------
> > > > >
> > > > > --
> > > > > W I Z O F F I C E . C O M - Your Online Wizard
> > > > > 16 Tannery Lane, Cristal Time Building, #06-00, Singapore 347778
> > > > > Ring : (65) 844 3228 [ext 118] Fax : (65) 842 7228
> > > > > email : [EMAIL PROTECTED] URL : http://www.wizoffice.com
> > > > --
> > > >
> > > > ----------------------------------------------------------------------
> > > > Eric Peters
> > > > I Do: http://www.tekmetrics.com/transcript.jsp?pid=143745
> > > > [EMAIL PROTECTED] - [EMAIL PROTECTED] - [EMAIL PROTECTED]
> > > > ----------------------------------------------------------------------
> > >
> > > --
> > > W I Z O F F I C E . C O M - Your Online Wizard
> > > 16 Tannery Lane, Cristal Time Building, #06-00, Singapore 347778
> > > Ring : (65) 844 3228 [ext 118] Fax : (65) 842 7228
> > > email : [EMAIL PROTECTED] URL : http://www.wizoffice.com
> > --
> >
> > ----------------------------------------------------------------------
> > Eric Peters
> > I Do: http://www.tekmetrics.com/transcript.jsp?pid=143745
> > [EMAIL PROTECTED] - [EMAIL PROTECTED] - [EMAIL PROTECTED]
> > ----------------------------------------------------------------------
>
> --
> W I Z O F F I C E . C O M - Your Online Wizard
> 16 Tannery Lane, Cristal Time Building, #06-00, Singapore 347778
> Ring : (65) 844 3228 [ext 118] Fax : (65) 842 7228
> email : [EMAIL PROTECTED] URL : http://www.wizoffice.com
>
