Re: [gentoo-user] horrible mysql performance on gentoo SOLVED for real this time
Solved for real this time. Turns out that 4.0.16 wasn't using the same indexes in the table as the older 4.0.14, so the newer version was using "filesort" instead of indexes, causing the massive slowdown. Reverting back to 4.0.14 and everything went back to full speed. I have no idea why mysql would not using the indexes the same database, but I'm happy to have things back up at 100% :) alan -- Alan <[EMAIL PROTECTED]> - http://arcterex.net "There are only 3 real sports: bull-fighting, car racing and mountain climbing. All the others are mere games."-- Hemingway -- [EMAIL PROTECTED] mailing list
Re: [gentoo-user] horrible mysql performance on gentoo
use deadline scheduler
On Wed, 2004-02-04 at 00:25, Alan wrote:
> Hi guys... still in the middle of getting a server cut over from debian
> to gentoo and I just found some serious performance problems with mysql.
>
> My new hardware is a dual p3 1.13Ghz system with 2G of ECC ram running
> kernel 2.6.1 (gentoo-dev-sources) with preempt compiled.
>
> The current hardware is an athlon XP1800 with 1G of ram running 2.4.24.
>
> Running apache benchmark (ab -n 1000 -c 50 http://blah/) on both boxes
> on a non-database intensive page shows the new hardware to be about twice
> as fast as the old (expected as it's got dual CPUs).
>
> However, when I load a search page on the UBBThreads (php based forums)
> board that is running on the box and do a long search ("this and that or
> the other thing") I see a HUGE performance hit :(
>
> Based on 'time wget "http://url-with-search"; -O /dev/null' the query on the
> old box take about .13s but on the new (stage 2 set up and fully tuned)
> server take 39s!
>
> I ran "ab -n 1000 -c 5 " and it's *still going* while on the
> old box (debian unstable) it's been done for ages. Not only that but
> the load from running ab is up to 7.6 on the gentoo box but barely
> blipped on the old system.
>
> The new system has Mysql 4.0.16 and is compiled with CFLAGS of:
> -O2 -march=pentium3 -fprefetch-loop-arrays -funroll-loops -pipe
> and USE flags of:
> -static +readline +innodb +berkdb +tcpd +ssl +perl -debug
>
> Currently using the example my-huge.conf file for my configuration.
>
> The old system is debian mysql-server version 4.0.14-1.
>
> Any clue as to what could be making it so slow?
--
Regards, Redeeman
() ascii ribbon campaign - against html e-mail
/\- against microsoft attachments
--
[EMAIL PROTECTED] mailing list
Re: [gentoo-user] horrible mysql performance on gentoo (SOLVED - myisamchk to the rescue!)
On Wed, Feb 04, 2004 at 01:34:47PM +, Mike Williams wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > On Wednesday 04 February 2004 03:59, Alan wrote: > > > *sigh* > > Never mind, still sucks. Turns out I forgot to restart the mysql server > > after running the above command, and ab and wget happily returned pages, > > just ones that had no data on them. > > > > Oh well, back to looking > > I'd go for a nice vanilla kernel next. > Then check for query logging, the extra IO could be hurting it. Same problem with 2.4.24 vanilla, and I've also tried using the precompiled binary from mysql.com. I don't think it's query logging either, as this performance hit can be seen in a single query. Any other ideas? -- Alan <[EMAIL PROTECTED]> - http://arcterex.net "There are only 3 real sports: bull-fighting, car racing and mountain climbing. All the others are mere games."-- Hemingway -- [EMAIL PROTECTED] mailing list
Re: [gentoo-user] horrible mysql performance on gentoo (SOLVED - myisamchk to the rescue!)
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Wednesday 04 February 2004 03:59, Alan wrote: > *sigh* > Never mind, still sucks. Turns out I forgot to restart the mysql server > after running the above command, and ab and wget happily returned pages, > just ones that had no data on them. > > Oh well, back to looking I'd go for a nice vanilla kernel next. Then check for query logging, the extra IO could be hurting it. - -- Mike Williams -BEGIN PGP SIGNATURE- Version: GnuPG v1.2.3 (GNU/Linux) iD8DBQFAIPT3InuLMrk7bIwRAhNZAJ9ETV/Hc4ohTYH8hgfj1W24TRfp9ACeMPW6 N2dwSK8acbis01JZSNLiqbg= =TZqz -END PGP SIGNATURE- -- [EMAIL PROTECTED] mailing list
Re: [gentoo-user] horrible mysql performance on gentoo (SOLVED - myisamchk to the rescue!)
On Tue, Feb 03, 2004 at 07:20:12PM -0800, Alan wrote: > On Tue, Feb 03, 2004 at 03:25:11PM -0800, Alan wrote: > > Hi guys... still in the middle of getting a server cut over from debian > > to gentoo and I just found some serious performance problems with mysql. > > Figured it out as soon as I got home today from work. I'm not sure if > it was due to it never being done, or moving tables from one server to > another, or swapping mysql versions, but running > > # myisamchk -r -S -n *.MYI *sigh* Never mind, still sucks. Turns out I forgot to restart the mysql server after running the above command, and ab and wget happily returned pages, just ones that had no data on them. Oh well, back to looking -- Alan <[EMAIL PROTECTED]> - http://arcterex.net "There are only 3 real sports: bull-fighting, car racing and mountain climbing. All the others are mere games."-- Hemingway -- [EMAIL PROTECTED] mailing list
Re: [gentoo-user] horrible mysql performance on gentoo (SOLVED - myisamchk to the rescue!)
On Tue, Feb 03, 2004 at 03:25:11PM -0800, Alan wrote: > Hi guys... still in the middle of getting a server cut over from debian > to gentoo and I just found some serious performance problems with mysql. Figured it out as soon as I got home today from work. I'm not sure if it was due to it never being done, or moving tables from one server to another, or swapping mysql versions, but running # myisamchk -r -S -n *.MYI in the /var/lib/mysql/ directory and now all the speed has returned. alan -- Alan <[EMAIL PROTECTED]> - http://arcterex.net "There are only 3 real sports: bull-fighting, car racing and mountain climbing. All the others are mere games."-- Hemingway -- [EMAIL PROTECTED] mailing list
Re: [gentoo-user] horrible mysql performance on gentoo
> >Any clue as to what could be making it so slow? > > Check to make sure that DMA is enabled on the HD. Yup, that's fine, I have the system running on scsi with software raid5 and get about 100mb/s transfer rates. I'm pretty sure it's not the hard drives as everything else seems to go ok, just the database that's slow. -- Alan <[EMAIL PROTECTED]> - http://arcterex.net "There are only 3 real sports: bull-fighting, car racing and mountain climbing. All the others are mere games."-- Hemingway -- [EMAIL PROTECTED] mailing list
Re: [gentoo-user] horrible mysql performance on gentoo
On Tue, Feb 03, 2004 at 11:28:00PM +, Mike Williams wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > On Tuesday 03 February 2004 23:25, Alan wrote: > > Hi guys... still in the middle of getting a server cut over from debian > > to gentoo and I just found some serious performance problems with mysql. > > > > My new hardware is a dual p3 1.13Ghz system with 2G of ECC ram running > > kernel 2.6.1 (gentoo-dev-sources) with preempt compiled. > > I stopped reading here. > Get rid of preempt, it's only useful on a desktop and makes a right mess of a > server. Hi Mike. I thought of that just after I posted. However, moving to gss-sources (2.4.25_pre6) with no preempt enabled and the same result. Top shows the following while the stat is running: top - 15:57:35 up 12 min, 2 users, load average: 1.97, 0.53, 0.18 Tasks: 96 total, 7 running, 89 sleeping, 0 stopped, 0 zombie Cpu0 : 71.1% user, 28.9% system, 0.0% nice, 0.0% idle Cpu1 : 73.1% user, 26.9% system, 0.0% nice, 0.0% idle Mem: 2069524k total, 582020k used, 1487504k free, 3936k buffers Swap: 1494012k total,0k used, 1494012k free, 459904k cached And on the debian box: top - 16:01:39 up 13:38, 6 users, load average: 8.69, 3.39, 2.20 Tasks: 320 total, 6 running, 308 sleeping, 2 stopped, 4 zombie Cpu0 : 25.6% user, 8.3% system, 2.5% nice, 63.6% idle Mem: 1033384k total, 1007244k used,26140k free,10176k buffers Swap: 20k total, 126116k used, 873804k free, 613216k cached This is about the same as under 2.6 with prempt, with lots of system resources (not just user). My 2.4 .config is at http://arcterex.net/stuff/kernel24-config if that helps at all. -- Alan <[EMAIL PROTECTED]> - http://arcterex.net "There are only 3 real sports: bull-fighting, car racing and mountain climbing. All the others are mere games."-- Hemingway -- [EMAIL PROTECTED] mailing list
Re: [gentoo-user] horrible mysql performance on gentoo
Alan wrote:
Hi guys... still in the middle of getting a server cut over from debian
to gentoo and I just found some serious performance problems with mysql.
My new hardware is a dual p3 1.13Ghz system with 2G of ECC ram running
kernel 2.6.1 (gentoo-dev-sources) with preempt compiled.
The current hardware is an athlon XP1800 with 1G of ram running 2.4.24.
Running apache benchmark (ab -n 1000 -c 50 http://blah/) on both boxes
on a non-database intensive page shows the new hardware to be about twice
as fast as the old (expected as it's got dual CPUs).
However, when I load a search page on the UBBThreads (php based forums)
board that is running on the box and do a long search ("this and that or
the other thing") I see a HUGE performance hit :(
Based on 'time wget "http://url-with-search"; -O /dev/null' the query on the
old box take about .13s but on the new (stage 2 set up and fully tuned)
server take 39s!
I ran "ab -n 1000 -c 5 " and it's *still going* while on the
old box (debian unstable) it's been done for ages. Not only that but
the load from running ab is up to 7.6 on the gentoo box but barely
blipped on the old system.
The new system has Mysql 4.0.16 and is compiled with CFLAGS of:
-O2 -march=pentium3 -fprefetch-loop-arrays -funroll-loops -pipe
and USE flags of:
-static +readline +innodb +berkdb +tcpd +ssl +perl -debug
Currently using the example my-huge.conf file for my configuration.
The old system is debian mysql-server version 4.0.14-1.
Any clue as to what could be making it so slow?
Check to make sure that DMA is enabled on the HD.
--
Andrew Gaffney
Network Administrator
Skyline Aeronautics, LLC.
636-357-1548
--
[EMAIL PROTECTED] mailing list
Re: [gentoo-user] horrible mysql performance on gentoo
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Tuesday 03 February 2004 23:25, Alan wrote: > Hi guys... still in the middle of getting a server cut over from debian > to gentoo and I just found some serious performance problems with mysql. > > My new hardware is a dual p3 1.13Ghz system with 2G of ECC ram running > kernel 2.6.1 (gentoo-dev-sources) with preempt compiled. I stopped reading here. Get rid of preempt, it's only useful on a desktop and makes a right mess of a server. - -- Mike Williams -BEGIN PGP SIGNATURE- Version: GnuPG v1.2.3 (GNU/Linux) iD8DBQFAIC6AInuLMrk7bIwRAiQbAJ9+cdCUjzAiabh4ZCOZcEYoCoj7vQCcDfeR GGUYGyGP20dSEZXuD1GoLRk= =0YAK -END PGP SIGNATURE- -- [EMAIL PROTECTED] mailing list
[gentoo-user] horrible mysql performance on gentoo
Hi guys... still in the middle of getting a server cut over from debian
to gentoo and I just found some serious performance problems with mysql.
My new hardware is a dual p3 1.13Ghz system with 2G of ECC ram running
kernel 2.6.1 (gentoo-dev-sources) with preempt compiled.
The current hardware is an athlon XP1800 with 1G of ram running 2.4.24.
Running apache benchmark (ab -n 1000 -c 50 http://blah/) on both boxes
on a non-database intensive page shows the new hardware to be about twice
as fast as the old (expected as it's got dual CPUs).
However, when I load a search page on the UBBThreads (php based forums)
board that is running on the box and do a long search ("this and that or
the other thing") I see a HUGE performance hit :(
Based on 'time wget "http://url-with-search"; -O /dev/null' the query on the
old box take about .13s but on the new (stage 2 set up and fully tuned)
server take 39s!
I ran "ab -n 1000 -c 5 " and it's *still going* while on the
old box (debian unstable) it's been done for ages. Not only that but
the load from running ab is up to 7.6 on the gentoo box but barely
blipped on the old system.
The new system has Mysql 4.0.16 and is compiled with CFLAGS of:
-O2 -march=pentium3 -fprefetch-loop-arrays -funroll-loops -pipe
and USE flags of:
-static +readline +innodb +berkdb +tcpd +ssl +perl -debug
Currently using the example my-huge.conf file for my configuration.
The old system is debian mysql-server version 4.0.14-1.
Any clue as to what could be making it so slow?
--
Alan <[EMAIL PROTECTED]> - http://arcterex.net
"There are only 3 real sports: bull-fighting, car racing and mountain
climbing. All the others are mere games."-- Hemingway
--
[EMAIL PROTECTED] mailing list
