Re: Hi CPU on FreeBSD
We had the same problem. Upgrading Freebsd to 4.8 and recompiling MySQL to work with Linux style threads seemed to work. The MySQLd process no longer pops up to ~90% on each request. However, with the application we're running that queries the database (Request Tracker 3), we still get process bloat with certain queries (searches mostly). But, this problem doesn't come up with any other application, or with manual querys of the database, so we think it's a bug in the app. Lalo Gunnar Helliesen wrote: On Sat, 22 Jun 2002 17:43:12 -0700 Jeremy Zawodny wrote: On Sat, Jun 22, 2002 at 07:26:36PM -0500, mos wrote: We've managed to reproduce this pretty reliably at Yahoo and are working to track and fix the bug. If we find a resolution, I'll post a note here. There have been a few threads regarding high CPU utilization on FreeBSD systems. Yeah, I mostly ingored them because I thought it was a fluke. But it happens much more than I had thought. It's still happening on the site I first reported it on. We're currently running max-4.0.11-gamma, but the problem has been present since 3.x. FreeBSD 4.4 and 4.5. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Hi CPU on FreeBSD
On Mon, Jun 09, 2003 at 11:26:36AM -0700, Lalo Castro wrote: We had the same problem. Upgrading Freebsd to 4.8 and recompiling MySQL to work with Linux style threads seemed to work. Great. The MySQLd process no longer pops up to ~90% on each request. However, with the application we're running that queries the database (Request Tracker 3), we still get process bloat with certain queries (searches mostly). But, this problem doesn't come up with any other application, or with manual querys of the database, so we think it's a bug in the app. Is this process bloat on the MySQL site or on the RT/Perl side? If it's on the MySQL side, can you describe it a bit and perhaps post your my.cnf file along with a sample query and table structure that tends to trigger the bloat? I suspect that if it's a design deficiency in RT, Jesse and the folks at Best Practical would like to fix it. Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! [EMAIL PROTECTED] | http://jeremy.zawodny.com/ MySQL 4.0.13: up 6 days, processed 195,846,290 queries (348/sec. avg) -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Hi CPU on FreeBSD
the load average in my freebsd 5.0 (latest releng) compiled statically with linuxthreads decreased 80% after I tunned these variables: set-variable = key_buffer_size=100MB set-variable = read_buffer_size=5M set-variable = table_cache=500 set-variable = max_delayed_threads=0 set-variable = max_user_connections=25 set-variable = query_cache_size=50M set-variable = thread_cache_size=100 The only problem I couldn't solve is that some connections will never die... since most of this connections come from tomcat, I'm restarting it more often. Using query cache and thread cache will definetely give you a boost of performance This machine has lots of memory, so you have to be careful with variables like key_buffer_size, table_cache and query_cache_size... you need memory for that, don't let it swap. Lalo Castro wrote: We had the same problem. Upgrading Freebsd to 4.8 and recompiling MySQL to work with Linux style threads seemed to work. The MySQLd process no longer pops up to ~90% on each request. However, with the application we're running that queries the database (Request Tracker 3), we still get process bloat with certain queries (searches mostly). But, this problem doesn't come up with any other application, or with manual querys of the database, so we think it's a bug in the app. Lalo Gunnar Helliesen wrote: On Sat, 22 Jun 2002 17:43:12 -0700 Jeremy Zawodny wrote: On Sat, Jun 22, 2002 at 07:26:36PM -0500, mos wrote: We've managed to reproduce this pretty reliably at Yahoo and are working to track and fix the bug. If we find a resolution, I'll post a note here. There have been a few threads regarding high CPU utilization on FreeBSD systems. Yeah, I mostly ingored them because I thought it was a fluke. But it happens much more than I had thought. It's still happening on the site I first reported it on. We're currently running max-4.0.11-gamma, but the problem has been present since 3.x. FreeBSD 4.4 and 4.5. -- -- Gustavo Baratto - Programming and Technical Support [EMAIL PROTECTED] * (604) 638-2525 ext. 408 Technical support web-site: http://support.superb.net Superb Internet Corp. Ahead of the Rest - -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Hi CPU on FreeBSD
On Mon, Jun 09, 2003 at 01:41:00PM +, Gustavo A. Baratto wrote: the load average in my freebsd 5.0 (latest releng) compiled statically with linuxthreads decreased 80% after I tunned these variables: What about actual CPU usage? Did is increase similarly? The load average isn't necessarily a good measure of performance. It's often a good measure of bottlenecks beyond the scheduler's control--suck as poor I/O. Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! [EMAIL PROTECTED] | http://jeremy.zawodny.com/ MySQL 4.0.13: up 6 days, processed 198,532,567 queries (349/sec. avg) -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Hi CPU on FreeBSD
CPU usage improved a lot as well... It's always above 90% free and before it was 70-75% idle... here is a snapshot: last pid: 58730; load averages: 0.09, 0.11, 0.08 up 9+20:59:57 17:11:24 216 processes: 1 running, 215 sleeping CPU states: 0.0% user, 1.8% nice, 1.2% system, 0.2% interrupt, 96.9% idle Jeremy Zawodny wrote: On Mon, Jun 09, 2003 at 01:41:00PM +, Gustavo A. Baratto wrote: the load average in my freebsd 5.0 (latest releng) compiled statically with linuxthreads decreased 80% after I tunned these variables: What about actual CPU usage? Did is increase similarly? The load average isn't necessarily a good measure of performance. It's often a good measure of bottlenecks beyond the scheduler's control--suck as poor I/O. Jeremy -- -- Gustavo Baratto - Programming and Technical Support [EMAIL PROTECTED] * (604) 638-2525 ext. 408 Technical support web-site: http://support.superb.net Superb Internet Corp. Ahead of the Rest - -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Hi CPU on FreeBSD
On Sat, 22 Jun 2002 17:43:12 -0700 Jeremy Zawodny wrote: On Sat, Jun 22, 2002 at 07:26:36PM -0500, mos wrote: We've managed to reproduce this pretty reliably at Yahoo and are working to track and fix the bug. If we find a resolution, I'll post a note here. There have been a few threads regarding high CPU utilization on FreeBSD systems. Yeah, I mostly ingored them because I thought it was a fluke. But it happens much more than I had thought. It's still happening on the site I first reported it on. We're currently running max-4.0.11-gamma, but the problem has been present since 3.x. FreeBSD 4.4 and 4.5. The 2nd processor may be causing the problem. We can reproduce it on a single CPU box too. The number of CPUs isn't the issue. Same here. One or more CPUs makes _no_ difference. Load seems to factor in, though. Since I made my original post http://lists.mysql.com/list.php?list=mysqlpost=107745, I've moved the load (web site access tracking ++) from the single-CPU machine to the SMP machine. The problem moved right along with the load. You may want to contact the original authors to see if they've come up with a solution. I likely will. Thanks. Jeremy Any news? Gunnar -- Gunnar Helliesen | Bergen IT Consult | Open Source activist Systems Consultant | Bergen, Norway| Jaguar enthusiast [EMAIL PROTECTED] | www.bitcon.no/~gunnar | Märklin collector -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Hi CPU on FreeBSD
On Sun, Jun 08, 2003 at 03:37:17PM +0200, Gunnar Helliesen wrote: On Sat, 22 Jun 2002 17:43:12 -0700 Jeremy Zawodny wrote: On Sat, Jun 22, 2002 at 07:26:36PM -0500, mos wrote: We've managed to reproduce this pretty reliably at Yahoo and are working to track and fix the bug. If we find a resolution, I'll post a note here. There have been a few threads regarding high CPU utilization on FreeBSD systems. Yeah, I mostly ingored them because I thought it was a fluke. But it happens much more than I had thought. [snip] Any news? Wow, you fond 1-year old thread on this. Impressive. :-) Yes, there's good news: http://jeremy.zawodny.com/blog/archives/000697.html Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! [EMAIL PROTECTED] | http://jeremy.zawodny.com/ MySQL 4.0.13: up 5 days, processed 170,695,248 queries (358/sec. avg) -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Hi CPU on FreeBSD
On Sat, Jun 22, 2002 at 07:26:36PM -0500, mos wrote: We've managed to reproduce this pretty reliably at Yahoo and are working to track and fix the bug. If we find a resolution, I'll post a note here. There have been a few threads regarding high CPU utilization on FreeBSD systems. Yeah, I mostly ingored them because I thought it was a fluke. But it happens much more than I had thought. The 2nd processor may be causing the problem. We can reproduce it on a single CPU box too. The number of CPUs isn't the issue. You may want to contact the original authors to see if they've come up with a solution. I likely will. Thanks. Jeremy -- Jeremy D. Zawodny, [EMAIL PROTECTED] Technical Yahoo - Yahoo Finance Desk: (408) 349-7878 Fax: (408) 349-5454 Cell: (408) 685-5936 MySQL 3.23.51: up 24 days, processed 517,620,372 queries (249/sec. avg) - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: Hi CPU on FreeBSD
On Mon, May 27, 2002 at 11:46:44AM +0100, Simon Green wrote: Re Gunnar Helliesen e-mail I have FreeBSD4.2 and MySQL 3.23.49. I two have hi cpu (99%) on a twin cpu system. (Compaq DL380) After making the suggested changes to my.cnf we rebooted the system. For 3 days all ran fine (low cpu) then at 2am cpu went back up to 99%. Has any body know why FreeBSD with MySQL had this problem? Simon PS apart from that it kicks ass.as MySQL should... We've managed to reproduce this pretty reliably at Yahoo and are working to track and fix the bug. If we find a resolution, I'll post a note here. Jeremy -- Jeremy D. Zawodny, [EMAIL PROTECTED] Technical Yahoo - Yahoo Finance Desk: (408) 349-7878 Fax: (408) 349-5454 Cell: (408) 685-5936 MySQL 3.23.51: up 23 days, processed 517,327,740 queries (249/sec. avg) - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: Hi CPU on FreeBSD
At 06:59 PM 6/22/2002, you wrote: On Mon, May 27, 2002 at 11:46:44AM +0100, Simon Green wrote: Re Gunnar Helliesen e-mail I have FreeBSD4.2 and MySQL 3.23.49. I two have hi cpu (99%) on a twin cpu system. (Compaq DL380) After making the suggested changes to my.cnf we rebooted the system. For 3 days all ran fine (low cpu) then at 2am cpu went back up to 99%. Has any body know why FreeBSD with MySQL had this problem? Simon PS apart from that it kicks ass.as MySQL should... We've managed to reproduce this pretty reliably at Yahoo and are working to track and fix the bug. If we find a resolution, I'll post a note here. There have been a few threads regarding high CPU utilization on FreeBSD systems. The 2nd processor may be causing the problem. You may want to contact the original authors to see if they've come up with a solution. Mike Here are 3 threads: Thread #1: X-Sieve: CMU Sieve 2.1 Received: from www.fastmail.fm ([unix socket]) by www.fastmail.fm (Cyrus v2.1.3) with LMTP; Tue, 11 Jun 2002 04:13:55 -0500 Received: from www.fastmail.fm (localhost [127.0.0.1]) by localhost.localdomain (Postfix) with ESMTP id 398FF6D9FB for [EMAIL PROTECTED]; Tue, 11 Jun 2002 04:13:55 -0500 (CDT) X-Mail-from: [EMAIL PROTECTED] X-Delivered-to: [EMAIL PROTECTED] Received: from web.mysql.com (web.mysql.com [192.58.197.162]) by www.fastmail.fm (Postfix) with SMTP id 43FE26D9E5 for [EMAIL PROTECTED]; Tue, 11 Jun 2002 04:13:54 -0500 (CDT) Received: (qmail 1417 invoked by uid 7797); 11 Jun 2002 09:04:38 - Mailing-List: contact [EMAIL PROTECTED]; run by ezmlm (http://www.ezmlm.org) List-ID: mysql.mysql.com Precedence: bulk List-Help: mailto:[EMAIL PROTECTED] List-Unsubscribe: mailto:[EMAIL PROTECTED] List-Post: mailto:[EMAIL PROTECTED] List-Subscribe: mailto:[EMAIL PROTECTED] Delivered-To: mailing list [EMAIL PROTECTED] Received: (qmail 1341 invoked from network); 11 Jun 2002 09:04:17 - Content-Type: text/plain; charset=iso-8859-1 From: Leo De Geer [EMAIL PROTECTED] Reply-To: [EMAIL PROTECTED] Organization: Kristianstad Teknikverkstad To: Simon Green [EMAIL PROTECTED], [EMAIL PROTECTED] Subject: Re: problem with mysql threads on freebsd Date: Tue, 11 Jun 2002 11:12:46 +0200 X-Mailer: KMail [version 1.4] References: [EMAIL PROTECTED] In-Reply-To: [EMAIL PROTECTED] MIME-Version: 1.0 Message-Id: [EMAIL PROTECTED] On Tuesday 11 June 2002 10.48, Simon Green wrote: We are ruing a box with freeBSD and MySQL with twin processors It looked like it was using only on processor but we decided that it was the way FreeBSD's threads work? There seems to be two problems with ruing MySQL on FreeBSD. One: Seems not to use both processors (on twin system) Two: All ways a load on 1 even when the system in not at hi load (seem to go down when it is!) What is up with freeBSD or MySQL. Simon -Original Message- From: Leo De Geer [mailto:[EMAIL PROTECTED]] Sent: 11 June 2002 09:35 To: Alexander V Zubchenko Cc: Dicky Wahyu Purnomo; [EMAIL PROTECTED]; [EMAIL PROTECTED] Subject: Re: problem with mysql threads on freebsd On Tuesday 11 June 2002 09.57, Alexander V Zubchenko wrote: Greetings! On Tue, 11 Jun 2002, Leo De Geer wrote: but in my case its not good to have it that way im having one dedikated dual server for the sql and now im yust using one cpu for the sql questions. i nead it to start sub conections to the sql to serv all my conections good. In such case provide, please additional info. AFAIU, You want to use both cpu for sql, in other words, optimal use of Your server. Than, do You recompile (or compile) kernel with SMP support (afaik, this is only arch for multicpu systems, supported by fbsd)? You can b sure, that if mysql will run separate process for each request, it will slowdown perfomance, but never increase it. In fact, balancing load on many cpus is OS task. And multithreaded processes _must_ b processed similarly to multiprocess environment (but i don't know, how exactly fbsd smp-support built). Check Your kernel config /usr/src/sys/i386/conf/name. You may find also this name interesting: LINT - list [almost?] all options recognized in config-file. With respect, Alexander V Zubchenko, E-Mail: [EMAIL PROTECTED] System Administrator, WWW: http://www.hermes-comp.zp.ua/ Hermes-comp, Ukraine, Zaporizhzhya, Geroev Stalingrada 50 phone/fax: +380 612 64-19-72 the kernel is runing both cpu. and the balancing is working good on everything but the sql! i have on my linux sql server aproximatly 100 simultanius conections that du you think that the standard memory size of 128 do you think i nead to put it up to 256 meg in the kernel the problen nr 2 i dont have but the server we have dont handle the load on one cpu. at the moment we are runing the sql on a linux
