RE: Opteron HOWTO - #mysql Freenode
Over the last week I added in lots of comments pasted in from various places. I'd appreciate those running with Opteron and MySQL to have a close look at the WIKI and make any amendments/suggestions. http://hashmysql.org/index.php?title=Opteron_HOWTO My Opteron server will be here shortly and I'll do some performance testing on RAID5 (8 disks) versus RAID 10 (8 disks, 2 channels). I'll also do some performance tests with 128MB cache and 512MB cache on the SCSI card to let you know if that makes a difference. Best regards, Richard Dale. Norgate Investor Services - Premium quality Stock, Futures and Foreign Exchange Data for markets in Australia, Asia, Canada, Europe, UK USA - www.premiumdata.net -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Opteron HOWTO - #mysql Freenode
Richard Dale wrote: Over the last week I added in lots of comments pasted in from various places. I'd appreciate those running with Opteron and MySQL to have a close look at the WIKI and make any amendments/suggestions. http://hashmysql.org/index.php?title=Opteron_HOWTO My Opteron server will be here shortly and I'll do some performance testing on RAID5 (8 disks) versus RAID 10 (8 disks, 2 channels) Awesome! Thats great news... I reconfigured one of our slaves from RAID5 to RAID1 and setup the controller as writeback and caching the stripes. I'm getting about 75% additional performance. I wanted to put the controller on additional channels but it turns out that I need a stupid proprietary cable from Dell to accomplish this. I'm not sure what benchmark I could see from using two channels then. My gut though in our config says that we won't see any performance increase since I'm not maxing out the IO on each channel (but I might be wrong). I'd love to see your numbers here. -- Use Rojo (RSS/Atom aggregator)! - visit http://rojo.com. See irc.freenode.net #rojo if you want to chat. Rojo is Hiring! - http://www.rojonetworks.com/JobsAtRojo.html Kevin A. Burton, Location - San Francisco, CA AIM/YIM - sfburtonator, Web - http://peerfear.org/ GPG fingerprint: 5FB2 F3E2 760E 70A8 6174 D393 E84D 8D04 99F1 4412 -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Opteron HOWTO?!
Dathan Pattishall wrote: Are you using NPTL? No that sucks we use the other one. Can't make a static build with NPTL. What type of performance boost are you getting from running a static build. Kevin -- Use Rojo (RSS/Atom aggregator)! - visit http://rojo.com. See irc.freenode.net #rojo if you want to chat. Rojo is Hiring! - http://www.rojonetworks.com/JobsAtRojo.html Kevin A. Burton, Location - San Francisco, CA AIM/YIM - sfburtonator, Web - http://peerfear.org/ GPG fingerprint: 5FB2 F3E2 760E 70A8 6174 D393 E84D 8D04 99F1 4412 -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Opteron HOWTO?!
Dathan Pattishall wrote: We do about 70K qps at peak for about 1 Billion Queries per day (only on 30 servers BOOYA). So, it's pretty stable. Also... based on my math.. this yields ~ 2300 qps per MySQL box... which is pretty good. Kevin -- Use Rojo (RSS/Atom aggregator)! - visit http://rojo.com. See irc.freenode.net #rojo if you want to chat. Rojo is Hiring! - http://www.rojonetworks.com/JobsAtRojo.html Kevin A. Burton, Location - San Francisco, CA AIM/YIM - sfburtonator, Web - http://peerfear.org/ GPG fingerprint: 5FB2 F3E2 760E 70A8 6174 D393 E84D 8D04 99F1 4412 -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
RE: Opteron HOWTO?!
DVP Dathan Vance Pattishall http://www.friendster.com -Original Message- From: Kevin Burton [mailto:[EMAIL PROTECTED] Sent: Wednesday, May 11, 2005 12:10 PM To: Dathan Pattishall Cc: [EMAIL PROTECTED]; Jochem van Dieten; mysql@lists.mysql.com Subject: Re: Opteron HOWTO?! Dathan Pattishall wrote: Are you using NPTL? No that sucks we use the other one. Can't make a static build with NPTL. What type of performance boost are you getting from running a static build. 5-7% with the security knowing that if another package updates a shared lib mySQL will not crash. Kevin -- Use Rojo (RSS/Atom aggregator)! - visit http://rojo.com. See irc.freenode.net #rojo if you want to chat. Rojo is Hiring! - http://www.rojonetworks.com/JobsAtRojo.html Kevin A. Burton, Location - San Francisco, CA AIM/YIM - sfburtonator, Web - http://peerfear.org/ GPG fingerprint: 5FB2 F3E2 760E 70A8 6174 D393 E84D 8D04 99F1 4412 -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
RE: Opteron HOWTO?!
On some boxes we do more. Some we do less. DVP Dathan Vance Pattishall http://www.friendster.com -Original Message- From: Kevin Burton [mailto:[EMAIL PROTECTED] Sent: Wednesday, May 11, 2005 12:24 PM To: Dathan Pattishall Cc: Jochem van Dieten; mysql@lists.mysql.com Subject: Re: Opteron HOWTO?! Dathan Pattishall wrote: We do about 70K qps at peak for about 1 Billion Queries per day (only on 30 servers BOOYA). So, it's pretty stable. Also... based on my math.. this yields ~ 2300 qps per MySQL box... which is pretty good. Kevin -- Use Rojo (RSS/Atom aggregator)! - visit http://rojo.com. See irc.freenode.net #rojo if you want to chat. Rojo is Hiring! - http://www.rojonetworks.com/JobsAtRojo.html Kevin A. Burton, Location - San Francisco, CA AIM/YIM - sfburtonator, Web - http://peerfear.org/ GPG fingerprint: 5FB2 F3E2 760E 70A8 6174 D393 E84D 8D04 99F1 4412 -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Opteron HOWTO?!
Excellent, I'll be waiting to see performance numbers, specifically for FreeBSD vs. Linux. Save for a few odd machines, we're pretty much pure FreeBSD and the last releases in the 4 branch are really impressive as far as speed and stability. That being said, the Opteron would have to offer a pretty decent performance gain for us to consider switching. At the moment, our software layout is such that we have not had a need to take advantage of more than 2G memory. Feel free to woo me with your performance results. ;) In the not so distant future I will have to get an Opteron box so I can see for myself.. Atle - Flying Crocodile Inc, Unix Systems Administrator On Mon, 9 May 2005, Kevin Burton wrote: Great! I created a wiki node for this issue. http://hashmysql.org/index.php?title=Opteron_HOWTO -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Opteron HOWTO?!
On 5/9/05, Kevin Burton wrote: So... it sounds like a lot of people here (Dathan and Greg) have had problems deploying MySQL on Opteron in a production environment. To me it sounds more like a lot of people have had problems running Linux on x86-64 systems. Jochem -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Opteron HOWTO?!
While you're at it, take a look at Gentoo Linux (http://www.gentoo.org). I've been having very good luck with it on everything from a Duron 1GHz to Opterons. Very responsive. It compiled a kernel on an opteron in about 5 minutes. Curtis Atle Veka wrote: Excellent, I'll be waiting to see performance numbers, specifically for FreeBSD vs. Linux. Save for a few odd machines, we're pretty much pure FreeBSD and the last releases in the 4 branch are really impressive as far as speed and stability. That being said, the Opteron would have to offer a pretty decent performance gain for us to consider switching. At the moment, our software layout is such that we have not had a need to take advantage of more than 2G memory. Feel free to woo me with your performance results. ;) In the not so distant future I will have to get an Opteron box so I can see for myself.. Atle - Flying Crocodile Inc, Unix Systems Administrator On Mon, 9 May 2005, Kevin Burton wrote: Great! I created a wiki node for this issue. http://hashmysql.org/index.php?title=Opteron_HOWTO
RE: Opteron HOWTO?!
Subject: Re: Opteron HOWTO?! On 5/9/05, Kevin Burton wrote: So... it sounds like a lot of people here (Dathan and Greg) have had problems deploying MySQL on Opteron in a production environment. To me it sounds more like a lot of people have had problems running Linux on x86-64 systems. We don't have any problems running Opterons at all. With all the tests me and my team have done, we know the ins and outs of getting Opterons up, running-stable, and blazing fast. Our entire datacenter are (about 200 servers) Dual Opterons with at least 4GB of memory running in 64-bit mode. All the databases (about 30) - Are dual opterons with 8 GB of memory connected to a Hitachi 9980 SAN-through a McData Switch. We do about 70K qps at peak for about 1 Billion Queries per day (only on 30 servers BOOYA). So, it's pretty stable. -- Dathan V Pattishall Sr. Database Engineer / Sr. Software Engineer Friendster Inc. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Opteron HOWTO?!
Care to share any secrets? You guys are running Suse w/ 2.4 kernel yes? Any specifics as far as kernel/glibc/gcc versions. Are you running mysql 4.1.*? Are you using NPTL? You using the binary from mysql, or building yourself? Are you running Innodb or Myisam. You mentioned reiserfs correct? Any problems w/ ext3? Sorry to bombard you w/ questions, but we have had nothing but horrible performance using Opterons, and any specifics you can give would help to clear up this mess. I know that I am not the only person who is seeing this flakyiness. Thanks, Greg Dathan Pattishall wrote: Subject: Re: Opteron HOWTO?! On 5/9/05, Kevin Burton wrote: So... it sounds like a lot of people here (Dathan and Greg) have had problems deploying MySQL on Opteron in a production environment. To me it sounds more like a lot of people have had problems running Linux on x86-64 systems. We don't have any problems running Opterons at all. With all the tests me and my team have done, we know the ins and outs of getting Opterons up, running-stable, and blazing fast. Our entire datacenter are (about 200 servers) Dual Opterons with at least 4GB of memory running in 64-bit mode. All the databases (about 30) - Are dual opterons with 8 GB of memory connected to a Hitachi 9980 SAN-through a McData Switch. We do about 70K qps at peak for about 1 Billion Queries per day (only on 30 servers BOOYA). So, it's pretty stable. -- Dathan V Pattishall Sr. Database Engineer / Sr. Software Engineer Friendster Inc. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
RE: Opteron HOWTO?!
-Original Message- From: Greg Whalin [mailto:[EMAIL PROTECTED] Sent: Tuesday, May 10, 2005 3:12 PM To: Dathan Pattishall Cc: Jochem van Dieten; mysql@lists.mysql.com Subject: Re: Opteron HOWTO?! Care to share any secrets? You guys are running Suse w/ 2.4 kernel yes? Yes. We run RedHat with a Suse Kernel and pure Suse. Any specifics as far as kernel/glibc/gcc versions. Kernel - 2.4.21-215-default #5 SMP Glibc - rpm -qa |grep glib glibc-profile-2.3.2-95.6 glibc-2.3.2-95.20 glibc-headers-2.3.2-95.6 glib2-2.2.3-2.0 glibc-kernheaders-2.4-8.34 glibc-devel-2.3.2-95.6 glibc-common-2.3.2-95.20 glibc-devel-2.3.2-95.6 glib-1.2.10-11.1 glibc-utils-2.3.2-95.6 glib-1.2.10-11.1 glibc-2.3.2-95.6 Gcc - gcc3.3 Are you running mysql 4.1.*? Yes Are you using NPTL? No that sucks we use the other one. Can't make a static build with NPTL. You using the binary from mysql, or building yourself? I build it myself using gcc3.3 - 3.4 will crash mysql using -O of any level. Are you running Innodb or Myisam. Both You mentioned reiserfs correct? Any problems w/ ext3? You can't use O_DIRECT on ext3 and 2.4 there is a bug in EXT3 when used under heavy load the volume will lock. Thanks, Greg Dathan Pattishall wrote: Subject: Re: Opteron HOWTO?! On 5/9/05, Kevin Burton wrote: So... it sounds like a lot of people here (Dathan and Greg) have had problems deploying MySQL on Opteron in a production environment. To me it sounds more like a lot of people have had problems running Linux on x86-64 systems. We don't have any problems running Opterons at all. With all the tests me and my team have done, we know the ins and outs of getting Opterons up, running-stable, and blazing fast. Our entire datacenter are (about 200 servers) Dual Opterons with at least 4GB of memory running in 64-bit mode. All the databases (about 30) - Are dual opterons with 8 GB of memory connected to a Hitachi 9980 SAN-through a McData Switch. We do about 70K qps at peak for about 1 Billion Queries per day (only on 30 servers BOOYA). So, it's pretty stable. -- Dathan V Pattishall Sr. Database Engineer / Sr. Software Engineer Friendster Inc. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Opteron HOWTO?!
Greg Whalin wrote: Care to share any secrets? You guys are running Suse w/ 2.4 kernel yes? Any specifics as far as kernel/glibc/gcc versions. Are you running mysql 4.1.*? Are you using NPTL? You using the binary from mysql, or building yourself? Are you running Innodb or Myisam. You mentioned reiserfs correct? Any problems w/ ext3? Sorry to bombard you w/ questions, but we have had nothing but horrible performance using Opterons, and any specifics you can give would help to clear up this mess. I know that I am not the only person who is seeing this flakyiness. Thanks, Greg # emerge --info Portage 2.0.51-r15 (default-linux/amd64/2004.3, gcc-3.4.3-hardenednossp, glibc-2.3.4.20050125-r0, 2.6.11-rc2-mm1 x86_64) = System uname: 2.6.11-rc2-mm1 x86_64 AMD Opteron(tm) Processor 246 Gentoo Base System version 1.6.9 ... sys-devel/autoconf: 2.59-r6, 2.13 sys-devel/automake: 1.7.9-r1, 1.8.5-r3, 1.5, 1.4_p6, 1.6.3, 1.9.4 sys-devel/binutils: 2.15.92.0.2-r4 sys-devel/libtool: 1.5.10-r5 virtual/os-headers: 2.6.8.1-r3 ... CFLAGS=-Os -march=opteron -mtune=opteron CHOST=x86_64-pc-linux-gnu ... CXXFLAGS=-Os -march=opteron -mtune=opteron ... USE=nptl nptlonly # mount | grep DB /dev/sda5 on /DB type reiserfs (rw,noatime,notail) # mysqld --version mysqld Ver 4.1.10-log for pc-linux-gnu on x86_64 (Still Not g.o Linux mysql-4.1.10) Regards, Francesco Riosa -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Opteron HOWTO?!
So... it sounds like a lot of people here (Dathan and Greg) have had problems deploying MySQL on Opteron in a production environment. I was wondering if we could start an Opteron HOWTO somewhere (mysql wiki?) which could illustrate the minefields they've had to walk to hopefully solidify MySQL on this platform and to prevent others from having the same bad experiences. We're considering an Opteron migration as well and as the 2G memory barrier fast approaches I'm expecting more MySQL users to migrate as well. Maybe this should be a X86_64 bit FAQ though since Intel is coming out with more EM64T stuff Kevin -- Use Rojo (RSS/Atom aggregator)! - visit http://rojo.com. See irc.freenode.net #rojo if you want to chat. Rojo is Hiring! - http://www.rojonetworks.com/JobsAtRojo.html Kevin A. Burton, Location - San Francisco, CA AIM/YIM - sfburtonator, Web - http://peerfear.org/ GPG fingerprint: 5FB2 F3E2 760E 70A8 6174 D393 E84D 8D04 99F1 4412 -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Opteron HOWTO?!
I am all in favor of this idea. Currently, this info is scattered all over the web, and finding it can be time consuming (even w/ Google). I see lots of people jumping the same hurdles, so a central location for this info seems it would greatly benefit the community. Greg Kevin Burton wrote: So... it sounds like a lot of people here (Dathan and Greg) have had problems deploying MySQL on Opteron in a production environment. I was wondering if we could start an Opteron HOWTO somewhere (mysql wiki?) which could illustrate the minefields they've had to walk to hopefully solidify MySQL on this platform and to prevent others from having the same bad experiences. We're considering an Opteron migration as well and as the 2G memory barrier fast approaches I'm expecting more MySQL users to migrate as well. Maybe this should be a X86_64 bit FAQ though since Intel is coming out with more EM64T stuff Kevin -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Opteron HOWTO?!
Greg Whalin wrote: I am all in favor of this idea. Currently, this info is scattered all over the web, and finding it can be time consuming (even w/ Google). I see lots of people jumping the same hurdles, so a central location for this info seems it would greatly benefit the community. Great! I created a wiki node for this issue. http://hashmysql.org/index.php?title=Opteron_HOWTO Please help fill it out guys. I promise that while we're making the migration that I'll make all my notes public and on this wiki node. Kevin -- Use Rojo (RSS/Atom aggregator)! - visit http://rojo.com. See irc.freenode.net #rojo if you want to chat. Rojo is Hiring! - http://www.rojonetworks.com/JobsAtRojo.html Kevin A. Burton, Location - San Francisco, CA AIM/YIM - sfburtonator, Web - http://peerfear.org/ GPG fingerprint: 5FB2 F3E2 760E 70A8 6174 D393 E84D 8D04 99F1 4412 -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Opteron HOWTO - #mysql Freenode
Its pretty filled now now. If you have anything to add please feel free. http://hashmysql.org/index.php?title=Opteron_HOWTO -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
