Re: Best hardware for a very large MySQL server? looking at x86
Well, its tough to compare system configurations in a very general way. I've run any number of different systems. I can tell you that Sun has some very nice boxes. A 4 way SMP server with a couple gigs of ram and 1-2 internal 36 gig drives can be had in the 25k price range. They're perfectly nice boxes and will run Linux fine as far as I know. IBM makes a whole line of similar PPC servers. I think you'll find that the RISC systems have fewer processors and run at lower clockspeeds for the same total performance. 100k is a HUGE amount of money to drop on a system. You could get 2 full racks of high performance 1U systems, including everything, for less, but whatever! On Wednesday 03 April 2002 22:49, JW wrote: Trying to send this again... SPAM filter messing with me... this is a query about what hardware might make for a really good sql server There :-p Hello, I need some advise. We are about to purchase a huge system for use as a DB/web application server (mostly DB). I'd like to point out that upper management (not me) has decided to do this... please don't tell me that I don't need something that big, or that I should use an x86 cluster - that's already out of the question, and out of my hands. The server they had already decided to get is a Dell PowerEdge 8450 with an external PowerVault storage array. See details here: PowerEdge 8450: http://configure.us.dell.com/dellstore/config.asp?customer_id=04keycode=6 W300order_code=PE8450cfgpg=1#updatepriceNS PowerVault 22xS http://configure.us.dell.com/dellstore/config.asp?order_code=PV22XScustom er_id=04keycode=6W300family_id=9171 The server is an eight-way PIII Xeon , 32GB of RAM, price approx. $99,000 USD - let's say $100,000 In some configurations we've gotten higher. PowerVault approx. $7,500 USD for five-disk RAID 5, 36GB 15k SCSI disks. Management asked me and another tech. to figure out exactly what we need. We called Dell, and the Dell tech said this would be going head on with RISC based systems. Which got me to thinking I am personally not fond of x86, and don't want to pass up an opportunity to get a RISC system, like an Alpha, SPARC or PPC. Management has given me permission to make a comparison, I'm hoping someone here has experience with RISC systems. I'd _really_ like to have a RISC system but I've got no idea how to go about comparing them. For me it's like trying to compare apples and oranges when you don't even know what an orange is =) Does anyone here know how much an Alpha, SPARC, or PPC system that has comparable power would be? Or even _what_ systems are comparable? As I said, I've never dealt with anything besides x86 and Apple PPC before, so I'm venturing into totally new territory. If someone can give me a clue, I'd really appreciate it. Apparently we are mostly after processing power (CPU+RAM), my boss said we wouldn't even need a GigaBit NIC (though of course he may be wrong). I basically need to find a RISC system that produces the same amount of power for less $$$, or at LEAST more power for the same amount of $$$. It must run Linux of course, much preferably SuSE. I know SuSE Enterprise edition runs on SPARC, PPC ({i|p|z}Series and Itanium/IA64 ( I really don't want the latter, though if someone gives me a convincing argument, I'll consider it), and Professional 7.1 runs on Alpha, 7.3 runs on PowerPC Any help would be greatly appreciated. Thanks! Jonathan Wilson System Administrator Clickpatrol.com Cedar Creek Software http://www.cedarcreeksoftware.com Jonathan Wilson System Administrator Clickpatrol.com Cedar Creek Software http://www.cedarcreeksoftware.com - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: Best hardware for a very large MySQL server? looking at x86
On Thursday 04 April 2002 09:48 am, you wrote: I think you'll find that the RISC systems have fewer processors and run at lower clockspeeds for the same total performance. 100k is a HUGE amount of money to drop on a system. You could get 2 full racks of high performance 1U systems, including everything, for less, but whatever! did you mean to say You could get 2 full racks of high performance 1U x86 systems ? Or are you saying I should get several smaller systems either way? Thanks. sql query - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: Clustering MySQL was: Re: Best hardware for a very large MySQL server? looking at x86
At 10:28 AM 4/4/2002, you wrote: On Thursday 04 April 2002 09:48 am, you wrote: I think you'll find that the RISC systems have fewer processors and run at lower clockspeeds for the same total performance. 100k is a HUGE amount of money to drop on a system. You could get 2 full racks of high performance 1U systems, including everything, for less, but whatever! I forgot to ask... while I haven't looked, I've never seen anythign on clustering MySQL. I presume that it can be done since you said that, but has anyone here actually tried it? Is it better than one huge server? Our problem is we're dealing with some enourmous tables that our web servers are accessing. We currently have a PowerEdge 2450, 5disk RAID 5, Dual PIII 850s, 2GB RAM and we are killing it - the load is too much. That's why our management decided to get a whopping big server - so it can handle the load. We're not done growing yet either... JW JW et al, Where is the bottleneck? How many concurrent users do you have? How many rows are their queries returning? I always slap a LIMIT 100 on each query to prevent the user from retrieving too much data. If they don't like it, there is a query form that allows them to refine their query. For non-registered users I limit them to 10 rows. How many webservers do you have and what are you running on them? PHP, ASP, JSP? If you are using PHP you can compile the PHP with Zend optimizer (I think that's what it is called). It will give you around a 50% performance increase on the webserver. PC Mag reviewed it a few months ago. Is your MySQL server disk bound? Does it have too much I/O for the drives to handle? If so, adding more processors won't solve the problem. It would probably only make the problem worse because it would put even more demand on the drives. There are (very expensive $30,000) ram disks that may solve the I/O problem (it that is your problem). These are hardware RAM disks complete with onboard battery backup. It looks and acts just like a super fast hard disk. If you turn the server off (or it crashes) the data is still retained in RAM. To the OS it looks like another hard disk. I looked at them a couple of years ago and they were very expensive for the amount of RAM you get. Perhaps the prices have come down. But it would certainly speed up your data access. Are people accessing your database as read-only? If so, replicating the data to several servers will be relatively easy. I assume if there are a lot of users writing to the tables, you've eliminated the table locking problem by trying InnoDb. And of course the first thing you should look at is optimizing the SQL you're using to access the database. You could have inefficient code. Contract someone at MySQL AB to look over the code to see how it can be optimized. It could be money well spent. And if you've just won the lottery or your client has some deep pockets, there is also the IBM zSeries mainframes that run multiple Linux machines. I believe it supports up to 512 processors and 64 gb of RAM. It will run hundreds of Linux sessions independently or in a parallel cluster. You only buy what you need ($500 per Linux image) and expand later. http://www-1.ibm.com/servers/eserver/zseries/. You can also use it to heat your building during the winter.g Brent _ Do You Yahoo!? Get your free @yahoo.com address at http://mail.yahoo.com - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
More then 2-way SMP, process threading Sun Fire v880: Re: Best hardware for a very large MySQL server? looking at x86
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 DN In the last episode (Apr 04), JW said: DN Heh. plus the maintenence nightmare of managing 48 servers, 96 mirrored DN boot disks, 96 power supplies, etc etc.. DN DN A comparable system to the Dell link you pasted is the Sun Fire v880. DN For $120k, you get 8x750mhz Ultrasparc III CPUs, 32GB of RAM, and 12 DN 36gb fibrechannel disks. Those are 64-bit CPUs with 8MB of cache DN (compared to the 32bit Xeons w/2M you'd get with the Dell), and should DN easily outperform the Dell box. DN DN http://store.sun.com/catalog/doc/BrowsePage.jhtml?cid=71713 I was already looking at these... Does anyone have any experience with MySQL a v880? Someone on another list was saying: ou've got to remember that in a lot of scenerios, more processors can degrade preformance instead of enhancing it. 4 Dual processing machines always beats one 8-way machine as far as network services related things like File/Web/Print serving. 4-way machines can add benefit in fine-grain tightly coupled processes like a heavily threaded DB server (like Oracle). You start to loose I/O performance with most x86 architectures after 4-way. What do ya'll say to that? Does MySQL performance really go down with more processors? - --- filter bypass: query sql - -- - Jonathan Wilson System Administrator Clickpatrol.com Cedar Creek Software http://www.cedarcreeksoftware.com -BEGIN PGP SIGNATURE- Version: GnuPG v1.0.6 (GNU/Linux) Comment: For info see http://www.gnupg.org iD8DBQE8rJrCW3F87Q8SQQARAhBJAKDZxvdJEZNFMi/+iEmerwSD/VENcwCfUlpT 5FeCpR8noGhFV/sQ/isp5KU= =t1aj -END PGP SIGNATURE- - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: More then 2-way SMP, process threading Sun Fire v880: Re: Best hardware for a very large MySQL server? looking at x86
In the last episode (Apr 04), JW said: I was already looking at these... Does anyone have any experience with MySQL a v880? Someone on another list was saying: You've got to remember that in a lot of scenerios, more processors can degrade preformance instead of enhancing it. 4 Dual processing machines always beats one 8-way machine as far as network services related things like File/Web/Print serving. 4-way machines can add benefit in fine-grain tightly coupled processes like a heavily threaded DB server (like Oracle). You start to loose I/O performance with most x86 architectures after 4-way. That's just a limitation of the x86 platform; inter-processor locking starts getting really expensive above 4 CPUs. Oracle definitely has no problems on the 8-way Solaris/Sparc boxes here, so I'd assume MySQL would run well also. -- Dan query Nelson [EMAIL PROTECTED] - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: Best hardware for a very large MySQL server? looking at x86
In the last episode (Apr 04), JW said: On Thursday 04 April 2002 09:48 am, you wrote: I think you'll find that the RISC systems have fewer processors and run at lower clockspeeds for the same total performance. 100k is a HUGE amount of money to drop on a system. You could get 2 full racks of high performance 1U systems, including everything, for less, but whatever! did you mean to say You could get 2 full racks of high performance 1U x86 systems ? Or are you saying I should get several smaller systems either way? Heh. plus the maintenence nightmare of managing 48 servers, 96 mirrored boot disks, 96 power supplies, etc etc.. A comparable system to the Dell link you pasted is the Sun Fire v880. For $120k, you get 8x750mhz Ultrasparc III CPUs, 32GB of RAM, and 12 36gb fibrechannel disks. Those are 64-bit CPUs with 8MB of cache (compared to the 32bit Xeons w/2M you'd get with the Dell), and should easily outperform the Dell box. http://store.sun.com/catalog/doc/BrowsePage.jhtml?cid=71713 -- Dan sql,query Nelson [EMAIL PROTECTED] - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Best hardware for a very large MySQL server? looking at x86
Trying to send this again... SPAM filter messing with me... this is a query about what hardware might make for a really good sql server There :-p Hello, I need some advise. We are about to purchase a huge system for use as a DB/web application server (mostly DB). I'd like to point out that upper management (not me) has decided to do this... please don't tell me that I don't need something that big, or that I should use an x86 cluster - that's already out of the question, and out of my hands. The server they had already decided to get is a Dell PowerEdge 8450 with an external PowerVault storage array. See details here: PowerEdge 8450: http://configure.us.dell.com/dellstore/config.asp?customer_id=04keycode=6W300order_code=PE8450cfgpg=1#updatepriceNS PowerVault 22xS http://configure.us.dell.com/dellstore/config.asp?order_code=PV22XScustomer_id=04keycode=6W300family_id=9171 The server is an eight-way PIII Xeon , 32GB of RAM, price approx. $99,000 USD - let's say $100,000 In some configurations we've gotten higher. PowerVault approx. $7,500 USD for five-disk RAID 5, 36GB 15k SCSI disks. Management asked me and another tech. to figure out exactly what we need. We called Dell, and the Dell tech said this would be going head on with RISC based systems. Which got me to thinking I am personally not fond of x86, and don't want to pass up an opportunity to get a RISC system, like an Alpha, SPARC or PPC. Management has given me permission to make a comparison, I'm hoping someone here has experience with RISC systems. I'd _really_ like to have a RISC system but I've got no idea how to go about comparing them. For me it's like trying to compare apples and oranges when you don't even know what an orange is =) Does anyone here know how much an Alpha, SPARC, or PPC system that has comparable power would be? Or even _what_ systems are comparable? As I said, I've never dealt with anything besides x86 and Apple PPC before, so I'm venturing into totally new territory. If someone can give me a clue, I'd really appreciate it. Apparently we are mostly after processing power (CPU+RAM), my boss said we wouldn't even need a GigaBit NIC (though of course he may be wrong). I basically need to find a RISC system that produces the same amount of power for less $$$, or at LEAST more power for the same amount of $$$. It must run Linux of course, much preferably SuSE. I know SuSE Enterprise edition runs on SPARC, PPC ({i|p|z}Series and Itanium/IA64 ( I really don't want the latter, though if someone gives me a convincing argument, I'll consider it), and Professional 7.1 runs on Alpha, 7.3 runs on PowerPC Any help would be greatly appreciated. Thanks! Jonathan Wilson System Administrator Clickpatrol.com Cedar Creek Software http://www.cedarcreeksoftware.com Jonathan Wilson System Administrator Clickpatrol.com Cedar Creek Software http://www.cedarcreeksoftware.com - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php