Re: fastest filesystem for MySQL
On 14 May 2004, at 4:37 am, Roy Butler wrote: Jacob, I'd go with Reiser on SuSE. What about Reiser on Debian? I'd choose SuSE since Reiser is their default filesystem and they have been an early implementor of Reiser-related patches. If you use Linux kernel 2.4.24 (or later) and the latest 3.6 series of ReiserFS+tools, the Linux distribution you choose shouldn't technically matter. I'm under the impression that Debian isn't bleeding-edge in many respects, perhaps due to its support of so many architectures, so you might have to build all of this yourself (or find someone who has) if you go that route. Debian is reasonably current if you follow the testing tree, rather than its stable releases. Debian stable is on ReiserFS 3.6.25 for 2.4 kernels, so it's not too out of date. The testing tree has support for 2.6 kernels too. Tim -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: fastest filesystem for MySQL
Reiser is good for lots of small files. ext3 would is better for large ones. At least that's what I get from the benchmark data that I've seen posted in various places. Curtis -- Curtis Maurand mailto:[EMAIL PROTECTED] http://www.maurand.com On Wed, 12 May 2004, Roy Butler wrote: Jacob, I'd go with Reiser on SuSE. Like Sasha mentioned though, the filesystem component may have little overall effect, depending on your set-up. I'd stay away from XFS when working with databases, as its performance gains are achieved via extended write delays while the queue sits in main memory: not the sort of thing you want after a crash... If you have the time/interest, why not try some benchmarks of your own? Roy -- Date: Wed, 12 May 2004 00:22:21 +0200 To: [EMAIL PROTECTED] From: JFL [EMAIL PROTECTED] Subject: fastest filesystem for MySQL Message-ID: [EMAIL PROTECTED] I've heard and read that the Reiser filesystem should be better for MySQL than Ext3. Is this still true? We will be running MySQL on either Red Hat ES 3, Suse or Debian. Thanks, Jacob -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: fastest filesystem for MySQL
On 13 May 2004, at 4:02 pm, Jacob Friis Larsen wrote: I'd go with Reiser on SuSE. What about Reiser on Debian? It shouldn't matter too much. This functionality is in the kernel, so if the kernel version on SuSE and Debian is the same, the filesystem code will be the same, with the possible caveat that SuSE may have applied some other patches. The same isn't so true of Red Hat, who patch their kernels up to the eyeballs with whatever they feel like, until it bears scant resemblance to the version it actually says it is. Debian kernels are pretty much vanilla kernel.org kernels. Tim -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: fastest filesystem for MySQL
Does the filesystem matter as much as disk throughput? I'd imagine that is where the bottleneck would be, at least as I've seen... Tim Cutts [EMAIL PROTECTED] 05/13/2004 11:13 AM To: Jacob Friis Larsen [EMAIL PROTECTED] cc: [EMAIL PROTECTED] Subject:Re: fastest filesystem for MySQL On 13 May 2004, at 4:02 pm, Jacob Friis Larsen wrote: I'd go with Reiser on SuSE. What about Reiser on Debian? It shouldn't matter too much. This functionality is in the kernel, so if the kernel version on SuSE and Debian is the same, the filesystem code will be the same, with the possible caveat that SuSE may have applied some other patches. The same isn't so true of Red Hat, who patch their kernels up to the eyeballs with whatever they feel like, until it bears scant resemblance to the version it actually says it is. Debian kernels are pretty much vanilla kernel.org kernels. Tim -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED] -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: fastest filesystem for MySQL
The InnoDB storage engine can use raw disks without a filesystem. Would that be the fastest possible setup? Thanks, Jacob -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: fastest filesystem for MySQL
On Thu, May 13, 2004 at 10:21:15AM +0200, JFL wrote: The InnoDB storage engine can use raw disks without a filesystem. Would that be the fastest possible setup? Probably, yes. Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! [EMAIL PROTECTED] | http://jeremy.zawodny.com/ [book] High Performance MySQL -- http://highperformancemysql.com/ -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: fastest filesystem for MySQL
I'd go with Reiser on SuSE. What about Reiser on Debian? Thanks, Jacob -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: fastest filesystem for MySQL
On Thu, May 13, 2004 at 11:16:18AM -0400, Peter J Milanese wrote: Does the filesystem matter as much as disk throughput? I'd imagine that is where the bottleneck would be, at least as I've seen... Throughput or seek time? Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! [EMAIL PROTECTED] | http://jeremy.zawodny.com/ [book] High Performance MySQL -- http://highperformancemysql.com/ -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: fastest filesystem for MySQL
I would think that seek time may be interdependent on disk speed and Filesystem type... I can see why it would matter sort of... Jeremy Zawodny [EMAIL PROTECTED] 05/13/2004 02:45 PM Please respond to mysql To: Peter J Milanese [EMAIL PROTECTED] cc: Tim Cutts [EMAIL PROTECTED], Jacob Friis Larsen [EMAIL PROTECTED], [EMAIL PROTECTED] Subject:Re: fastest filesystem for MySQL On Thu, May 13, 2004 at 11:16:18AM -0400, Peter J Milanese wrote: Does the filesystem matter as much as disk throughput? I'd imagine that is where the bottleneck would be, at least as I've seen... Throughput or seek time? Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! [EMAIL PROTECTED] | http://jeremy.zawodny.com/ [book] High Performance MySQL -- http://highperformancemysql.com/ -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED] -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: fastest filesystem for MySQL
Jacob, I'd go with Reiser on SuSE. What about Reiser on Debian? I'd choose SuSE since Reiser is their default filesystem and they have been an early implementor of Reiser-related patches. If you use Linux kernel 2.4.24 (or later) and the latest 3.6 series of ReiserFS+tools, the Linux distribution you choose shouldn't technically matter. I'm under the impression that Debian isn't bleeding-edge in many respects, perhaps due to its support of so many architectures, so you might have to build all of this yourself (or find someone who has) if you go that route. In regard to using raw disks under the InnoDB storage engine, if it's I/O code is of the same quality as the filesystems we're discussing, it'll almost necessarily be faster. Again, you'll probably be your own best judge and panel. If you do perform benchmarks, you'll probably want to perform reboots (at a minimum) between tests to bypass caching effects - unless that's what you're trying to test. :) I'd be interested in hearing what you discover. Roy -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: fastest filesystem for MySQL
Sasha Pachev wrote: Based on what I've seen so far, JFS and XFS do not yet have a solid track record of stability with MySQL. This does not mean they could not be good - I just do not trust them yet. I do vaguely remember a support case when a very strange corruption happened on either one of them - now cannot recall which one. In 3 years of handling MySQL supoprt (2000-2003), I do not recall reports of table corruption on a ReiserFS file system. I do remember corruption cases in the early ext3. Thought I should reply with my experience on this. I've been running various ( the most recent ) versions of MySQL-4.0.x since it was released on a Gentoo box with an XFS filesystem. XFS has never given us any problems. Ever. We even had a disaster the other day, where my boss pulled the power on the server. The XFS recovery went without a hitch, and the InnoDB recovery also went without a hitch. This server is under moderate load: IMAP server for 38 clients. MySQL server for 30 or so MS Access clients ( as well as 3 PHP clients ). Setiathome full-time. Having said that, XFS isn't particularly fast, at least for what I like doing. I just moved everything to a RAID 1 array, formatted as a Reiserfs system ( just did this tonight ). XFS was particularly slow doing the IMAP stuff - I assume because courier-imap stores things in lots of small files. XFS was also very slow doing Gentoo's 'emerge' searches. Reiserfs is much faster at both of these. But I thought I'd better post and say that XFS has been 100% stable for me, and if it weren't for the speed hit, I would have stayed with it. Dan -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: fastest filesystem for MySQL
I thouught I read somewhere a while back that MySQL was working on an option to create a MySQL partition so as to avoide all OS filesystem overhead to speed things up and I think to save a small bit of over head. Is this true? Chris W. -- Bring Back the HP 15C http://hp15c.org:8080 If you don't get the gifts you really want The Wish Zone can help. http://thewishzone.com:8086 -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: fastest filesystem for MySQL
On Wed, May 12, 2004 at 12:39:59PM -0500, Chris W wrote: I thouught I read somewhere a while back that MySQL was working on an option to create a MySQL partition so as to avoide all OS filesystem overhead to speed things up and I think to save a small bit of over head. Is this true? The InnoDB storage engine can use raw disks without a filesystem. Perhaps you're thinking of that? Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! [EMAIL PROTECTED] | http://jeremy.zawodny.com/ [book] High Performance MySQL -- http://highperformancemysql.com/ -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: fastest filesystem for MySQL
Jacob, I'd go with Reiser on SuSE. Like Sasha mentioned though, the filesystem component may have little overall effect, depending on your set-up. I'd stay away from XFS when working with databases, as its performance gains are achieved via extended write delays while the queue sits in main memory: not the sort of thing you want after a crash... If you have the time/interest, why not try some benchmarks of your own? Roy -- Date: Wed, 12 May 2004 00:22:21 +0200 To: [EMAIL PROTECTED] From: JFL [EMAIL PROTECTED] Subject: fastest filesystem for MySQL Message-ID: [EMAIL PROTECTED] I've heard and read that the Reiser filesystem should be better for MySQL than Ext3. Is this still true? We will be running MySQL on either Red Hat ES 3, Suse or Debian. Thanks, Jacob -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
fastest filesystem for MySQL
I've heard and read that the Reiser filesystem should be better for MySQL than Ext3. Is this still true? We will be running MySQL on either Red Hat ES 3, Suse or Debian. Thanks, Jacob -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: fastest filesystem for MySQL
Completely depends on your situation -- big files, small files? Lots of writes or reads or both? Growing tables/files or lots of large dropped tables? If you're into small files, go Reiser. Big data, JFS or XFS. EXT3 is slow, but, IIRC, it also is a true data journaling filesystem while some of the others aren't (and that's as deep as I go without a life-vest, if you know what I mean!). Just saw this on LWN.net: Benchmarks of EXT2, EXT3, JFS, XFS in various unreal stressful scenarios. Interesting, anyway: http://209.81.41.149/~jpiszcz/index.html Robert J Taylor [EMAIL PROTECTED] JFL wrote: I've heard and read that the Reiser filesystem should be better for MySQL than Ext3. Is this still true? We will be running MySQL on either Red Hat ES 3, Suse or Debian. Thanks, Jacob -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: fastest filesystem for MySQL
I've heard and read that the Reiser filesystem should be better for MySQL than Ext3. Is this still true? We will be running MySQL on either Red Hat ES 3, Suse or Debian. Completely depends on your situation -- big files, small files? Lots of writes or reads or both? Growing tables/files or lots of large dropped tables? It's for a community site. Lots of small data reads, less writes, many updates, and few deletes. If you're into small files, go Reiser. Big data, JFS or XFS. EXT3 is slow, but, IIRC, it also is a true data journaling filesystem while some of the others aren't (and that's as deep as I go without a life-vest, if you know what I mean!). -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: fastest filesystem for MySQL
Robert J Taylor wrote: Completely depends on your situation -- big files, small files? Lots of writes or reads or both? Growing tables/files or lots of large dropped tables? If you're into small files, go Reiser. Big data, JFS or XFS. EXT3 is slow, but, IIRC, it also is a true data journaling filesystem while some of the others aren't (and that's as deep as I go without a life-vest, if you know what I mean!). Based on what I've seen so far, JFS and XFS do not yet have a solid track record of stability with MySQL. This does not mean they could not be good - I just do not trust them yet. I do vaguely remember a support case when a very strange corruption happened on either one of them - now cannot recall which one. In 3 years of handling MySQL supoprt (2000-2003), I do not recall reports of table corruption on a ReiserFS file system. I do remember corruption cases in the early ext3. If you are using InnoDB, the choice of the filesystem should not be that critical because of full caching. For MyISAM, having a good file system is very important - unlike InnoDB, MyISAM does not cache the data itself, and relies on the OS cache. So you do have a lot of read/write syscalls. To illustrate the difference - I recall a case when performance on MyISAM was terrible over NFS (well, that is to be expected), but once the table was changed to InnoDB, it improved drastically. -- Sasha Pachev Create online surveys at http://www.surveyz.com/ -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
