[HACKERS] Linux filesystem performance and checkpoint sorting

2011-02-04 Thread Greg Smith
Switching to a new thread for this summary since there's some much more generic info here...at this point I've finished exploring the major Linux filesystem and tuning options I wanted to, as part of examining changes to the checkpoint code. You can find all the raw data at

Re: [HACKERS] Linux filesystem performance and checkpoint sorting

2011-02-04 Thread Josh Berkus
Greg, Thanks for doing these tests! So: Linux flavor? Kernel version? Disk system and PG directory layout? -- -- Josh Berkus PostgreSQL Experts Inc. http://www.pgexperts.com -- Sent

Re: [HACKERS] Linux filesystem performance and checkpoint sorting

2011-02-04 Thread Mark Kirkwood
On 05/02/11 07:31, Greg Smith wrote: Switching to a new thread for this summary since there's some much more generic info here...at this point I've finished exploring the major Linux filesystem and tuning options I wanted to, as part of examining changes to the checkpoint code. You can find

Re: [HACKERS] Linux filesystem performance and checkpoint sorting

2011-02-04 Thread Stephen J. Butler
On Fri, Feb 4, 2011 at 12:31 PM, Greg Smith g...@2ndquadrant.com wrote: -Switching from ext3 to xfs gave over a 3X speedup on the smaller test set:  from the 600-700 TPS range to around 2200 TPS.  TPS rate on the larger data set actually slowed down a touch on XFS, around 10%.  Still, such a

Re: [HACKERS] Linux filesystem performance and checkpoint sorting

2011-02-04 Thread Greg Smith
Mark Kirkwood wrote: Are you going to do some runs with ext4? I'd be very interested to see how it compares (assuming that you are on a kernel version 2.6.32 or later so ext4 is reasonably stable...). Yes, before I touch this system significantly I'll do ext4 as well, and this is running the

Re: [HACKERS] Linux filesystem performance and checkpoint sorting

2011-02-04 Thread Greg Smith
Josh Berkus wrote: So: Linux flavor? Kernel version? Disk system and PG directory layout? OS configuration and PostgreSQL settings are saved into the output from the later runs (I added that somewhere in the middle): http://www.2ndquadrant.us/pgbench-results/294/pg_settings.txt That's