Re: [CentOS] disk I/O problems and Solutions

2009-10-09 Thread Ross Walker
On Fri, Oct 9, 2009 at 1:34 PM, Alan McKay wrote: > On Fri, Oct 9, 2009 at 1:28 PM, Ray Van Dolson wrote: >> Really hard to say what's going on.  Does your DB need optimization? >> Do the applications hitting it?  Maybe some indexing?  Maybe some more >> RAM on the machine would help?  What exact

Re: [CentOS] disk I/O problems and Solutions

2009-10-09 Thread James A. Peltier
On Fri, 9 Oct 2009, James A. Peltier wrote: > > Are you seeing any high I/O waits and lots of kjournald's running? Sorry, what I meant to say here is, are you seeing logs of long running kjournald's. -- James A. Peltier Systems Analyst (FASNet), VIVARIUM Technical Director HPC Coordinator Simo

Re: [CentOS] disk I/O problems and Solutions

2009-10-09 Thread James A. Peltier
On Fri, 9 Oct 2009, Alan McKay wrote: > Hey folks, > > CentOS / PostgreSQL shop over here. > > I'm hitting 3 of my favorite lists with this, so here's hoping that > the BCC trick is the right way to do it :-) > > We've just discovered thanks to a new Munin plugin > http://blogs.amd.co.at/robe/2008

Re: [CentOS] disk I/O problems and Solutions

2009-10-09 Thread Martin Suehowicz
really good for random io. I don't know of a website, but one would be nice. -Original Message- From: centos-boun...@centos.org [mailto:centos-boun...@centos.org] On Behalf Of Alan McKay Sent: Friday, October 09, 2009 9:45 AM To: Alan McKay Subject: [CentOS] disk I/O problems and Solu

Re: [CentOS] disk I/O problems and Solutions

2009-10-09 Thread Pasi Kärkkäinen
On Fri, Oct 09, 2009 at 12:45:14PM -0400, Alan McKay wrote: > Hey folks, > > CentOS / PostgreSQL shop over here. > > I'm hitting 3 of my favorite lists with this, so here's hoping that > the BCC trick is the right way to do it :-) > > We've just discovered thanks to a new Munin plugin > http://b

Re: [CentOS] disk I/O problems and Solutions

2009-10-09 Thread aurfalien
Hi Alan, Strictly on a disk I/O issue, I would test diff raid/disk configs and use Iozone with the wks output flag which generates some nice Exel spread sheets and graphs. I was at a job years ago were I used a combo of strace, ptrace and some other mysql debug utils to determine why the DB

Re: [CentOS] disk I/O problems and Solutions

2009-10-09 Thread Blake Hudson
Original Message Subject: Re: [CentOS] disk I/O problems and Solutions From: Alan McKay To: CentOS mailing list Date: Friday, October 09, 2009 12:55:35 PM Since you stated that your system is only having trouble at writes, doing batch inserts, I would look at how you are

Re: [CentOS] disk I/O problems and Solutions

2009-10-09 Thread Brian Mathis
On Fri, Oct 9, 2009 at 1:55 PM, Alan McKay wrote: >> Since you stated that your system is only having trouble at writes, >> doing batch inserts, I would look at how you are doing these batch >> inserts and see if you can optimize this by using techniques to delay >> key writes or adjust locking me

Re: [CentOS] disk I/O problems and Solutions

2009-10-09 Thread Alan McKay
> Since you stated that your system is only having trouble at writes, > doing batch inserts, I would look at how you are doing these batch > inserts and see if you can optimize this by using techniques to delay > key writes or adjust locking mechanisms on the insert. Some databases > have special i

Re: [CentOS] disk I/O problems and Solutions

2009-10-09 Thread Blake Hudson
I would second what another poster stated, to look at DB/RAM optimizations. If possible, you should have enough RAM in the system to hold your entire DB in memory - and your db software should be setup to take advantage of that memory. Since you stated that your system is only having trouble at

Re: [CentOS] disk I/O problems and Solutions

2009-10-09 Thread Ray Van Dolson
On Fri, Oct 09, 2009 at 01:34:17PM -0400, Alan McKay wrote: > On Fri, Oct 9, 2009 at 1:28 PM, Ray Van Dolson wrote: > > Really hard to say what's going on.  Does your DB need optimization? > > Do the applications hitting it?  Maybe some indexing?  Maybe some more > > RAM on the machine would help?

Re: [CentOS] disk I/O problems and Solutions

2009-10-09 Thread Alan McKay
On Fri, Oct 9, 2009 at 1:28 PM, Ray Van Dolson wrote: > Really hard to say what's going on.  Does your DB need optimization? > Do the applications hitting it?  Maybe some indexing?  Maybe some more > RAM on the machine would help?  What exactly is the workload like -- > especially during the time

Re: [CentOS] disk I/O problems and Solutions

2009-10-09 Thread Tim Pickard
Hi Alan, You will get the best performance on /dev/sdb by making that a RAID 10 device. The write penalty for R5 is a killer. You will lose a bit of space over R5 but the performance is worth it. As to the external enclosure, 15k 300g SAS drives are dropping in price if you shop around or ask a

Re: [CentOS] disk I/O problems and Solutions

2009-10-09 Thread Ray Van Dolson
On Fri, Oct 09, 2009 at 12:45:14PM -0400, Alan McKay wrote: > Hey folks, > > CentOS / PostgreSQL shop over here. > > I'm hitting 3 of my favorite lists with this, so here's hoping that > the BCC trick is the right way to do it :-) > > We've just discovered thanks to a new Munin plugin > http://b

[CentOS] disk I/O problems and Solutions

2009-10-09 Thread Alan McKay
Hey folks, CentOS / PostgreSQL shop over here. I'm hitting 3 of my favorite lists with this, so here's hoping that the BCC trick is the right way to do it :-) We've just discovered thanks to a new Munin plugin http://blogs.amd.co.at/robe/2008/12/graphing-linux-disk-io-statistics-with-munin.html