Re: [SLUG] Performance Tuning

2008-09-10 Thread Kyle
Sorry for the dropout and lack of acknowledgement. Words 'hell', 'loose', 'break' uppermost in memory. Lots of information there. Thanks to everyone who's responded. Plenty of start points and paths to follow. Looks like it's a going to be a long month. :-) Kyle Glen Turner wrote: Kyle w

Re: [SLUG] Performance Tuning

2008-09-07 Thread Matthew Hannigan
On Sat, Sep 06, 2008 at 09:54:13AM +1000, Kyle wrote: > Can somebody recommend a reasonably comprehensive but straightforward > performance tuning article/HowTo/PDF/site I could read pls? > > Specifically, I am looking to perf-tune a dual-CPU RAID5 box used as a > backup server. Are you backin

Re: [SLUG] Performance Tuning

2008-09-07 Thread Daniel Pittman
Glen Turner <[EMAIL PROTECTED]> writes: [...] > Note the contention between network and disk I/O buffers. These both > need low memory. A 32b OS only has 512MB of that, which is a fail for > this application (especially since Linux locks hard on kernel memory > fragmentation). You need a 64b inst

Re: [SLUG] Performance Tuning

2008-09-07 Thread Alex Samad
On Sun, Sep 07, 2008 at 07:06:08PM +0930, Glen Turner wrote: > Kyle wrote: >> Ok, [snip] > - use jumbo frames (9000B packet > 8KB disk block, so very efficient) I noticed a lot of people have talked about using large >1500 frames, usually >9k. I had been using jumbo frames for +8 months and I

Re: [SLUG] Performance Tuning

2008-09-07 Thread Glen Turner
Kyle wrote: Ok, a couple of responses thus far. Some further info. The software I can tune myself. I was more looking for Linux specific tuning. * Yes, I was/am concerned about I/O. * But also ensuring the OS itself (system processes) is not hindering anything otherwise. * The RAID is the

Re: [SLUG] Performance Tuning

2008-09-06 Thread Jason Ball
On 06/09/2008, at 5:11 PM, Daniel Pittman wrote: "Tony Sceats" <[EMAIL PROTECTED]> writes: On Sat, Sep 6, 2008 at 12:22 PM, Daniel Pittman <[EMAIL PROTECTED]> wrote: Kyle <[EMAIL PROTECTED]> writes: The software I can tune myself. I was more looking for Linux specific tuning. * Yes,

Re: [SLUG] Performance Tuning

2008-09-06 Thread Daniel Pittman
"Tony Sceats" <[EMAIL PROTECTED]> writes: > On Sat, Sep 6, 2008 at 12:22 PM, Daniel Pittman <[EMAIL PROTECTED]> wrote: > > Kyle <[EMAIL PROTECTED]> writes: > > > The software I can tune myself. I was more looking for Linux specific > tuning. > > > > * Yes, I was/am concerned about

Re: [SLUG] Performance Tuning

2008-09-05 Thread Daniel Pittman
Kyle <[EMAIL PROTECTED]> writes: > The software I can tune myself. I was more looking for Linux specific tuning. > > * Yes, I was/am concerned about I/O. > * But also ensuring the OS itself (system processes) is not hindering anything > otherwise. Unless you are running other processes on the s

Re: [SLUG] Performance Tuning

2008-09-05 Thread Daniel Pittman
"Tony Sceats" <[EMAIL PROTECTED]> writes: > Actually I was under the impression that this was a vanilla on-disk > backup - ie, something akin to dumping tgz's onto a server with > reliable disks (hence RAID5).. It could be, but that is a pretty uncommon model in my experience. > I must say thoug

Re: [SLUG] Performance Tuning

2008-09-05 Thread Kyle
Ok, a couple of responses thus far. Some further info. The software I can tune myself. I was more looking for Linux specific tuning. * Yes, I was/am concerned about I/O. * But also ensuring the OS itself (system processes) is not hindering anything otherwise. * The RAID is the storage mediu

Re: [SLUG] Performance Tuning

2008-09-05 Thread Tony Sceats
Actually I was under the impression that this was a vanilla on-disk backup - ie, something akin to dumping tgz's onto a server with reliable disks (hence RAID5).. I must say though that I am surprised that a tape feeder is faster than disks to the point of having to maintain a large buffer, but th

Re: [SLUG] Performance Tuning

2008-09-05 Thread Daniel Pittman
"Tony Sceats" <[EMAIL PROTECTED]> writes: > Performance depends specifically on the job at hand, and whilst short on > detail, I would suspect that you want fast file systems and disks optimised > for write speed, For backups? Often you need very fast reads, either to feed a modern tape streame

Re: [SLUG] Performance Tuning

2008-09-05 Thread Tony Sceats
Performance depends specifically on the job at hand, and whilst short on detail, I would suspect that you want fast file systems and disks optimised for write speed, but that's probably less than half the story, and I'm guessing that whatever the rest of the details are, you will be trying to tune

Re: [SLUG] Performance Tuning

2008-09-05 Thread Daniel Pittman
Kyle <[EMAIL PROTECTED]> writes: > Can somebody recommend a reasonably comprehensive but straightforward > performance tuning article/HowTo/PDF/site I could read pls? There isn't one, because... > Specifically, I am looking to perf-tune a dual-CPU RAID5 box used as a > backup server. ...what yo