Re: [Veritas-bu] Disk backup - Storage Hardware configurations
We are currently using Clariion CX700 disk arrays for B2D. We did find that RAID-5 was the best performance for our testing. We also found that some environments performed better at 4+1 and some performed better at 7+1. We are in the process of migrating off the Clariion on to a IBM/NetApp 5500 Array. We will be dusting their RAID 6 configuration. Reneé Carlisle Sr. Systems Administrator 675 Basket Road Webster, NY 14580 Jer 29:11-13 585-216-0497 (w) 585-472-2360 (c) From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Ambrose, Monte Sent: Wednesday, March 22, 2006 9:54 PM To: veritas-bu@mailman.eng.auburn.edu Subject: [Veritas-bu] Disk backup - Storage Hardware configurations I wanted to get a feel for what type of disk storage is being used out there for disk based backups. I am specifically looking for SAN attached storage ATA, SATA and what type of RAID is used and how it is performing overall. The NBU 6.0 tuning guide shows RAID-5 but I am wondering if anyone is using RAID-10 or others. Thanks, Monte - The information contained in this message may be privileged, confidential, and protected from disclosure. If the reader of this message is not the intended recipient, or any employee or agent responsible for delivering this message to the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this communication is strictly prohibited. If you have received this communication in error, please notify us immediately by replying to the message and deleting it from your computer. Thank you. Paychex, Inc. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Disk backup - Storage Hardware configurations
On 3/24/06, Sander <[EMAIL PROTECTED]> wrote: Tim Berger wrote (ao):>Agreed. 70MB/sec writes is disappointing but acceptable for my>requirements. On a fast cpu machine you'll see better performance>with software raid. That's normal. There's lots of other reasons to >go with 3ware. Here's what led me there:>- Auto-sector repair. With big disks, this is critical. I've lost>software raids in the past due to latent bad block loss that led to>more than one disk getting failed out. All big disks have this >problem.I agree with you. But Linux sw raid improves. Nowadays you can (andshould if you care) run a background read test over the raid array.This detects latent bad blocks. Detection and correction are two different things. With sw raid, a persistant bad block is not always recoverable resulting in failing out a disk or hanging your system. Hardware raids can remap them on the fly. >- Very reliable driver support.Dito for both Linux software raid and the disk controllers. > smartd support.That goes for anything in Linux.Are you using a 2.6 kernel? The smartmontools require ATA-passthrough ioctl() calls with 2.6 for sata support which isn't there yet (unless it came out like last week or something). In any event, everyone should select what works best for them.[snip] --Humilis IT Services and Solutionshttp://www.humilis.net-- -Tim
Re: [Veritas-bu] Disk backup - Storage Hardware configurations
Agreed. 70MB/sec writes is disappointing but acceptable for my requirements. On a fast cpu machine you'll see better performance with software raid. That's normal. There's lots of other reasons to go with 3ware. Here's what led me there: - Auto-sector repair. With big disks, this is critical. I've lost software raids in the past due to latent bad block loss that led to more than one disk getting failed out. All big disks have this problem. - Very reliable driver support. smartd support.- Hot swap support, good management interface.Software raid is good for some things, but I would not use it in a machine that requires high uptime. Each of my media servers has 24 400GB drives so ease of managment and reliability is critical. I used to strictly use software raid. No more. On 3/23/06, Sander <[EMAIL PROTECTED]> wrote: Tim Berger wrote (ao):>I have two Linux media servers setup with 3ware 9500S controllers>using raid "50" with seagate disks. With our configuration this is>two raid 5's of 6 disks each that are then striped together. I get up >to about 70MB/sec writes and 300MB/sec reads after the readahead is>tweaked up.I'm not impressed at all by 70MB/sec on a raid config. I currently haveeight Maxtor 300GB disks (slow) sw raid5 on a Marvell 8-port sata controller, and see at least twice as much for writing.Not to mention that the Marvell 8-port controller is much, much cheaperthan a 3ware 9500S controller.With 3 controllers and 24 WD Raptors raid5, 500MB/sec should not be a problem.Can you try this for me, just for fun? It creates four 10GB files.for i in `seq 4`do time dd if=/dev/zero of=bigfile.$i bs=1024k count=1time dd if=bigfile.$i of=/dev/null bs=1024k count=1 donetime rm bigfile.*With a modern 'dd' it will also output the MB/sec speed.Kind regards, Sander--Humilis IT Services and Solutionshttp://www.humilis.net -- -Tim
Re: [Veritas-bu] Disk backup - Storage Hardware configurations
I have two Linux media servers setup with 3ware 9500S controllers using raid "50" with seagate disks. With our configuration this is two raid 5's of 6 disks each that are then striped together. I get up to about 70MB/sec writes and 300MB/sec reads after the readahead is tweaked up. They are used for DSSU's going to IBM LTO3's and I'm seeing up to 160MB/sec writes to tape. I'm very happy so far.I get better read performance with raid5 or raid50 than with raid 10. But I use raid 10 for the catalog raid for best write performance. I see a bit over 100MB/sec reads & writes with raid 10. On 3/22/06, Ambrose, Monte <[EMAIL PROTECTED]> wrote: I wanted to get a feel for what type of disk storage is being used out there for disk based backups. I am specifically looking for SAN attached storage ATA, SATA and what type of RAID is used and how it is performing overall. The NBU 6.0 tuning guide shows RAID-5 but I am wondering if anyone is using RAID-10 or others. Thanks, Monte -- -Tim
RE: [Veritas-bu] Disk backup - Storage Hardware configurations
Title: Message So you're building your LUNs RAID5 4+1, then presenting multiple LUNs to the server and striping across them with your VM, or what? or is each DSSU only the size of 4 disks. Paul -Original Message-From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Carlisle, D ReneeSent: March 23, 2006 1:55 PMTo: [EMAIL PROTECTED]; Ambrose, MonteCc: veritas-bu@mailman.eng.auburn.eduSubject: RE: [Veritas-bu] Disk backup - Storage Hardware configurations We are just starting to set up DSU storage and have completed some extensive performance tests. So far, we have found RAID5 4+1 works best with our file system (small files) backups and RAID3 4+1 works best with our database and raw backups. There is still some testing going on as far as buffer settings, we are between 256k and 512K buffer settings and are still not sure which is going to work out best for us. These tests have all just been done in a test environment, we won't know if we have to tweak anything for production for another month or so. Reneé Carlisle Sr. Systems Administrator675 Basket RoadWebster, NY 14580 Jer 29:11-13 585-216-0497 (w)585-472-2360 (c) From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of [EMAIL PROTECTED]Sent: Thursday, March 23, 2006 4:57 AMTo: Ambrose, MonteCc: veritas-bu@mailman.eng.auburn.eduSubject: Re: [Veritas-bu] Disk backup - Storage Hardware configurations Hi Monte, I did one install with EMC DMX1000 disk with hardware mirroring used for a DSSU and I have to say I found performance wasn't great. Worse than LTO2 performance but this was writing to a fairly small number of physical drives, though performance wasn't an issue so I didn't spend a lot of time tuning it, cheers Andy. "Ambrose, Monte" <[EMAIL PROTECTED]> Sent by: [EMAIL PROTECTED] 23/03/2006 01:54 To: cc: Subject: [Veritas-bu] Disk backup - Storage Hardware configurationsI wanted to get a feel for what type of disk storage is being used out there for disk based backups. I am specifically looking for SAN attached storage ATA, SATA and what type of RAID is used and how it is performing overall. The NBU 6.0 tuning guide shows RAID-5 but I am wondering if anyone is using RAID-10 or others. Thanks, Monte The information contained in this message may be privileged,confidential, and protected from disclosure. If the reader of thismessage is not the intended recipient, or any employee or agentresponsible for delivering this message to the intended recipient,you are hereby notified that any dissemination, distribution, orcopying of this communication is strictly prohibited. If you havereceived this communication in error, please notify us immediatelyby replying to the message and deleting it from your computer.Thank you. Paychex, Inc.
RE: [Veritas-bu] Disk backup - Storage Hardware configurations
We are just starting to set up DSU storage and have completed some extensive performance tests. So far, we have found RAID5 4+1 works best with our file system (small files) backups and RAID3 4+1 works best with our database and raw backups. There is still some testing going on as far as buffer settings, we are between 256k and 512K buffer settings and are still not sure which is going to work out best for us. These tests have all just been done in a test environment, we won't know if we have to tweak anything for production for another month or so. Reneé Carlisle Sr. Systems Administrator675 Basket RoadWebster, NY 14580 Jer 29:11-13 585-216-0497 (w)585-472-2360 (c) From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of [EMAIL PROTECTED]Sent: Thursday, March 23, 2006 4:57 AMTo: Ambrose, MonteCc: veritas-bu@mailman.eng.auburn.eduSubject: Re: [Veritas-bu] Disk backup - Storage Hardware configurations Hi Monte, I did one install with EMC DMX1000 disk with hardware mirroring used for a DSSU and I have to say I found performance wasn't great. Worse than LTO2 performance but this was writing to a fairly small number of physical drives, though performance wasn't an issue so I didn't spend a lot of time tuning it, cheers Andy. "Ambrose, Monte" <[EMAIL PROTECTED]> Sent by: [EMAIL PROTECTED] 23/03/2006 01:54 To: cc: Subject: [Veritas-bu] Disk backup - Storage Hardware configurationsI wanted to get a feel for what type of disk storage is being used out there for disk based backups. I am specifically looking for SAN attached storage ATA, SATA and what type of RAID is used and how it is performing overall. The NBU 6.0 tuning guide shows RAID-5 but I am wondering if anyone is using RAID-10 or others. Thanks, Monte The information contained in this message may be privileged, confidential, and protected from disclosure. If the reader of this message is not the intended recipient, or any employee or agent responsible for delivering this message to the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this communication is strictly prohibited. If you have received this communication in error, please notify us immediately by replying to the message and deleting it from your computer. Thank you. Paychex, Inc.
Re: [Veritas-bu] Disk backup - Storage Hardware configurations
Hi Monte, I did one install with EMC DMX1000 disk with hardware mirroring used for a DSSU and I have to say I found performance wasn't great. Worse than LTO2 performance but this was writing to a fairly small number of physical drives, though performance wasn't an issue so I didn't spend a lot of time tuning it, cheers Andy. "Ambrose, Monte" <[EMAIL PROTECTED]> Sent by: [EMAIL PROTECTED] 23/03/2006 01:54 To: cc: Subject: [Veritas-bu] Disk backup - Storage Hardware configurations I wanted to get a feel for what type of disk storage is being used out there for disk based backups. I am specifically looking for SAN attached storage ATA, SATA and what type of RAID is used and how it is performing overall. The NBU 6.0 tuning guide shows RAID-5 but I am wondering if anyone is using RAID-10 or others. Thanks, Monte
Re: [Veritas-bu] Disk backup - Storage Hardware configurations
<> That is at the minimum required for LTO3. Is anyone using LTO3 for D2D2T? I'd like to understand what does and what does not work. There is some pressure to start using LTO3 as the price gap narrows, but I doubt many of our systems can deliver the data rate even off local disk. I think we will need to get some disk for staging so I too would like to know what works. William D L Brown ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Disk backup - Storage Hardware configurations
--- "Ambrose, Monte" <[EMAIL PROTECTED]> wrote: > I wanted to get a feel for what type of disk storage > is being used out > there for disk based backups. I am specifically > looking for SAN > attached storage ATA, SATA and what type of RAID is > used and how it is > performing overall. The NBU 6.0 tuning guide shows > RAID-5 but I am > wondering if anyone is using RAID-10 or others. weve got ata on a cx700 (raid 5). its does very well with our lto2 drives. we use the disk for incremental jobs and normal disk stu activity. we see 40-50MB/sec when doing disk to tape jobs. __ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] Disk backup - Storage Hardware configurations
I wanted to get a feel for what type of disk storage is being used out there for disk based backups. I am specifically looking for SAN attached storage ATA, SATA and what type of RAID is used and how it is performing overall. The NBU 6.0 tuning guide shows RAID-5 but I am wondering if anyone is using RAID-10 or others. Thanks, Monte