Re: [Lustre-discuss] software raid

2011-03-28 Thread Eudes PHILIPPE
Hello For me hard raid (3ware card) is important for hotplug, and have no downtime. I hate shutdown / reboot a server :) But software raid works fine and consumes few resources if it's a mirror raid. I think, use software raid on a cluster is a source of problems we can avoid. it's just my opinio

Re: [Lustre-discuss] software raid

2011-03-28 Thread Lundgren, Andrew
We have also had a few kernel panic's at the same time as a failed disk. I don't know what was first but anecdotally, it seems that we might be seeing an occasional kernel panic with a disk failure on swraid... Though that is still just FUD, so don't put stock in it unless you see it. -Ori

Re: [Lustre-discuss] software raid

2011-03-28 Thread Oleg Drokin
Hello! On Mar 28, 2011, at 4:43 PM, Lundgren, Andrew wrote: > > When you reboot a machine that has a failed disk in the array (degraded), the > array will not start by default in a degraded state. If you have LVMs on top > of your raid arrays, they will also not start. You will need to log in

Re: [Lustre-discuss] software raid

2011-03-28 Thread Lundgren, Andrew
I have done both SW and HW raid across with OSTs and MDTs. As part of your choice, look into what happens when you have to replace a failed disk in a sw configuration. My negatives for sw raid are all management at this point. When you pull a bad disk out of a linux box (/dev/sde for example)

Re: [Lustre-discuss] IB storage as an OST target

2011-03-28 Thread Ken Hornstein
>Anybody had any experience using an IB based storage >target as an OST? We do that. >Apart from the obvious issue of separating the IB SAN(SRP/SER) >storage traffic from the Lustre traffic are there any issues? We don't actually separate the IB traffic from the Lustre traffic; in our cases they

Re: [Lustre-discuss] IB storage as an OST target

2011-03-28 Thread Ashley Pittman
On 28 Mar 2011, at 06:21, Brian O'Connor wrote: > Anybody had any experience using an IB based storage > target as an OST? We do this all the time at DDN. > Apart from the obvious issue of separating the IB SAN(SRP/SER) > storage traffic from the Lustre traffic are there any issues? Personally

Re: [Lustre-discuss] IB storage as an OST target

2011-03-28 Thread Jason Hill
Hi Brian, Here at ORNL we don't sepearate the IB SAN from the Lustre fabric and we don't see any performance degredation on any of it. We have two links to the backed storage from the OSS nodes - one is direct to the storage controller, the other (primary) is through the SAN. Any specific question