Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread mike
yeah i am on gigabit, but the clients are things like an xbox which is only 10/100, etc. right now the setup works fine. i'm thinking the new CIFS implementation should make it run even cleaner too. On 8/22/08, Ross Smith <[EMAIL PROTECTED]> wrote: > Yup, you got it, and an 8 disk raid-z2 array sh

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Ross Smith
gt; To: [EMAIL PROTECTED] > Subject: Re: [zfs-discuss] Best layout for 15 disks? > CC: zfs-discuss@opensolaris.org > > On 8/22/08, Ross <[EMAIL PROTECTED]> wrote: > > > Yes, that looks pretty good mike. There are a few limitations to that as > > you add the 2

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread mike
On 8/22/08, Ross <[EMAIL PROTECTED]> wrote: > Yes, that looks pretty good mike. There are a few limitations to that as you > add the 2nd raidz2 set, but nothing major. When you add the extra disks, > your original data will still be stored on the first set of disks, if you've > any free space

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Ross
Yes, that looks pretty good mike. There are a few limitations to that as you add the 2nd raidz2 set, but nothing major. When you add the extra disks, your original data will still be stored on the first set of disks, if you've any free space left on those you'll then get some data stored acros

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Miles Nordin
> "m" == mike <[EMAIL PROTECTED]> writes: m> that could only be accomplished through combinations of pools? m> i don't really want to have to even think about managing two m> separate "partitions" - i'd like to group everything together m> into one large 13tb instance You

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Bob Friesenhahn
On Fri, 22 Aug 2008, Jacob Ritorto wrote: > While on the subject, in a home scenario where one actually notices > the electric bill personally, is it more economical to purchase a big > expensive 1tb disk and save on electric to run it for five years or to > purchase two cheap 1/2 TB disk and spen

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread mike
On 8/22/08, Kyle McDonald <[EMAIL PROTECTED]> wrote: > You only need 1 disk to use ZFS root. You won't have any redundancy, but as > Darren said in another email, you can convert single device vDevs to > Mirror'd vDevs later without any hassle. I'd just get some 80 gig disks and mirror them. Migh

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Kyle McDonald
mike wrote: > On 8/22/08, Rich Teer <[EMAIL PROTECTED]> wrote: > > >> ZFS boot works fine; it only recently integrated into Nevada, but it >> has been in use for quite some time now. >> > > Yeah I got the install option when I installed snv_94 but wound up not > having enough disks to use i

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Jacob Ritorto
While on the subject, in a home scenario where one actually notices the electric bill personally, is it more economical to purchase a big expensive 1tb disk and save on electric to run it for five years or to purchase two cheap 1/2 TB disk and spend double on electric for them for 5 years? Has any

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Kyle McDonald
mike wrote: > Or do smaller groupings of raidz1's (like 3 disks) so I can remove > them and put 1.5TB disks in when they come out for instance? > I wouldn't reduce it to 3 disks (should almost mirror if you go that low.) Remember, while you can't take a drive out of a vDev, or a vDev out of a

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Chris Cosby
On Fri, Aug 22, 2008 at 1:08 PM, mike <[EMAIL PROTECTED]> wrote: > It looks like this will be the way I do it: > > initially: > zpool create mypool raidz2 disk0 disk1 disk2 disk3 disk4 disk5 disk6 disk7 > > when I need more space and buy 8 more disks: > zpool add mypool raidz2 disk8 disk9 disk10 d

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread mike
On 8/22/08, Rich Teer <[EMAIL PROTECTED]> wrote: > ZFS boot works fine; it only recently integrated into Nevada, but it > has been in use for quite some time now. Yeah I got the install option when I installed snv_94 but wound up not having enough disks to use it. > Even better: just use ZFS roo

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread mike
It looks like this will be the way I do it: initially: zpool create mypool raidz2 disk0 disk1 disk2 disk3 disk4 disk5 disk6 disk7 when I need more space and buy 8 more disks: zpool add mypool raidz2 disk8 disk9 disk10 disk11 disk12 disk13 disk14 disk15 Correct? > Enable compression, and set up

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread mike
On 8/22/08, Kyle McDonald <[EMAIL PROTECTED]> wrote: > Antoher note, as someone said earlier, if you can go to 16 drives, you > should consider 2 8disk RAIDZ2 vDevs, over 2 7disk RAIDZ vDevs with a spare, > or (I would think) even a 14disk RAIDZ2 vDev with a spare. > > If you can (now or later) ge

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Rich Teer
On Fri, 22 Aug 2008, mike wrote: > Oh sorry - for boot I don't care if it's redundant or anything. 8-O > Worst case the drive fails, I replace it and reinstall, and just re-mount the > ZFS stuff. If you use a ZFS mirrored root, you just replace a drive when it fails. None of this reinstall no

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Bill Sommerfeld
On Thu, 2008-08-21 at 21:15 -0700, mike wrote: > I've seen 5-6 disk zpools are the most recommended setup. This is incorrect. Much larger zpools built out of striped redundant vdevs (mirror, raidz1, raidz2) are recommended and also work well. raidz1 or raidz2 vdevs of more than a single-digit nu

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread mike
On 8/22/08, Darren J Moffat <[EMAIL PROTECTED]> wrote: > I could if I wanted to add another vdev to this pool but it doesn't > have to be raidz it could be raidz2 or mirror. > If they did they are wrong, hope the above clarifies. I get it now. If you add more disks they have to be in their own m

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Kyle McDonald
mike wrote: > > > Sorry :) > > Okay, so you can create a zpool from multiple vdevs. But you cannot > add more vdevs to a zpool once the zpool is created. Is that right? Nope. That's exactly what you *CAN* do. So say today you only really need 6TB usable, you could go buy 8 of your 1TB disks, and

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Darren J Moffat
mike wrote: >> No that isn't correct. > >> One or move vdevs create a pool. Each vdev in a pool can be a >> different type, eg a mix or mirror, raidz, raidz2. > >> There is no such thing as zdev. > > Sorry :) > > Okay, so you can create a zpool from multiple vdevs. But you cannot > add more vd

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Kyle McDonald
mike wrote: > And terminology-wise, one or more zpools create zdevs right? > Lets get the terminology right first. You can have more than one zPool. Each zPool can have many filesystems which all share *ALL* the space in the pool. Each zPool can get it's space from one or more vDevs. (Yes you c

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread mike
> No that isn't correct. > One or move vdevs create a pool. Each vdev in a pool can be a > different type, eg a mix or mirror, raidz, raidz2. > There is no such thing as zdev. Sorry :) Okay, so you can create a zpool from multiple vdevs. But you cannot add more vdevs to a zpool once the zpool

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Darren J Moffat
mike wrote: > And terminology-wise, one or more zpools create zdevs right? No that isn't correct. One or move vdevs create a pool. Each vdev in a pool can be a different type, eg a mix or mirror, raidz, raidz2. There is no such thing as zdev. -- Darren J Moffat _

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread mike
Oh sorry - for boot I don't care if it's redundant or anything. Worst case the drive fails, I replace it and reinstall, and just re-mount the ZFS stuff. If I have the space in the case and the ports I could get a pair of 80 gig drives or something and mirror them using SVM (which was recommende

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Claus Guttesen
> Are there any benchmarks or numbers showing the performance difference using > a 15 disk raidz2 zpool? I am fine sacrificing some performance but obviously > don't want to make the machine crawl. > > It sounds like I could go with 15 disks evenly and have to sacrifice 3, but I > would have 1 p

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread mike
I hear everyone's concerns about multiple parity disks. Are there any benchmarks or numbers showing the performance difference using a 15 disk raidz2 zpool? I am fine sacrificing some performance but obviously don't want to make the machine crawl. It sounds like I could go with 15 disks evenly

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Tim
14+2 or 7+1 On 8/22/08, Miles Nordin <[EMAIL PROTECTED]> wrote: >> "m" == mike <[EMAIL PROTECTED]> writes: > > m> can you combine two zpools together? > > no. You can have many vdevs in one pool. for example you can have a > mirror vdev and a raidz2 vdev in the same pool. You can al

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Ross
Hey Mike, First of all, I'd strongly suggest going for raidz2 instead of raidz. Dual parity protection is something I'd strongly recommended over single parity protection. You also don't mention your boot pool. You can't boot from a raid pool, so you need to put one disk aside for booting fr

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Darren J Moffat
mike wrote: > likewise i could also do something like > > zpool create tank raidz1 disk1 disk2 disk3 disk4 disk5 disk6 disk7 \ > raidz1 disk8 disk9 disk10 disk11 disk12 disk13 disk14 disk15 > > and i'd have a 7 disk raidz1 and an 8 disk raidz1... and i'd have 15 disks > still broken up into not-

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread mike
likewise i could also do something like zpool create tank raidz1 disk1 disk2 disk3 disk4 disk5 disk6 disk7 \ raidz1 disk8 disk9 disk10 disk11 disk12 disk13 disk14 disk15 and i'd have a 7 disk raidz1 and an 8 disk raidz1... and i'd have 15 disks still broken up into not-too-horrible pool sizes an

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Robert Milkowski
Hello mike, Friday, August 22, 2008, 8:11:36 AM, you wrote: m> see, originally when i read about zfs it said it could expand to m> petabytes or something. but really, that's not as a single m> "filesystem" ? that could only be accomplished through combinations of pools? m> i don't really want to

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Peter Tribble
On Fri, Aug 22, 2008 at 8:11 AM, mike <[EMAIL PROTECTED]> wrote: > see, originally when i read about zfs it said it could expand to petabytes or > something. but really, that's not as a single "filesystem" ? that could only > be accomplished through combinations of pools? > > i don't really want

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Claus Guttesen
> see, originally when i read about zfs it said it could expand to petabytes or > something. but really, that's not as a single "filesystem" ? that could only > be accomplished through combinations of pools? > > i don't really want to have to even think about managing two separate > "partitions"

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread mike
see, originally when i read about zfs it said it could expand to petabytes or something. but really, that's not as a single "filesystem" ? that could only be accomplished through combinations of pools? i don't really want to have to even think about managing two separate "partitions" - i'd like

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-21 Thread Miles Nordin
> "m" == mike <[EMAIL PROTECTED]> writes: m> can you combine two zpools together? no. You can have many vdevs in one pool. for example you can have a mirror vdev and a raidz2 vdev in the same pool. You can also destroy pool B, and add its (now empty) devices to pool A. but once two

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-21 Thread mike
i could probably do 16 disks and maybe do a raidz on both for 14 disks usable combined... that's probably as redundant as i'd need, i think. can you combine two zpools together? or will i have two separate "partitions" (i.e. i'll have "tank" for example and "tank2" instead of making one single lar

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-21 Thread Will Murnane
On Fri, Aug 22, 2008 at 00:15, mike <[EMAIL PROTECTED]> wrote: > Question #1: > > I've seen 5-6 disk zpools are the most recommended setup. > > In traditional RAID terms, I would like to do RAID5 + hot spare (13 disks > usable) out of the 15 disks (like raidz2 I suppose). What would make the most

[zfs-discuss] Best layout for 15 disks?

2008-08-21 Thread mike
Question #1: I've seen 5-6 disk zpools are the most recommended setup. In traditional RAID terms, I would like to do RAID5 + hot spare (13 disks usable) out of the 15 disks (like raidz2 I suppose). What would make the most sense to setup 15 disks with ~ 13 disks of usable space? This is for a h