Re: [zfs-discuss] dedupe question

2009-11-08 Thread George Wilson
Dennis Clarke wrote: On Sat, 2009-11-07 at 17:41 -0500, Dennis Clarke wrote: Does the dedupe functionality happen at the file level or a lower block level? it occurs at the block allocation level. I am writing a large number of files that have the fol structure : -- file begins 1024

[zfs-discuss] RAID-Z and virtualization

2009-11-08 Thread besson3c
I'm entertaining something which might be a little wacky, I'm wondering what your general reaction to this scheme might be :) I would like to invest in some sort of storage appliance, and I like the idea of something I can grow over time, something that isn't tethered to my servers (i.e. not

[zfs-discuss] Disk I/O in RAID-Z as new disks are added/removed

2009-11-08 Thread besson3c
Hello, As I understand it, in a traditional RAID 5 setup adding new disks to the pool provides more overall I/O as the load is spread out across multiple disks. What exactly is this relationship in a RAID-Z setup? What should one expect in terms of overall I/O performance as disks are added

Re: [zfs-discuss] marvell88sx2 driver build126

2009-11-08 Thread Orvar Korvar
I can't boot into an older version because the last version I had was b118 which doesn't have zfs version 19 support. I've been looking to see if there's a way to downgrade via IPS but that's turned up a lot of nothing. If someone can tell me which files are needed for the driver I can extract

Re: [zfs-discuss] ZFS + fsck

2009-11-08 Thread Robert Milkowski
fyi Robert Milkowski wrote: XXX wrote: | Have you actually tried to roll-back to previous uberblocks when you | hit the issue? I'm asking as I haven't yet heard about any case | of the issue witch was not solved by rolling back to a previous | uberblock. The problem though was that the way

Re: [zfs-discuss] marvell88sx2 driver build126

2009-11-08 Thread Ross
I can't boot into an older version because the last version I had was b118 which doesn't have zfs version 19 support. I've been looking to see if there's a way to downgrade via IPS but that's turned up a lot of nothing. If someone can tell me which files are needed for the driver I can

[zfs-discuss] What can I get with 2x250Gb ?

2009-11-08 Thread Wael Nasreddine (a.k.a eMxyzptlk)
Hello, I'm sure this question has been asked many times already, but I couldn't find the answer myself. Anyway I have a laptop with 2 identical hard disks 250Gb each, I'm currently using Linux on RAID0 which gave me ~500Gb.. I'm planning to switch to FreeBSD but I want to know before I do, what

Re: [zfs-discuss] What can I get with 2x250Gb ?

2009-11-08 Thread Alex Blewitt
If you want any kind of data guarantee, you need to go for a mirrored pool. If you don't want a data guarantee, you can create a single pool (non-mirrored) of the two devs which will give you 500Gb. The key is in the 'zpool create' command zpool create twofifty mirror disk1 disk2 zpool

Re: [zfs-discuss] What can I get with 2x250Gb ?

2009-11-08 Thread Wael Nasreddine (a.k.a eMxyzptlk)
Since all my data are on this PC and I have many externals HDDs (around 3Tb) I think I'm gonna go with Mirrored setup, protect my data.. but out of curiosity, if someday I decide I want 500Gb, can mirrored setup be switched to single devs on the fly or a complete array rebuild is necessary? On

Re: [zfs-discuss] dedupe question

2009-11-08 Thread Bob Friesenhahn
On Sat, 7 Nov 2009, Dennis Clarke wrote: Now the first test I did was to write 26^2 files [a-z][a-z].dat in 26^2 directories named [a-z][a-z] where each file is 64K of random non-compressible data and then some english text. What method did you use to produce this random data? The dedupe

Re: [zfs-discuss] What can I get with 2x250Gb ?

2009-11-08 Thread Orvar Korvar
A zpool consists of vdevs (a group of discs). You can create a mirror of your 250GB. And later you can add another group of discs to your zpool, on the fly. Each group of discs should have redundancy, for instance, mirror, raidz1 or raidz2. So you can add vdev to a zpool on the fly, but you can

Re: [zfs-discuss] marvell88sx2 driver build126

2009-11-08 Thread Orvar Korvar
Great! So if I want another build, for instance b125, I just change step 10? 10) pkg -R /mnt install ent...@0.5.11-0.125 Yes? What is this 0.5.11 thing? Should that be changed too, if I try to install b125? Like 0.5.12-0.125? -- This message posted from opensolaris.org

Re: [zfs-discuss] RAID-Z and virtualization

2009-11-08 Thread Bob Friesenhahn
On Sun, 8 Nov 2009, besson3c wrote: What if I were to run a FreeBSD VM and present it several vdisks, format these as ZFS, and serve up ZFS shares through this VM? I realize that I'm getting the sort of userland conveniences of ZFS this way since the host would still be writing to an EXT3/4

Re: [zfs-discuss] What can I get with 2x250Gb ?

2009-11-08 Thread Wael Nasreddine (a.k.a eMxyzptlk)
Gotcha. Thank you. On Sun, Nov 8, 2009 at 16:42, Orvar Korvar knatte_fnatte_tja...@yahoo.comwrote: A zpool consists of vdevs (a group of discs). You can create a mirror of your 250GB. And later you can add another group of discs to your zpool, on the fly. Each group of discs should have

Re: [zfs-discuss] RAID-Z and virtualization

2009-11-08 Thread besson3c
My impression was that the ZFS Fuse project was no longer being maintained? -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Re: [zfs-discuss] What can I get with 2x250Gb ?

2009-11-08 Thread Bob Friesenhahn
On Sun, 8 Nov 2009, Wael Nasreddine (a.k.a eMxyzptlk) wrote: I'm sure this question has been asked many times already, but I couldn't find the answer myself. Anyway I have a laptop with 2 identical hard disks 250Gb each, I'm currently using Linux on RAID0 which gave me ~500Gb.. I'm planning

Re: [zfs-discuss] marvell88sx2 driver build126

2009-11-08 Thread Tim Cook
On Sun, Nov 8, 2009 at 9:47 AM, Orvar Korvar knatte_fnatte_tja...@yahoo.com wrote: Great! So if I want another build, for instance b125, I just change step 10? 10) pkg -R /mnt install ent...@0.5.11-0.125 Yes? What is this 0.5.11 thing? Should that be changed too, if I try to install b125?

Re: [zfs-discuss] RAID-Z and virtualization

2009-11-08 Thread Tim Cook
On Sun, Nov 8, 2009 at 2:03 AM, besson3c j...@netmusician.org wrote: I'm entertaining something which might be a little wacky, I'm wondering what your general reaction to this scheme might be :) I would like to invest in some sort of storage appliance, and I like the idea of something I can

Re: [zfs-discuss] RAID-Z and virtualization

2009-11-08 Thread Ross Walker
On Nov 8, 2009, at 12:09 PM, Tim Cook t...@cook.ms wrote: Why not just convert the VM's to run in virtualbox and run Solaris directly on the hardware? Or use OpenSolaris xVM (Xen) with either qemu img files on zpools for the VMs or zvols. -Ross

Re: [zfs-discuss] RAID-Z and virtualization

2009-11-08 Thread Tim Cook
On Sun, Nov 8, 2009 at 11:20 AM, Joe Auty j...@netmusician.org wrote: Tim Cook wrote: On Sun, Nov 8, 2009 at 2:03 AM, besson3c j...@netmusician.org wrote: I'm entertaining something which might be a little wacky, I'm wondering what your general reaction to this scheme might be :) I

Re: [zfs-discuss] RAID-Z and virtualization

2009-11-08 Thread Tim Cook
On Sun, Nov 8, 2009 at 11:37 AM, Joe Auty j...@netmusician.org wrote: Tim Cook wrote: On Sun, Nov 8, 2009 at 11:20 AM, Joe Auty j...@netmusician.org wrote: Tim Cook wrote: On Sun, Nov 8, 2009 at 2:03 AM, besson3c j...@netmusician.org wrote: I'm entertaining something which might be a

Re: [zfs-discuss] RAID-Z and virtualization

2009-11-08 Thread jay
From your description, it sounds like you are looking for an independent nas hardware box? In which case using freenas or opensolaris to handle the hardware and present iscsi volumes to your vms, is a pretty simple solution. If your instead looking for one box to handle both data storage and

Re: [zfs-discuss] RAID-Z and virtualization

2009-11-08 Thread Tim Cook
On Sun, Nov 8, 2009 at 11:48 AM, Joe Auty j...@netmusician.org wrote: Tim Cook wrote: It appears that one can get more in the way of features out of VMWare Server for free than with ESX, which is seemingly a hook into buying more VMWare stuff. I've never looked at Sun xVM, in fact I

Re: [zfs-discuss] dedupe question

2009-11-08 Thread Dennis Clarke
On Sat, 7 Nov 2009, Dennis Clarke wrote: Now the first test I did was to write 26^2 files [a-z][a-z].dat in 26^2 directories named [a-z][a-z] where each file is 64K of random non-compressible data and then some english text. What method did you use to produce this random data? I'm using

Re: [zfs-discuss] RAID-Z and virtualization

2009-11-08 Thread Erik Ableson
Uhhh - for an unmanaged server you can use ESXi for free. Identical server functionality, just requires licenses if you need multiserver features (ie vMotion) Cordialement, Erik Ableson On 8 nov. 2009, at 19:12, Tim Cook t...@cook.ms wrote: On Sun, Nov 8, 2009 at 11:48 AM, Joe Auty

Re: [zfs-discuss] dedupe question

2009-11-08 Thread Dennis Clarke
You can get more dedup information by running 'zdb -DD zp_dd'. This should show you how we break things down. Add more 'D' options and get even more detail. - George OKay .. thank you. Looks like I have piles of numbers here : # zdb -DDD zp_dd DDT-sha256-zap-duplicate: 37317 entries, size

Re: [zfs-discuss] RAID-Z and virtualization

2009-11-08 Thread Tim Cook
On Sun, Nov 8, 2009 at 12:39 PM, Joe Auty j...@netmusician.org wrote: Erik Ableson wrote: Uhhh - for an unmanaged server you can use ESXi for free. Identical server functionality, just requires licenses if you need multiserver features (ie vMotion) How does ESXi w/o vMotion, vSphere, and

Re: [zfs-discuss] RAID-Z and virtualization

2009-11-08 Thread Erik Ableson
Simply put ESXi is exactly the same local feature set as ESX server. So you get all of the useful stuff like transparent memory page sharing (memory deduplication), virtual switches with VLAN tagging, and high performance storage I/O. For free. As many copies as you like. But... You will

Re: [zfs-discuss] RAID-Z and virtualization

2009-11-08 Thread jay
Really if your just talking a handful of drives then hardware raid may be the simpilest solution for now. However, I also would be inclided to use seperate nas and vm servers. Even with ecc you can put together a nas box for a few hundred (or use existing hardware), plus what you need for a

Re: [zfs-discuss] RAID-Z and virtualization

2009-11-08 Thread jay
In terms of capability and preformance, esxi is well above anything your getting from vmware serve, even just using the free utilities. The issues to consider are complexity and hardware support. You shouldn't have a problem with hardware if you do your home work before you buy. However the

Re: [zfs-discuss] marvell88sx2 driver build126

2009-11-08 Thread Nigel Smith
I think you can work out the files for the driver by looking here: http://src.opensolaris.org/source/xref/onnv/onnv-gate/usr/src/pkgdefs/SUNWmv88sx/prototype_i386 So the 32 bit driver is: kernel/drv/marvell88sx And the 64 bit driver is: kernel/drv/amd64/marvell88sx It a pity that the

Re: [zfs-discuss] ZFS + fsck

2009-11-08 Thread Jason King
On Sun, Nov 8, 2009 at 7:55 AM, Robert Milkowski mi...@task.gda.pl wrote: fyi Robert Milkowski wrote: XXX wrote: | Have you actually tried to roll-back to previous uberblocks when you | hit the issue?  I'm asking as I haven't yet heard about any case | of the issue witch was not solved

Re: [zfs-discuss] dedupe question

2009-11-08 Thread Bob Friesenhahn
On Sun, 8 Nov 2009, Dennis Clarke wrote: That works well. You know what ... I'm a schmuck. I didn't grab a time based seed first. All those files with random text .. have identical twins on the filesystem somewhere. :-P damn That is one reason why I asked. Failure to get a good seed is

Re: [zfs-discuss] marvell88sx2 driver build126

2009-11-08 Thread Orvar Korvar
This is from build 125. -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Re: [zfs-discuss] RAID-Z and virtualization

2009-11-08 Thread Morten Dall
Just to clear out the vmware stuff. ESXi + ZFS I've run production with a thumper 4540, solaris10 (before dedup:) ,48 drives, one pool, NFS through 1 GB to ESX(+ESXi) on dedicated NICs ZFS snapshots always proved to be consistent data to ESX = ESX or ESXi depends on your needs NFS (leaves all

[zfs-discuss] zpool resilver - error history

2009-11-08 Thread Marcel Gschwandl
Hi all! I'm running a Solaris 10 Update 6 (10/08) system and had to resilver a zpool. It's now showing snip scrub: resilver completed after 9h0m with 21 errors on Wed Nov 4 22:07:49 2009 /snip but I haven't found an option to see what files where affected, Is there any way to do that?