Re: [zfs-discuss] "zfs send..." too slow?

2009-10-25 Thread Ian Collins
Orvar Korvar wrote: It seems that "zfs send..." takes quite some time? 300GB takes 10 hours, this far. And I have in total 3TB to backup. This means it will take 100 hours. Is this normal? If I had 30TB to back up, it would take 1000 hours, which is more than a month. Can I speed this up?

Re: [zfs-discuss] zfs inotify?

2009-10-25 Thread Paul Archer
5:12pm, Cyril Plisko wrote: Question: Is there a facility similar to inotify that I can use to monitor a directory structure in OpenSolaris/ZFS, such that it will block until a file is modified (added, deleted, etc), and then pass the state along (STDOUT is fine)? One other requirement: inotify

[zfs-discuss] zfs code and fishworks "fork"

2009-10-25 Thread Al Hopper
First up, anyone that knows me, will know I'm a huge ZFS advocate. With that said I'm concerned that there appears to be a fork between the opensource version of ZFS and ZFS that is part of the Sun/Oracle FishWorks 7nnn series appliances. I understand (implicitly) that Sun (/Oracle) as a commerci

Re: [zfs-discuss] SNV_125 MPT warning in logfile

2009-10-25 Thread Adam Cheal
So, while we are working on resolving this issue with Sun, let me approach this from the another perspective: what kind of controller/drive ratio would be the minimum recommended to support a functional OpenSolaris-based archival solution? Given the following: - the vast majority of IO to the s

Re: [zfs-discuss] Dumb idea?

2009-10-25 Thread Bob Friesenhahn
On Sun, 25 Oct 2009, j...@lentecs.com wrote: But I think this is something better left to run on top of the file system. Rather than integrated into the file system. A true database and "crawling bot" would seem to be the better method of implementing this. I think that you will rue the da

Re: [zfs-discuss] Dumb idea?

2009-10-25 Thread jay
This actually sounds a little like what ms is trying to accomplish, in win7, with libraries. They will act as standard folders if you treat them as such. But they are really designed to group different pools of files into one easy place. You just have to configure it to pull from local and re

Re: [zfs-discuss] Checksums

2009-10-25 Thread Adam Leventhal
Thank you for the correction. My next question is, do you happen to know what the overhead difference between fletcher4 and SHA256 is? Is the checksumming multi-threaded in nature? I know my fileserver has a lot of spare cpu cycles, but it would be good to know if I'm going to take a sub

Re: [zfs-discuss] Apple cans ZFS project

2009-10-25 Thread Joerg Schilling
Kyle McDonald wrote: > > Apple can currently just take the ZFS CDDL code and incorporate it > > (like they did with DTrace), but it may be that they wanted a "private > > license" from Sun (with appropriate technical support and > > indemnification), and the two entities couldn't come to mutua

Re: [zfs-discuss] Apple cans ZFS project

2009-10-25 Thread Kyle McDonald
David Magda wrote: On Oct 24, 2009, at 08:53, Joerg Schilling wrote: The article that was mentioned a few hours ago did mention licensing problems without giving any kind of evidence for this claim. If there is evidence, I would be interested in knowing the background, otherwise it looks to me

Re: [zfs-discuss] zfs inotify?

2009-10-25 Thread Cyril Plisko
On Sun, Oct 25, 2009 at 4:16 PM, Paul Archer wrote: > OK, so this may be a little off-topic, but here goes: > The reason I switched to OpenSolaris was primarily to take advantage of > ZFS's features when storing my digital imaging collection. > > I switched from a pretty stock Linux setup, but it

[zfs-discuss] zfs inotify?

2009-10-25 Thread Paul Archer
OK, so this may be a little off-topic, but here goes: The reason I switched to OpenSolaris was primarily to take advantage of ZFS's features when storing my digital imaging collection. I switched from a pretty stock Linux setup, but it left me at one disadvantage. I had been using inotify unde

Re: [zfs-discuss] PSARC 2009/571: ZFS deduplication properties

2009-10-25 Thread Orvar Korvar
Hey, buy them a beer from me, too! (Easy for me to say, as I cant shell out money). ZFS developers rocks. Hard. And long. -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/ma

Re: [zfs-discuss] Performance problems with Thumper and >7TB ZFS pool using RAIDZ2

2009-10-25 Thread Jeff Savit
On 10/24/09 12:31 PM, Jim Mauro wrote: Posting to zfs-discuss. There's no reason this needs to be kept confidential. okay. 5-disk RAIDZ2 - doesn't that equate to only 3 data disks? Seems pointless - they'd be much better off using mirrors, which is a better choice for random IO... Hmm, they

[zfs-discuss] "zfs send..." too slow?

2009-10-25 Thread Orvar Korvar
I am trying to backup a large zfs file system to two different identical hard drives. I have therefore started two commands to backup "myfs" and when they have finished, I will backup "nextfs" zfs send mypool/m...@now | zfs receive backupzpool1/now & zfs send mypool/m...@now | zfs receive backu