Re: [zfs-discuss] ZFS space efficiency when copying files from another source

2008-11-24 Thread Albert Chin
On Mon, Nov 24, 2008 at 08:43:18AM -0800, Erik Trimble wrote: > I _really_ wish rsync had an option to "copy in place" or something like > that, where the updates are made directly to the file, rather than a > temp copy. Isn't this what --inplace does? -- albert chin ([EMAIL PROTECTED]) __

Re: [zfs-discuss] ZFS space efficiency when copying files from another source

2008-11-24 Thread Bob Friesenhahn
On Mon, 24 Nov 2008, Erik Trimble wrote: > > One note here for ZFS users: > > On ZFS (or any other COW filesystem), rsync unfortunately does NOT do the > "Right Thing" when syncing an existing file. From ZFS's standpoint, the most > efficient way would be merely to rewrite the changed blocks, th

Re: [zfs-discuss] ZFS space efficiency when copying files from another source

2008-11-24 Thread Erik Trimble
Bob Friesenhahn wrote: > On Mon, 24 Nov 2008, BJ Quinn wrote: > > >> Here's an idea - I understand that I need rsync on both sides if I >> want to minimize network traffic. What if I don't care about that - >> the entire file can come over the network, but I specifically only >> want rsync t

Re: [zfs-discuss] ZFS space efficiency when copying files from another source

2008-11-24 Thread Bob Friesenhahn
On Mon, 24 Nov 2008, BJ Quinn wrote: > Here's an idea - I understand that I need rsync on both sides if I > want to minimize network traffic. What if I don't care about that - > the entire file can come over the network, but I specifically only > want rsync to write the changed blocks to disk.

Re: [zfs-discuss] ZFS space efficiency when copying files from another source

2008-11-24 Thread BJ Quinn
Here's an idea - I understand that I need rsync on both sides if I want to minimize network traffic. What if I don't care about that - the entire file can come over the network, but I specifically only want rsync to write the changed blocks to disk. Does rsync offer a mode like that? -- This

Re: [zfs-discuss] ZFS space efficiency when copying files from another source

2008-11-17 Thread Tim
On Mon, Nov 17, 2008 at 3:33 PM, Will Murnane <[EMAIL PROTECTED]>wrote: > On Mon, Nov 17, 2008 at 20:54, BJ Quinn <[EMAIL PROTECTED]> wrote: > > 1. Dedup is what I really want, but it's not implemented yet. > Yes, as I read it. greenBytes [1] claims to have dedup on their > system; you might inv

Re: [zfs-discuss] ZFS space efficiency when copying files from another source

2008-11-17 Thread Will Murnane
On Mon, Nov 17, 2008 at 20:54, BJ Quinn <[EMAIL PROTECTED]> wrote: > 1. Dedup is what I really want, but it's not implemented yet. Yes, as I read it. greenBytes [1] claims to have dedup on their system; you might investigate them if you decide rsync won't work for your application. > 2. The onl

Re: [zfs-discuss] ZFS space efficiency when copying files from another source

2008-11-17 Thread BJ Quinn
Thank you both for your responses. Let me see if I understand correctly - 1. Dedup is what I really want, but it's not implemented yet. 2. The only other way to accomplish this sort of thing is rsync (in other words, don't overwrite the block in the first place if it's not different), and i

Re: [zfs-discuss] ZFS space efficiency when copying files from another source

2008-11-17 Thread Will Murnane
On Mon, Nov 17, 2008 at 11:51, BJ Quinn <[EMAIL PROTECTED]> wrote: > I believe rsync can do this, but some of the servers in question are Windows > servers and rsync/cygwin might not be an option. I'd check to make sure rsync has the correct behavior first, but there is a Windows-based rsync daemo

Re: [zfs-discuss] ZFS space efficiency when copying files from another source

2008-11-17 Thread Mertol Ozyoney
I think what you define IS dedup. You can search the archieves for dedup. Best regards Mertol Sent from a mobile device Mertol Ozyoney On 17.Kas.2008, at 18:51, BJ Quinn <[EMAIL PROTECTED]> wrote: > We're considering using an OpenSolaris server as a backup server. > Some of the servers to

[zfs-discuss] ZFS space efficiency when copying files from another source

2008-11-17 Thread BJ Quinn
We're considering using an OpenSolaris server as a backup server. Some of the servers to be backed up would be Linux and Windows servers, and potentially Windows desktops as well. What I had imagined was that we could copy files over to the ZFS-based server nightly, take a snapshot, and only t