On Tue, Aug 29, 2006 at 02:17:06PM -0500, James Dickens wrote:
> ZFS + rsync, backup on steroids.
I've long thought that network filesystem protocols could implement
portion of the rsync algorithm, namely:
- servers could compute rsync rolling CRC file checksums
- ZFS could do it at the lowest layer, and might even cache this
on-disk
- servers could compute and send back to clients file diffs based on
rsync file checksums sent by the client
- clients could apply rsync diffs to server-side files efficiently if
the server provided operations such as "read fh X, offset Y, length
Z, write to some other fh at some other offset."
I would love to see extensions to NFSv4, SFTP, for efficient distributed
data synchronization based on the rsync algorithm.
Additionally, since ZFS tracks differences between snapshost and
filesystems there's no reason that ZFS could not export block-level
diffs for individual files (with the same dnode/generation numbers).
(Finding differences like renames/links/unlinks is another story.)
Nico
--
_______________________________________________
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
