Richard Elling wrote: > Recently, I've been working on a project which had agressive backup > requirements. I believe we solved the problem with parallelism. You > might consider doing the same. If you get time to do your own experiments, > please share your observations with the community. > http://richardelling.blogspot.com/2009/01/parallel-zfs-sendreceive.html >
You raise some interesting points about rsync getting bogged down over time. I have been working with a client with a requirement for replication between a number of hosts and I have found doing several rend/receives made quite an impact. What I haven't done is try this with the latest performance improvements in b105. Have you? My guess is the gain will be less. One thing I have yet to do is find the optimum number of parallel transfers when there are 100s of filesystems. I'm looking into making this dynamic, based on throughput. Are you working with OpenSolaris? I still haven't managed to nail the toxic streams problem in Solaris 10, which have curtailed my project. -- Ian. _______________________________________________ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
