The one thing I'd like to add here - is that depending on how many files you have rsync might not be the best thing possible. Because rsync must inspect each file's timestamp, it must walk the tree. For example, I have a 1Tb filesystem right now, that I rsync nightly . for 10 hours a night on a local Gb network.
Something else, such as ZFS or Snapmirror, can accomplish the same task enormously faster. Instantly, it already knows exactly which blocks have changed, and just simply starts sending the blocks. No waiting for a tree scan. From: [email protected] [mailto:[email protected]] On Behalf Of Rob Cherry Sent: Thursday, July 02, 2009 2:44 PM To: [email protected] Subject: [lopsa-discuss] Storage Clouds for backups Whilst tape still gives me a good feeling in terms of having something physical to point the auditors at, and is very quick to restore once it is on site, there is still a gap in coverage. There is always going to be some amount of potential data loss between when the tapes last got picked up and when a disaster happens. As such I am pursuing a few options for nearline, recently synced storage, whilst trying to keep costs somewhat low. One of the options would be to rsync from my multiple NFS mountable storage pools to a storage cloud filesystem (preferably encrypted). I would have one mondo transfer to start things off, but thereafter a small hourly/daily rsync to keep things up to date. One of the players in this space is Nirvanix who provide a simple interface to let me mount a /nirvanix filesystem under linux. I could mount this with AES encryption built in, and rsync to it as discussed. Amazon S3 is another option, although I would be on my own in terms of working out a good way to make it encrypted, mountable and rsyncable. Does anyone have any experience in using storage clouds for anything like what I propose? Any feedback on providers? Any glaring warning signs that should make me run screaming and find another way? Let me know! Thanks, Rob
_______________________________________________ Discuss mailing list [email protected] http://lopsa.org/cgi-bin/mailman/listinfo/discuss This list provided by the League of Professional System Administrators http://lopsa.org/
