Re: Sorta OT - Backup solutions Mac to FreeBSD
Hello, I am backing up 5 servers on one centralized machines using rsnapshot It is doing a perfect job, including : -- SSH transport. -- Rsync based. -- Incremental backup. As It uses a symlink strategy, It does not use very much space on the backup device. It is in the ports /usr/ports/sysutil/rsnapshot and described as : rsnapshot is a filesystem snapshot utility based on rsync(1). rsnapshot makes it easy to make periodic snapshots of local machines, and remote machines over ssh. The code makes extensive use of hard links whenever possible, to greatly reduce the disk space required. It is written entirely in perl with no module dependencies, and has been tested with versions 5.004 through 5.8.1. WWW:http://www.rsnapshot.org -- I am backing up 2To of data, with a daily flow of 20 to 100 Go. The first backup is quite long - after it's a matter of hours (1 or 2 max). In order to fully automate the process, I have created an ssh key signature that allows me to access directly as root - if you would like more security, you could create a specific user… which will lead you to ownership problem, unless very well setup. The main problem with mac would be to sync the specific MetaData files specific to the Mac. I don't think these are synced in my backup. This is only a problem if your users are not naming their files with the right extension (.doc, .pdf, …). If you are syncing OSX 10.4 use the Apple provided rsync and not any other (more steady). The main piece if to configure rsnapshot.conf cron # Cron # 0 3 * * 1,2,3,4,5,6,7 /usr/bin/rsnapshot daily; 0 4 1 * * /usr/bin/rsnapshot monthly; # # rsnapshot.conf - rsnapshot configuration file # # # # # PLEASE BE AWARE OF THE FOLLOWING RULES: # # # # This file requires tabs between elements # # # # Directories require a trailing slash: # # right: /home/ # # wrong: /home# # # # ### # CONFIG FILE VERSION # ### config_version 1.2 ### # SNAPSHOT ROOT DIRECTORY # ### # All snapshots will be stored under this root directory. #snapshot_root /var/cache/rsnapshot/ snapshot_root /home/snapshot/ # If no_create_root is enabled, rsnapshot will not automatically create the # snapshot_root directory. This is particularly useful if you are backing # up to removable media, such as a FireWire drive. # #no_create_root 1 # # EXTERNAL PROGRAM DEPENDENCIES # # # LINUX USERS: Be sure to uncomment cmd_cp. This gives you extra features. # EVERYONE ELSE: Leave cmd_cp commented out for compatibility. # # See the README file or the man page for more details. # #cmd_cp /bin/cp # uncomment this to use the rm program instead of the built-in perl routine cmd_rm /bin/rm # rsync must be enabled for anything to work. cmd_rsync /usr/bin/rsync # Uncomment this to enable remote ssh backups over rsync. cmd_ssh /usr/bin/ssh # Comment this out to disable syslog support. cmd_logger /usr/bin/logger # Uncomment this to specify a path to du for disk usage checks. cmd_du /usr/bin/du # # BACKUP INTERVALS# # Must be unique and in ascending order # # i.e. hourly, daily, weekly, etc. # # # The interval names (hourly, daily, ...) are just names and have no influence # on the length of the interval. The numbers set the number of snapshots to # keep for each interval (hourly.0, hourly.1, ...). # The length of the interval is set by the time between two executions of # rsnapshot interval name, this is normally done via cron. # Feel free to adopt the names, and the sample cron file under /etc/ cron.d/rsnapshot # to your needs. The only requirement is that the intervals must be listed # in ascending order. To activate just uncomment the entries. #interval hourly 6 intervaldaily 5 intervalmonthly 1 #interval monthly 6 # GLOBAL OPTIONS # # All are optional, with sensible defaults # # If your version of rsync supports --link-dest, you should enable this. # This is the best way to support special files (FIFOs, etc) cross- platform. # The default is 0 (off). # In Debian GNU cp is available which is superior to link_dest, so it should be # commented
Re: Sorta OT - Backup solutions Mac to FreeBSD
I have been poking around the 'Net a bit looking for an easy to use backup solution for our Mac's (1 mini, 1 powerbook, more in the future). Basically there is a server, offsite (FBSD 6.2) with 2 RAID 5 arrays. I would like to be able to set the 2 (for now) clients to automatically, incrementally backup certain directories, nightly. Something encrypted would be nice aswell. I like Bacula (www.bacula.org) easier to set up than Amanda IMHO, and works with FreeBSD, MacOS X, Windows, and Linux. Full, Differential, and incremental backups, plus encryption. -- Kenny Dail [EMAIL PROTECTED] ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Sorta OT - Backup solutions Mac to FreeBSD
On Mon, Jan 29, 2007 at 12:45:45PM -0700, Kenny Dail wrote: I have been poking around the 'Net a bit looking for an easy to use backup solution for our Mac's (1 mini, 1 powerbook, more in the future). Basically there is a server, offsite (FBSD 6.2) with 2 RAID 5 arrays. I would like to be able to set the 2 (for now) clients to automatically, incrementally backup certain directories, nightly. Something encrypted would be nice aswell. I like Bacula (www.bacula.org) easier to set up than Amanda IMHO, and works with FreeBSD, MacOS X, Windows, and Linux. Full, Differential, and incremental backups, plus encryption. You could use rsyncx over ssh? Google for OS X rsync and you'll find several tutorials. Roland -- R.F.Smith http://www.xs4all.nl/~rsmith/ [plain text _non-HTML_ PGP/GnuPG encrypted/signed email much appreciated] pgp: 1A2B 477F 9970 BA3C 2914 B7CE 1277 EFB0 C321 A725 (KeyID: C321A725) pgpjwrhpsFdor.pgp Description: PGP signature
Re: Sorta OT - Backup solutions Mac to FreeBSD
On Jan 29, 2007, at Monday, Jan29, 2007 12:45 PM, Kenny Dail wrote: I have been poking around the 'Net a bit looking for an easy to use backup solution for our Mac's (1 mini, 1 powerbook, more in the future). Basically there is a server, offsite (FBSD 6.2) with 2 RAID 5 arrays. I would like to be able to set the 2 (for now) clients to automatically, incrementally backup certain directories, nightly. Something encrypted would be nice aswell. Here is a script I run out of crontab on my Mac. Things to note: - Uses tar to create the backup. - Uses rcp to get the backup to the FreeBSD box. Could use scp if security is an issue. - It is a cshell script. - No software to find and install, everything you need is already on your Mac and freeBSD boxes. - I do a primary backup every night; no secondaries. - The script has been in production for about a year now and works flawlessly. - Restores are easy, just reverse the process. - I get an email daily giving me the status of the backup. - The tar file is written to /tmp before it is copied to the backup server so disk space could be an issue. - The tar file could be gziped (tar czf ) to save space at the expense of cpu time. - The log directory contains the status of the last two backups. - The backup server maintains 31 days of primaries. ## #!/bin/csh set LHOST=`hostname` set BASE=/backup_4/$LHOST set INFOPATH=/Users/root/dump_info set RHOST=some.remote.host set RUSER=rmotuser set TARCMD=tar cf set BKUP_DIR=/Users set SUCCESS_SUBJECT=$LHOST primary succeeded set FAIL_SUBJECT=$LHOST primary failed set MAIL_TO=[EMAIL PROTECTED] set SEQFILE=$INFOPATH/Sequence echo *** `date` $LHOST Begin setup for this primary backup echo *** `date` Set sequence number of this dump if(-s $SEQFILE) then set LAST=`cat $SEQFILE` else echo WARNING: $SEQFILE non-existant or 0 size echo Set last sequence to 0 set LAST=0 endif echo *** `date` Last sequence number used: $LAST switch($LAST) case 0: set SEQ=1 breaksw case 1: set SEQ=0 breaksw default: echo WARNING: Dump sequence is invalid: $LAST echoSet dump sequence to 0 set SEQ=0 breaksw endsw echo *** `date` Sequence number of this dump is: $SEQ echo *** `date` Set path variables set INFO=$INFOPATH/primary.$SEQ set FILE=Users_$SEQ.tar set [EMAIL PROTECTED]:$BASE/$FILE set TMPFILE=/var/tmp/$FILE echo Path to backup: $BKUP_DIR echo Log file..: $INFO echo Temporary file: $TMPFILE echo Remote file...: $RFILE echo *** `date` $LHOST Setup for this primary backup complete echo *** `date` $LHOST primary backup begun $INFO echo *** `date` Sequence number of this dump is: $SEQ$INFO echo *** `date` get space used in $BKUP_DIR $INFO du -hs $BKUP_DIR/* $INFO echo *** `date` tar $BKUP_DIR to $TMPFILE$INFO $TARCMD $TMPFILE $BKUP_DIR $INFO set rslt=$status if($rslt != 0) then echo FATAL: tar failed, status=$rslt $INFO set subject=$FAIL_SUBJECT goto pgm_exit endif echo *** `date` Check size of $TMPFILE $INFO ls -l $TMPFILE $INFO echo *** `date` rcp $TMPFILE to $RFILE $INFO rcp $TMPFILE $RFILE $INFO set rslt=$status if($rslt != 0) then echo FATAL: rcp failed, status=$rslt $INFO set subject=$FAIL_SUBJECT goto pgm_exit endif echo *** `date` rm $TMPFILE $INFO rm $TMPFILE $INFO set rslt=$status if($rslt != 0) then echo FATAL: rm failed, status=$rslt $INFO set subject=$FAIL_SUBJECT goto pgm_exit endif set subject=$SUCCESS_SUBJECT echo *** `date` Record sequence number of this dump $INFO echo $SEQ $SEQFILE pgm_exit: echo *** `date` Exit status=$subject $INFO echo *** `date` $LHOST primary backup ended $INFO mail -s $subject $MAIL_TO $INFO exit 0 ### ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Sorta OT - Backup solutions Mac to FreeBSD
I've heard of many people having problems with RsyncX and the version of rsync included in OS X crapping out and being unreliable. RsyncX and the patched rsync (the former being a GUI for the CLI rsync) that ships with OS X attempts to preserve resource forks and other file metadata (a lot of it from the OS 9 era where this stuff mattered). If you don't care at all about these attributes (I don't), I would recommend building a copy of the stock rsync from Macports, similar to FreeBSD ports in design: http://www.macports.org Here is a partial (or possibly complete) list of file metadata that I believe would be lost by using the stock rsync in OS X: - get info/Finder comments (this has been replaced with Spotlight comments in 10.4 which are saved to the Spotlight DB, not as file metadata) - application associations for files without file extensions - application associations for many OS 9 files, since OS 9 did not force file extensions and many users didn't bother with them - custom icons pasted on On Jan 26, 2007, at 5:28 PM, Gable Barber wrote: On 1/26/07, Doug Hardie [EMAIL PROTECTED] wrote: RsyncX for Mac will sync to a FreeBSD filesystem. Thank you. I will try these out. Gable ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions- [EMAIL PROTECTED] PGP.sig Description: This is a digitally signed message part
Re: Sorta OT - Backup solutions Mac to FreeBSD
On Mon, Jan 29, 2007, Joe Auty wrote: I've heard of many people having problems with RsyncX and the version of rsync included in OS X crapping out and being unreliable. RsyncX and the patched rsync (the former being a GUI for the CLI rsync) that ships with OS X attempts to preserve resource forks and other file metadata (a lot of it from the OS 9 era where this stuff mattered). If you don't care at all about these attributes (I don't), I would recommend building a copy of the stock rsync from Macports, similar to FreeBSD ports in design: http://www.macports.org The resource forks matter to some OS X software, in particular the Reunion 8 genealogy program (which may also have issues when run on case sensitive file systems). Reunion is the only OS X program I personally use where this has been an issue (resource forks, not case insensitivity problems). Bill -- INTERNET: [EMAIL PROTECTED] Bill Campbell; Celestial Software LLC URL: http://www.celestial.com/ PO Box 820; 6641 E. Mercer Way FAX:(206) 232-9186 Mercer Island, WA 98040-0820; (206) 236-1676 When I hear a man applauded by the mob I always feel a pang of pity for him. All he has to do to be hissed is to live long enough. -- H.L. Mencken, ``Minority Report'' ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Sorta OT - Backup solutions Mac to FreeBSD
On Jan 29, 2007, at 14:00, Joe Auty wrote: I've heard of many people having problems with RsyncX and the version of rsync included in OS X crapping out and being unreliable. RsyncX and the patched rsync (the former being a GUI for the CLI rsync) that ships with OS X attempts to preserve resource forks and other file metadata (a lot of it from the OS 9 era where this stuff mattered). If you don't care at all about these attributes (I don't), I would recommend building a copy of the stock rsync from Macports, similar to FreeBSD ports in design: http://www.macports.org Here is a partial (or possibly complete) list of file metadata that I believe would be lost by using the stock rsync in OS X: - get info/Finder comments (this has been replaced with Spotlight comments in 10.4 which are saved to the Spotlight DB, not as file metadata) - application associations for files without file extensions - application associations for many OS 9 files, since OS 9 did not force file extensions and many users didn't bother with them - custom icons pasted on I have heard that also. However, I have been using it for backups for about 3 years now and every time the backup disk boots and everything I check works normally. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Sorta OT - Backup solutions Mac to FreeBSD
Amanda works well on MacOSX and FreeBSD. virtual tapes, encrypted backup and (just as important) easy to restore! -- Martin On 1/26/07, Gable Barber [EMAIL PROTECTED] wrote: Hello all, I have been poking around the 'Net a bit looking for an easy to use backup solution for our Mac's (1 mini, 1 powerbook, more in the future). Basically there is a server, offsite (FBSD 6.2) with 2 RAID 5 arrays. I would like to be able to set the 2 (for now) clients to automatically, incrementally backup certain directories, nightly. Something encrypted would be nice aswell. This one looks interesting to me: http://sourceforge.net/projects/areca/ If anyone has used an open source solution for this , I would genuinely appreciate hearing about it. Thanks in advance - Gable Barber ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED] ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Sorta OT - Backup solutions Mac to FreeBSD
Hello all, I have been poking around the 'Net a bit looking for an easy to use backup solution for our Mac's (1 mini, 1 powerbook, more in the future). Basically there is a server, offsite (FBSD 6.2) with 2 RAID 5 arrays. I would like to be able to set the 2 (for now) clients to automatically, incrementally backup certain directories, nightly. Something encrypted would be nice aswell. This one looks interesting to me: http://sourceforge.net/projects/areca/ If anyone has used an open source solution for this , I would genuinely appreciate hearing about it. I don't, but you could use rsync over ssh if you just want a mirrored copy... and if you set up rsync to archive changed files you can keep a history as well. I do that for about 20 servers now and it works great. No reason a mac wouldn't work. Let me know if you're interested in the scripts... ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Sorta OT - Backup solutions Mac to FreeBSD
On 1/26/07, Doug Hardie [EMAIL PROTECTED] wrote: RsyncX for Mac will sync to a FreeBSD filesystem. Thank you. I will try these out. Gable ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
