[BackupPC-users] automated off-site backup (via BackupPC_archiveStart or restore)
Hello all, sorry if this questions has been asked several times, but I cannot find the information I need to make a decision. So because of the number of hard links you can't just rsync the data pool or anything so the best option to send your backuppc server's data offsite is through the archive or restore scripts (correct me if I am wrong). Please give me advice on which option might be best (I plan to restore to a sshfs from rsync.net or something). I am assuming archive is best because it creates a tar, gz, or bz2 file from the archive (ability to compress). I tried using the archive from command line option on backuppc docshttp://backuppc.sourceforge.net/faq/BackupPC.html#starting_an_archive_from_the_command_linewebpage but it has limited info and no examples. Please advise, Shaun Curry BS-InformationTechnology 936.718.2175 -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] automated off-site backup (via BackupPC_archiveStart or restore)
Shaun Curry wrote: Hello all, sorry if this questions has been asked several times, but I cannot find the information I need to make a decision. So because of the number of hard links you can't just rsync the data pool or anything so the best option to send your backuppc server's data offsite is through the archive or restore scripts (correct me if I am wrong). Whether or not it is practical to rsync -H the pool and pc directories will depend on how big your archive is (more on the number of files than the size), how much RAM you have, and what version of rsync you use (3.x is more effecient). Please give me advice on which option might be best (I plan to restore to a sshfs from rsync.net http://rsync.net or something). I am assuming archive is best because it creates a tar, gz, or bz2 file from the archive (ability to compress). I tried using the archive from command line option on backuppc docs http://backuppc.sourceforge.net/faq/BackupPC.html#starting_an_archive_from_the_command_line webpage but it has limited info and no examples. You should probably just use BackupPC_tarCreate directly if you are going to make an archive from the command line. -- Les Mikesell lesmikes...@gmail.com -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] automated off-site backup (via BackupPC_archiveStart or restore)
Thanks Les for this. Does anyone have a working rsync with -H option over a sshfs? I have been trying this all afternoon with much difficulty. First I was getting errors about chown permissions (Worked through - mounted sshfs as root user), now I am getting a strange error: rsync: link /backup/pool/backuppc/pc/10.0.0.99/0/fshare/fdrivers/fDell - 720/fWin_XP2K/fdlbcw2k.inf = backuppc/pc/10.0.0.99/0/fshare/fdrivers/fDell- 720/fWin_XP2K/fdlbcw2k.ini failed: Function not implemented (38) rsync: connection unexpectedly closed (2914 bytes received so far) [sender] rsync error: error in rsync protocol data stream (code 12) at io.c(600) [sender=3.0.5] I am running this command::~# rsync -avH /var/lib/backuppc /backup/pool/ I have no problem working through my errs but if someone is currently implementing this and it works please let me know how you accomplished it! thanks in advance On Mon, Aug 10, 2009 at 11:52 AM, Les Mikesell lesmikes...@gmail.comwrote: Shaun Curry wrote: Hello all, sorry if this questions has been asked several times, but I cannot find the information I need to make a decision. So because of the number of hard links you can't just rsync the data pool or anything so the best option to send your backuppc server's data offsite is through the archive or restore scripts (correct me if I am wrong). Whether or not it is practical to rsync -H the pool and pc directories will depend on how big your archive is (more on the number of files than the size), how much RAM you have, and what version of rsync you use (3.x is more effecient). Please give me advice on which option might be best (I plan to restore to a sshfs from rsync.net http://rsync.net or something). I am assuming archive is best because it creates a tar, gz, or bz2 file from the archive (ability to compress). I tried using the archive from command line option on backuppc docs http://backuppc.sourceforge.net/faq/BackupPC.html#starting_an_archive_from_the_command_line webpage but it has limited info and no examples. You should probably just use BackupPC_tarCreate directly if you are going to make an archive from the command line. -- Les Mikesell lesmikes...@gmail.com -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ -- Shaun Curry BS-InformationTechnology 936.718.2175 -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] automated off-site backup (via BackupPC_archiveStart or restore)
Hi, On Mon, Aug 10, 2009 at 16:00, Shaun Curryscur...@gmail.com wrote: Thanks Les for this. Does anyone have a working rsync with -H option over a sshfs? You are making this harder than it has to be... rsync supports doing a transfer over the network using SSH as a transport. Instead of mounting the filesystem as SSHFS and then doing rsync local local, do not mount anything and use rsync local remote, it will use SSH by default. If you want to do that in a cron job or something like that, you can set up SSH keys to do the authentication without user interaction. I am running this command::~# rsync -avH /var/lib/backuppc /backup/pool/ Run instead: # rsync -avH /var/lib/backuppc remote.host.domain.name:/path/to/backup/pool/ Where obviously remote.host.domain.name:/path/to/backup/pool/ is what you have mounted under /backup/pool/ using SSHFS on your local machine... HTH, Filipe -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] automated off-site backup (via BackupPC_archiveStart or restore)
Shaun Curry wrote: Thanks Les for this. Does anyone have a working rsync with -H option over a sshfs? The concept doesn't make very much sense. If you mount a remote site via sshfs and run rsync locally it's going to have to read all of the remote data through the filesystem mount for comparison and not save you any bandwidth with the remote block-checksum technique. I have been trying this all afternoon with much difficulty. First I was getting errors about chown permissions (Worked through - mounted sshfs as root user), now I am getting a strange error: rsync: link /backup/pool/backuppc/pc/10.0.0.99/0/fshare/fdrivers/fDell http://10.0.0.99/0/fshare/fdrivers/fDell - 720/fWin_XP2K/fdlbcw2k.inf = backuppc/pc/10.0.0.99/0/fshare/fdrivers/fDell http://10.0.0.99/0/fshare/fdrivers/fDell - 720/fWin_XP2K/fdlbcw2k.ini failed: Function not implemented (38) I think that means that hardlinks don't work over sshfs. -- Les Mikesell lesmikes...@gmail.com -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] automated off-site backup (via BackupPC_archiveStart or restore)
Les Mikesell wrote: Shaun Curry wrote: Thanks Les for this. Does anyone have a working rsync with -H option over a sshfs? The concept doesn't make very much sense. If you mount a remote site via sshfs and run rsync locally it's going to have to read all of the remote data through the filesystem mount for comparison and not save you any bandwidth with the remote block-checksum technique. That's why you should use the '-W' option with rsync. It says don't use the magic rsync algorithm. I think rsync is great but in cases when you have only new files or files that change completely, the rsync algorithm doesn't do anything for you that I can see. -- Jon Forrest Research Computing Support College of Chemistry 173 Tan Hall University of California Berkeley Berkeley, CA 94720-1460 510-643-1032 jlforr...@berkeley.edu -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] automated off-site backup (via BackupPC_archiveStart or restore)
oh right, my bad (feel like a n00b)... thanks Filipe, and Les that worked...(now to wipe my system and try to restore) thanks all again! On Mon, Aug 10, 2009 at 3:40 PM, Filipe Brandenburger filbran...@gmail.comwrote: Hi, On Mon, Aug 10, 2009 at 16:00, Shaun Curryscur...@gmail.com wrote: Thanks Les for this. Does anyone have a working rsync with -H option over a sshfs? You are making this harder than it has to be... rsync supports doing a transfer over the network using SSH as a transport. Instead of mounting the filesystem as SSHFS and then doing rsync local local, do not mount anything and use rsync local remote, it will use SSH by default. If you want to do that in a cron job or something like that, you can set up SSH keys to do the authentication without user interaction. I am running this command::~# rsync -avH /var/lib/backuppc /backup/pool/ Run instead: # rsync -avH /var/lib/backuppc remote.host.domain.name: /path/to/backup/pool/ Where obviously remote.host.domain.name:/path/to/backup/pool/ is what you have mounted under /backup/pool/ using SSHFS on your local machine... HTH, Filipe -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ -- Shaun Curry BS-InformationTechnology 936.718.2175 -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/