[BackupPC-users] Backup aborted (SUCCESS - 0 opening remote file.....)
Hi all, my environment: Debian Lenny 5.0.3 BackupPC 3.2.0beta0 I've recompiled Samba to solve the 2 milliseconds timeout issue. All works good (as always :-D), but i've this error with a host (that had an incomplete backup during this new one): 2009-10-18 14:33:44 Got fatal error during xfer (SUCCESS - 0 opening remote file \remote\path\0 (\remote\path\)) 2009-10-18 14:33:49 Backup aborted (SUCCESS - 0 opening remote file \remote\path\0 (\remote\path\)) ... What's wrong? Thanks! Regards M ** -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] pre/post backup script for KVM guests
Hi everyone. I've written a script to backup virtual machines managed by libvirt (only tested with KVM guests, but should works for Xen too, maybe others as well). It's called virt-backup.pl I've written it for integration with BackupPC: - take a dump of a VM in using the pre-backup facility - backup the dumps using BackupPC - cleanup the dumps in the post-backup phase This script can be used outside of BackupPC as it's quite generic. There are two main mode for this script: --pre: take the backup of the VM. This is called --pre because I use it as a pre-backup script for BackupPC --post: cleanup the dumps Here're some functionalities: - no configuration file needed, everything can be passed as command line arg - can take snapshots of virtual disks if they are on LVM Logical volume (the default is to try LVM in any case, if it's not possible, then, just dump the block device/file) - Supports backup of running VM with minimal downtime (if each virtual disks can be snapshoted, just resume the VM immediately resulting in just a few seconds of downtime, then, dump the snapshots. If snapshots are not available, the guest is suspended during the dump) - can save the state of running vm (equivalent of virsh save/virsh restore). This is optional because it's still not very reliable, and sometimes the restoration fails, leaving a crashed qemu process running and eating CPU cycles. - Can compress on-the-fly the virtual disks dumps (gzip,bzip2,pbzip2,lzop,xz) - Support virtual disks exclusions (if you want to backup the system disk of a VM, but not the data one for example) - Can work on installations where virtual disks are stored on one hosts, and guests runs on another on (NFS, iscsi etc... in any case, the script must be run on the host which holds the virtual disks) - Can backup as many guests as you want in one run (they'll be dumped sequentially) - Backups are run with low priority (nice and ionice), so it should'nt slow down too much your system. Here are the dependencies for this script to work - Sys::Virt perl module - XML::Simple per module - Getopt::Long perl module - lvm2 - gzip (optional) - bzip2 (optional) - pbzip2 (optional) - lzop (optional) - xz (optional) You can run this script without argument to see the help. Edit it if you want more informations (there are some examples on how to use it at the beginning of the script). The script can be found here: http://repo.firewall-services.com/misc/virt-backup.pl Regards, Daniel -- Daniel Berteaud FIREWALL-SERVICES SARL. Société de Services en Logiciels Libres Technopôle Montesquieu 33650 MARTILLAC Tel : 05 56 64 15 32 Fax : 05 56 64 15 32 Mail: dan...@firewall-services.com Web : http://www.firewall-services.com -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] pre/post backup script for KVM guests
Very handy, Daniel, thank you. Why do it this way? That is, why not back up the VMs like any other server? Regards, Tyler On Monday 19 October 2009 14:02:58 Daniel Berteaud wrote: Hi everyone. I've written a script to backup virtual machines managed by libvirt (only tested with KVM guests, but should works for Xen too, maybe others as well). It's called virt-backup.pl I've written it for integration with BackupPC: - take a dump of a VM in using the pre-backup facility - backup the dumps using BackupPC - cleanup the dumps in the post-backup phase This script can be used outside of BackupPC as it's quite generic. There are two main mode for this script: --pre: take the backup of the VM. This is called --pre because I use it as a pre-backup script for BackupPC --post: cleanup the dumps Here're some functionalities: - no configuration file needed, everything can be passed as command line arg - can take snapshots of virtual disks if they are on LVM Logical volume (the default is to try LVM in any case, if it's not possible, then, just dump the block device/file) - Supports backup of running VM with minimal downtime (if each virtual disks can be snapshoted, just resume the VM immediately resulting in just a few seconds of downtime, then, dump the snapshots. If snapshots are not available, the guest is suspended during the dump) - can save the state of running vm (equivalent of virsh save/virsh restore). This is optional because it's still not very reliable, and sometimes the restoration fails, leaving a crashed qemu process running and eating CPU cycles. - Can compress on-the-fly the virtual disks dumps (gzip,bzip2,pbzip2,lzop,xz) - Support virtual disks exclusions (if you want to backup the system disk of a VM, but not the data one for example) - Can work on installations where virtual disks are stored on one hosts, and guests runs on another on (NFS, iscsi etc... in any case, the script must be run on the host which holds the virtual disks) - Can backup as many guests as you want in one run (they'll be dumped sequentially) - Backups are run with low priority (nice and ionice), so it should'nt slow down too much your system. Here are the dependencies for this script to work - Sys::Virt perl module - XML::Simple per module - Getopt::Long perl module - lvm2 - gzip (optional) - bzip2 (optional) - pbzip2 (optional) - lzop (optional) - xz (optional) You can run this script without argument to see the help. Edit it if you want more informations (there are some examples on how to use it at the beginning of the script). The script can be found here: http://repo.firewall-services.com/misc/virt-backup.pl Regards, Daniel -- I have never killed a man, but I have read many obituaries with great pleasure. -- Clarence Darrow -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Backup aborted (SUCCESS - 0 opening remote file.....)
Mirco writes: 2009-10-18 14:33:44 Got fatal error during xfer (SUCCESS - 0 opening remote file \remote\path\0 (\remote\path\)) Try running a Windowns error check on that disk. Craig -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] pre/post backup script for KVM guests
Le lundi 19 octobre 2009 à 14:36 +0100, Tyler J. Wagner a écrit : Very handy, Daniel, thank you. Why do it this way? That is, why not back up the VMs like any other server? I do both. Backup the VM at the file system level, like any other real server, but I also backup the VM at the block device level, because it provides a very easy/fast disaster recovery mecanism. If the --state flag is present, I can restore the guest in the exact state it was when the backup was made (including running programs, opened files etc...). Without the --state flag, I can restore it, just as if the guest had crashed (power failure). Regards Regards, Tyler On Monday 19 October 2009 14:02:58 Daniel Berteaud wrote: Hi everyone. I've written a script to backup virtual machines managed by libvirt (only tested with KVM guests, but should works for Xen too, maybe others as well). It's called virt-backup.pl I've written it for integration with BackupPC: - take a dump of a VM in using the pre-backup facility - backup the dumps using BackupPC - cleanup the dumps in the post-backup phase This script can be used outside of BackupPC as it's quite generic. There are two main mode for this script: --pre: take the backup of the VM. This is called --pre because I use it as a pre-backup script for BackupPC --post: cleanup the dumps Here're some functionalities: - no configuration file needed, everything can be passed as command line arg - can take snapshots of virtual disks if they are on LVM Logical volume (the default is to try LVM in any case, if it's not possible, then, just dump the block device/file) - Supports backup of running VM with minimal downtime (if each virtual disks can be snapshoted, just resume the VM immediately resulting in just a few seconds of downtime, then, dump the snapshots. If snapshots are not available, the guest is suspended during the dump) - can save the state of running vm (equivalent of virsh save/virsh restore). This is optional because it's still not very reliable, and sometimes the restoration fails, leaving a crashed qemu process running and eating CPU cycles. - Can compress on-the-fly the virtual disks dumps (gzip,bzip2,pbzip2,lzop,xz) - Support virtual disks exclusions (if you want to backup the system disk of a VM, but not the data one for example) - Can work on installations where virtual disks are stored on one hosts, and guests runs on another on (NFS, iscsi etc... in any case, the script must be run on the host which holds the virtual disks) - Can backup as many guests as you want in one run (they'll be dumped sequentially) - Backups are run with low priority (nice and ionice), so it should'nt slow down too much your system. Here are the dependencies for this script to work - Sys::Virt perl module - XML::Simple per module - Getopt::Long perl module - lvm2 - gzip (optional) - bzip2 (optional) - pbzip2 (optional) - lzop (optional) - xz (optional) You can run this script without argument to see the help. Edit it if you want more informations (there are some examples on how to use it at the beginning of the script). The script can be found here: http://repo.firewall-services.com/misc/virt-backup.pl Regards, Daniel -- Daniel Berteaud FIREWALL-SERVICES SARL. Société de Services en Logiciels Libres Technopôle Montesquieu 33650 MARTILLAC Tel : 05 56 64 15 32 Fax : 05 56 64 15 32 Mail: dan...@firewall-services.com Web : http://www.firewall-services.com -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] Full Backups Only
Hi Guys I'd like to only do Full backups once a week (and only keep 2 full backups ant any one time) and I'm a little unsure of what I should set the scheduling settings to. Could someone please suggest to me the correct Schedule settings? Thanks Mark -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Full Backups Only
I’d like to only do Full backups once a week (and only keep 2 full backups
ant any one time) and I’m a little unsure of what I should set the
scheduling settings to.
This is probably more than necessary, but you're looking for something like
$Conf{FullPeriod} = 6.97;
$Conf{FullKeepCnt} = 2;
$Conf{FullKeepCntMin} = 2;
$Conf{IncrKeepCnt} = 0;
$Conf{IncrKeepCntMin} = 0;
$Conf{IncrAgeMax}= 0;
$Conf{IncrLevels} = 0;
--
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
[BackupPC-users] request for comment
I am trying to figure out a set of scripts to get a reliable offsite backup of a client's backuppc (300GB pool). I've read a lot of the older posts and I'm aware of some of the issues. At the moment we have a backuppc install running at an office. We have a second backuppc offsite. This works pretty well but there are a lot of problems backing up the various clients because they aren't always online late at night. So this is a wild attempt to get a fast rsync backup of each client offsite into a second backuppc program (so you have all of the great benefits of checking on progress etc). I am trying to avoid tars archives that take a long time to transfer. Tape backups haven't worked. I've read large rsyncs don't work with a lot of files. Please give feedback if there is a better way to accomplish this, if I'm overlooking anything etc. Thanks. I am thinking the offsite backuppc will run a script before the backup of a client. 1. It would take the latest backup for the client and expand it into a temp dir. This would serve as a snapshot of what the client machine looked like last week. 2. It will look at the backuppc's dirs at the onsite install and determine the latest backup in that pc's dir. It might use the second to the last backup to avoid issues if a backup is in progress. 3. It will rsync that dir with the files in the temp dir to create an updated snapshot of the machine. 4. The backup for the client would run on that temp dir. Once the backup is complete the temp dir would be cleared to make space for another client. Thanks for any comments/help. Ryan -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] request for comment
On Mon, Oct 19, 2009 at 04:51:08PM -0700, Ryan Jewell wrote: I am trying to figure out a set of scripts to get a reliable offsite backup of a client's backuppc (300GB pool). I've read a lot of the older posts and I'm aware of some of the issues. At the moment we have a backuppc install running at an office. We have a second backuppc offsite. This works pretty well but there are a lot of problems backing up the various clients because they aren't always online late at night. So this is a wild attempt to get a fast rsync Are you aware of the BlackoutPeriods, BlackoutBadPingLimit, and BlackoutGoodCnt settings? They are designed to ensure that machines get backed up, even if they are not left on overnight. -Rob -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Full Backups Only
Great thanks for that, what about IncrPeriod? Should I make that 0 also?
-Original Message-
From: Robert Kosinski [mailto:robert.kosin...@gmail.com]
Sent: Tuesday, 20 October 2009 8:58 AM
To: General list for user discussion, questions and support
Subject: Re: [BackupPC-users] Full Backups Only
I'd like to only do Full backups once a week (and only keep 2 full backups
ant any one time) and I'm a little unsure of what I should set the
scheduling settings to.
This is probably more than necessary, but you're looking for something like
$Conf{FullPeriod} = 6.97;
$Conf{FullKeepCnt} = 2;
$Conf{FullKeepCntMin} = 2;
$Conf{IncrKeepCnt} = 0;
$Conf{IncrKeepCntMin} = 0;
$Conf{IncrAgeMax}= 0;
$Conf{IncrLevels} = 0;
--
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
--
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Full Backups Only
I think setting IncrLevels to 0 negates IncrPeriod, so it wouldn't
matter. Like I said, half that stuff probably isn't necessary. I
copy/pasted it from a setup of mine that pretty much does exactly what
you want, with the exception of mine keeping one backup instead of
two. I never bothered pruning once I found something that worked.
On Mon, Oct 19, 2009 at 9:20 PM, Mark Wass m...@market-analyst.com wrote:
Great thanks for that, what about IncrPeriod? Should I make that 0 also?
-Original Message-
From: Robert Kosinski [mailto:robert.kosin...@gmail.com]
Sent: Tuesday, 20 October 2009 8:58 AM
To: General list for user discussion, questions and support
Subject: Re: [BackupPC-users] Full Backups Only
I'd like to only do Full backups once a week (and only keep 2 full backups
ant any one time) and I'm a little unsure of what I should set the
scheduling settings to.
This is probably more than necessary, but you're looking for something like
$Conf{FullPeriod} = 6.97;
$Conf{FullKeepCnt} = 2;
$Conf{FullKeepCntMin} = 2;
$Conf{IncrKeepCnt} = 0;
$Conf{IncrKeepCntMin} = 0;
$Conf{IncrAgeMax}= 0;
$Conf{IncrLevels} = 0;
--
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
--
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
--
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
