[BackupPC-users] Discrepant file size reports of backups
Hi, we have a problem with our backuppc server. The disk is almost full, but the reported size of the backups is much less. Additionally, the pool is reported to be empty in the CGI. I tried to set all backups (full and incremental) to a minimum and maximum number of one and run a nightly cleanup. No data is deleted at all, the pool is reported to be emtpy. Can someone explain why the reported sizes (see below) are that different? Is there orphaned data in the pool directory and how can I clean it? Any other ideas? OS: Ubuntu Server 8.04 LTS Backuppc 3.0.0 $Conf{TopDir} = '/usr/share/backuppc/data'; $Conf{ConfDir} = '/etc/backuppc'; $Conf{LogDir} = ''; $Conf{InstallDir} = '/usr/share/backuppc'; $Conf{CgiDir} = '/usr/share/backuppc/cgi-bin'; This is what the host summary shows on top: * 19 full backups of total size 274.58GB (prior to pooling and compression), * 13 incr backups of total size 24.86GB (prior to pooling and compression). r...@server:/var/lib/backuppc# du -h --max-depth=1 4.0K./.ssh 8.7M./pc 96K ./log 1.2T./pool 4.0K./cpool 4.0K./trash 1.2T r...@server:/usr/share/backuppc# du -h --max-depth=1 4.0K./doc 176K./image 332K./bin 964K./lib 169G./data 8.0K./cgi-bin 169G. regards Stefan signature.asc Description: Dies ist ein digital signierter Nachrichtenteil -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Discrepant file size reports of backups
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Stefan Dürrenberger wrote: > $Conf{TopDir} = '/usr/share/backuppc/data'; > r...@server:/var/lib/backuppc# du -h --max-depth=1 > r...@server:/usr/share/backuppc# du -h --max-depth=1 Are you using the backuppc deb from ubuntu? If so, you seem to have modified topdir incorrectly. the pool, cpool and pc directories *must* all reside on the same filesystem. Also, you can't simply change topdir in the config file. Regards, Adam -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.9 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEARECAAYFAkrW8ywACgkQGyoxogrTyiWovgCcDBWDihYLUM95+6BHmM/6okPZ uu8An1dV1T0aAq5hS3gFluSz6FOAnHnX =L3k1 -END PGP SIGNATURE- -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Discrepant file size reports of backups
Hi, Adam Goryachev wrote on 2009-10-15 21:02:24 +1100 [Re: [BackupPC-users] Discrepant file size reports of backups]: > Stefan Dürrenberger wrote: > > $Conf{TopDir} = '/usr/share/backuppc/data'; > > r...@server:/var/lib/backuppc# du -h --max-depth=1 > > r...@server:/usr/share/backuppc# du -h --max-depth=1 > > Are you using the backuppc deb from ubuntu? If so, you seem to have > modified topdir incorrectly. that seems to be the case, judging from the du output. > the pool, cpool and pc directories *must* all reside on the same > filesystem. Also, you can't simply change topdir in the config file. See https://sourceforge.net/apps/mediawiki/backuppc/index.php?title=Change_archive_directory for details. Regards, Holger -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Diskshadow and Exchange 2007
I have a backup script for this if anyone needs it. David From: Palmer, David W. [mailto:dwpal...@cazenovia.edu] Sent: Wednesday, October 14, 2009 3:37 PM To: 'General list for user discussion, questions and support' Subject: [BackupPC-users] Diskshadow and Exchange 2007 Hello, Is anyone using diskshadow and exchange 2007 for backups? If so what files are you backing up? Do you backup just the database or the logs too? David -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Diskshadow and Exchange 2007
I am interested in this script! -Original Message- From: Palmer, David W. [mailto:dwpal...@cazenovia.edu] Sent: Thu 10/15/2009 8:46 AM To: 'General list for user discussion, questions and support' Subject: Re: [BackupPC-users] Diskshadow and Exchange 2007 I have a backup script for this if anyone needs it. David From: Palmer, David W. [mailto:dwpal...@cazenovia.edu] Sent: Wednesday, October 14, 2009 3:37 PM To: 'General list for user discussion, questions and support' Subject: [BackupPC-users] Diskshadow and Exchange 2007 Hello, Is anyone using diskshadow and exchange 2007 for backups? If so what files are you backing up? Do you backup just the database or the logs too? David <>-- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Diskshadow and Exchange 2007
I, too, am interested. On Thu, Oct 15, 2009 at 10:09 AM, Nick Hadaway wrote: > I am interested in this script! > > > -Original Message- > From: Palmer, David W. [mailto:dwpal...@cazenovia.edu] > Sent: Thu 10/15/2009 8:46 AM > To: 'General list for user discussion, questions and support' > Subject: Re: [BackupPC-users] Diskshadow and Exchange 2007 > > I have a backup script for this if anyone needs it. > > David > > > > From: Palmer, David W. [mailto:dwpal...@cazenovia.edu] > Sent: Wednesday, October 14, 2009 3:37 PM > To: 'General list for user discussion, questions and support' > Subject: [BackupPC-users] Diskshadow and Exchange 2007 > > Hello, > > Is anyone using diskshadow and exchange 2007 for backups? If so what files > are you backing up? Do you backup just the database or the logs too? > > David > > > > > -- > Come build with us! The BlackBerry(R) Developer Conference in SF, CA > is the only developer event you need to attend this year. Jumpstart your > developing skills, take BlackBerry mobile applications to market and stay > ahead of the curve. Join us from November 9 - 12, 2009. Register now! > http://p.sf.net/sfu/devconference > ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List: https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki: http://backuppc.wiki.sourceforge.net > Project: http://backuppc.sourceforge.net/ > > -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] BackupPC and power saving
On Tue, Oct 13, 2009 at 12:28 PM, dan wrote: > 1)boot on bios power-on schedule > 2)let backuppc process all backups. should automatically happen due to the > wakeup schedule though I would shorten that period. > 3)run a script to determine if backuppc is doing a backup, if so then sleep > for your wakeup schedule + 1 minute, if not then execute backuppc nightly > 4)trigger a shutdown when backuppc nightly completes. I built a surprisingly simple proof of concept around the above flow, and it looks like the idea is valid. There are still bugs to track down and race conditions to examine, but I don't think it's too early to call the idea of "BackupPC Green" a success. Some followup questions: Does "activeJob" still equal 1 during the link stage? I'm having trouble catching a backup when it's doing so. Speaking of "activeJob", I haven't found a way to answer the question "Are any hosts active?" Using BackupPC_serverMesg status hosts doesn't work because trashClean always reports itself as active. Is there any other criterion I could use to examine all possible jobs to see if any are active? My proof of concept only examined a single host. -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] BackupPC and power saving
On Thu, Oct 15, 2009 at 11:20:10AM -0400, Robert Kosinski wrote: > > 1)boot on bios power-on schedule > > 2)let backuppc process all backups. should automatically happen due to the > > wakeup schedule though I would shorten that period. > > 3)run a script to determine if backuppc is doing a backup, if so then sleep > > for your wakeup schedule + 1 minute, if not then execute backuppc nightly > > 4)trigger a shutdown when backuppc nightly completes. > > I built a surprisingly simple proof of concept around the above flow, > and it looks like the idea is valid. There are still bugs to track > down and race conditions to examine, but I don't think it's too early > to call the idea of "BackupPC Green" a success. > > Some followup questions: > > Does "activeJob" still equal 1 during the link stage? I'm having > trouble catching a backup when it's doing so. I just catched a host in link stage and it has activeJob=1: "myhost" => {"lastGoodBackupTime" => "1255622063","deadCnt" => 0,"reason" => "Reason_backup_done","activeJob" => 1,"state" => "Status_link_running","aliveCnt" => 575,"endTime" => "1255622063","needLink" => 0,"startTime" => "1255611675","type" => "incr","userReq" => undef}, > Speaking of "activeJob", I haven't found a way to answer the question > "Are any hosts active?" Using BackupPC_serverMesg status hosts doesn't > work because trashClean always reports itself as active. Is there any > other criterion I could use to examine all possible jobs to see if any > are active? My proof of concept only examined a single host. Maybe you could better use "status jobs" instead? It looks like this: %Jobs = ( " admin " => {"cmd" => "/path/to/BackupPC-3.1.0/bin/BackupPC_nightly -m 192 255", "reqTime" => "1255622404","mesg" => "","pid" => 29003,"fh" => *::FH, "user" => "BackupPC","startTime" => "1255622404","type" => undef,"fn" => 7}, " trashClean " => {"cmd" => "/path/to/BackupPC-3.1.0/bin/BackupPC_trashClean", "reqTime" => "1234604612","mesg" => "","pid" => 6293,"fh" => *::FH, "user" => "BackupPC","processState" => "running","startTime" => "1234604612", "type" => undef,"fn" => 5}, "myhost" => {"cmd" => "/path/to/BackupPC-3.1.0/bin/BackupPC_link myhost", "reqTime" => "1255622063","pid" => 28848,"fh" => *::FH, "user" => "BackupPC","startTime" => "1255622063","type" => "incr", "fn" => 6}); -> So just use the result as the perl hash it is, remove the trashClean entry (which is not critical to interrupt at any time) and check the size of the resulting hash. HTH, Tino. -- "What we nourish flourishes." - "Was wir nähren erblüht." www.lichtkreis-chemnitz.de www.craniosacralzentrum.de -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] BackupPC and power saving
On Thu, Oct 15, 2009 at 12:15 PM, Tino Schwarze wrote: > Maybe you could better use "status jobs" instead? Thanks. That's definitely a superior idea. I used this logic to determine if a job is running: BackupPC_serverMesg status jobs|awk -F } '{print $2}' If only trashClean is running, the above evaluates to ");" (without quotes), which is the end of the status statement. If one or more backup jobs are running, job text will appear. Therefore, I simply wait for the expression to evaluate ");". -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Diskshadow and Exchange 2007
Ok I will clean up the scripts and post. David -Original Message- From: Robert Kosinski [mailto:robert.kosin...@gmail.com] Sent: Thursday, October 15, 2009 11:09 AM To: General list for user discussion, questions and support Subject: Re: [BackupPC-users] Diskshadow and Exchange 2007 I, too, am interested. On Thu, Oct 15, 2009 at 10:09 AM, Nick Hadaway wrote: > I am interested in this script! > > > -Original Message- > From: Palmer, David W. [mailto:dwpal...@cazenovia.edu] > Sent: Thu 10/15/2009 8:46 AM > To: 'General list for user discussion, questions and support' > Subject: Re: [BackupPC-users] Diskshadow and Exchange 2007 > > I have a backup script for this if anyone needs it. > > David > > > > From: Palmer, David W. [mailto:dwpal...@cazenovia.edu] > Sent: Wednesday, October 14, 2009 3:37 PM > To: 'General list for user discussion, questions and support' > Subject: [BackupPC-users] Diskshadow and Exchange 2007 > > Hello, > > Is anyone using diskshadow and exchange 2007 for backups? If so what files > are you backing up? Do you backup just the database or the logs too? > > David > > > > > -- > Come build with us! The BlackBerry(R) Developer Conference in SF, CA > is the only developer event you need to attend this year. Jumpstart your > developing skills, take BlackBerry mobile applications to market and stay > ahead of the curve. Join us from November 9 - 12, 2009. Register now! > http://p.sf.net/sfu/devconference > ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List: https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki: http://backuppc.wiki.sourceforge.net > Project: http://backuppc.sourceforge.net/ > > -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/