[BackupPC-users] Discrepant file size reports of backups

2009-10-15 Thread Stefan Dürrenberger
Hi,
we have a problem with our backuppc server. The disk is almost full, but
the reported size of the backups is much less. Additionally, the pool is
reported to be empty in the CGI.

I tried to set all backups (full and incremental) to a minimum and
maximum number of one and run a nightly cleanup. No data is deleted at
all, the pool is reported to be emtpy. 
Can someone explain why the reported sizes (see below) are that
different? Is there orphaned data in the pool directory and how can I
clean it? Any other ideas?


OS: Ubuntu Server 8.04 LTS
Backuppc 3.0.0

$Conf{TopDir} = '/usr/share/backuppc/data';
$Conf{ConfDir} = '/etc/backuppc';
$Conf{LogDir} = '';
$Conf{InstallDir} = '/usr/share/backuppc';
$Conf{CgiDir} = '/usr/share/backuppc/cgi-bin';


This is what the host summary shows on top:
*  19 full backups of total size 274.58GB (prior to pooling and
  compression),
* 13 incr backups of total size 24.86GB (prior to pooling and
  compression).


r...@server:/var/lib/backuppc# du -h --max-depth=1
4.0K./.ssh
8.7M./pc
96K ./log
1.2T./pool
4.0K./cpool
4.0K./trash
1.2T 


r...@server:/usr/share/backuppc# du -h --max-depth=1
4.0K./doc
176K./image
332K./bin
964K./lib
169G./data
8.0K./cgi-bin
169G.


regards

Stefan



signature.asc
Description: Dies ist ein digital signierter Nachrichtenteil
--
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay 
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Discrepant file size reports of backups

2009-10-15 Thread Adam Goryachev
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Stefan Dürrenberger wrote:
> $Conf{TopDir} = '/usr/share/backuppc/data';
> r...@server:/var/lib/backuppc# du -h --max-depth=1
> r...@server:/usr/share/backuppc# du -h --max-depth=1

Are you using the backuppc deb from ubuntu? If so, you seem to have
modified topdir incorrectly.

the pool, cpool and pc directories *must* all reside on the same
filesystem. Also, you can't simply change topdir in the config file.

Regards,
Adam
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.9 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iEYEARECAAYFAkrW8ywACgkQGyoxogrTyiWovgCcDBWDihYLUM95+6BHmM/6okPZ
uu8An1dV1T0aAq5hS3gFluSz6FOAnHnX
=L3k1
-END PGP SIGNATURE-

--
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay 
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Discrepant file size reports of backups

2009-10-15 Thread Holger Parplies
Hi,

Adam Goryachev wrote on 2009-10-15 21:02:24 +1100 [Re: [BackupPC-users] 
Discrepant file size reports of backups]:
> Stefan Dürrenberger wrote:
> > $Conf{TopDir} = '/usr/share/backuppc/data';
> > r...@server:/var/lib/backuppc# du -h --max-depth=1
> > r...@server:/usr/share/backuppc# du -h --max-depth=1
> 
> Are you using the backuppc deb from ubuntu? If so, you seem to have
> modified topdir incorrectly.

that seems to be the case, judging from the du output.

> the pool, cpool and pc directories *must* all reside on the same
> filesystem. Also, you can't simply change topdir in the config file.

See

https://sourceforge.net/apps/mediawiki/backuppc/index.php?title=Change_archive_directory

for details.

Regards,
Holger

--
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay 
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Diskshadow and Exchange 2007

2009-10-15 Thread Palmer, David W.
I have a backup script for this if anyone needs it.

David



From: Palmer, David W. [mailto:dwpal...@cazenovia.edu]
Sent: Wednesday, October 14, 2009 3:37 PM
To: 'General list for user discussion, questions and support'
Subject: [BackupPC-users] Diskshadow and Exchange 2007

Hello,

Is anyone using diskshadow and exchange 2007 for backups? If so what files are 
you backing up? Do you backup just the database or the logs too?

David


--
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay 
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Diskshadow and Exchange 2007

2009-10-15 Thread Nick Hadaway
I am interested in this script!


-Original Message-
From: Palmer, David W. [mailto:dwpal...@cazenovia.edu]
Sent: Thu 10/15/2009 8:46 AM
To: 'General list for user discussion,  questions and support'
Subject: Re: [BackupPC-users] Diskshadow and Exchange 2007
 
I have a backup script for this if anyone needs it.

David



From: Palmer, David W. [mailto:dwpal...@cazenovia.edu]
Sent: Wednesday, October 14, 2009 3:37 PM
To: 'General list for user discussion, questions and support'
Subject: [BackupPC-users] Diskshadow and Exchange 2007

Hello,

Is anyone using diskshadow and exchange 2007 for backups? If so what files are 
you backing up? Do you backup just the database or the logs too?

David



<>--
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay 
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Diskshadow and Exchange 2007

2009-10-15 Thread Robert Kosinski
I, too, am interested.

On Thu, Oct 15, 2009 at 10:09 AM, Nick Hadaway
 wrote:
> I am interested in this script!
>
>
> -Original Message-
> From: Palmer, David W. [mailto:dwpal...@cazenovia.edu]
> Sent: Thu 10/15/2009 8:46 AM
> To: 'General list for user discussion,  questions and support'
> Subject: Re: [BackupPC-users] Diskshadow and Exchange 2007
>
> I have a backup script for this if anyone needs it.
>
> David
>
>
>
> From: Palmer, David W. [mailto:dwpal...@cazenovia.edu]
> Sent: Wednesday, October 14, 2009 3:37 PM
> To: 'General list for user discussion, questions and support'
> Subject: [BackupPC-users] Diskshadow and Exchange 2007
>
> Hello,
>
> Is anyone using diskshadow and exchange 2007 for backups? If so what files 
> are you backing up? Do you backup just the database or the logs too?
>
> David
>
>
>
>
> --
> Come build with us! The BlackBerry(R) Developer Conference in SF, CA
> is the only developer event you need to attend this year. Jumpstart your
> developing skills, take BlackBerry mobile applications to market and stay
> ahead of the curve. Join us from November 9 - 12, 2009. Register now!
> http://p.sf.net/sfu/devconference
> ___
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:    http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
>
>

--
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay 
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] BackupPC and power saving

2009-10-15 Thread Robert Kosinski
On Tue, Oct 13, 2009 at 12:28 PM, dan  wrote:

> 1)boot on bios power-on schedule
> 2)let backuppc process all backups.  should automatically happen due to the
> wakeup schedule though I would shorten that period.
> 3)run a script to determine if backuppc is doing a backup, if so then sleep
> for your wakeup schedule + 1 minute, if not then execute backuppc nightly
> 4)trigger a shutdown when backuppc nightly completes.

I built a surprisingly simple proof of concept around the above flow,
and it looks like the idea is valid. There are still bugs to track
down and race conditions to examine, but I don't think it's too early
to call the idea of "BackupPC Green" a success.

Some followup questions:

Does "activeJob" still equal 1 during the link stage? I'm having
trouble catching a backup when it's doing so.

Speaking of "activeJob", I haven't found a way to answer the question
"Are any hosts active?" Using BackupPC_serverMesg status hosts doesn't
work because trashClean always reports itself as active. Is there any
other criterion I could use to examine all possible jobs to see if any
are active? My proof of concept only examined a single host.

--
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay 
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] BackupPC and power saving

2009-10-15 Thread Tino Schwarze
On Thu, Oct 15, 2009 at 11:20:10AM -0400, Robert Kosinski wrote:

> > 1)boot on bios power-on schedule
> > 2)let backuppc process all backups.  should automatically happen due to the
> > wakeup schedule though I would shorten that period.
> > 3)run a script to determine if backuppc is doing a backup, if so then sleep
> > for your wakeup schedule + 1 minute, if not then execute backuppc nightly
> > 4)trigger a shutdown when backuppc nightly completes.
> 
> I built a surprisingly simple proof of concept around the above flow,
> and it looks like the idea is valid. There are still bugs to track
> down and race conditions to examine, but I don't think it's too early
> to call the idea of "BackupPC Green" a success.
> 
> Some followup questions:
> 
> Does "activeJob" still equal 1 during the link stage? I'm having
> trouble catching a backup when it's doing so.
 
I just catched a host in link stage and it has activeJob=1:

"myhost" => {"lastGoodBackupTime" => "1255622063","deadCnt" =>
0,"reason" => "Reason_backup_done","activeJob" => 1,"state" =>
"Status_link_running","aliveCnt" => 575,"endTime" =>
"1255622063","needLink" => 0,"startTime" => "1255611675","type" =>
"incr","userReq" => undef},

> Speaking of "activeJob", I haven't found a way to answer the question
> "Are any hosts active?" Using BackupPC_serverMesg status hosts doesn't
> work because trashClean always reports itself as active. Is there any
> other criterion I could use to examine all possible jobs to see if any
> are active? My proof of concept only examined a single host.

Maybe you could better use "status jobs" instead? It looks like this:

%Jobs = (
" admin " => 
  {"cmd" => "/path/to/BackupPC-3.1.0/bin/BackupPC_nightly -m 192 255",
   "reqTime" => "1255622404","mesg" => "","pid" => 29003,"fh" => *::FH,
   "user" => "BackupPC","startTime" => "1255622404","type" => undef,"fn" => 7},
" trashClean " => 
  {"cmd" => "/path/to/BackupPC-3.1.0/bin/BackupPC_trashClean",
   "reqTime" => "1234604612","mesg" => "","pid" => 6293,"fh" => *::FH,
   "user" => "BackupPC","processState" => "running","startTime" => "1234604612",
   "type" => undef,"fn" => 5},
"myhost" => 
  {"cmd" => "/path/to/BackupPC-3.1.0/bin/BackupPC_link myhost",
   "reqTime" => "1255622063","pid" => 28848,"fh" => *::FH,
"user" => "BackupPC","startTime" => "1255622063","type" => "incr",
"fn" => 6});

-> So just use the result as the perl hash it is, remove the trashClean
entry (which is not critical to interrupt at any time) and check the
size of the resulting hash.

HTH,

Tino.

-- 
"What we nourish flourishes." - "Was wir nähren erblüht."

www.lichtkreis-chemnitz.de
www.craniosacralzentrum.de

--
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay 
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] BackupPC and power saving

2009-10-15 Thread Robert Kosinski
On Thu, Oct 15, 2009 at 12:15 PM, Tino Schwarze  wrote:

> Maybe you could better use "status jobs" instead?

Thanks. That's definitely a superior idea. I used this logic to
determine if a job is running:

BackupPC_serverMesg status jobs|awk -F } '{print $2}'

If only trashClean is running, the above evaluates to ");" (without
quotes), which is the end of the status statement. If one or more
backup jobs are running, job text will appear. Therefore, I simply
wait for the expression to evaluate ");".

--
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay 
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Diskshadow and Exchange 2007

2009-10-15 Thread Palmer, David W.
Ok I will clean up the scripts and post. 

David


-Original Message-
From: Robert Kosinski [mailto:robert.kosin...@gmail.com] 
Sent: Thursday, October 15, 2009 11:09 AM
To: General list for user discussion, questions and support
Subject: Re: [BackupPC-users] Diskshadow and Exchange 2007

I, too, am interested.

On Thu, Oct 15, 2009 at 10:09 AM, Nick Hadaway
 wrote:
> I am interested in this script!
>
>
> -Original Message-
> From: Palmer, David W. [mailto:dwpal...@cazenovia.edu]
> Sent: Thu 10/15/2009 8:46 AM
> To: 'General list for user discussion,  questions and support'
> Subject: Re: [BackupPC-users] Diskshadow and Exchange 2007
>
> I have a backup script for this if anyone needs it.
>
> David
>
>
>
> From: Palmer, David W. [mailto:dwpal...@cazenovia.edu]
> Sent: Wednesday, October 14, 2009 3:37 PM
> To: 'General list for user discussion, questions and support'
> Subject: [BackupPC-users] Diskshadow and Exchange 2007
>
> Hello,
>
> Is anyone using diskshadow and exchange 2007 for backups? If so what files 
> are you backing up? Do you backup just the database or the logs too?
>
> David
>
>
>
>
> --
> Come build with us! The BlackBerry(R) Developer Conference in SF, CA
> is the only developer event you need to attend this year. Jumpstart your
> developing skills, take BlackBerry mobile applications to market and stay
> ahead of the curve. Join us from November 9 - 12, 2009. Register now!
> http://p.sf.net/sfu/devconference
> ___
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:    http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
>
>

--
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay 
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

--
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay 
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/