Hi all:

We use backuppc to perform backups of 70 odd systems at remote sites
to our main servers over the internet. As a result we have a bandwidth
limitation of 5Mbit/sec that we don't want to exceed.

To do this, I limit the number of simultaneous backups to 4, and use
--bwlimit 100 to limit the sending rsync speed. This gives us a total
of 3,276,800 bits/sec approx. It can be a bit higher at tims, but
averages out.

We run full backups once week, and daily backups every day (go
figure). We also exclude backups during the day (7AM-7PM local time)
to make the bandwidth available for others.

We are seeing gaps in backup coverage, the worst was a system without
backups for three days We have had up to 10 systems with at least 1
day's backups missed. Since this is bad (TM), I am looking for ideas
on solving this problem.

  1) Tweaking the backup scheduler so that it tries to schedule the
     system with the longest time since it's last backup first.

  2) Tweaking the scheduler to run the jobs with the highest
     incremental levels first (so a level 3 backups runs before a
     level 2, or a level 1 or a level 0). On the theory that the
     higher level backups will run faster resulting in better overall
     throughput within the backup window.

  3) running more jobs at a lower bandwidth so that a full backup that
     will take hours doesn't block incrementals from running

  4) running fewer jobs but at a higher bandwith to get the full and
     large incrementals over with faster.

So two of the ideas are scheduling based and the other two are handling
the data/jobs based. Any thoughts?

Also in looking into this, I have seen a couple of instances where an
incremental and a full backup ran on the same day. Has anybody else
seen this? AFAIK, nobody ran manual backups of the hosts in question,
and the incremental backup occurred before the full, but the
incremental was at the beginning of the non-excluded time and the full
was at the end. Has anybody else seen this?

-- 
                                -- rouilj

John Rouillard
System Administrator
Renesys Corporation
603-643-9300 x 111

-------------------------------------------------------------------------
SF.Net email is sponsored by: The Future of Linux Business White Paper
from Novell.  From the desktop to the data center, Linux is going
mainstream.  Let it simplify your IT future.
http://altfarm.mediaplex.com/ad/ck/8857-50307-18918-4
_______________________________________________
BackupPC-users mailing list
[email protected]
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Reply via email to