Re: Duration Of Backup
Jon LaBadie wrote:
On Wed, Aug 17, 2005 at 09:13:22AM -0400, Mangala Gunadasa wrote:
[...]
backup takes 9hrs to finish. We have tried to make it more efficient by
changing the parameters "interface", and "net usage" of the amanda.conf
and did not succeed( Probably those parameters do not matter). We would
like to perform Full backup every Day to a SDLT Tape drive.
[...]
Seconding Dave's comments, figure out what pieces of the backup take time.
Thirding! Oh well, you know what I mean.
One additional thought, see if the estimate phase is an appreciable
part of the total time. As you are doing full backups daily, I presume
you have a pretty good idea of the amount of data daily. In that case
newer versions of amanda have alternatives to the estimate phase that
can greatly speed up that part of the backup.
Indeed, especially when using gnutar the estimates can take
a lot of time.
I use these parameters in my archive backups that do
full backups only. I do not want any incrementals at all, even
if the tape is full, and do not want to waste time on estimates
for incrementals either:
define dumptype global {
program "GNUTAR"
index yes
record no
compress client fast
skip-incr yes # emphasize we only want full dumps
strategy noinc # also reduce time to do estimates
}
If you have have really really fast servers, then adding "maxdumps 2"
or even more, together with a careful indication of splindlenumbers in
the disklist allows amanda to start more than one dump on one host
at a time.
Other general tips: make sure you have enough holdingdisk space.
Then the backups themselves can finish as fast as they can, without
tapedrive speed constraints.
Also the command "amplot" can greatly help pointing to bottlenecks.
--
Paul Bijnens, XplanationTel +32 16 397.511
Technologielaan 21 bus 2, B-3001 Leuven, BELGIUMFax +32 16 397.512
http://www.xplanation.com/ email: [EMAIL PROTECTED]
***
* I think I've got the hang of it now: exit, ^D, ^C, ^\, ^Z, ^Q, F6, *
* quit, ZZ, :q, :q!, M-Z, ^X^C, logoff, logout, close, bye, /bye, *
* stop, end, F3, ~., ^]c, +++ ATH, disconnect, halt, abort, hangup, *
* PF4, F20, ^X^X, :D::D, KJOB, F14-f-e, F8-e, kill -1 $$, shutdown, *
* init 0, kill -9 1, Alt-F4, Ctrl-Alt-Del, AltGr-NumLock, Stop-A, ... *
* ... "Are you sure?" ... YES ... Phew ... I'm out *
***
Re: Duration Of Backup
On Wed, Aug 17, 2005 at 09:13:22AM -0400, Mangala Gunadasa wrote: > Greetings > > We have been using amanda for many years. Our capacity had grown and > currently we are backing up 60 file systems across 12 servers. The > backup takes 9hrs to finish. We have tried to make it more efficient by > changing the parameters "interface", and "net usage" of the amanda.conf > and did not succeed( Probably those parameters do not matter). We would > like to perform Full backup every Day to a SDLT Tape drive. > We will be adding 2 IBM P570's and we are concerned about the duration > of the backup. Can we find how the big sites manage this type of > situation?. I appreciate any comments on this subject. Seconding Dave's comments, figure out what pieces of the backup take time. One additional thought, see if the estimate phase is an appreciable part of the total time. As you are doing full backups daily, I presume you have a pretty good idea of the amount of data daily. In that case newer versions of amanda have alternatives to the estimate phase that can greatly speed up that part of the backup. -- Jon H. LaBadie [EMAIL PROTECTED] JG Computing 4455 Province Line Road(609) 252-0159 Princeton, NJ 08540-4322 (609) 683-7220 (fax)
Re: Duration Of Backup
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Wednesday, 17.08.2005 at 09:13 -0400, Mangala Gunadasa wrote: > We have been using amanda for many years. Our capacity had grown and > currently we are backing up 60 file systems across 12 servers. The > backup takes 9hrs to finish. We have tried to make it more efficient > by changing the parameters "interface", and "net usage" of the > amanda.conf and did not succeed( Probably those parameters do not > matter). We would like to perform Full backup every Day to a SDLT Tape > drive. We will be adding 2 IBM P570's and we are concerned about the > duration of the backup. Can we find how the big sites manage this type > of situation?. I appreciate any comments on this subject. To figure out a way to reduce the run time of the backups, you need to work out whether you are hitting a network bandwidth limit, a hardware limitation or something else. Some ideas: 1. Relaxing your condition of a full backup every day would reduce your backup duration, since each day AMANDA would be doing full backups of some systems and level 1 backups of others. If your filesystems are fairly static, this may make sense. I obviously don't know your circumstances, but do you *really* need a full backup of *everything* every day? If you have a largely static setup, then insisting on a full backup only once every two days may reduce your run time from 9 hours down to 5 or 6 hours. 2. Upgrade your network infrastructure or your AMANDA server. For example, if you're running 100megabit, can you switch to gigabit? Can you give your AMANDA server a faster holding disk? 3. Get another tape drive and run backups in parallel. Note however, that this will not reduce run time if your backup job is network-bandwidth-bound. 4. Check your compression configuration parameters. Are dumps being compressed on the client, or the server, or on the tape drive? For example, are slow clients being made to compress stuff themselves? Dave. - -- Dave Ewart [EMAIL PROTECTED] Computing Manager, Cancer Epidemiology Unit Cancer Research UK / Oxford University PGP: CC70 1883 BD92 E665 B840 118B 6E94 2CFD 694D E370 N 51.7518, W 1.2016 -BEGIN PGP SIGNATURE- Version: GnuPG v1.2.4 (GNU/Linux) iD8DBQFDAzu1bpQs/WlN43ARAtLiAJ95fwMkh+awuET9OGw/7I7QfohiugCeNRXO ccD6x1zIA5lMf2y9J7FXW1I= =uaa+ -END PGP SIGNATURE-
Re: Duration Of Backup
Greetings We have been using amanda for many years. Our capacity had grown and currently we are backing up 60 file systems across 12 servers. The backup takes 9hrs to finish. We have tried to make it more efficient by changing the parameters "interface", and "net usage" of the amanda.conf and did not succeed( Probably those parameters do not matter). We would like to perform Full backup every Day to a SDLT Tape drive. We will be adding 2 IBM P570's and we are concerned about the duration of the backup. Can we find how the big sites manage this type of situation?. I appreciate any comments on this subject. Thank You, Mangala Gunadasa EHIT/Montefiore Medical Center
