Re: is excluding /usr/local/var/amanda a bad idea ?

2005-11-11 Thread Geert Uytterhoeven
On Thu, 10 Nov 2005, Gene Heskett wrote:
 On Thursday 10 November 2005 16:42, Jon LaBadie wrote:
 
 [...]
 
 Gene H, on this list, has described his approach.  Realizing that
 there is generally space left on the last tape, and further, amanda
 does not rewind the tape when finished.  Thus he adds his tar'red
 up amanda tree in an extra tape file after the last amanda file.
 
  Say you lose the amanda indexes and db, is there some sort of way to
  rebuild it from the tapes ? Or a way to know what files (and last
  modified date) are on which tapes ?
 
 That is a tool just waiting for someone to volunteer to write.
 
 Who needs to write it Jon?  I simply untar/unzip the files from the end
 of the tape (vtape in my case), back to the directory they belong in. 

Because you didn't really loose them, since you stored them at the end of your
tape?

 That doesn't really need a script does it?

He meant a script to read the complete tapes and reconstruct the database from
that information.

Gr{oetje,eeting}s,

Geert

--
Geert Uytterhoeven -- There's lots of Linux beyond ia32 -- [EMAIL PROTECTED]

In personal conversations with technical people, I call myself a hacker. But
when I'm talking to journalists I just say programmer or something like that.
-- Linus Torvalds


Amanda performance

2005-11-11 Thread Montagni, Giovanni
Title: Amanda performance






I have a problem with amanda speed.

I have an lto drive with 100gb tape. To fill that tape amanda take more time than necessary, because it takes about 8 hours.

LTO speed is ~10 Mb/s, so i expect that the tape is filled up in about 3 hours.

I also have another lto drive, on a windows machine and it takes 3 hour to fill tapes.


What parameters i have to set-up to speed up amanda?

Does the presence of the holding disk influence performance?

And what about compression? Should i set client best or server best?


Thanks in advance.


Giovanni




--
Il contenuto della presente comunicazione  riservato e destinato esclusivamente ai destinatari indicati. Nel caso in cui sia ricevuto da persona diversa dal destinatario sono proibite la diffusione, la distribuzione e la copia. Nel caso riceveste la presente per errore, Vi preghiamo di informarci e di distruggerlo e/o cancellarlo dal Vostro computer, senza utilizzare i dati contenuti. 

La presente comunicazione (comprensiva dei documenti allegati) non avr valore di proposta contrattuale e/o accettazione di proposte provenienti dal destinatario, n rinuncia o riconoscimento di diritti, debiti e/o crediti, n sar impegnativa, qualora non sia sottoscritto successivo accordo da chi pu validamente obbligarci. Non deriver alcuna responsabilit precontrattuale a ns. carico, se la presente non sia seguita da contratto sottoscritto dalle parti.
--
The contents of the present communication is strictly confidential and reserved solely to the referred addressees. In the event was received by person different from the addressee, it is forbidden the diffusion, distribution and copy. In the event you have received it mistakenly we ask you to inform us and to destroy and/or to delete it by your computer, without using the data herein contained. 

The present message (eventual annexes inclusive) shall not be considered any contractual proposal and/or acceptance of offer coming from the addressee, nor waiver neither recognizance of rights, debts and/or credits, and it shall not be binding, when it is not executed a subsequent agreement by person who could lawfully represent us. No pre-contractual liability shall derive to us, when the present communication is not followed by any binding agreement between the parties.





Re: Amanda performance

2005-11-11 Thread Geert Uytterhoeven
On Fri, 11 Nov 2005, Montagni, Giovanni wrote:
 I have a problem with amanda speed.
 I have an lto drive with 100gb tape. To fill that tape amanda take more
 time than necessary, because it takes about 8 hours.
 LTO speed is ~10 Mb/s, so i expect that the tape is filled up in about 3
 hours.
 I also have another lto drive, on a windows machine and it takes 3 hour
 to fill tapes.
 
 What parameters i have to set-up to speed up amanda?
 Does the presence of the holding disk influence performance?

You should use a holding disk to keep the tape drive at full streaming speed.

 --
[...]

Damned, the Dutch version of the email disclaimer is missing! ;-)

Gr{oetje,eeting}s,

Geert

--
Geert Uytterhoeven -- There's lots of Linux beyond ia32 -- [EMAIL PROTECTED]

In personal conversations with technical people, I call myself a hacker. But
when I'm talking to journalists I just say programmer or something like that.
-- Linus Torvalds


Re: is excluding /usr/local/var/amanda a bad idea ?

2005-11-11 Thread Tobias Bluhm
I exclude the amanda dir from the rest of the backup, set it up so that 
the amanda dir is a DLE, always full, no record or index, starttime is 
when I'm sure all the other backups are done. This can have amanda report 
very long Run Time  Dump Time as it will include the time waiting for 
0700 to come around after the rest of the dumps have finished. If needed, 
I can pull it off the tape in the usual amanda DR way just using standard 
UNIX/Linux tools. It will be the very last DLE recorded.


mrdds2 /usr/local/etc/amanda {
 swcomp
 program GNUTAR
 record no
 index no
 dumpcycle 0
 starttime 0700
}


-
toby bluhm
philips medical systems, cleveland ohio
[EMAIL PROTECTED]
440-483-5323








Guy Dallaire [EMAIL PROTECTED] 
Sent by:
[EMAIL PROTECTED]
11/10/2005 03:33 PM

To
Amanda (E-mail) amanda-users@amanda.org
cc

Subject
is excluding /usr/local/var/amanda a bad idea ?
Classification







I excluded /usr/local/var/amanda from my amanda server backup because 
amanda was complaining a lot about strange backups (the indexes and db 
were updated while amanda was running tar on them, or something like that)

I'm realizing that if I lose this directory for some reason (ex: destroy 
the db or index directories by error) I will no longer be able to use 
amrecover and get a list of the backups that are on a particular tape. Or 
restores will be a lot more difficult, until I go through a complete 
dumpcycle.

Say you lose the amanda indexes and db, is there some sort of way to 
rebuild it from the tapes ? Or a way to know what files (and last modified 
date) are on which tapes ?

Thanks



Re: is excluding /usr/local/var/amanda a bad idea ?

2005-11-11 Thread Gene Heskett
On Friday 11 November 2005 05:07, Geert Uytterhoeven wrote:
On Thu, 10 Nov 2005, Gene Heskett wrote:
 On Thursday 10 November 2005 16:42, Jon LaBadie wrote:

 [...]

 Gene H, on this list, has described his approach.  Realizing that
 there is generally space left on the last tape, and further, amanda
 does not rewind the tape when finished.  Thus he adds his tar'red
 up amanda tree in an extra tape file after the last amanda file.
 
  Say you lose the amanda indexes and db, is there some sort of way
  to rebuild it from the tapes ? Or a way to know what files (and
  last modified date) are on which tapes ?
 
 That is a tool just waiting for someone to volunteer to write.

 Who needs to write it Jon?  I simply untar/unzip the files from the
 end of the tape (vtape in my case), back to the directory they belong
 in.

Because you didn't really loose them, since you stored them at the end
 of your tape?

Correct.  I learned early on that for some strange reason, amanda never
touched its own database, and didn't get all of its config dir.  So I
wrote a wrapper script that runs the regular amdump, then when amanda
is all done  the file locks are all released, tars up the database dir
tree and the config dir, and adds them as seperate files to the end of
the backup.  When I was using real tapes, I had to reduce the tapesize
setting by about 300 megs to make sure I had room for them.  Now I
don't care about the virtual tapes as I watch the df report mailed to
be every night and adjust the size or schedule to keep that partition
at about 90% full.

 That doesn't really need a script does it?

He meant a script to read the complete tapes and reconstruct the
 database from that information.

I don't know but what there may be such a utility hidden in the myriad
of utils that already come with amanda.  Its been a while since I
perused the docs.  Stephan W. could probably answer that better than I.

Gr{oetje,eeting}s,

  Geert

--
Geert Uytterhoeven -- There's lots of Linux beyond ia32 --
 [EMAIL PROTECTED]

In personal conversations with technical people, I call myself a
 hacker. But when I'm talking to journalists I just say programmer or
 something like that. -- Linus Torvalds

-- 
Cheers, Gene
There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order.
-Ed Howdershelt (Author)
99.36% setiathome rank, not too shabby for a WV hillbilly
Free OpenDocument reader/writer/converter download:
http://www.openoffice.org
Yahoo.com and AOL/TW attorneys please note, additions to the above
message by Gene Heskett are:
Copyright 2005 by Maurice Eugene Heskett, all rights reserved.



Re: Amanda performance

2005-11-11 Thread Gene Heskett
On Friday 11 November 2005 05:18, Montagni, Giovanni wrote:
I have a problem with amanda speed.
I have an lto drive with 100gb tape. To fill that tape amanda take more
time than necessary, because it takes about 8 hours.
LTO speed is ~10 Mb/s, so i expect that the tape is filled up in about
 3 hours.
I also have another lto drive, on a windows machine and it takes 3 hour
to fill tapes.

What parameters i have to set-up to speed up amanda?
Does the presence of the holding disk influence performance?

Without a holding disk, amanda writes the dumps direct to tape, and
cannot run several in parallel, which extends the time considerably.
The holding disk needs to be maybe 2-4x the size of the largest DLE for
best performance.  The data is not erased from the holding disk until
the file has been completely written, and there needs to be room for
the other, smaller DLE's that may get done while the big one is writing.

And what about compression? Should i set client best or server best?

That depends on which box has the most horsepower, but theres a fudge
factor in a multiple box environment that encourages the use of client
best because each client then does its own, all of them at the same
time, and the network bandwidth usage is also reduced since the files
sent are smaller.  In my setup, only 2 machines, one is a 500 mhz
K6-III, the other is a XP-2800 Athlon.  I have the client doing its own
compression as its quicker than saddling the athlon with all of it.

Thanks in advance.

Giovanni


--
Il contenuto della presente comunicazione è riservato e destinato
 esclusivamente ai destinatari indicati. Nel caso in cui sia ricevuto
 da persona diversa dal destinatario sono proibite la diffusione, la
 distribuzione e la copia. Nel caso riceveste la presente per errore,
 Vi preghiamo di informarci e di distruggerlo e/o cancellarlo dal
 Vostro computer, senza utilizzare i dati contenuti.

La presente comunicazione (comprensiva dei documenti allegati) non avrà
 valore di proposta contrattuale e/o accettazione di proposte
 provenienti dal destinatario, nè rinuncia o riconoscimento di diritti,
 debiti e/o crediti, nè sarà impegnativa, qualora non sia sottoscritto
 successivo accordo da chi può validamente obbligarci. Non deriverà
 alcuna responsabilità precontrattuale a ns. carico, se la presente non
 sia seguita da contratto sottoscritto dalle parti.
 --
 The contents of the present communication is strictly confidential and
 reserved solely to the referred addressees. In the event was received
 by person different from the addressee, it is forbidden the diffusion,
 distribution and copy. In the event you have received it mistakenly we
 ask you to inform us and to destroy and/or to delete it by your
 computer, without using the data herein contained.

The present message (eventual annexes inclusive) shall not be
 considered any contractual proposal and/or acceptance of offer coming
 from the addressee, nor waiver neither recognizance of rights, debts
 and/or credits, and it shall not be binding, when it is not executed a
 subsequent agreement by person who could lawfully represent us. No
 pre-contractual liability shall derive to us, when the present
 communication is not followed by any binding agreement between the
 parties.

-- 
Cheers, Gene
There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order.
-Ed Howdershelt (Author)
99.36% setiathome rank, not too shabby for a WV hillbilly
Free OpenDocument reader/writer/converter download:
http://www.openoffice.org
Yahoo.com and AOL/TW attorneys please note, additions to the above
message by Gene Heskett are:
Copyright 2005 by Maurice Eugene Heskett, all rights reserved.