Re: is excluding /usr/local/var/amanda a bad idea ?
On Thu, 10 Nov 2005, Gene Heskett wrote: On Thursday 10 November 2005 16:42, Jon LaBadie wrote: [...] Gene H, on this list, has described his approach. Realizing that there is generally space left on the last tape, and further, amanda does not rewind the tape when finished. Thus he adds his tar'red up amanda tree in an extra tape file after the last amanda file. Say you lose the amanda indexes and db, is there some sort of way to rebuild it from the tapes ? Or a way to know what files (and last modified date) are on which tapes ? That is a tool just waiting for someone to volunteer to write. Who needs to write it Jon? I simply untar/unzip the files from the end of the tape (vtape in my case), back to the directory they belong in. Because you didn't really loose them, since you stored them at the end of your tape? That doesn't really need a script does it? He meant a script to read the complete tapes and reconstruct the database from that information. Gr{oetje,eeting}s, Geert -- Geert Uytterhoeven -- There's lots of Linux beyond ia32 -- [EMAIL PROTECTED] In personal conversations with technical people, I call myself a hacker. But when I'm talking to journalists I just say programmer or something like that. -- Linus Torvalds
Amanda performance
Title: Amanda performance I have a problem with amanda speed. I have an lto drive with 100gb tape. To fill that tape amanda take more time than necessary, because it takes about 8 hours. LTO speed is ~10 Mb/s, so i expect that the tape is filled up in about 3 hours. I also have another lto drive, on a windows machine and it takes 3 hour to fill tapes. What parameters i have to set-up to speed up amanda? Does the presence of the holding disk influence performance? And what about compression? Should i set client best or server best? Thanks in advance. Giovanni -- Il contenuto della presente comunicazione riservato e destinato esclusivamente ai destinatari indicati. Nel caso in cui sia ricevuto da persona diversa dal destinatario sono proibite la diffusione, la distribuzione e la copia. Nel caso riceveste la presente per errore, Vi preghiamo di informarci e di distruggerlo e/o cancellarlo dal Vostro computer, senza utilizzare i dati contenuti. La presente comunicazione (comprensiva dei documenti allegati) non avr valore di proposta contrattuale e/o accettazione di proposte provenienti dal destinatario, n rinuncia o riconoscimento di diritti, debiti e/o crediti, n sar impegnativa, qualora non sia sottoscritto successivo accordo da chi pu validamente obbligarci. Non deriver alcuna responsabilit precontrattuale a ns. carico, se la presente non sia seguita da contratto sottoscritto dalle parti. -- The contents of the present communication is strictly confidential and reserved solely to the referred addressees. In the event was received by person different from the addressee, it is forbidden the diffusion, distribution and copy. In the event you have received it mistakenly we ask you to inform us and to destroy and/or to delete it by your computer, without using the data herein contained. The present message (eventual annexes inclusive) shall not be considered any contractual proposal and/or acceptance of offer coming from the addressee, nor waiver neither recognizance of rights, debts and/or credits, and it shall not be binding, when it is not executed a subsequent agreement by person who could lawfully represent us. No pre-contractual liability shall derive to us, when the present communication is not followed by any binding agreement between the parties.
Re: Amanda performance
On Fri, 11 Nov 2005, Montagni, Giovanni wrote: I have a problem with amanda speed. I have an lto drive with 100gb tape. To fill that tape amanda take more time than necessary, because it takes about 8 hours. LTO speed is ~10 Mb/s, so i expect that the tape is filled up in about 3 hours. I also have another lto drive, on a windows machine and it takes 3 hour to fill tapes. What parameters i have to set-up to speed up amanda? Does the presence of the holding disk influence performance? You should use a holding disk to keep the tape drive at full streaming speed. -- [...] Damned, the Dutch version of the email disclaimer is missing! ;-) Gr{oetje,eeting}s, Geert -- Geert Uytterhoeven -- There's lots of Linux beyond ia32 -- [EMAIL PROTECTED] In personal conversations with technical people, I call myself a hacker. But when I'm talking to journalists I just say programmer or something like that. -- Linus Torvalds
Re: is excluding /usr/local/var/amanda a bad idea ?
I exclude the amanda dir from the rest of the backup, set it up so that the amanda dir is a DLE, always full, no record or index, starttime is when I'm sure all the other backups are done. This can have amanda report very long Run Time Dump Time as it will include the time waiting for 0700 to come around after the rest of the dumps have finished. If needed, I can pull it off the tape in the usual amanda DR way just using standard UNIX/Linux tools. It will be the very last DLE recorded. mrdds2 /usr/local/etc/amanda { swcomp program GNUTAR record no index no dumpcycle 0 starttime 0700 } - toby bluhm philips medical systems, cleveland ohio [EMAIL PROTECTED] 440-483-5323 Guy Dallaire [EMAIL PROTECTED] Sent by: [EMAIL PROTECTED] 11/10/2005 03:33 PM To Amanda (E-mail) amanda-users@amanda.org cc Subject is excluding /usr/local/var/amanda a bad idea ? Classification I excluded /usr/local/var/amanda from my amanda server backup because amanda was complaining a lot about strange backups (the indexes and db were updated while amanda was running tar on them, or something like that) I'm realizing that if I lose this directory for some reason (ex: destroy the db or index directories by error) I will no longer be able to use amrecover and get a list of the backups that are on a particular tape. Or restores will be a lot more difficult, until I go through a complete dumpcycle. Say you lose the amanda indexes and db, is there some sort of way to rebuild it from the tapes ? Or a way to know what files (and last modified date) are on which tapes ? Thanks
Re: is excluding /usr/local/var/amanda a bad idea ?
On Friday 11 November 2005 05:07, Geert Uytterhoeven wrote: On Thu, 10 Nov 2005, Gene Heskett wrote: On Thursday 10 November 2005 16:42, Jon LaBadie wrote: [...] Gene H, on this list, has described his approach. Realizing that there is generally space left on the last tape, and further, amanda does not rewind the tape when finished. Thus he adds his tar'red up amanda tree in an extra tape file after the last amanda file. Say you lose the amanda indexes and db, is there some sort of way to rebuild it from the tapes ? Or a way to know what files (and last modified date) are on which tapes ? That is a tool just waiting for someone to volunteer to write. Who needs to write it Jon? I simply untar/unzip the files from the end of the tape (vtape in my case), back to the directory they belong in. Because you didn't really loose them, since you stored them at the end of your tape? Correct. I learned early on that for some strange reason, amanda never touched its own database, and didn't get all of its config dir. So I wrote a wrapper script that runs the regular amdump, then when amanda is all done the file locks are all released, tars up the database dir tree and the config dir, and adds them as seperate files to the end of the backup. When I was using real tapes, I had to reduce the tapesize setting by about 300 megs to make sure I had room for them. Now I don't care about the virtual tapes as I watch the df report mailed to be every night and adjust the size or schedule to keep that partition at about 90% full. That doesn't really need a script does it? He meant a script to read the complete tapes and reconstruct the database from that information. I don't know but what there may be such a utility hidden in the myriad of utils that already come with amanda. Its been a while since I perused the docs. Stephan W. could probably answer that better than I. Gr{oetje,eeting}s, Geert -- Geert Uytterhoeven -- There's lots of Linux beyond ia32 -- [EMAIL PROTECTED] In personal conversations with technical people, I call myself a hacker. But when I'm talking to journalists I just say programmer or something like that. -- Linus Torvalds -- Cheers, Gene There are four boxes to be used in defense of liberty: soap, ballot, jury, and ammo. Please use in that order. -Ed Howdershelt (Author) 99.36% setiathome rank, not too shabby for a WV hillbilly Free OpenDocument reader/writer/converter download: http://www.openoffice.org Yahoo.com and AOL/TW attorneys please note, additions to the above message by Gene Heskett are: Copyright 2005 by Maurice Eugene Heskett, all rights reserved.
Re: Amanda performance
On Friday 11 November 2005 05:18, Montagni, Giovanni wrote: I have a problem with amanda speed. I have an lto drive with 100gb tape. To fill that tape amanda take more time than necessary, because it takes about 8 hours. LTO speed is ~10 Mb/s, so i expect that the tape is filled up in about 3 hours. I also have another lto drive, on a windows machine and it takes 3 hour to fill tapes. What parameters i have to set-up to speed up amanda? Does the presence of the holding disk influence performance? Without a holding disk, amanda writes the dumps direct to tape, and cannot run several in parallel, which extends the time considerably. The holding disk needs to be maybe 2-4x the size of the largest DLE for best performance. The data is not erased from the holding disk until the file has been completely written, and there needs to be room for the other, smaller DLE's that may get done while the big one is writing. And what about compression? Should i set client best or server best? That depends on which box has the most horsepower, but theres a fudge factor in a multiple box environment that encourages the use of client best because each client then does its own, all of them at the same time, and the network bandwidth usage is also reduced since the files sent are smaller. In my setup, only 2 machines, one is a 500 mhz K6-III, the other is a XP-2800 Athlon. I have the client doing its own compression as its quicker than saddling the athlon with all of it. Thanks in advance. Giovanni -- Il contenuto della presente comunicazione è riservato e destinato esclusivamente ai destinatari indicati. Nel caso in cui sia ricevuto da persona diversa dal destinatario sono proibite la diffusione, la distribuzione e la copia. Nel caso riceveste la presente per errore, Vi preghiamo di informarci e di distruggerlo e/o cancellarlo dal Vostro computer, senza utilizzare i dati contenuti. La presente comunicazione (comprensiva dei documenti allegati) non avrà valore di proposta contrattuale e/o accettazione di proposte provenienti dal destinatario, nè rinuncia o riconoscimento di diritti, debiti e/o crediti, nè sarà impegnativa, qualora non sia sottoscritto successivo accordo da chi può validamente obbligarci. Non deriverà alcuna responsabilità precontrattuale a ns. carico, se la presente non sia seguita da contratto sottoscritto dalle parti. -- The contents of the present communication is strictly confidential and reserved solely to the referred addressees. In the event was received by person different from the addressee, it is forbidden the diffusion, distribution and copy. In the event you have received it mistakenly we ask you to inform us and to destroy and/or to delete it by your computer, without using the data herein contained. The present message (eventual annexes inclusive) shall not be considered any contractual proposal and/or acceptance of offer coming from the addressee, nor waiver neither recognizance of rights, debts and/or credits, and it shall not be binding, when it is not executed a subsequent agreement by person who could lawfully represent us. No pre-contractual liability shall derive to us, when the present communication is not followed by any binding agreement between the parties. -- Cheers, Gene There are four boxes to be used in defense of liberty: soap, ballot, jury, and ammo. Please use in that order. -Ed Howdershelt (Author) 99.36% setiathome rank, not too shabby for a WV hillbilly Free OpenDocument reader/writer/converter download: http://www.openoffice.org Yahoo.com and AOL/TW attorneys please note, additions to the above message by Gene Heskett are: Copyright 2005 by Maurice Eugene Heskett, all rights reserved.