Re: Quantum SuperLoader 3
Nick Brockner schrieb: Is anyone here using a Quantum Superloader 3 (I know at least one person is) and care to share your config details with me? Specifically, how did you set up amanda.conf to use it. What kind of drive is in it? I take a look at the specification, but it seems that is autoloader is available with different kind of drives (e. g. DLT, LTO-2/3/4): ER-SL1AA-YF DLT VS160, 8 Slots /1 Magazin ER-S21AA-YF DLT VS160, 16 Slots/2 Magazine EC-SL6AA-YF DLT-V4, 8 Slots/1 Magazin EC-S26AA-YF DLT-V4, 16 Slots/2 Magazine ER-SL2AA-YF SDLT 600, 8 Slots/1 Magazin ER-S22AA-YF SDLT 600, 16 Slots/2 Magazine ER-LL4AA-YF LTO-2 HH, 8 Slots/1 Magazin ER-L24AA-YF LTO-2 HH, 16 Slots/2 Magazine EC-L2DAA-YF LTO-3 16 Slots/2 Magazine EC-LLDAA-YF LTO-3 8 Slots/1 Magazin EC-SL3AA-YF DLT-S4, 8 Slots/1 Magazin EC-S23AA-YF DLT-S4, 16 Slots/2 Magazine EC-SL3AC-YF DLT-S4 nFC, 8 Slots/1 Magazin EC-S23AC-YF DLT-S4 nFC, 16 Slots/2 Magazine EC-LL8AC-YF LTO-3 nFC, 8 Slots/1 Magazin EC-L28AC-YF LTO-3 nFC, 16 Slots/ 2 Magazine EC-LLEAA-YF LTO-4 SCSI, 8 Slots/1 Magazin EC-L2EAA-YF LTO-4 SCSI, 16 Slots/2 Magazine Regards Marc -- Marc Muehlfeld (Leitung IT) Zentrum fuer Humangenetik und Laboratoriumsmedizin Dr. Klein und Dr. Rost Lochhamer Str. 29 - D-82152 Martinsried Telefon: +49(0)89/895578-0 - Fax: +49(0)89/895578-78 http://www.medizinische-genetik.de
Re: recovery question
On Thursday 20 November 2008, Thomas Wegner wrote: >> On Wednesday 19 November 2008, Gene Heskett wrote: > >Hi Gene! > >> Extracting files using tape drive chg-disk on host coyote. >> Load tape Dailys-17 now >> Continue [?/Y/n/s/d]? >> Volume labeled 'Dailys-17' not found. > >Is your tape labeld correct? AFAIK, nothing was changed, this amanda was built from the exact same src, with the exact same config directives. And 20 minutes later, it worked, but set the wrong contexts on the recovered files, so I had to go pester the selinux list to get that fix. One of those things that go bump in the night I guess. :) Is this context thing a tar problem? In that case, should it be bz'd? Or is amanda maybe passing the wrong options to it? I dunno, and its too late to think about anything but a few zzz's here. A bit after 1am. Thanks Thomas. -- Cheers, Gene "There are four boxes to be used in defense of liberty: soap, ballot, jury, and ammo. Please use in that order." -Ed Howdershelt (Author) The District of Columbia has a law forbidding you to exert pressure on a balloon and thereby cause a whistling sound on the streets.
Re: recovery question
> On Wednesday 19 November 2008, Gene Heskett wrote: Hi Gene! > Extracting files using tape drive chg-disk on host coyote. > Load tape Dailys-17 now > Continue [?/Y/n/s/d]? > Volume labeled 'Dailys-17' not found. Is your tape labeld correct? -- Regards Thomas
Re: how large must the data volume be...
Hi, > ...so that tape drives become more cost-effective than storing > everything on HD's? >From my past experience, 50GB SLR100 tape costs $100 while for that price I can have a 500GB disk... Olivier
how large must the data volume be...
hi hi ...so that tape drives become more cost-effective than storing everything on HD's? does anyone has experience/ calculations on that topic he wants to share? greetz olli
Re: performance of backup process
hi > The best program to spot bottlenecks and have an overview for > the performance of the whole backup process is "amplot". ok, than this will be my way to go. thanks for the tip :-) > It takes some time to get it running, and study the output, but > it's really worthwhile. from the manpage it 'looks' pretty simple, since amplot has only a few options. what are the caveats? > > > > right now I'm looking at the 'amstatus' of my daily backup job, which > > gives me the following output > > > > Using /var/log/amanda/daily/amdump from Mon Nov 17 08:31:51 CET 2008 > > > > 172.31.2.10:/daten/business 011085m dumping 4380m ( 39.52%) > > (8:38:25) > > 172.31.2.10:/daten/company 1 16m finished (8:38:25) > > 172.31.2.10:/daten/intern 024001m wait for dumping > > 172.31.2.10:/daten/software 1 242107m wait for dumping > > 172.31.6.10:/daten/blub 0 1623m finished (8:40:33) > > 172.31.6.10:/daten/business 10m finished (8:37:14) > > 172.31.6.10:/daten/doku 0 5413m finished (8:45:19) > > > > SUMMARY part real estimated > >size size > > partition : 7 > > estimated : 7 284248m > > flush : 0 0m > > failed : 00m ( 0.00%) > > wait for dumping: 2 266108m ( 93.62%) > > dumping to tape : 00m ( 0.00%) > > dumping : 1 4380m 11085m ( 39.52%) ( 1.54%) > > dumped : 4 7054m 7054m (100.00%) ( 2.48%) > > wait for writing: 0 0m 0m ( 0.00%) ( 0.00%) > > wait to flush : 0 0m 0m (100.00%) ( 0.00%) > > writing to tape : 0 0m 0m ( 0.00%) ( 0.00%) > > failed to tape : 0 0m 0m ( 0.00%) ( 0.00%) > > taped : 4 7054m 7054m (100.00%) ( 2.48%) > > tape 1: 4 7054m 7054m ( 3.44%) ERNW-daily02 > > 9 dumpers idle : client-constrained > > taper writing, tapeq: 0 > > network free kps:248976 > > holding space :408372m ( 96.12%) > > chunker0 busy : 0:00:00 ( 0.00%) > > chunker1 busy : 0:00:00 ( 0.00%) > > dumper0 busy : 0:05:25 ( 40.25%) > > dumper1 busy : 0:08:04 ( 60.00%) > >taper busy : 0:04:12 ( 31.21%) > > 0 dumpers busy : 0:05:23 ( 40.04%)not-idle: 0:05:23 > > (100.00%) > > 1 dumper busy : 0:03:36 ( 26.79%) client-constrained: 0:02:25 > > ( 67.29%) > >start-wait: 0:01:10 > > ( 32.71%) > > 2 dumpers busy : 0:04:27 ( 33.15%) client-constrained: 0:04:27 > > (100.00%) > > > > Above you say you have 20 clients, but this output shows only 1 client. > is this a test. > You can see that from amstatus that no dumper runs in parallel, because > the default parameters have a restriction of only one dumper per client. > When you have more clients, Amanda will run some dumpers in parallel, > speeding up the whole process. 20 all together. the output above is from my daily backup job, which covers only the data of 2 file servers. all other hosts store less relevant data, so they're backed up only once a week. > > from my understanding amanda is dumping (writing to holding disk) and > > taping (writing from holding disk to virtual tapes) at the same time. > Indeed. > > > Doesn't this reduce speed on the dumper caused by the head-seeks on the > > holding disc? Is there a way to prevent this scenario (as long as the > > holding disc is big enough for all data that belongs to the job)? > > Yes it does reduce the speed indeed. *DAMN* > Optimizing the holdingdisk subsystem is indeed very important for > the newer tapedrives like LTO4 that *need* a sustained feed at 80MB/sec > *at least*, to avoid shoeshining. ok, that doesn't bother me, since I use HD with a virtual tape library to backup my data, and the holding disc is physically another drive than the one storing the data. > Things people often do: > - use a separate controller for disk and tape. > - use a raid striped over several disks as holdingdisk.M > - use large buffers (tapebufs or device_output_buffer_size) > - avoid reading from and writing to the holdingdisk at the same >time (flush-threshold-dumped) ok, I read the amanda.conf(5) man-page on that parameter, but I don't understand what is meant with the term 'volume'. Is it a tape, is it the total amount of data for this backup-job??? please help me clear this. greetz olli
Re: performance of backup process
hi hi... [snip] > > from my understanding amanda is dumping (writing to holding disk) and > > taping (writing from holding disk to virtual tapes) at the same time. > > Doesn't this reduce speed on the dumper caused by the head-seeks on the > > holding disc? Is there a way to prevent this scenario (as long as the > > holding disc is big enough for all data that belongs to the job)? > > > There are some tips here: > http://wiki.zmanda.com/index.php/How_To:Set_Up_Virtual_Tapes. > > In particular, if you have a holding disk and your virtual tapes on the > same disk or raid, it is going to degrade performance. > > [/snip] yeah that manual is great, I used it to setup my vtapes. I'm just curious if it's possible to reduce the runtime of amanda. on my daily backupjob there's a folder containing 250GB of data, and it takes nearly 400min to backup this folder. the backup system itself is very basic (a 1U machine with 4 HD's and 1GB ethernet connection). enough for the current needs (and my knowledge of amanda ;-)). so thinking about the best way to setup a performant enough backup server brought me to these steps: - calculate size of backup - measure read troughput of backup clients (what is the most realistic way to do this?) - have enough bandwidth and writing speed on the holding disc to (nearly) save the datastream from multiple clients without introducing a bottleneck - taping time doesn't matter, as long as it's done within the remaining time of the day ;-)) suggestions on this? greetz olli
Installing 2.6.0p2 on Ubuntu
I used the Ubuntu Hardy Haron package to install Amanda server on my server. It ran the backups correctly, but now I need to recover a file. If I ran recover, it was asking for one of the 2.6.0p1 files - so I uninstalled Amanda through apt-get and pulled down the 2.6.0p2 package and compiled it on the machine. I changed the user and groups when running ./configure to match up with the users and groups defined with the Ubuntu package - and now I'm trying to run amrecover by typing sudo amrecover /etc/amanda/DailySet1 but I get - AMRECOVER Version 2.6.0p2. Contacting server on ubuntu ... [request failed: timeout waiting for ACK] Is there another configure directive to find the original files? Matt Burkhardt, MSTM President Impari Systems, Inc. 502 Fairview Avenue Frederick, MD 21701 [EMAIL PROTECTED] www.imparisystems.com (301) 682-7901
Re: recovery question
On Wednesday 19 November 2008, Gene Heskett wrote: >On Wednesday 19 November 2008, Thomas Wegner wrote: >>Hi Gene! >> >>> Unforch, what I need is an amfind utility. I need to find all the >>> spamassassin & perl stuffs that made spamassassin work before, I'm >>> drowning in spam here. >> >>Take a look at "amadmin info" and "amadmin find". I think that are the >>tools you are looking for. More at >>http://wiki.zmanda.com/index.php/Restoring_files > >I actually found enough rpms to get it installed. Unforch, selinux is now >disabling spamd's access to that users .user_prefs file, so while I've > gotten rid of the "MISSED" message, it isn't actually working as planned > yet. > >Would my backups contain the correct perms and selinux contexts to restore >this? > >I have a msg posted to the selinux list, but so far no replies there. > >Thanks Thomas. And I am now trying to use amrecover to extract the whole .spamassassin directory in /home/gene. But: amrecover> add .spamassassin Added dir /gene/.spamassassin/ at date 2008-11-16-01-25-05 amrecover> extract Extracting files using tape drive chg-disk on host coyote. The following tapes are needed: Dailys-17 Restoring files into directory /home/gene Continue [?/Y/n]? Extracting files using tape drive chg-disk on host coyote. Load tape Dailys-17 now Continue [?/Y/n/s/d]? Volume labeled 'Dailys-17' not found. Load tape Dailys-17 now Continue [?/Y/n/d]? I have even manually edited the /amandatapes/Dailys/data simlink to point at slot17. So something in my install still isn't 'kosher'. This is a vtape setup here. Full trace: [EMAIL PROTECTED] gene]# amrecover Daily AMRECOVER Version 2.6.1alpha-20081114. Contacting server on coyote.coyote.den ... 220 coyote AMANDA index server (2.6.1alpha-20081114) ready. Setting restore date to today (2008-11-19) 200 Working date set to 2008-11-19. 200 Config set to Daily. 501 Host coyote.coyote.den is not in your disklist. Trying host coyote.coyote.den ... 501 Host coyote.coyote.den is not in your disklist. Trying host coyote ... 200 Dump host set to coyote. Use the setdisk command to choose dump disk to recover amrecover> setdisk /home/gene/.spamassassin 501 Disk coyote:/home/gene/.spamassassin is not in your disklist. amrecover> setdisk /home 200 Disk set to /home. amrecover> ls 2008-11-16-01-25-05 shop/ 2008-11-16-01-25-05 shop-gene/ 2008-11-16-01-25-05 roadrunner/ 2008-11-16-01-25-05 postgresql/ 2008-11-16-01-25-05 lost+found/ 2008-11-16-01-25-05 gene/ 2008-11-16-01-25-05 gene.old/ 2008-11-16-01-25-05 elmer/ 2008-11-16-01-25-05 dd-wrt/ 2008-11-16-01-25-05 clamav/ 2008-11-16-01-25-05 amanda/ 2008-11-16-01-25-05 Sparky/ 2008-11-16-01-25-05 .windows-label 2008-11-16-01-25-05 . amrecover> lcd /home/gene/.spamassassin amrecover> cd gene/.spamassassin /home/gene/.spamassassin amrecover> lpwd /home/gene/.spamassassin amrecover> pwd /home/gene/.spamassassin amrecover> ls 2008-11-16-01-25-05 v310.pre 2008-11-16-01-25-05 user_prefs 2008-11-16-01-25-05 init.pre 2008-11-16-01-25-05 bayes_toks 2008-11-16-01-25-05 bayes_seen 2008-11-16-01-25-05 bayes_journal 2008-11-16-01-25-05 bayes.mutex 2008-11-16-01-25-05 auto-whitelist.mutex 2008-11-16-01-25-05 auto-whitelist 2008-11-16-01-25-05 . amrecover> cd .. /home/gene amrecover> lcd .. amrecover> ls [...] amrecover> add .spamassassin Added dir /gene/.spamassassin/ at date 2008-11-16-01-25-05 amrecover> extract Extracting files using tape drive chg-disk on host coyote. The following tapes are needed: Dailys-17 Restoring files into directory /home/gene Continue [?/Y/n]? Extracting files using tape drive chg-disk on host coyote. Load tape Dailys-17 now Continue [?/Y/n/s/d]? Volume labeled 'Dailys-17' not found. Load tape Dailys-17 now Continue [?/Y/n/d]? The level0 file is there, I just checked. Probably something CRS related, but what? Thanks. -- Cheers, Gene "There are four boxes to be used in defense of liberty: soap, ballot, jury, and ammo. Please use in that order." -Ed Howdershelt (Author) Be frank and explicit with your lawyer ... it is his business to confuse the issue afterwards.
Quantum SuperLoader 3
Hi All, Is anyone here using a Quantum Superloader 3 (I know at least one person is) and care to share your config details with me? Specifically, how did you set up amanda.conf to use it. Thanks in advance, Nick Brockner
Re: recovery question
On Wednesday 19 November 2008, Thomas Wegner wrote: >Hi Gene! > >> Unforch, what I need is an amfind utility. I need to find all the >> spamassassin & perl stuffs that made spamassassin work before, I'm >> drowning in spam here. > >Take a look at "amadmin info" and "amadmin find". I think that are the >tools you are looking for. More at >http://wiki.zmanda.com/index.php/Restoring_files I actually found enough rpms to get it installed. Unforch, selinux is now disabling spamd's access to that users .user_prefs file, so while I've gotten rid of the "MISSED" message, it isn't actually working as planned yet. Would my backups contain the correct perms and selinux contexts to restore this? I have a msg posted to the selinux list, but so far no replies there. Thanks Thomas. -- Cheers, Gene "There are four boxes to be used in defense of liberty: soap, ballot, jury, and ammo. Please use in that order." -Ed Howdershelt (Author) War hath no fury like a non-combatant. -- Charles Edward Montague
Re: recovery question
Hi Gene! > Unforch, what I need is an amfind utility. I need to find all the > spamassassin & perl stuffs that made spamassassin work before, I'm drowning > in spam here. Take a look at "amadmin info" and "amadmin find". I think that are the tools you are looking for. More at http://wiki.zmanda.com/index.php/Restoring_files -- Regards Thomas
recovery question
Greetings all; I've just managed to get back to a working install here, after 4 days. My main 500Gb disk took a dump. Anyway, I now have amanda passing an amcheck operation so I assume that I could run amrecover. Unforch, what I need is an amfind utility. I need to find all the spamassassin & perl stuffs that made spamassassin work before, I'm drowning in spam here. Is this possible? -- Cheers, Gene "There are four boxes to be used in defense of liberty: soap, ballot, jury, and ammo. Please use in that order." -Ed Howdershelt (Author) May a Misguided Platypus lay its Eggs in your Jockey Shorts.
