chg-disk question
Greetings; I had to do an emergency main disk change over the last 2 days, and used rsync to copy everything to a new drive. It wasn't quite that easy cuz my dvd copy of F10 I was going to use to re-install grub from turned out to have had an early mortality, not the first time that spindle of 100 dvd's has bit me. So I had to go have a friend pull it and burn me a new copy, a several hour delay. Those red label HP dvd-r's aren't exactly top of the line IMO. Anyway, as I was editing my amanda.conf to let it use enough tapes to complete a level 0 tonight, I noted this a few lines away: tpchanger chg-disk # deprecated, use amanda_changer now. #amanda_changer chg-disk It seems to be working, but I wonder when it was that I added that comment? Which is it supposed to be for future compatibility? Thanks. -- Cheers, Gene There are four boxes to be used in defense of liberty: soap, ballot, jury, and ammo. Please use in that order. -Ed Howdershelt (Author) The NRA is offering FREE Associate memberships to anyone who wants them. https://www.nrahq.org/nrabonus/accept-membership.asp Our country has plenty of good five-cent cigars, but the trouble is they charge fifteen cents for them.
Re: chg-disk question
On Fri, Nov 13, 2009 at 11:42 AM, Gene Heskett gene.hesk...@verizon.net wrote: tpchanger chg-disk # deprecated, use amanda_changer now. #amanda_changer chg-disk It seems to be working, but I wonder when it was that I added that comment? Which is it supposed to be for future compatibility? Check amanda.conf(5) -- they're two completely different config parameters. Dustin -- Open Source Storage Engineer http://www.zmanda.com
Re: chg-disk question
On Friday 13 November 2009, Dustin J. Mitchell wrote: On Fri, Nov 13, 2009 at 11:42 AM, Gene Heskett gene.hesk...@verizon.net wrote: tpchanger chg-disk # deprecated, use amanda_changer now. #amanda_changer chg-disk It seems to be working, but I wonder when it was that I added that comment? Which is it supposed to be for future compatibility? Check amanda.conf(5) -- they're two completely different config parameters. Dustin Maybe, but there is nowhere near enough info in that to allow the un-assisted configuration of all that define amanda_changer {}. I saw someplace where I should create a set of slot# directories in the /usr/local/var/amanda tree, but there are none, its never been setup. My man-pages, installed with the 2.6.2-20091112 snapshot yesterday, are apparently _way_ behind in terms of tutorial value. And yet its working. Where are the docs to let us take advantage of these new features. If this needs to be configured, it would be very very nice if amcheck nagged us about it. As it is, it reports no errors. Except after changing runtapes from 1 to 3 for tonight's run, I get this: --- [ama...@coyote example]$ amcheck Daily /usr/local/etc/amanda/Daily/amanda.conf, line 107: configuration keyword expected amcheck: errors processing config file -- Ok, line 107: runtapes3 Hummm, where the heck did the space go? Put it back in... == [ama...@coyote example]$ amcheck Daily Amanda Tape Server Host Check - Holding disk /dumps: 87150592 kB disk space available, using 86638592 kB stage 1: search for oldest reusable volume oldest reusable volume is 'Dailys-29' changer is not fast-searchable; skipping to stage 2 stage 2: scan for any reusable volume trying slot 28 Volume with label 'Dailys-28' is still active and cannot be overwritten trying slot 29 Will write to volume 'Dailys-29' in slot 29. NOTE: skipping tape-writable test Server check took 1.767 seconds Amanda Backup Client Hosts Check Client check: 2 hosts checked in 1.588 seconds. 0 problems found. (brought to you by Amanda 2.6.2alpha) [ama...@coyote example]$ === As can be seen, no nagging. Unless this is what causes the changer not fast- searchable notice. Please excuse my bad mood, I am about to go to the funeral home stare at the urn a long time employee named Doug Butcher's ashes are in for several hours make small talk with all his friends then head for the Moose at about 6Pm for a Broken Circle ceremony finger food there. He made it to 44. Working for us at WDTV was pretty close to the only job he ever had. His whole family has a history of shortened lives, his only sibling, younger sister Letha has been gone for about 8 years already. Both his parents passed in their early 40's too, heart failure too. Even pacemakers didn't help extend him much, although he was implanted about 6 years ago so maybe he got some free time. Neither Letha nor Doug had any progeny or partners. -- Cheers, Gene There are four boxes to be used in defense of liberty: soap, ballot, jury, and ammo. Please use in that order. -Ed Howdershelt (Author) The NRA is offering FREE Associate memberships to anyone who wants them. https://www.nrahq.org/nrabonus/accept-membership.asp Fraud is the homage that force pays to reason. -- Charles Curtis, A Commonplace Book
Re: chg-disk question
On Fri, Nov 13, 2009 at 2:39 PM, Gene Heskett gene.hesk...@verizon.net wrote: Maybe, but there is nowhere near enough info in that to allow the un-assisted configuration of all that define amanda_changer {}. I saw someplace where I should create a set of slot# directories in the /usr/local/var/amanda tree, but there are none, its never been setup. My man-pages, installed with the 2.6.2-20091112 snapshot yesterday, are apparently _way_ behind in terms of tutorial value. And yet its working. Where are the docs to let us take advantage of these new features. I'm not sure what new features you're talking about -- from what I can tell, you had a disk failure and did a recovery, checked your config file and saw something that didn't look familiar (but was in fact familiar), and deleted a space between runtapes and 3. There's no such thing as define amanda_changer. What are you trying to do? Dustin -- Open Source Storage Engineer http://www.zmanda.com
Re: Inparallel - not paralleling
At 9:43 PM -0600 11/12/09, Frank Smith wrote: Deb Baddorf wrote: I have a 6 yr old amanda config which has been very nicely using up to 10 parallel dumpers. I've got 32 client nodes, so I have MAXDUMPS set to 2. The parallelism I desire is across different clients, not so much on the same client. Taking the same configuration (editted) to a new machine and new tape changer robot, I've still got INPARALLEL set to 10 ... but no parallelism is occurring (in test runs of only 7 client nodes). What am I missing -- why is my new setup not using multiple dumpers? Seven clients ought to be enough to cause parallelism. Deb Baddorf Fermilab Oh -- the new server is Linux rather than FreeBSD, so that's another difference. But: ulimit -a core file size (blocks, -c) 0 data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 32767 max locked memory (kbytes, -l) 32 max memory size (kbytes, -m) unlimited open files (-n) 1024 pipe size(512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 10240 cpu time (seconds, -t) unlimited max user processes (-u) 32767 virtual memory (kbytes, -v) unlimited file locks (-x) unlimited - my configs: -- # # configMAIN.include - Amanda configuration global definitions # # dumpuser operator inparallel 10 dumporder BTBTBTBTBT taperalgo largestfit flush-threshold-dumped 70 flush-threshold-scheduled 100 taperflush 0 netusage 1800 Kbps bumpsize 2 Mb bumpdays 1 bumppercent 20 bumpmult 4 maxdumpsize -1 amrecover_do_fsf yes amrecover_check_label yes amrecover_changer changer etimeout 2000 dtimeout 1800 ctimeout 30 tapebufs 20 tpchanger chg-zd-mtx # the tape-changer glue script reserve 02 # percent autoflush yes ## define tapetype SDLT320 { comment HP Super DLTtape I, data cartridge, C7980A, compression on length 139776 mbytes filemark 0 kbytes speed 13980 kps } #old 30-tape stacker. Keep in case needed to read older tapes. define tapetype DLT4000-IV { comment Quantum DLT4000 or DLT7000 writing DLT4000 format, with DLTtape IV uncompr essed length 4 mbytes filemark 8 kbytes speed 1500 kps lbl-templ /usr/local/etc/amanda/3hole.ps } #==# define dumptype BDglobal { comment Global definitions index yes priority medium compress client fast } define dumptype BDnormal { BDglobal record yes } -- --- # DAILY configuration #=# includefile /usr/local/etc/amanda/configMAIN.include #=# dumpcycle 7 days runspercycle 5 runtapes 5 tapecycle 100 tapes # 42-stacker unit: # 11/01/09 changerdev /dev/changer tapedev tape:/dev/nst2# the no-rewind tape device to be used # nst2 = changer 0 top unit, where 2/3 of daily tapes are changerfile /usr/local/etc/amanda/chg-daily-42 #my config data tapetype SDLT320# what kind of tape # (see tapetypes in ../configMAIN.include) ## holdingdisk hd1 { comment main holding disk directory /spool/amanda/daily # where the holding disk is use -100 Mb # how much space can we use on it # a non-positive value means: #use all space but that value # 20Gb was causing a perl glitch: - values in flush chunksize 2000Mb# size of chunk if you want big dump to be # dumped on multiple files on holding disks # N Kb/Mb/Gb split images in chunks of size N # The maximum value should be # (MAX_FILE_SIZE - 1Mb) # 0 same as INT_MAX bytes } holdingdisk hd2 { directory /spool2/amanda/daily use -100 Mb chunksize 2000Mb# size of chunk if you want big dump to be # dumped on multiple files on holding disks # N Kb/Mb/Gb split images in chunks of size N # The maximum value should be # (MAX_FILE_SIZE - 1Mb) # 0 same as INT_MAX bytes } ## define dumptype dailyNormal { BDnormal } define dumptype dailyNormalFast { BDnormal maxdumps 3 } The report and debug files on the server may provide more clues, but for starters I would verify that you actually have
Re: Inparallel - not paralleling
At 4:38 PM -0600 11/13/09, Deb Baddorf wrote: At 9:43 PM -0600 11/12/09, Frank Smith wrote: Deb Baddorf wrote: I have a 6 yr old amanda config which has been very nicely using up to 10 parallel dumpers. I've got 32 client nodes, so I have MAXDUMPS set to 2. The parallelism I desire is across different clients, not so much on the same client. Taking the same configuration (editted) to a new machine and new tape changer robot, I've still got INPARALLEL set to 10 ... but no parallelism is occurring (in test runs of only 7 client nodes). What am I missing -- why is my new setup not using multiple dumpers? Seven clients ought to be enough to cause parallelism. Deb Baddorf Fermilab Oh -- the new server is Linux rather than FreeBSD, so that's another difference. But: ulimit -a core file size (blocks, -c) 0 data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 32767 max locked memory (kbytes, -l) 32 max memory size (kbytes, -m) unlimited open files (-n) 1024 pipe size(512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 10240 cpu time (seconds, -t) unlimited max user processes (-u) 32767 virtual memory (kbytes, -v) unlimited file locks (-x) unlimited - my configs: -- # # configMAIN.include - Amanda configuration global definitions # # dumpuser operator inparallel 10 dumporder BTBTBTBTBT taperalgo largestfit flush-threshold-dumped 70 flush-threshold-scheduled 100 taperflush 0 netusage 1800 Kbps bumpsize 2 Mb bumpdays 1 bumppercent 20 bumpmult 4 maxdumpsize -1 amrecover_do_fsf yes amrecover_check_label yes amrecover_changer changer etimeout 2000 dtimeout 1800 ctimeout 30 tapebufs 20 tpchanger chg-zd-mtx # the tape-changer glue script reserve 02 # percent autoflush yes ## define tapetype SDLT320 { comment HP Super DLTtape I, data cartridge, C7980A, compression on length 139776 mbytes filemark 0 kbytes speed 13980 kps } #old 30-tape stacker. Keep in case needed to read older tapes. define tapetype DLT4000-IV { comment Quantum DLT4000 or DLT7000 writing DLT4000 format, with DLTtape IV uncompr essed length 4 mbytes filemark 8 kbytes speed 1500 kps lbl-templ /usr/local/etc/amanda/3hole.ps } #==# define dumptype BDglobal { comment Global definitions index yes priority medium compress client fast } define dumptype BDnormal { BDglobal record yes } -- --- # DAILY configuration #=# includefile /usr/local/etc/amanda/configMAIN.include #=# dumpcycle 7 days runspercycle 5 runtapes 5 tapecycle 100 tapes # 42-stacker unit: # 11/01/09 changerdev /dev/changer tapedev tape:/dev/nst2# the no-rewind tape device to be used # nst2 = changer 0 top unit, where 2/3 of daily tapes are changerfile /usr/local/etc/amanda/chg-daily-42 #my config data tapetype SDLT320# what kind of tape # (see tapetypes in ../configMAIN.include) ## holdingdisk hd1 { comment main holding disk directory /spool/amanda/daily # where the holding disk is use -100 Mb # how much space can we use on it # a non-positive value means: #use all space but that value # 20Gb was causing a perl glitch: - values in flush chunksize 2000Mb# size of chunk if you want big dump to be # dumped on multiple files on holding disks # N Kb/Mb/Gb split images in chunks of size N # The maximum value should be # (MAX_FILE_SIZE - 1Mb) # 0 same as INT_MAX bytes } holdingdisk hd2 { directory /spool2/amanda/daily use -100 Mb chunksize 2000Mb# size of chunk if you want big dump to be # dumped on multiple files on holding disks # N Kb/Mb/Gb split images in chunks of size N # The maximum value should be # (MAX_FILE_SIZE - 1Mb) # 0 same as INT_MAX bytes } ## define dumptype dailyNormal { BDnormal } define dumptype dailyNormalFast { BDnormal maxdumps 3 } The report and debug files on the server may provide more clues, but for
Re: chg-disk question
On Friday 13 November 2009, Dustin J. Mitchell wrote: On Fri, Nov 13, 2009 at 2:39 PM, Gene Heskett gene.hesk...@verizon.net wrote: Maybe, but there is nowhere near enough info in that to allow the un-assisted configuration of all that define amanda_changer {}. I saw someplace where I should create a set of slot# directories in the /usr/local/var/amanda tree, but there are none, its never been setup. My man-pages, installed with the 2.6.2-20091112 snapshot yesterday, are apparently _way_ behind in terms of tutorial value. And yet its working. Where are the docs to let us take advantage of these new features. I'm not sure what new features you're talking about -- from what I can tell, you had a disk failure and did a recovery, checked your config file and saw something that didn't look familiar (but was in fact familiar), and deleted a space between runtapes and 3. There's no such thing as define amanda_changer. What are you trying to do? Dustin Explain why my amanda.config says the option I'm using is deprecated? -- Cheers, Gene There are four boxes to be used in defense of liberty: soap, ballot, jury, and ammo. Please use in that order. -Ed Howdershelt (Author) The NRA is offering FREE Associate memberships to anyone who wants them. https://www.nrahq.org/nrabonus/accept-membership.asp /* * Buddy system. Hairy. You really aren't expected to understand this * */ -- From /usr/src/linux/mm/page_alloc.cA
Re: chg-disk question
On Fri, Nov 13, 2009 at 9:52 PM, Gene Heskett gene.hesk...@verizon.net wrote: Explain why my amanda.config says the option I'm using is deprecated? That's not in the example configurations, so I assume that you wrote it. A google for the phrase use amanda_changer now only turns up references to this thread. Also, it says that tpchanger is deprecated and to use amanda_changer instead, which is flagrantly incorrect - the two are completely unrelated. So if someone told you that they should be chided vigorously. Dustin -- Open Source Storage Engineer http://www.zmanda.com
Re: chg-disk question
On Friday 13 November 2009, Dustin J. Mitchell wrote: On Fri, Nov 13, 2009 at 9:52 PM, Gene Heskett gene.hesk...@verizon.net wrote: Explain why my amanda.config says the option I'm using is deprecated? That's not in the example configurations, so I assume that you wrote it. A google for the phrase use amanda_changer now only turns up references to this thread. Also, it says that tpchanger is deprecated and to use amanda_changer instead, which is flagrantly incorrect - the two are completely unrelated. So if someone told you that they should be chided vigorously. Dustin Ok, I now see where I saw the mention of it, in the new example/amanda.conf, it says: == tapedev tape:/dev/YOUR-TAPE-DEVICE-HERE # tape changer or device to use # To use vtapes, create some slotN directories (slot0, slot1, etc.) under # /var/amanda/vtapes and use this tapedev: ## tapedev chg-disk:/var/amanda/vtapes == Now, I can do the above, and I also assume I can move them to /usr.local/var/amanda, (and that this does not effect my present location for the vtapes themselves, which is a separate 1 terrabyte drive mounted to /amandatapes, ) where amanda keeps some other records also, but then what do I do with the tpchanger setting? You say its unrelated? It is not used in the new amanda.conf except inside a definition, but mine is not inside a define {}. That original advice did come from this list, but my corpus of old messages doesn't reach back that far as it was at least a year ago, maybe even 2. No actions are planned yet tonight though. Thanks Dustin. -- Cheers, Gene There are four boxes to be used in defense of liberty: soap, ballot, jury, and ammo. Please use in that order. -Ed Howdershelt (Author) The NRA is offering FREE Associate memberships to anyone who wants them. https://www.nrahq.org/nrabonus/accept-membership.asp Not only is UNIX dead, it's starting to smell really bad. -- Rob Pike