chg-disk question

2009-11-13 Thread Gene Heskett
Greetings;

I had to do an emergency main disk change over the last 2 days, and used 
rsync to copy everything to a new drive.  It wasn't quite that easy cuz my 
dvd copy of F10 I was going to use to re-install grub from turned out to have 
had an early mortality, not the first time that spindle of 100 dvd's has bit 
me.  So I had to go have a friend pull it and burn me a new copy, a several 
hour delay. Those red label HP dvd-r's aren't exactly top of the line IMO.

Anyway, as I was editing my amanda.conf to let it use enough tapes to 
complete a level 0 tonight, I noted this a few lines away:

tpchanger   chg-disk  # deprecated, use amanda_changer now.
#amanda_changer chg-disk

It seems to be working, but I wonder when it was that I added that comment?
Which is it supposed to be for future compatibility?

Thanks.

-- 
Cheers, Gene
There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order.
-Ed Howdershelt (Author)
The NRA is offering FREE Associate memberships to anyone who wants them.
https://www.nrahq.org/nrabonus/accept-membership.asp

Our country has plenty of good five-cent cigars, but the trouble is
they charge fifteen cents for them.


Re: chg-disk question

2009-11-13 Thread Dustin J. Mitchell
On Fri, Nov 13, 2009 at 11:42 AM, Gene Heskett gene.hesk...@verizon.net wrote:
 tpchanger       chg-disk      # deprecated, use amanda_changer now.
 #amanda_changer chg-disk

 It seems to be working, but I wonder when it was that I added that comment?
 Which is it supposed to be for future compatibility?

Check amanda.conf(5) -- they're two completely different config parameters.

Dustin

-- 
Open Source Storage Engineer
http://www.zmanda.com


Re: chg-disk question

2009-11-13 Thread Gene Heskett
On Friday 13 November 2009, Dustin J. Mitchell wrote:
On Fri, Nov 13, 2009 at 11:42 AM, Gene Heskett gene.hesk...@verizon.net 
wrote:
 tpchanger   chg-disk  # deprecated, use amanda_changer now.
 #amanda_changer chg-disk

 It seems to be working, but I wonder when it was that I added that
 comment? Which is it supposed to be for future compatibility?

Check amanda.conf(5) -- they're two completely different config parameters.

Dustin

Maybe, but there is nowhere near enough info in that to allow the un-assisted 
configuration of all that define amanda_changer {}.  I saw someplace where 
I should create a set of slot# directories in the /usr/local/var/amanda tree, 
but there are none, its never been setup.  My man-pages, installed with the 
2.6.2-20091112 snapshot yesterday, are apparently _way_ behind in terms of 
tutorial value.   And yet its working.  Where are the docs to let us take 
advantage of these new features.

If this needs to be configured, it would be very very nice if amcheck nagged 
us about it.  As it is, it reports no errors.  Except after changing runtapes 
from 1 to 3 for tonight's run, I get this:
---
[ama...@coyote example]$ amcheck Daily
/usr/local/etc/amanda/Daily/amanda.conf, line 107: configuration keyword 
expected
amcheck: errors processing config file
--
Ok, line 107:
runtapes3
Hummm, where the heck did the space go?  Put it back in...
==
[ama...@coyote example]$ amcheck Daily
Amanda Tape Server Host Check
-
Holding disk /dumps: 87150592 kB disk space available, using 86638592 kB
stage 1: search for oldest reusable volume
oldest reusable volume is 'Dailys-29'
changer is not fast-searchable; skipping to stage 2
stage 2: scan for any reusable volume
trying slot 28
Volume with label 'Dailys-28' is still active and cannot be overwritten
trying slot 29
Will write to volume 'Dailys-29' in slot 29.
NOTE: skipping tape-writable test
Server check took 1.767 seconds

Amanda Backup Client Hosts Check

Client check: 2 hosts checked in 1.588 seconds.  0 problems found.

(brought to you by Amanda 2.6.2alpha)
[ama...@coyote example]$
===

As can be seen, no nagging.  Unless this is what causes the changer not 
fast- searchable notice.

Please excuse my bad mood, I am about to go to the funeral home  stare at 
the urn a long time employee named Doug Butcher's ashes are in for several 
hours  make small talk with all his friends  then head for the Moose at 
about 6Pm for a Broken Circle ceremony  finger food there.  He made it to 
44.  Working for us at WDTV was pretty close to the only job he ever had.  

His whole family has a history of shortened lives, his only sibling, younger 
sister Letha has been gone for about 8 years already.  Both his parents 
passed in their early 40's too, heart failure too.  Even pacemakers didn't 
help extend him much, although he was implanted about 6 years ago so maybe he 
got some free time.  Neither Letha nor Doug had any progeny or partners.

-- 
Cheers, Gene
There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order.
-Ed Howdershelt (Author)
The NRA is offering FREE Associate memberships to anyone who wants them.
https://www.nrahq.org/nrabonus/accept-membership.asp

Fraud is the homage that force pays to reason.
-- Charles Curtis, A Commonplace Book


Re: chg-disk question

2009-11-13 Thread Dustin J. Mitchell
On Fri, Nov 13, 2009 at 2:39 PM, Gene Heskett gene.hesk...@verizon.net wrote:
 Maybe, but there is nowhere near enough info in that to allow the un-assisted
 configuration of all that define amanda_changer {}.  I saw someplace where
 I should create a set of slot# directories in the /usr/local/var/amanda tree,
 but there are none, its never been setup.  My man-pages, installed with the
 2.6.2-20091112 snapshot yesterday, are apparently _way_ behind in terms of
 tutorial value.   And yet its working.  Where are the docs to let us take
 advantage of these new features.

I'm not sure what new features you're talking about -- from what I
can tell, you had a disk failure and did a recovery, checked your
config file and saw something that didn't look familiar (but was in
fact familiar), and deleted a space between runtapes and 3.
There's no such thing as define amanda_changer.

What are you trying to do?

Dustin

-- 
Open Source Storage Engineer
http://www.zmanda.com


Re: Inparallel - not paralleling

2009-11-13 Thread Deb Baddorf

At 9:43 PM -0600 11/12/09, Frank Smith wrote:

Deb Baddorf wrote:

I have a 6 yr old amanda config which has been very nicely using up to
10 parallel dumpers.   I've got 32 client nodes,  so I have  MAXDUMPS
set to 2.  The parallelism I desire is across different clients, 
not so much

on the same client.

Taking the same configuration (editted)   to a new machine and new 
tape changer

robot,   I've still got INPARALLEL  set to 10 ...   but no parallelism is
occurring  (in test runs of only 7 client nodes).   What am I missing --
why is my new setup not using multiple dumpers?   Seven clients ought
to be enough to cause parallelism.

Deb Baddorf
Fermilab


Oh -- the new server is Linux rather than FreeBSD,  so that's  another
difference.   But:
ulimit -a
core file size  (blocks, -c) 0
data seg size   (kbytes, -d) unlimited
scheduling priority (-e) 0
file size   (blocks, -f) unlimited
pending signals (-i) 32767
max locked memory   (kbytes, -l) 32
max memory size (kbytes, -m) unlimited
open files  (-n) 1024
pipe size(512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority  (-r) 0
stack size  (kbytes, -s) 10240
cpu time   (seconds, -t) unlimited
max user processes  (-u) 32767
virtual memory  (kbytes, -v) unlimited
file locks  (-x) unlimited

-
my configs:
--
#
# configMAIN.include - Amanda configuration global definitions
#
#
dumpuser operator
inparallel 10
dumporder BTBTBTBTBT
taperalgo largestfit

flush-threshold-dumped 70
flush-threshold-scheduled 100
taperflush 0
netusage  1800 Kbps
bumpsize 2 Mb
bumpdays 1
bumppercent 20
bumpmult 4

maxdumpsize -1
amrecover_do_fsf yes
amrecover_check_label yes
amrecover_changer changer

etimeout 2000
dtimeout 1800
ctimeout 30

tapebufs 20
tpchanger chg-zd-mtx  # the tape-changer glue script

reserve 02 # percent
autoflush yes
##


define tapetype SDLT320 {
 comment HP Super DLTtape I, data cartridge, C7980A, compression on
 length 139776 mbytes
 filemark 0 kbytes
 speed 13980 kps
}


#old 30-tape stacker.   Keep in case needed to read older tapes.
define tapetype DLT4000-IV {
comment Quantum DLT4000 or DLT7000 writing DLT4000 format, 
with DLTtape IV uncompr

essed
length 4 mbytes
filemark 8 kbytes
speed 1500 kps
lbl-templ /usr/local/etc/amanda/3hole.ps
}


#==#
define dumptype BDglobal {
comment Global definitions
index yes
priority medium
compress client fast
}
define dumptype BDnormal {
BDglobal
record yes
}

--
---
#  DAILY configuration
#=#

includefile /usr/local/etc/amanda/configMAIN.include

#=#


dumpcycle 7 days
runspercycle 5
runtapes 5
tapecycle 100 tapes

# 42-stacker unit:   # 11/01/09
changerdev /dev/changer
tapedev tape:/dev/nst2# the no-rewind tape device to be used
#   nst2  = changer 0   top unit,  where 2/3 of daily tapes are

changerfile /usr/local/etc/amanda/chg-daily-42   #my config data

tapetype SDLT320# what kind of tape
#  (see tapetypes in  ../configMAIN.include)

##
holdingdisk hd1 {
comment main holding disk
directory /spool/amanda/daily   # where the holding disk is
use -100 Mb # how much space can we use on it
# a non-positive value means:
#use all space but that value
   # 20Gb was causing a perl glitch: - 
values in flush

chunksize 2000Mb# size of chunk if you want big dump to be
# dumped on multiple files on holding disks
#  N Kb/Mb/Gb split images in chunks of size N
# The maximum value should be
# (MAX_FILE_SIZE - 1Mb)
#  0  same as INT_MAX bytes
}
holdingdisk hd2 {
directory /spool2/amanda/daily
use -100 Mb
chunksize 2000Mb# size of chunk if you want big dump to be
# dumped on multiple files on holding disks
#  N Kb/Mb/Gb split images in chunks of size N
# The maximum value should be
# (MAX_FILE_SIZE - 1Mb)
#  0  same as INT_MAX bytes
}

##
define dumptype dailyNormal {
BDnormal
}

define dumptype dailyNormalFast {
BDnormal
maxdumps 3
}


The report and debug files on the server may provide more clues,
but for starters I would verify that you actually have 

Re: Inparallel - not paralleling

2009-11-13 Thread Deb Baddorf

At 4:38 PM -0600 11/13/09, Deb Baddorf wrote:

At 9:43 PM -0600 11/12/09, Frank Smith wrote:

Deb Baddorf wrote:

I have a 6 yr old amanda config which has been very nicely using up to
10 parallel dumpers.   I've got 32 client nodes,  so I have  MAXDUMPS
set to 2.  The parallelism I desire is across different clients, not so much
on the same client.

Taking the same configuration (editted)   to a new machine and new 
tape changer

robot,   I've still got INPARALLEL  set to 10 ...   but no parallelism is
occurring  (in test runs of only 7 client nodes).   What am I missing --
why is my new setup not using multiple dumpers?   Seven clients ought
to be enough to cause parallelism.

Deb Baddorf
Fermilab


Oh -- the new server is Linux rather than FreeBSD,  so that's  another
difference.   But:
ulimit -a
core file size  (blocks, -c) 0
data seg size   (kbytes, -d) unlimited
scheduling priority (-e) 0
file size   (blocks, -f) unlimited
pending signals (-i) 32767
max locked memory   (kbytes, -l) 32
max memory size (kbytes, -m) unlimited
open files  (-n) 1024
pipe size(512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority  (-r) 0
stack size  (kbytes, -s) 10240
cpu time   (seconds, -t) unlimited
max user processes  (-u) 32767
virtual memory  (kbytes, -v) unlimited
file locks  (-x) unlimited

-
my configs:
--
#
# configMAIN.include - Amanda configuration global definitions
#
#
dumpuser operator
inparallel 10
dumporder BTBTBTBTBT
taperalgo largestfit

flush-threshold-dumped 70
flush-threshold-scheduled 100
taperflush 0
netusage  1800 Kbps
bumpsize 2 Mb
bumpdays 1
bumppercent 20
bumpmult 4

maxdumpsize -1
amrecover_do_fsf yes
amrecover_check_label yes
amrecover_changer changer

etimeout 2000
dtimeout 1800
ctimeout 30

tapebufs 20
tpchanger chg-zd-mtx  # the tape-changer glue script

reserve 02 # percent
autoflush yes
##


define tapetype SDLT320 {
 comment HP Super DLTtape I, data cartridge, C7980A, compression on
 length 139776 mbytes
 filemark 0 kbytes
 speed 13980 kps
}


#old 30-tape stacker.   Keep in case needed to read older tapes.
define tapetype DLT4000-IV {
comment Quantum DLT4000 or DLT7000 writing DLT4000 format, 
with DLTtape IV uncompr

essed
length 4 mbytes
filemark 8 kbytes
speed 1500 kps
lbl-templ /usr/local/etc/amanda/3hole.ps
}


#==#
define dumptype BDglobal {
comment Global definitions
index yes
priority medium
compress client fast
}
define dumptype BDnormal {
BDglobal
record yes
}

--
---
#  DAILY configuration
#=#

includefile /usr/local/etc/amanda/configMAIN.include

#=#


dumpcycle 7 days
runspercycle 5
runtapes 5
tapecycle 100 tapes

# 42-stacker unit:   # 11/01/09
changerdev /dev/changer
tapedev tape:/dev/nst2# the no-rewind tape device to be used
#   nst2  = changer 0   top unit,  where 2/3 of daily tapes are

changerfile /usr/local/etc/amanda/chg-daily-42   #my config data

tapetype SDLT320# what kind of tape
#  (see tapetypes in  ../configMAIN.include)

##
holdingdisk hd1 {
comment main holding disk
directory /spool/amanda/daily   # where the holding disk is
use -100 Mb # how much space can we use on it
# a non-positive value means:
#use all space but that value
   # 20Gb was causing a perl glitch: - 
values in flush

chunksize 2000Mb# size of chunk if you want big dump to be
# dumped on multiple files on holding disks
#  N Kb/Mb/Gb split images in chunks of size N
# The maximum value should be
# (MAX_FILE_SIZE - 1Mb)
#  0  same as INT_MAX bytes
}
holdingdisk hd2 {
directory /spool2/amanda/daily
use -100 Mb
chunksize 2000Mb# size of chunk if you want big dump to be
# dumped on multiple files on holding disks
#  N Kb/Mb/Gb split images in chunks of size N
# The maximum value should be
# (MAX_FILE_SIZE - 1Mb)
#  0  same as INT_MAX bytes
}

##
define dumptype dailyNormal {
BDnormal
}

define dumptype dailyNormalFast {
BDnormal
maxdumps 3
}


The report and debug files on the server may provide more clues,
but for 

Re: chg-disk question

2009-11-13 Thread Gene Heskett
On Friday 13 November 2009, Dustin J. Mitchell wrote:
On Fri, Nov 13, 2009 at 2:39 PM, Gene Heskett gene.hesk...@verizon.net 
wrote:
 Maybe, but there is nowhere near enough info in that to allow the
 un-assisted configuration of all that define amanda_changer {}.  I saw
 someplace where I should create a set of slot# directories in the
 /usr/local/var/amanda tree, but there are none, its never been setup.  My
 man-pages, installed with the 2.6.2-20091112 snapshot yesterday, are
 apparently _way_ behind in terms of tutorial value.   And yet its
 working.  Where are the docs to let us take advantage of these new
 features.

I'm not sure what new features you're talking about -- from what I
can tell, you had a disk failure and did a recovery, checked your
config file and saw something that didn't look familiar (but was in
fact familiar), and deleted a space between runtapes and 3.
There's no such thing as define amanda_changer.

What are you trying to do?

Dustin

Explain why my amanda.config says the option I'm using is deprecated?

-- 
Cheers, Gene
There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order.
-Ed Howdershelt (Author)
The NRA is offering FREE Associate memberships to anyone who wants them.
https://www.nrahq.org/nrabonus/accept-membership.asp

/*
 * Buddy system. Hairy. You really aren't expected to understand this
 *
 */
-- From /usr/src/linux/mm/page_alloc.cA


Re: chg-disk question

2009-11-13 Thread Dustin J. Mitchell
On Fri, Nov 13, 2009 at 9:52 PM, Gene Heskett gene.hesk...@verizon.net wrote:
 Explain why my amanda.config says the option I'm using is deprecated?

That's not in the example configurations, so I assume that you wrote
it.  A google for the phrase use amanda_changer now only turns up
references to this thread.

Also, it says that tpchanger is deprecated and to use amanda_changer
instead, which is flagrantly incorrect - the two are completely
unrelated.  So if someone told you that they should be chided
vigorously.

Dustin

-- 
Open Source Storage Engineer
http://www.zmanda.com


Re: chg-disk question

2009-11-13 Thread Gene Heskett
On Friday 13 November 2009, Dustin J. Mitchell wrote:
On Fri, Nov 13, 2009 at 9:52 PM, Gene Heskett gene.hesk...@verizon.net 
wrote:
 Explain why my amanda.config says the option I'm using is deprecated?

That's not in the example configurations, so I assume that you wrote
it.  A google for the phrase use amanda_changer now only turns up
references to this thread.

Also, it says that tpchanger is deprecated and to use amanda_changer
instead, which is flagrantly incorrect - the two are completely
unrelated.  So if someone told you that they should be chided
vigorously.

Dustin

Ok, I now see where I saw the mention of it, in the new example/amanda.conf, 
it says:
==
tapedev tape:/dev/YOUR-TAPE-DEVICE-HERE   # tape changer or device to 
use

# To use vtapes, create some slotN directories (slot0, slot1, etc.) under
# /var/amanda/vtapes and use this tapedev:
## tapedev chg-disk:/var/amanda/vtapes
==

Now, I can do the above, and I also assume I can move them to 
/usr.local/var/amanda, (and that this does not effect my present location for 
the vtapes themselves, which is a separate 1 terrabyte drive mounted to 
/amandatapes, ) where amanda keeps some other records also, but then what do 
I do with the tpchanger setting?  You say its unrelated?  It is not used in 
the new amanda.conf except inside a definition, but mine is not inside a 
define {}.

That original advice did come from this list, but my corpus of old messages 
doesn't reach back that far as it was at least a year ago, maybe even 2.

No actions are planned yet tonight though.

Thanks Dustin.

-- 
Cheers, Gene
There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order.
-Ed Howdershelt (Author)
The NRA is offering FREE Associate memberships to anyone who wants them.
https://www.nrahq.org/nrabonus/accept-membership.asp

Not only is UNIX dead, it's starting to smell really bad.
-- Rob Pike