RE: amlabel

2003-03-12 Thread afourey
Hi,

I get error with rpm version of amanda (2.4.2P2-9).

I compile version 2.4.4 of amanda and all working fine

thanks.

--

Alexandre FOUREY

Consultant Architecture de Systèmes
T-Systems Soleri
Groupe Deutsche Telekom
Notre métier : la convergence informatique et télécoms
Convergence is our Business
-
tél. : +33 (0)4 37 65 24 34
fax  : +33 (0)4 37 65 24 24
mob  : +33 (0)6 61 92 43 00
-
www.t-systems.fr
Hi,

Which release of amanda?
What's in amanda.conf
What's in your changer conf file?
Jean-Louis

On Tue, Mar 11, 2003 at 10:01:00AM +0100, afourey wrote:

I would like to create virtual tape on hard disk.

mkdir -p  /data/backups/tape01/data
chown -R amanda.disk /data/backups
chmod -R 770 /data/backups
amlabel -f DailySet1 DailySet101
I get the following error :
amlabel: could not load slot current: file:/data/backups/tape01: not a 
device file

Please help


 





Re: raw device ownership permissions on SGI machine

2003-03-12 Thread Harri Haataja
On Tue, Mar 11, 2003 at 03:35:44PM -0800, Stephen D. Lane wrote:
 Greetings.  I am using amanda to back up several clients, one of which
 is an SGI Origin workstation.  This client was recently rebuilt from
 scratch to IRIX 6.5.19m (yesterday, as a matter of fact :), and I
 don't know if the following problem was present prior to the rebuild
 (it was at 6.5.18m, after having been upgraded from 6.5.3m).  I do
 know that amanda was working fine.
 After I rebuilt the client, it had the following:
0 crw---1 root sys 0,125 Mar 11 15:26 /hw/rdisk/root
 As this is the device amcheck complains about when I tell it I want to
 back up the root partition, I made the following changes:
0 crw-rw1 amanda   disk0,125 Mar 11 15:26 /hw/rdisk/root
 This is how it was configured before the rebuild, and amcheck is
 perfectly happy with this.
 If I reboot the machine, however, the device goes back to:
0 crw---1 root sys 0,125 Mar 11 15:26 /hw/rdisk/root
 
 Is anyone familiar with this behavior in IRIX?  I am seriously contemplating
 a root cronjob...

I believe the /hw filesystem is created on the fly like /proc or a
devfs. Actually..

[EMAIL PROTECTED] uname
IRIX64
[EMAIL PROTECTED] mount | grep hw
/hw on /hw type hwgfs (rw)
[EMAIL PROTECTED] man -k hwgfs
hwgraph, hwgfs, hw (4)  - hardware graph and hardware graph file system

And from there, I find:

Since hwgfs is a pseudo-filesystem whose files don't actually use any
disk space, there is no persistent information associated with files
under /hw.  In particular, file attributes (mode, owner, group) are not
stored across reboots under hwgfs.  Rather, reasonable default are used
for all hwgfs special files.  These defaults can be changed in the
normal ways (i.e. with chmod(1), chown(1), chgrp(1)), but the changes
only last until the next time the system is rebooted.  In order to
supply the appearance of special file attributes that are persistent
across reboots, hwgfs uses the ioconfig(1m) utility, controlled by the
contents of the file /etc/ioperms.

Nice to know this. I have not used amanda and dump on Irix so I haven't
come across this.

-- 
I suggest that you refrain from posting in a forum such as this one,
in which you are clearly intellectually overmatched. Perhaps you
should find a debating companion that more closely reflects your natural
abilities, such as a rock.  -- Jake, in the Monastery


Re: drive compression discovery

2003-03-12 Thread Sven Rudolph
Gene Heskett [EMAIL PROTECTED] writes:

 To get around this, one would assume that amcheck has already been 
 run, and that the correct tape for tonights session is indeed 
 loaded into the drive,

This doesn't work when you have to write to more than one
tape. Sometimes you do not even know in advance how many tapes will be
needed.

 a: rewind tape
 b: dd tape label to scratch file, don't forget the 'bs=32k'
 c: rewind tape
 d: turn compression off by whatever method
 e: dd 10 megs or more worth of /dev/zero to the drive, causing it to
   flush its buffers.  This will cause that compression flag to be 
   reset permanently on this tape.  Using bs=32k of course
 f: rewind tape
 g: dd the scratch file back to the tape to restore the proper label.

For my DLT drives writing 32k is sufficient.

The taper rewrites the label anyway, so the only additional step is to
have the taper do the mt call before writing the label back.

Two options:
- do the ioctl internally. This might be machine-specific ...
- call external mt. This means taper has to close the tape fd, call the 
  external program and the reopen the tape. This is against taper's 
  race-avoiding principles.

But when you handcraft this by any workaround like you proposed, there
are even more races possible. (Like something migt change the tape
beetween your amcheck and yout script-erasing.)

So I see these two options which both have their drawbacks.

Sven


Who uses amanda?

2003-03-12 Thread Dr. David Kirkby
Can anyone tell me if they use amanda and are a large commercial company
( 250 employees), a hospital or a university and if so how much it's
used (whole institution, small department, single server etc). How many
Gb do you back up (don't answer that if you feel its confidential, or
you don't know). 

I don't work in computer support but are aware there is a talk of buying
a Veritas backup package at academic discount (around 800 UK pounds or
$1300). I wanted to know if amanda would be a viable option. I guess
there are going to be issues bought up about support, stability, the
importance of backups etc. I'd like to know of big organistations using
the software and if they have compared it to Veritas. 

I looked at using amanda once for my home computer (Sun Ultra 80, about
200 Gb of disk space over 4/5 drives, 40 Gb tape drive), but decided
that for such a small system, a couple of unix shell scripts run by cron
was all I needed, so never bothered using amanda. I know shell scripts
are currently used here but we intend expanding the disk space by quite
a lot. 

So basically:
a) I know little about amanda
b) Have no intention of using it myself for my home computer, but wonder
if its a variable option in a university department (~100 staff).


Dr. David Kirkby PhD,
Senior Research Fellow,
Department of Medical Physics,
University College London,
11-20 Capper St, London, WC1E 6JA.
Tel: 020 7679 6408 Fax: 020 7679 6269
Internal telephone: ext 46408
e-mail [EMAIL PROTECTED]  
Web page: http://www.medphys.ucl.ac.uk/~davek


Re: Who uses amanda?

2003-03-12 Thread Matt Hyclak
On Wed, Mar 12, 2003 at 11:59:45AM +, Dr. David Kirkby enlightened us:
 Can anyone tell me if they use amanda and are a large commercial company
 ( 250 employees), a hospital or a university and if so how much it's
 used (whole institution, small department, single server etc). How many
 Gb do you back up (don't answer that if you feel its confidential, or
 you don't know). 
 

David,

We used amanda at my previous job in a small department at Ohio State
University (Linguistics). We had about 20 faculty and 80 grad students.
Amanda was used to backup the 2 servers, 20 or so Sun workstations, and a
handful of faculty PCs running windows. I can't remember exactly how much
data we backed up, but I believe it was about 80-90GB for a full dump of all
the DLEs which we archived after every academic quarter.

I am presently in the process of setting up amanda in a slightly larger
department at Ohio University (Mathematics). I expect the numbers to be
about the same, and may look into backing up all of our faculty computers. 

I also use amanda at home, and would trust it with the most critical of
data. The big selling point there is that you don't need amanda to recover
data from a tape...just dd, tar, and dump. 

Hope that helps,
Matt

-- 
Matt Hyclak
Department of Mathematics
Ohio University
(740) 593-1263


pgp0.pgp
Description: PGP signature


Re: Who uses amanda?

2003-03-12 Thread Greg Troxel
For your home machine, amanda still makes sense.  It can schedule
full dumps of partitions over multiple nights, etc. and do the
bookkeeping of what is on what tape.  I know several people that run
amanda at home.

My department has ~30 employees.  We run 2 amanda setups onto DDS3 and
1 onto DDS2, and back up around 130 GB total (one has 93 GB of that).
They are not separate because one couldn't handle it, but for
administrative reasons I don't want to go into.  Absent the
administrative reasons, we'd probably have everything on one setup and
I'm confident it would work fine.

The servers are desktop PCs running NetBSD with SCSI cards and DDS3
tape drives.  A no longer loved sparc 20 with NetBSD is a decent
choice for smaller setups; there is one such setup at MIT backing up
about 6 machines.  For 100 people you probably want DLT, and maybe a
changer.  (Assume 400 GB, divide by perhaps 10 for a tape cycle with
30 tapes and full dumps every 10 runs, and an 80 GB native tape should
be fine for a while.  Remember that you need to buy 2 to have a
backup...)  I've seen what commercial backup support is like, and the
free support or some sysadmin time in your organization is probably as
good a bet.  My experience is that support people learn amanda faster
than commercial backups, and between self help and mailinglist both
have fewer problems and solve them faster than commercial backup
software.

Many others on the list run bigger setups, including with tape
changers.  Your size of 100 users is not 'large' in terms of existing
amanda practice.

Points to consider when choosing a backup system:

Amanda puts backups on tape in a way that can be read with standard
tools (dd, gunzip, restore, tar) by anybody with basic sysadmin clue.
You do not need amanda or proprietary tools.  Ask how bits can be
gotten back with any prospective system.  Ask if there is license
managment software that must work to get bits back.

Amanda self-schedules full dumps to fit.  The administrative burden is
_very_ low.  I am a researcher not a sysadmin, and run a 36 GB total
setup.  Most days I spend 1 minute glancing at the report, typing 'mt
offline' and putting in the next tape.  Even with this, I am confident
that all the bits are on tape if the report has no exception items.

I have seen a commercial system for MS Windows completely fail to
achieve its mission when indices were only on RAID sets and not on
tape (multiple disk failures occurred).  Amanda puts the bits on tape,
and you can read them back with any other computer and a tape drive,
even if you don't have the indices.  You may have to scan 20 tapes,
but that's a good situation to be in after a catastrophic failure,
really.

The importance of backups should lead to a regular program of randomly
selected test restores to do QA.  We have had a 100% success rate for
getting bits back when we needed them (several times since 1995 or so,
both disk failure and mistaken rm).  Our real only issue was a tape
drive that wrote bits wrong, and we read the entire tape back once a
week with amverify to ensure that the tape drive works.  I consider
amanda as reliable as anything commercial, and really even more so.

to be fair:

Amanda's big weakness is in making multiple tapes for offsite storage.
This can be done by various ways discussed on the list, none of which
are particularly pretty.  One is just to do a tape-tape copy after the
dump, and ship one of them offsite.  I gather than some commercial
programs have explicit support for this.

The other downside is that amanda doesn't have integrated Oracle
support, etc.  If you have postgres and do pg_dump to a file, that
seems to work fine.

Amanda security is a bit weak.  Kerberos is not really supported, even
though the code is sort of there.  The 'bsd style' authentication is
bogus (IP address check).  But although I say this, every commercial
package I've examined in detail has been worse.

Good questions to ask are whether there is strong authentication and
confidentiality of the data stream, both authenticating the server to
the client to authorize the request to send the bits (most important),
and the client to the server to ensure that the right bits are on
tape.  And, the bits should be encrypted in transit.  Amanda/kerberos
can do this, and I'm running it, but it's not trivial.  One could use
IPsec, too, although that may require minor wizardry.

Greg Troxel [EMAIL PROTECTED]


Re: dump largee than tape

2003-03-12 Thread Konrad Dienst
Hi!

Here are the debugs of one run.
amandad: debug 1 pid 1888 ruid 501 euid 501: start at Wed Mar 12 09:13:11 2003
amandad: version 2.4.4
amandad: build: VERSION=Amanda-2.4.4
amandad:BUILT_DATE=Mon Mar 3 09:53:03 CET 2003
amandad:BUILT_MACH=Linux corellia 2.4.18-3 #1 Thu Apr 18 07:32:41 EDT 2002 
i686 unknown
amandad:CC=gcc
amandad:CONFIGURE_COMMAND='./configure' '--with-user=amanda' 
'--with-group=amanda'
amandad: paths: bindir=/usr/local/bin sbindir=/usr/local/sbin
amandad:libexecdir=/usr/local/libexec mandir=/usr/local/man
amandad:AMANDA_TMPDIR=/tmp/amanda AMANDA_DBGDIR=/tmp/amanda
amandad:CONFIG_DIR=/usr/local/etc/amanda DEV_PREFIX=/dev/
amandad:RDEV_PREFIX=/dev/ DUMP=/sbin/dump
amandad:RESTORE=/sbin/restore GNUTAR=/bin/gtar
amandad:COMPRESS_PATH=/bin/gzip UNCOMPRESS_PATH=/bin/gzip
amandad:MAILER=/usr/bin/Mail
amandad:listed_incr_dir=/usr/local/var/amanda/gnutar-lists
amandad: defs:  DEFAULT_SERVER=corellia DEFAULT_CONFIG=DailySet1
amandad:DEFAULT_TAPE_SERVER=corellia
amandad:DEFAULT_TAPE_DEVICE=/dev/null HAVE_MMAP HAVE_SYSVSHM
amandad:LOCKING=POSIX_FCNTL SETPGRP_VOID DEBUG_CODE
amandad:AMANDA_DEBUG_DAYS=4 BSD_SECURITY USE_AMANDAHOSTS
amandad:CLIENT_LOGIN=amanda FORCE_USERID HAVE_GZIP
amandad:COMPRESS_SUFFIX=.gz COMPRESS_FAST_OPT=--fast
amandad:COMPRESS_BEST_OPT=--best UNCOMPRESS_OPT=-dc
amandad: time 0.000: got packet:

Amanda 2.4 REQ HANDLE 000-00560508 SEQ 1047460425
SECURITY USER amanda
SERVICE noop
OPTIONS features=feff9ffe0f;


amandad: time 0.000: sending ack:

Amanda 2.4 ACK HANDLE 000-00560508 SEQ 1047460425


amandad: time 0.000: bsd security: remote host altair user amanda local user amanda
amandad: time 0.001: amandahosts security check passed
amandad: time 0.001: running service noop
amandad: time 0.001: sending REP packet:

Amanda 2.4 REP HANDLE 000-00560508 SEQ 1047460425
OPTIONS features=feff9ffe0f;


amandad: time 0.001: got packet:

Amanda 2.4 ACK HANDLE 000-00560508 SEQ 1047460425


amandad: time 0.001: pid 1888 finish time Wed Mar 12 09:13:11 2003
killpgrp: debug 1 pid 1893 ruid 501 euid 0: start at Wed Mar 12 09:13:11 2003
/usr/local/libexec/killpgrp: version 2.4.4
sending SIGTERM to process group 1893
child process exited with status 0
selfcheck: debug 1 pid 1886 ruid 501 euid 501: start at Wed Mar 12 09:11:53 2003
/usr/local/libexec/selfcheck: version 2.4.4
selfcheck: time 0.000: checking disk /export
selfcheck: time 0.011: device /dev/sda3
selfcheck: time 0.011: disk /export OK
selfcheck: time 0.011: amdevice /export OK
selfcheck: time 0.011: device /dev/sda3 OK
selfcheck: time 0.011: pid 1886 finish time Wed Mar 12 09:11:53 2003
sendsize: debug 1 pid 1890 ruid 501 euid 501: start at Wed Mar 12 09:13:11 2003
sendsize: version 2.4.4
sendsize[1890]: time 0.023: waiting for any estimate child
sendsize[1892]: time 0.024: calculating for amname '/export', dirname '/export', 
spindle -1
sendsize[1892]: time 0.024: getting size via dump for /export level 0
sendsize[1892]: time 0.025: calculating for device '/dev/sda3' with 'ext2'
sendsize[1892]: time 0.025: running /sbin/dump 0Ssf 1048576 - /dev/sda3
sendsize[1892]: time 0.025: running /usr/local/libexec/killpgrp
sendsize[1892]: time 0.168:   DUMP: Warning: unable to translate LABEL=/
sendsize[1892]: time 0.169:   DUMP: Warning: unable to translate LABEL=/boot
sendsize[1892]: time 0.170:   DUMP: Warning: unable to translate LABEL=/var
sendsize[1892]: time 0.171:   DUMP: Added inode 7 to exclude list (resize inode)
sendsize[1892]: time 5.212: 133587968
sendsize[1892]: time 5.236: .
sendsize[1892]: estimate time for /export level 0: 5.211
sendsize[1892]: estimate size for /export level 0: 130457 KB
sendsize[1892]: time 5.236: asking killpgrp to terminate
sendsize[1892]: time 6.238: getting size via dump for /export level 1
sendsize[1892]: time 6.239: calculating for device '/dev/sda3' with 'ext2'
sendsize[1892]: time 6.239: running /sbin/dump 1Ssf 1048576 - /dev/sda3
sendsize[1892]: time 6.240: running /usr/local/libexec/killpgrp
sendsize[1892]: time 6.249:   DUMP: Warning: unable to translate LABEL=/
sendsize[1892]: time 6.250:   DUMP: Warning: unable to translate LABEL=/boot
sendsize[1892]: time 6.251:   DUMP: Warning: unable to translate LABEL=/var
sendsize[1892]: time 6.259:   DUMP: SIGSEGV: ABORTING!
sendsize[1892]: time 6.260: .
sendsize[1892]: estimate time for /export level 1: 0.020
sendsize[1892]: no size line match in /sbin/dump output for /export
sendsize[1892]: .
sendsize[1892]: estimate size for /export level 1: -1 KB
sendsize[1892]: time 6.260: asking killpgrp to terminate
sendsize[1892]: time 7.268: done with amname '/export', dirname '/export', spindle -1
sendsize[1890]: time 7.269: child 1892 terminated normally
sendsize: time 7.269: pid 1890 finish time Wed Mar 12 09:13:18 2003


Re: drive compression discovery

2003-03-12 Thread Paul Bijnens
Sven Rudolph wrote:
But when you handcraft this by any workaround like you proposed, there
are even more races possible. (Like something migt change the tape
beetween your amcheck and yout script-erasing.)
But you only have to do this once for each tape!  There is no need
to put this in the taper program.  Just like you have to label each
tape once manually too.  Just consider this as if you had labeled
your tapes bad, and you have to do it again (actually, this is
indeed what happened!).
While using the mentioned extended relabeling procedure to avoid
the compression on your tape, you are watching who inserts the tape 
yourself, no race condition, unless your shadow is faster than you.

--
Paul Bijnens, XplanationTel  +32 16 397.511
Technologielaan 21 bus 2, B-3001 Leuven, BELGIUMFax  +32 16 397.512
http://www.xplanation.com/  email:  [EMAIL PROTECTED]
***
* I think I've got the hang of it now:  exit, ^D, ^C, ^\, ^Z, ^Q, F6, *
* quit,  ZZ, :q, :q!,  M-Z, ^X^C,  logoff, logout, close, bye,  /bye, *
* stop, end, F3, ~., ^]c, +++ ATH, disconnect, halt,  abort,  hangup, *
* PF4, F20, ^X^X, :D::D, KJOB, F14-f-e, F8-e,  kill -1 $$,  shutdown, *
* kill -9 1,  Alt-F4,  Ctrl-Alt-Del,  AltGr-NumLock,  Stop-A,  ...*
* ...  Are you sure?  ...   YES   ...   Phew ...   I'm out  *
***



Flushing interrupted backups

2003-03-12 Thread Alex Page
Last night, my amdump was interrupted, and there is data left in my
holding disk. I'd like to use amflush to dump them onto the tape I was
using for last night's backup, but it insists that I use a new tape for
the flush. Is there any way to convince Amanda to use last night's tape?

Alex
-- 
Mail: Alex Page [EMAIL PROTECTED]
Real: Systems/Network Assistant, Epidemiology Unit, Oxford
Tel:  01865 302 223 (external) / 223 (internal)
PGP:  8868 21D7 3D35 DD77 9D06  BF0A 0746 2DE6 55EA 367E


pgp0.pgp
Description: PGP signature


a bit off topic but ...

2003-03-12 Thread Lars Segerlund
 I was wondering how amanda estimates the backup size ?

  is there a switch to tar to estimate the archive size without 
generating the file ?

 / Lars Segerlund.



Re: Who uses amanda?

2003-03-12 Thread Joshua Baker-LePain
On Wed, 12 Mar 2003 at 11:59am, Dr. David Kirkby wrote

 Can anyone tell me if they use amanda and are a large commercial company
 ( 250 employees), a hospital or a university and if so how much it's
 used (whole institution, small department, single server etc). How many
 Gb do you back up (don't answer that if you feel its confidential, or
 you don't know). 

I'm the sysadmin for two research groups here (total of about 30 or so 
faculty/staff/grad students), both with large data storage needs.  I use 
two amanda configs.  The first backs up the 30 or so desktops etc to a 7GB 
native exabyte drive.  Total amount of data is about 50GB.

The second backs up the 3 RAIDs in use for the groups (.5TB, 1TB, 2TB) to 
an Overland AIT3 changer (1 drive, 19 tapes).  There's currently about 2TB 
worth of data spread over the 3 arrays.

If you search the archives, you can find more threads like this, and more 
answers.  There are some folks running very large installs (both in terms 
of numbers of clients and in terms of amount of data.

Good luck.

-- 
Joshua Baker-LePain
Department of Biomedical Engineering
Duke University





Re: drive compression discovery

2003-03-12 Thread Gene Heskett
On Wed March 12 2003 06:46, Sven Rudolph wrote:
Gene Heskett [EMAIL PROTECTED] writes:
 To get around this, one would assume that amcheck has already
 been run, and that the correct tape for tonights session is
 indeed loaded into the drive,

This doesn't work when you have to write to more than one
tape. Sometimes you do not even know in advance how many tapes
 will be needed.

This is true, and I don't have a good fix for that other than to 
treat them all by hand after loading them into the magazine, doing 
it each time any untreated tapes have been loaded.

 a: rewind tape
 b: dd tape label to scratch file, don't forget the 'bs=32k'
 c: rewind tape
 d: turn compression off by whatever method
 e: dd 10 megs or more worth of /dev/zero to the drive, causing
 it to flush its buffers.  This will cause that compression flag
 to be reset permanently on this tape.  Using bs=32k of course f:
 rewind tape
 g: dd the scratch file back to the tape to restore the proper
 label.

For my DLT drives writing 32k is sufficient.

On thinking this over, it may be true for any useage of the 
rewinding device, because the close and rewind would force the 
buffer flush.  Good point, and a time saver too.

The taper rewrites the label anyway, so the only additional step
 is to have the taper do the mt call before writing the label
 back.

Also true, but I'll leave that to the folks who walk around in that 
code in their sleep. :)

Two options:
- do the ioctl internally. This might be machine-specific ...

Is that not something that a good configure.in writer couldn't 
ascertain somehow?  I mean I've seen configure ask the darndest 
questions at times.

- call external mt. This means taper has to close the tape fd,
 call the external program and the reopen the tape. This is
 against taper's race-avoiding principles.

But doable if the non-rewinding device is used.  We're talking about 
maybe a 3 second exposure here, maximum, unless the machine is a 
certified, can't hunt anymore, dawg.

But when you handcraft this by any workaround like you proposed,
 there are even more races possible. (Like something migt change
 the tape beetween your amcheck and yout script-erasing.)

Yup, cause amcheck emailed them that the wrong tape(s) are in the 
magazine.  In a home situation such as mine, thats not a concern as 
the missus stays as fur from this thing as she can.  She did 
successfully do the tape changing while I was out of town for 2 
weeks last fall, but it was against her better judgement, and she 
told me so. ;-)

So I see these two options which both have their drawbacks.

Acceptable risks.  Yes they do need evaluated, particularly in a 
commercial environment, but in the huge majority of the cases I can 
envision, it doesn't seem to be a showstopper.

We're sitting here, beating this subject to death, when it really is 
something that should be addressed (IMO) at some point by someone 
with authority over the code like JRJ.  It is a nearly constant 
gotcha for the noobie trying to get his system running as 
efficiently as his hardware will allow...

It seems to me that a simple ./configure --nocompression argument 
could be used to have taper (or whatever by breaking that ioctl out 
into a seperate function included by any util that needs it, and 
have that function do it as soon as the rewind is complete if that 
option was set at compile time.  That would make sure its off 
before writing the first byte to any rewound tape.

Food for thought anyway.

-- 
Cheers Sven, Gene
AMD [EMAIL PROTECTED] 320M
[EMAIL PROTECTED]  512M
99.24% setiathome rank, not too shabby for a WV hillbilly


Re: drive compression discovery

2003-03-12 Thread Eric Sproul
On Tue, 2003-03-11 at 14:39, Gene Heskett wrote:
 Two other points come up here, Eric.
 
 1. When a tape is inserted in most modern drives, the tape 
 recognition cycle will discover that this tape has been compressed 
 previously, and will turn the compression back on regardless of 
 your wishes.

Sounds good, so if I insert a tape that I *suspect* was written
compressed, but I check tapeinfo and it says the drive is still in
uncompressed mode, then I know that tape is OK, right?

 2: Jon's name isn't John. :-)

Whoops!  My bad.  I have a friend by the same name, and he is famous for
saying J-O-N.  I'm not a commode.  ;-P

Sorry Jon!

Eric




Re: drive compression discovery

2003-03-12 Thread Gene Heskett
On Wed March 12 2003 09:16, Eric Sproul wrote:
On Tue, 2003-03-11 at 14:39, Gene Heskett wrote:
 Two other points come up here, Eric.

 1. When a tape is inserted in most modern drives, the tape
 recognition cycle will discover that this tape has been
 compressed previously, and will turn the compression back on
 regardless of your wishes.

Sounds good, so if I insert a tape that I *suspect* was written
compressed, but I check tapeinfo and it says the drive is still in
uncompressed mode, then I know that tape is OK, right?

I'd have a strong tendency to believe that report until proven 
otherwise.  And if thats the case, we would like to know about it 
pronto so we can advise the next user of that gotcha.

 2: Jon's name isn't John. :-)

Whoops!  My bad.  I have a friend by the same name, and he is
 famous for saying J-O-N.  I'm not a commode.  ;-P

Chuckle, thats a good one.  I suspect even Jon is chuckling as he 
reads this.

Sorry Jon!

Eric

-- 
Cheers Eric, Gene
AMD [EMAIL PROTECTED] 320M
[EMAIL PROTECTED]  512M
99.24% setiathome rank, not too shabby for a WV hillbilly


Re: Who uses amanda?

2003-03-12 Thread Gerhard den Hollander
* Greg Troxel [EMAIL PROTECTED] (Wed, Mar 12, 2003 at 08:22:34AM -0500)

On the same lines,
we use amanda at a couple of sites (Middle east, UK and the netherlands)
handling somewhere between 1 and 2 Tb of data in total, and we're looking
to expand the setup to include another Tb of data to be backed up.

The big beneifts of amanda:
- reliable
- works with standard unix tools (mt, dd and tar/gzip (or (ufs)restore) )
  are all you need to get data of a backup tape if you really have to
- great support (this list)
- minimal overhead
- it prints it's own tapelabels
(you don;t know how handy it is until you have to restore the disk
which had all that information on it ;) )
- it can be setup to email when the wrong tape is in the drive a few hours
  before the backup starts (amcheck -m)

Kind regards,
 --
Gerhard den Hollander   Phone :+31-10.280.1515
Global IT Support manager   Direct:+31-10.280.1539 
Jason Geosystems BV Fax   :+31-10.280.1511 
  (When calling please note: we are in GMT+1)
[EMAIL PROTECTED]  POBox 1573
visit us at http://www.jasongeo.com 3000 BN Rotterdam  
JASON...#1 in Reservoir CharacterizationThe Netherlands

  This e-mail and any attachment is/are intended solely for the named
  addressee(s) and may contain information that is confidential and privileged.
   If you are not the intended recipient, we request that you do not
 disseminate, forward, distribute or copy this e-mail message.
  If you have received this e-mail message in error, please notify us
   immediately by telephone and destroy the original message.


Re: dump largee than tape

2003-03-12 Thread Gene Heskett
On Wed March 12 2003 07:25, Konrad Dienst wrote:
Hi!

Here are the debugs of one run.

Thats something that amanda cannot do, is span a single dump across 
more than one tape.

The normal fix is to use tar, and break the disklist entries up into 
subdirs that are small enough to fit.

-- 
Cheers, Gene
AMD [EMAIL PROTECTED] 320M
[EMAIL PROTECTED]  512M
99.24% setiathome rank, not too shabby for a WV hillbilly


Re: Who uses amanda?

2003-03-12 Thread Gene Heskett
On Wed March 12 2003 06:59, Dr. David Kirkby wrote:
Can anyone tell me if they use amanda and are a large commercial
 company ( 250 employees), a hospital or a university and if so
 how much it's used (whole institution, small department, single
 server etc). How many Gb do you back up (don't answer that if you
 feel its confidential, or you don't know).

I don't work in computer support but are aware there is a talk of
 buying a Veritas backup package at academic discount (around 800
 UK pounds or $1300). I wanted to know if amanda would be a viable
 option. I guess there are going to be issues bought up about
 support, stability, the importance of backups etc. I'd like to
 know of big organistations using the software and if they have
 compared it to Veritas.

You obviously have, in such a situation, a need for a library, and 
one with multimegabyte a second drives in it.  This will be far 
more important in terms of getting the backups done in a timely 
manner in the wee hours than the software you use to accomplish 
that.

Also far more costly than the software even if it was arkeia or 
veritas.

But since amanda is a client/server setup, and the client can be 
told to do the compression, the next consideration would be the 
occupied network bandwidth while the backup is running.  Using 
client compression can make night and day differences in the 
network loading and its general useability while the backup is in 
progress.  You'll need at least 100baseT if its going to get well 
into the 10's of gigabytes per session.

IMO amanda is a viable option, here's why:

Support: I'd be willing to bet you'll get help here at least as fast 
as you'll get it from veritas, we're (some of us) awake all around 
the world on a 24/7/365 basis.  Veritas keep office hours.

Stability: I've been running the latest snapshots, and have yet to 
feel the need to come back to this list and report that 
snapshot-version-date so-and-so was busted for my little 2 machine 
home system.

And we have been told that the United States Dept. of Agriculture 
has been using amanda for quite some time, and I believe that would 
qualify as a large organization.  However, I'd expect that, except 
for the Washington DC offices, is a distributed in little 
autonomous pieces setup.

I looked at using amanda once for my home computer (Sun Ultra 80,
 about 200 Gb of disk space over 4/5 drives, 40 Gb tape drive),
 but decided that for such a small system, a couple of unix shell
 scripts run by cron was all I needed, so never bothered using
 amanda. I know shell scripts are currently used here but we
 intend expanding the disk space by quite a lot.

So basically:
a) I know little about amanda

We were all there once :)

b) Have no intention of using it myself for my home computer, but
 wonder if its a variable option in a university department (~100
 staff).

Why not?  For a home system, its a piece of cake.  I have a 4 tape 
magazine drive, so I don't have the daily chore of remembering to 
change the tapes.  Amcheck emails me to remind me it couldn't find 
the next tape it needs, half a day before its actually needed, so 
the responsibility of seeing to it the proper tapes are loaded is 
mine.  Not too bad on an every 4th day schedule.  Other than that, 
once up and running, that is the sum total of human intervention 
required to run amanda.  If I had a 30 tape library, I could close 
the door and lock it, but then I do a 5 day cycle to get everything 
in a full, and have 28 tapes in the pool, so I have over 4 full 
fulls on hand at any one time.  Paranoid maybe...

Besides, doing it on your home system will automaticly make you an 
expert when the university deploys it.


Dr. David Kirkby PhD,
Senior Research Fellow,
Department of Medical Physics,
University College London,
11-20 Capper St, London, WC1E 6JA.
Tel: 020 7679 6408 Fax: 020 7679 6269
Internal telephone: ext 46408
e-mail [EMAIL PROTECTED]
Web page: http://www.medphys.ucl.ac.uk/~davek

-- 
Cheers, Gene
AMD [EMAIL PROTECTED] 320M
[EMAIL PROTECTED]  512M
99.24% setiathome rank, not too shabby for a WV hillbilly


problem with amrestore / tar permissions

2003-03-12 Thread liam pace
Hi,

when I run the command amrestore -p /dev/rmt/1n scuba /boot | tar -pxv on
the tape server itself,
I manage to restore the files however the files are restored in a new
directory structure. A number of new directories are created and also the
files loose permissions.

any idea how this can be solved?

regards,
liam



Re: Flushing interrupted backups

2003-03-12 Thread Joshua Baker-LePain
On Wed, 12 Mar 2003 at 2:00pm, Alex Page wrote

 Last night, my amdump was interrupted, and there is data left in my
 holding disk. I'd like to use amflush to dump them onto the tape I was
 using for last night's backup, but it insists that I use a new tape for
 the flush. Is there any way to convince Amanda to use last night's tape?

No.  Amanda doesn't append, and that's a safety feature.

-- 
Joshua Baker-LePain
Department of Biomedical Engineering
Duke University



Re: a bit off topic but ...

2003-03-12 Thread Joshua Baker-LePain
On Wed, 12 Mar 2003 at 2:47pm, Lars Segerlund wrote

   I was wondering how amanda estimates the backup size ?
 
is there a switch to tar to estimate the archive size without 
 generating the file ?

You can see the exact command in /tmp/amanda/sendsize*debug.

-- 
Joshua Baker-LePain
Department of Biomedical Engineering
Duke University



Re: Who uses amanda?

2003-03-12 Thread Mike Simpson
Dr. Kirkby --

I support about thirty or so UNIX servers (Solaris, AIX, Linux) that 
represent the development, testing, and production environments for 
the electronic resources of the University of Wisconsin at Madison 
Libraries.  I started using Amanda 2.4.x about two years ago to do 
backups on these systems, originally using a collection of 
miscellaneous resources (hosts, holding disks, and tape drives) left 
over from previous backup strategies.

We're just now finishing a re-implementation of the whole system that
will give us 1 TB of capacity on our primary (and now, finally,
dedicated) Amanda host.  We use a modestly-priced Linux host, coupled
with 500 GB of IDE-to-SCSI holding disk, and five Overland LibraryPro
AIT-3 autoloaders.  We configure for at least fourteen days of mixed
full and incremental backups (level zeroes every three days), plus at
least six weeks of level zero offsites.  Cost of the entire system,
including tape media and three years of onsite next-day support for
all hardware, was $60k.  Doing it again, shaving support costs and
with recent pricing changes, I think I could probably do it for $50k
even.

By comparison, I did a three-year cost workup for buying backups on 
our central storage solution (Tivoli-based).  Even assuming low 
initial capacity, ramping up gradually to 1 TB across the three 
years, the cost was easily $200k+, for a system that (in my opinion) 
would be almost useless to us in a true disaster-recovery scenario, 
as opposed to occasional file restores when someone fumble-fingers an 
rm -rf.

I have been told that I didn't allow for the cost of my time to
implement and babysit our system;  but from watching one of my
colleagues struggle with our Tivoli implementation, I'm not sure it
makes that much of a difference.  And that same colleague has now
approached me about buying some of the excess time and capacity on our
Amanda system, so we'll do some cost-recovery there as well.

-mgs




Re: Flushing interrupted backups

2003-03-12 Thread Martin hepworth
Alex Page wrote:
Last night, my amdump was interrupted, and there is data left in my
holding disk. I'd like to use amflush to dump them onto the tape I was
using for last night's backup, but it insists that I use a new tape for
the flush. Is there any way to convince Amanda to use last night's tape?
Alex
Hi Alex

not really, if you force the flush to tape it will overwrite the stuff 
already there.

Prob best to not put in a tape tonight. This will force the backups to 
the holding area, then flush everything to tape tomorrow when you get in.

--
Martin Hepworth
Senior Systems Administrator
Solid State Logic Ltd
+44 (0)1865 842300


**
This email and any files transmitted with it are confidential and
intended solely for the use of the individual or entity to whom they
are addressed. If you have received this email in error please notify
the system manager.
This footnote also confirms that this email message has been swept by
MIMEsweeper for the presence of computer viruses.
www.mimesweeper.com
**


Re: a bit off topic but ...

2003-03-12 Thread bukys
On Wed, 12 Mar 2003 at 2:47pm, Lars Segerlund wrote

   I was wondering how amanda estimates the backup size ?
 
is there a switch to tar to estimate the archive size without 
 generating the file ?

What actually happens:
- gnu tar knows that if its output is to /dev/null,
  it doesn't actually have to read the file contents.
- dump estimates dump size before it begins dumping.


tapes are doomed

2003-03-12 Thread bukys
I am observing that high capacity tapes continue to be expensive, while
high capacity disk drives continue to fall in price at an astrounding
rate.  Non-tape writable media are also cheap and falling, though they
tend to be lower capacity.

When some of these price/capacity curves cross, something has to change.
Maybe it's just that the price premium on tapes follows the competition
down, in a race to the marginal cost bottom.  Maybe we stop buying tapes
and (1) start feeding writable optical media into writers, or (2) tapes
are replaced by black box cartridges which standardize interfaces and
physical shape but not media.

The standardized black box has long-term advantages over other media:
no worries about alignment. no barriers to deploying new materials
or other technological innovations.  (It's why sealed Winchester
disks wiped out removable disk drives.)  It looks to me like the tape
industry is falling behind its competitors, and unless something (like
O-Mass) causes a big improvements in both capacity and price/capacity,
the reasons for buying tapes may disappear.


If I'm buying my next archive medium in about 12 months, there's a good
chance that my disposable tapes will be hot-plug FireWire drives and
my drive will just be a FireWire hub.  OR I'll buy a DVD writer (red or
blue laser) with robotic feeder.


One interesting question is where compression fits into this picture.
An interesting variation would be a manufacturer producing a tape drive
emulator whose sole functions are compression, serial interface to the
random access device (throw in an AIT-like random access component),
and physical interface to the cartridge.


In any event, it would be a good idea for Amanda to be ready to support
direct access devices as an output medium one of these days.
(The changes won't be hard.)

a prediction from:
Liudvikas Bukys
[EMAIL PROTECTED]


RE: Who uses amanda?

2003-03-12 Thread Martinez, Michael - CSREES/ISTM
We use amanda at the CSREES agency of U.S. Dept of Agriculture. We use it on
our Linux and unix servers. We back up approximately 30 Gigs of data with
it.

Michael Martinez
CSREES/ISTM/USDA



 -Original Message-
 From: Gene Heskett [mailto:[EMAIL PROTECTED] 
 Sent: Wednesday, March 12, 2003 9:34 AM
 To: Dr. David Kirkby; Amanda Users
 Subject: Re: Who uses amanda?
 
 
 On Wed March 12 2003 06:59, Dr. David Kirkby wrote:
 Can anyone tell me if they use amanda and are a large commercial  
 company ( 250 employees), a hospital or a university and if so  how 
 much it's used (whole institution, small department, single  server 
 etc). How many Gb do you back up (don't answer that if you  feel its 
 confidential, or you don't know).
 
 I don't work in computer support but are aware there is a talk of  
 buying a Veritas backup package at academic discount (around 800  UK 
 pounds or $1300). I wanted to know if amanda would be a 
 viable  option. 
 I guess there are going to be issues bought up about  support, 
 stability, the importance of backups etc. I'd like to  know of big 
 organistations using the software and if they have  compared it to 
 Veritas.
 
 You obviously have, in such a situation, a need for a library, and 
 one with multimegabyte a second drives in it.  This will be far 
 more important in terms of getting the backups done in a timely 
 manner in the wee hours than the software you use to accomplish 
 that.
 
 Also far more costly than the software even if it was arkeia or 
 veritas.
 
 But since amanda is a client/server setup, and the client can be 
 told to do the compression, the next consideration would be the 
 occupied network bandwidth while the backup is running.  Using 
 client compression can make night and day differences in the 
 network loading and its general useability while the backup is in 
 progress.  You'll need at least 100baseT if its going to get well 
 into the 10's of gigabytes per session.
 
 IMO amanda is a viable option, here's why:
 
 Support: I'd be willing to bet you'll get help here at least as fast 
 as you'll get it from veritas, we're (some of us) awake all around 
 the world on a 24/7/365 basis.  Veritas keep office hours.
 
 Stability: I've been running the latest snapshots, and have yet to 
 feel the need to come back to this list and report that 
 snapshot-version-date so-and-so was busted for my little 2 machine 
 home system.
 
 And we have been told that the United States Dept. of Agriculture 
 has been using amanda for quite some time, and I believe that would 
 qualify as a large organization.  However, I'd expect that, except 
 for the Washington DC offices, is a distributed in little 
 autonomous pieces setup.
 
 I looked at using amanda once for my home computer (Sun Ultra 80,  
 about 200 Gb of disk space over 4/5 drives, 40 Gb tape drive),  but 
 decided that for such a small system, a couple of unix shell 
  scripts 
 run by cron was all I needed, so never bothered using  
 amanda. I know 
 shell scripts are currently used here but we  intend 
 expanding the disk 
 space by quite a lot.
 
 So basically:
 a) I know little about amanda
 
 We were all there once :)
 
 b) Have no intention of using it myself for my home computer, but  
 wonder if its a variable option in a university department (~100  
 staff).
 
 Why not?  For a home system, its a piece of cake.  I have a 4 tape 
 magazine drive, so I don't have the daily chore of remembering to 
 change the tapes.  Amcheck emails me to remind me it couldn't find 
 the next tape it needs, half a day before its actually needed, so 
 the responsibility of seeing to it the proper tapes are loaded is 
 mine.  Not too bad on an every 4th day schedule.  Other than that, 
 once up and running, that is the sum total of human intervention 
 required to run amanda.  If I had a 30 tape library, I could close 
 the door and lock it, but then I do a 5 day cycle to get everything 
 in a full, and have 28 tapes in the pool, so I have over 4 full 
 fulls on hand at any one time.  Paranoid maybe...
 
 Besides, doing it on your home system will automaticly make you an 
 expert when the university deploys it.
 
 
 Dr. David Kirkby PhD,
 Senior Research Fellow,
 Department of Medical Physics,
 University College London,
 11-20 Capper St, London, WC1E 6JA.
 Tel: 020 7679 6408 Fax: 020 7679 6269
 Internal telephone: ext 46408
 e-mail [EMAIL PROTECTED]
 Web page: http://www.medphys.ucl.ac.uk/~davek
 
 -- 
 Cheers, Gene
 AMD [EMAIL PROTECTED] 320M
 [EMAIL PROTECTED]  512M
 99.24% setiathome rank, not too shabby for a WV hillbilly
 


Re: Who uses amanda? -- RFC

2003-03-12 Thread Jon LaBadie
This regular query never made it to the FAQ-O-Matic I see.

A proposal, I'll put together a survey form (sample follows)
and ask the list for submissions.

After a period I'll summarize the data, hopefully in a table
of some form and submit it to the F-O-M.

So, two questions:

 1. Is the survey desired or frowned upon?

 2. Is the data asked for, and the wording of the form suitable?

On or Off-list opinions gratefully accepted.

Jon,


[[ proposed survey form ]]


PLEASE DO NOT RESPOND TO THIS SURVEY, IT IS NOT FINALIZED!
--
RESPONDER INFORMATION

Name .. :
Organization .. :
Email Address   :
Date Submitted  :

   Note, responder information is requested for confirmation
   and clarification purposes only.  It will not be included
   in any published compendium of the information.

--
ORGANIZATION USING AMANDA INFORMATION

Name . :
Department ... :
Extent of Amanda Usage ... :
  (entire organization, department, subnet, ...)
Date of First Amanda Usage :
  (/mm)

Note, if you prefer the organization remain anonymous,
please provide descriptive information (eg. Fortune 100
insurance company, German computer manufacturer, eastern
state university, independent consultant home office, ...)

--
DESCRIPTION OF AMANDA INSTALLATION

Dumpcycle .. :
Frequency of Backups :
  (daily, weekly, 5/week, ...)

Number of Client Hosts Backed up by Amanda :
Total Disk Capacity of Client Hosts .. :
Total Data on Client Host Disks .. :
Average Size of Data Backed Up Per Backup  :
  (pre-compression)

Amanda Server Host(s)
  Amanda Version(s)   :
  Operating System(s) :

Amanda Client Host(s)
  Amanda Version(s)   :
  Operating System(s) :

Note, if you are running multiple configurations please
try to give pooled values; alternatively, repeat parts
of the survey as necessary.

--

[[ end of proposed survey form ]]
-- 
Jon H. LaBadie  [EMAIL PROTECTED]
 JG Computing
 4455 Province Line Road(609) 252-0159
 Princeton, NJ  08540-4322  (609) 683-7220 (fax)


Re: raw device ownership permissions on SGI machine

2003-03-12 Thread Gordon Pritchard
On Wed, 2003-03-12 at 03:02, Harri Haataja wrote:

 I believe the /hw filesystem is created on the fly like /proc or a
 devfs.

 Nice to know this. I have not used amanda and dump on Irix so I haven't
 come across this.


I use amanda to back up Irix clients (Onyx racks).  However, I have
chosen to back up filesystems, not devices:

b52 /data/cvsroot/  nocomp-user eth0
b52 /etc/   nocomp-user eth0
b52 /usr/people/nocomp-user eth0


It works fine, although I couldn't get the SGI freeware working right,
so I compiled from source.

-Gord

-- 
Gordon Pritchard, P.Eng. | Institute of Electrical and
Research Labs Manager|  Electronics Engineers
Simon Fraser University, Surrey  | Quarter Century Wireless Ass'n
[EMAIL PROTECTED]   | Telephone Pioneers of America
phone:  604.586.6186



Re: drive compression discovery

2003-03-12 Thread Paul Bijnens
Gene Heskett wrote:
On Wed March 12 2003 09:16, Eric Sproul wrote:

On Tue, 2003-03-11 at 14:39, Gene Heskett wrote:

Two other points come up here, Eric.

1. When a tape is inserted in most modern drives, the tape
recognition cycle will discover that this tape has been
compressed previously, and will turn the compression back on
regardless of your wishes.
Sounds good, so if I insert a tape that I *suspect* was written
compressed, but I check tapeinfo and it says the drive is still in
uncompressed mode, then I know that tape is OK, right?
You have to read something on it first to be really sure that the
drive did a recognition cycle. Something like:
  dd ibs=256K if=/dev/your/tapedev of=/dev/null count=1
(blocksize equal to or larger than the first block on tape is fine)

--
Paul Bijnens, XplanationTel  +32 16 397.511
Technologielaan 21 bus 2, B-3001 Leuven, BELGIUMFax  +32 16 397.512
http://www.xplanation.com/  email:  [EMAIL PROTECTED]
***
* I think I've got the hang of it now:  exit, ^D, ^C, ^\, ^Z, ^Q, F6, *
* quit,  ZZ, :q, :q!,  M-Z, ^X^C,  logoff, logout, close, bye,  /bye, *
* stop, end, F3, ~., ^]c, +++ ATH, disconnect, halt,  abort,  hangup, *
* PF4, F20, ^X^X, :D::D, KJOB, F14-f-e, F8-e,  kill -1 $$,  shutdown, *
* kill -9 1,  Alt-F4,  Ctrl-Alt-Del,  AltGr-NumLock,  Stop-A,  ...*
* ...  Are you sure?  ...   YES   ...   Phew ...   I'm out  *
***



Check length/capacity of tape?

2003-03-12 Thread John Oliver
My first successful backup withe the DLT7000 loader seems to have run
out of tape at about 20GB.  I'm *almost* certain that all of the tapes I
was using with the DLT4000 were new, and therefore should be capable of
holding the 35GB.  There isn't any definitive markings on any of the
tapes.  They all say DLT IV but nothing more.  Is there any way, short
of running tapetype on every tape, to know for certain its' capacity?

-- 
John Oliver, CCNAhttp://www.john-oliver.net/
Linux/UNIX/network consulting http://www.john-oliver.net/resume/
***   sendmail, Apache, ftp, DNS, spam filtering ***
Colocation, T1s, web/email/ftp hosting  


Re: Who uses amanda?

2003-03-12 Thread Paul Bijnens
Gene Heskett wrote:
But since amanda is a client/server setup, and the client can be 
told to do the compression, the next consideration would be the 
occupied network bandwidth while the backup is running.  Using 
client compression can make night and day differences in the 
network loading and its general useability while the backup is in 
progress.  You'll need at least 100baseT if its going to get well 
into the 10's of gigabytes per session.
The gain with the parallelisation of Amanda can be amazing!
Here is a snippet of my archive run last weekend:
STATISTICS:
  Total   Full  Daily
      
Estimate Time (hrs:min)0:13
Run Time (hrs:min) 8:12
Dump Time (hrs:min)   42:57  42:57   0:00
Output Size (meg)   70427.970427.90.0
Original Size (meg)149337.0   149337.00.0
Avg Compressed Size (%)47.2   47.2--
Filesystems Dumped  114114  0
Avg Dump Rate (k/s)   466.3  466.3--
It means that it did a full backup in 8 hours 12 minutes,
that would take almost 43 hours when run sequentially (what
many simple backup scripts actually do!).
We have a mix of fast and old slow machines (Sun Sparc IPX,
Intel Pentium 150Mhz with 32 MByte RAM etc); also a mix of
100baseT and 10baseT network cards.  Amanda does them all
(do there still exist veritas clients for SunOS 4.1.4?).
For curiosity, here is my Daily config statistics section:

STATISTICS:
  Total   Full  Daily
      
Estimate Time (hrs:min)0:28
Run Time (hrs:min) 2:52
Dump Time (hrs:min)   11:40   8:45   2:55
Output Size (meg)   16658.415116.6 1541.8
Original Size (meg) 42697.537183.0 5514.5
Avg Compressed Size (%)39.0   40.7   28.0
Filesystems Dumped  116 22 94   (1:89 2:5)
Avg Dump Rate (k/s)   406.4  491.5  150.7


--
Paul Bijnens, XplanationTel  +32 16 397.511
Technologielaan 21 bus 2, B-3001 Leuven, BELGIUMFax  +32 16 397.512
http://www.xplanation.com/  email:  [EMAIL PROTECTED]
***
* I think I've got the hang of it now:  exit, ^D, ^C, ^\, ^Z, ^Q, F6, *
* quit,  ZZ, :q, :q!,  M-Z, ^X^C,  logoff, logout, close, bye,  /bye, *
* stop, end, F3, ~., ^]c, +++ ATH, disconnect, halt,  abort,  hangup, *
* PF4, F20, ^X^X, :D::D, KJOB, F14-f-e, F8-e,  kill -1 $$,  shutdown, *
* kill -9 1,  Alt-F4,  Ctrl-Alt-Del,  AltGr-NumLock,  Stop-A,  ...*
* ...  Are you sure?  ...   YES   ...   Phew ...   I'm out  *
***



Re: a bit off topic but ...

2003-03-12 Thread Paul Bijnens
Lars Segerlund wrote:
 I was wondering how amanda estimates the backup size ?

  is there a switch to tar to estimate the archive size without 
generating the file ?
For the estimate phase Amanda uses the --file /dev/null  option
of gnutar, and gnutar has a special optimisation that if it detects
output to /dev/null, it will actually not read any bytes of files, but 
just make statistics.
For samba clients it uses the builtin du command of smbclient (if
your smbclient version is recent enough).

--
Paul Bijnens, XplanationTel  +32 16 397.511
Technologielaan 21 bus 2, B-3001 Leuven, BELGIUMFax  +32 16 397.512
http://www.xplanation.com/  email:  [EMAIL PROTECTED]
***
* I think I've got the hang of it now:  exit, ^D, ^C, ^\, ^Z, ^Q, F6, *
* quit,  ZZ, :q, :q!,  M-Z, ^X^C,  logoff, logout, close, bye,  /bye, *
* stop, end, F3, ~., ^]c, +++ ATH, disconnect, halt,  abort,  hangup, *
* PF4, F20, ^X^X, :D::D, KJOB, F14-f-e, F8-e,  kill -1 $$,  shutdown, *
* kill -9 1,  Alt-F4,  Ctrl-Alt-Del,  AltGr-NumLock,  Stop-A,  ...*
* ...  Are you sure?  ...   YES   ...   Phew ...   I'm out  *
***



Re: problem with amrestore / tar permissions

2003-03-12 Thread Paul Bijnens
liam pace wrote:
Hi,

when I run the command amrestore -p /dev/rmt/1n scuba /boot | tar -pxv on
the tape server itself,
I manage to restore the files however the files are restored in a new
directory structure. A number of new directories are created and also the
files loose permissions.
any idea how this can be solved?
If you run tar -px... as root, then the permissions are correct.
Tar also extracts files into the current directory (not bad if you first
want to check if what you have on tape is better than what is on disk).
If it is not these two problems, then you need to give more information.

--
Paul Bijnens, XplanationTel  +32 16 397.511
Technologielaan 21 bus 2, B-3001 Leuven, BELGIUMFax  +32 16 397.512
http://www.xplanation.com/  email:  [EMAIL PROTECTED]
***
* I think I've got the hang of it now:  exit, ^D, ^C, ^\, ^Z, ^Q, F6, *
* quit,  ZZ, :q, :q!,  M-Z, ^X^C,  logoff, logout, close, bye,  /bye, *
* stop, end, F3, ~., ^]c, +++ ATH, disconnect, halt,  abort,  hangup, *
* PF4, F20, ^X^X, :D::D, KJOB, F14-f-e, F8-e,  kill -1 $$,  shutdown, *
* kill -9 1,  Alt-F4,  Ctrl-Alt-Del,  AltGr-NumLock,  Stop-A,  ...*
* ...  Are you sure?  ...   YES   ...   Phew ...   I'm out  *
***



Re: Who uses amanda?

2003-03-12 Thread Gene Heskett
On Wed March 12 2003 12:45, Paul Bijnens wrote:
Gene Heskett wrote:
 But since amanda is a client/server setup, and the client can be
 told to do the compression, the next consideration would be the
 occupied network bandwidth while the backup is running.  Using
 client compression can make night and day differences in the
 network loading and its general useability while the backup is
 in progress.  You'll need at least 100baseT if its going to get
 well into the 10's of gigabytes per session.

The gain with the parallelisation of Amanda can be amazing!

Thats what I was trying to say Paul, but not all that well said.  
Data like this is very convincing.  And, here, I couldn't show that 
since the other machine is actually backed up by rsyncing it, and 
the rsync'd mirror then gets backed up here.  This gets rid of the 
smb and its bogus file dates gotchas, but doesn't allow for the 
paralleling of jobs out on the client...  Someday...

These are great figures in fact, thats a time shrinkage to 19% of 
what it would have taken if serialized.

Now the 64k question is, can veritas, arkeia, tivoli, or bru top 
that?  I have VERY serious doubts about that personally.

Here is a snippet of my archive run last weekend:

STATISTICS:
   Total   Full  Daily
       
Estimate Time (hrs:min)0:13
Run Time (hrs:min) 8:12
Dump Time (hrs:min)   42:57  42:57   0:00
Output Size (meg)   70427.970427.90.0
Original Size (meg)149337.0   149337.00.0
Avg Compressed Size (%)47.2   47.2--
Filesystems Dumped  114114  0
Avg Dump Rate (k/s)   466.3  466.3--


It means that it did a full backup in 8 hours 12 minutes,
that would take almost 43 hours when run sequentially (what
many simple backup scripts actually do!).
We have a mix of fast and old slow machines (Sun Sparc IPX,
Intel Pentium 150Mhz with 32 MByte RAM etc); also a mix of
100baseT and 10baseT network cards.  Amanda does them all
(do there still exist veritas clients for SunOS 4.1.4?).

For curiosity, here is my Daily config statistics section:

STATISTICS:
   Total   Full  Daily
       
Estimate Time (hrs:min)0:28
Run Time (hrs:min) 2:52
Dump Time (hrs:min)   11:40   8:45   2:55
Output Size (meg)   16658.415116.6 1541.8
Original Size (meg) 42697.537183.0 5514.5
Avg Compressed Size (%)39.0   40.7   28.0
Filesystems Dumped  116 22 94   (1:89 2:5)
Avg Dump Rate (k/s)   406.4  491.5  150.7

And this is a 75% reduction here.

You are doing about 20x the data I am, in about the same time.  But 
my drive is a DDS2, so one normally calls a surveyer to set stakes 
in order to measure its throughput anyway. :-(

-- 
Cheers, Gene
AMD [EMAIL PROTECTED] 320M
[EMAIL PROTECTED]  512M
99.24% setiathome rank, not too shabby for a WV hillbilly


Re: tapes are doomed

2003-03-12 Thread Joshua Baker-LePain
On Wed, 12 Mar 2003 at 11:31am, [EMAIL PROTECTED] wrote

 I am observing that high capacity tapes continue to be expensive, while
 high capacity disk drives continue to fall in price at an astrounding
 rate.  Non-tape writable media are also cheap and falling, though they
 tend to be lower capacity.

*snip*

This is a *very* common discussion -- see the archives of this list or 
google in comp.arch.storage.  Tape still has a lot of advantages, 
especially when it comes to archiving.  
 
 In any event, it would be a good idea for Amanda to be ready to support
 direct access devices as an output medium one of these days.

Amanda already support backup directly to files on disk.  It's trivial to 
then move those to your output medium of choice.

 (The changes won't be hard.)

Patches accepted, as they say.

-- 
Joshua Baker-LePain
Department of Biomedical Engineering
Duke University



Re: Who uses amanda?

2003-03-12 Thread Wayne Richards
Dr. Kirby,

We have used amanda for backup of about 65 workstations and servers for going 
on five years now here at corporate research for Goodyear.  Currently, we 
backup about 700GB.


 We use amanda at the CSREES agency of U.S. Dept of Agriculture. We use it on
 our Linux and unix servers. We back up approximately 30 Gigs of data with
 it.
 
 Michael Martinez
 CSREES/ISTM/USDA
 
 
 
  -Original Message-
  From: Gene Heskett [mailto:[EMAIL PROTECTED] 
  Sent: Wednesday, March 12, 2003 9:34 AM
  To: Dr. David Kirkby; Amanda Users
  Subject: Re: Who uses amanda?
  
  
  On Wed March 12 2003 06:59, Dr. David Kirkby wrote:
  Can anyone tell me if they use amanda and are a large commercial  
  company ( 250 employees), a hospital or a university and if so  how 
  much it's used (whole institution, small department, single  server 
  etc). How many Gb do you back up (don't answer that if you  feel its 
  confidential, or you don't know).
  
  I don't work in computer support but are aware there is a talk of  
  buying a Veritas backup package at academic discount (around 800  UK 
  pounds or $1300). I wanted to know if amanda would be a 
  viable  option. 
  I guess there are going to be issues bought up about  support, 
  stability, the importance of backups etc. I'd like to  know of big 
  organistations using the software and if they have  compared it to 
  Veritas.
  
  You obviously have, in such a situation, a need for a library, and 
  one with multimegabyte a second drives in it.  This will be far 
  more important in terms of getting the backups done in a timely 
  manner in the wee hours than the software you use to accomplish 
  that.
  
  Also far more costly than the software even if it was arkeia or 
  veritas.
  
  But since amanda is a client/server setup, and the client can be 
  told to do the compression, the next consideration would be the 
  occupied network bandwidth while the backup is running.  Using 
  client compression can make night and day differences in the 
  network loading and its general useability while the backup is in 
  progress.  You'll need at least 100baseT if its going to get well 
  into the 10's of gigabytes per session.
  
  IMO amanda is a viable option, here's why:
  
  Support: I'd be willing to bet you'll get help here at least as fast 
  as you'll get it from veritas, we're (some of us) awake all around 
  the world on a 24/7/365 basis.  Veritas keep office hours.
  
  Stability: I've been running the latest snapshots, and have yet to 
  feel the need to come back to this list and report that 
  snapshot-version-date so-and-so was busted for my little 2 machine 
  home system.
  
  And we have been told that the United States Dept. of Agriculture 
  has been using amanda for quite some time, and I believe that would 
  qualify as a large organization.  However, I'd expect that, except 
  for the Washington DC offices, is a distributed in little 
  autonomous pieces setup.
  
  I looked at using amanda once for my home computer (Sun Ultra 80,  
  about 200 Gb of disk space over 4/5 drives, 40 Gb tape drive),  but 
  decided that for such a small system, a couple of unix shell 
   scripts 
  run by cron was all I needed, so never bothered using  
  amanda. I know 
  shell scripts are currently used here but we  intend 
  expanding the disk 
  space by quite a lot.
  
  So basically:
  a) I know little about amanda
  
  We were all there once :)
  
  b) Have no intention of using it myself for my home computer, but  
  wonder if its a variable option in a university department (~100  
  staff).
  
  Why not?  For a home system, its a piece of cake.  I have a 4 tape 
  magazine drive, so I don't have the daily chore of remembering to 
  change the tapes.  Amcheck emails me to remind me it couldn't find 
  the next tape it needs, half a day before its actually needed, so 
  the responsibility of seeing to it the proper tapes are loaded is 
  mine.  Not too bad on an every 4th day schedule.  Other than that, 
  once up and running, that is the sum total of human intervention 
  required to run amanda.  If I had a 30 tape library, I could close 
  the door and lock it, but then I do a 5 day cycle to get everything 
  in a full, and have 28 tapes in the pool, so I have over 4 full 
  fulls on hand at any one time.  Paranoid maybe...
  
  Besides, doing it on your home system will automaticly make you an 
  expert when the university deploys it.
  
  
  Dr. David Kirkby PhD,
  Senior Research Fellow,
  Department of Medical Physics,
  University College London,
  11-20 Capper St, London, WC1E 6JA.
  Tel: 020 7679 6408 Fax: 020 7679 6269
  Internal telephone: ext 46408
  e-mail [EMAIL PROTECTED]
  Web page: http://www.medphys.ucl.ac.uk/~davek
  
  -- 
  Cheers, Gene
  AMD [EMAIL PROTECTED] 320M
  [EMAIL PROTECTED]  512M
  99.24% setiathome rank, not too shabby for a WV hillbilly
  



---
Wayne Richards  Phone:  330 796-4462
Goodyear 

Re: drive compression discovery

2003-03-12 Thread Brian Cuttler

I realize this isn't the correct forum, but as long as
your are already on the subject I'm hoping you will not
mind too much.

I have one system, just one, that I do not run amanda on
but perform backups of. Its a Redhat Linux rel 7.2, code
name Inigma, kernel 2.4.9.3-1, with a DLT 8000 drive. We
are running out of tape during our nightly dump and can't
seem to figure out the correct drive parameters to either
use better blocking or turn on compression.

Yes, I've been following this discussion but we haven't
been successful.

Current command is

# dump 0udsf 49125 67854 /dev/nst0 /iarcvol
(I'm not primary on that system, I'm not really sure where
 these values originated but have been involved in testing
 tweeking them).

Only about 18 of the 25 gig make it to tape and a DLT8000
should have sufficient capacity to dump all the date with
room to spare.

thanks,

Brian

 Gene Heskett wrote:
  On Wed March 12 2003 09:16, Eric Sproul wrote:
  
 On Tue, 2003-03-11 at 14:39, Gene Heskett wrote:
 
 Two other points come up here, Eric.
 
 1. When a tape is inserted in most modern drives, the tape
 recognition cycle will discover that this tape has been
 compressed previously, and will turn the compression back on
 regardless of your wishes.
 
 Sounds good, so if I insert a tape that I *suspect* was written
 compressed, but I check tapeinfo and it says the drive is still in
 uncompressed mode, then I know that tape is OK, right?
 
 You have to read something on it first to be really sure that the
 drive did a recognition cycle. Something like:
dd ibs=256K if=/dev/your/tapedev of=/dev/null count=1
 
 (blocksize equal to or larger than the first block on tape is fine)
 
 
 -- 
 Paul Bijnens, XplanationTel  +32 16 397.511
 Technologielaan 21 bus 2, B-3001 Leuven, BELGIUMFax  +32 16 397.512
 http://www.xplanation.com/  email:  [EMAIL PROTECTED]
 ***
 * I think I've got the hang of it now:  exit, ^D, ^C, ^\, ^Z, ^Q, F6, *
 * quit,  ZZ, :q, :q!,  M-Z, ^X^C,  logoff, logout, close, bye,  /bye, *
 * stop, end, F3, ~., ^]c, +++ ATH, disconnect, halt,  abort,  hangup, *
 * PF4, F20, ^X^X, :D::D, KJOB, F14-f-e, F8-e,  kill -1 $$,  shutdown, *
 * kill -9 1,  Alt-F4,  Ctrl-Alt-Del,  AltGr-NumLock,  Stop-A,  ...*
 * ...  Are you sure?  ...   YES   ...   Phew ...   I'm out  *
 ***
 
 



Re: drive compression discovery

2003-03-12 Thread Gene Heskett
On Wed March 12 2003 14:12, Brian Cuttler wrote:
I realize this isn't the correct forum, but as long as
your are already on the subject I'm hoping you will not
mind too much.

I'd guess thats since it has to do with tape, it should come under 
our umbrella.

I have one system, just one, that I do not run amanda on
but perform backups of. Its a Redhat Linux rel 7.2, code
name Inigma, kernel 2.4.9.3-1, with a DLT 8000 drive. We
are running out of tape during our nightly dump and can't
seem to figure out the correct drive parameters to either
use better blocking or turn on compression.

Yes, I've been following this discussion but we haven't
been successful.

Current command is

# dump 0udsf 49125 67854 /dev/nst0 /iarcvol
(I'm not primary on that system, I'm not really sure where
 these values originated but have been involved in testing
 tweeking them).

Hoo boy, a dump user.  Ok all you dump experts, jump right in. :-)
Me, I'm a tar user, so I have no idea what all those options might 
mean.

Only about 18 of the 25 gig make it to tape and a DLT8000
should have sufficient capacity to dump all the date with
room to spare.

   thanks,

   Brian

 Gene Heskett wrote:
[and snipped]

-- 
Cheers, Gene
AMD [EMAIL PROTECTED] 320M
[EMAIL PROTECTED]  512M
99.24% setiathome rank, not too shabby for a WV hillbilly


Re: Who uses amanda?

2003-03-12 Thread philo vivero
 I have been told that I didn't allow for the cost of my time to
 implement and babysit our system;  but from watching one of my
 colleagues struggle with our Tivoli implementation, I'm not sure it
 makes that much of a difference.

Hrm.

In a past life, I implemented Amanda in a company that backed up about
100GB of small Sybase dumps, a few web servers, a few app servers, and a
couple of user workstations to some fairly nice tape drive.

The company went out of business, but it was a dotcom, and they wanted
to maintain a presence as though they were still in business (to try to
sell the company, you see).

They left all the servers in colo but there was no-one to administer
them.

I continued to get daily emails from Amanda for months afterward as it
kept doing its best to spread backups across holding disks and the
single tape that never got changed out. I knew when they finally pulled
the plug on the Amanda machine, because that's when I stopped getting
emails.

I recall Amanda needing VERY LITTLE BABYSITTING whatsoever, and seemed
to make it very clear exactly what I needed to do to remedy whatever
problems it was having (someone change the damn tape, please!).

It was very clear Amanda was well-written to deal with edge cases and
abnormal circumstances.

It is this experience that has me currently implementing Amanda in a
3-office ~100-employee ~60 workstation mixed Unix/Windows environment. I
don't feel a single twinge of concern about whether or not Amanda is up
to the task, and quite frankly, I WOULD FEEL CONCERN about implementing
some commercial backup system, because the ones I've seen in operation
are buggy, annoying, and time-consuming.

--
pv




The amflush that wouldn't flush

2003-03-12 Thread DK Smith
I seem to have some sort of database anomaly in my AMANDA system.

I am looking for references to previous articles about this topic...
or maybe some guidance as to what I should be examining or evaluating...

##

I have sent the amflush command for the only degraded backup remaining. 
It always comes back indicating there is nothing to write to tape. 

I read the archives and found a thread where John R. Jackson advises 
users not to muck with the database manually, to let the Amanda system 
handle it... 

Well, it appears degraded mode entry is stale.

Any ideas?

Thanks!
DK


#

Subject: DailySet1 AMFLUSH MAIL REPORT FOR March 12, 2003

The dumps were flushed to tape DailySet1-14.
The next tape Amanda expects to use is: DailySet1-16.


STATISTICS:
  Total   Full  Daily
      
Estimate Time (hrs:min)0:00
Run Time (hrs:min) 0:01
Dump Time (hrs:min)0:00   0:00   0:00
Output Size (meg)   0.00.00.0
Original Size (meg) 0.00.00.0
Avg Compressed Size (%) -- -- -- 
Filesystems Dumped0  0  0
Avg Dump Rate (k/s) -- -- -- 

Tape Time (hrs:min)0:00   0:00   0:00
Tape Size (meg) 0.00.00.0
Tape Used (%)   0.00.00.0
Filesystems Taped 0  0  0
Avg Tp Write Rate (k/s) -- -- -- 

USAGE BY TAPE:
  Label  Time  Size  %Nb
  DailySet1-14   0:00   0.00.0 0


NOTES:
  amflush: legless._usr_local__legless_mysql_var.1: disk 
legless:/usr/local_legless/mysql/var not in database, skipping it.
  amflush: legless._usr_local__legless_mysql_var.2: disk 
legless:/usr/local_legless/mysql/var not in database, skipping it.
  taper: tape DailySet1-14 kb 0 fm 0 [OK]


DUMP SUMMARY:
 DUMPER STATS  
   TAPER STATS   
HOSTNAME   DISKLORIG-KB OUT-KB   COMP% MMM:SS  
   KB/s   MMM:SS KB/s
 
- -
anaconda   /etc  NO FILE TO FLUSH 
--
anaconda   /net/anaconda/scratch1NO FILE TO FLUSH 
--
boa/etc  NO FILE TO FLUSH 
--
boa/net/boa/srv  NO FILE TO FLUSH 
--
boa/var/yp   NO FILE TO FLUSH 
--
legless/etc  NO FILE TO FLUSH 
--
legless/usr/local_legless/mysql/data NO FILE TO FLUSH 
--
phenix /etc  NO FILE TO FLUSH 
--
phenix /home/phenix  NO FILE TO FLUSH 
--
phenix /usr/localNO FILE TO FLUSH 
--
redbelly   /etc  NO FILE TO FLUSH 
--
redbelly   /net/adder/scratch1   NO FILE TO FLUSH 
--
redbelly   /net/adder/scratch2   NO FILE TO FLUSH 
--
redbelly   /net/redbelly/home1   NO FILE TO FLUSH 
--
redbelly   /net/redbelly/lanl1   NO FILE TO FLUSH 
--
redbelly   /net/redbelly/lbnl1   NO FILE TO FLUSH 
--
redbelly   /usr/local_redbelly/etc   NO FILE TO FLUSH 
--
redbelly   /var/amanda   NO FILE TO FLUSH 
--
ringneck   /etc  NO FILE TO FLUSH 
--
ringneck   /net/ringneck/camb1   NO FILE TO FLUSH 
--
ringneck   /net/ringneck/scratch1NO FILE TO FLUSH 
--
ringneck   /net/ringneck/scratch2NO FILE TO FLUSH 
--
ringneck   /net/ringneck/tamu1   NO FILE TO FLUSH 
--

(brought to you by Amanda version 2.4.4)


drive compression discovery - I like dump :)

2003-03-12 Thread Stephen D. Lane
On Wed, Mar 12, 2003 at 02:34:13PM -0500, Gene Heskett wrote:
---cut---
 Current command is
 
 # dump 0udsf 49125 67854 /dev/nst0 /iarcvol
 (I'm not primary on that system, I'm not really sure where
  these values originated but have been involved in testing
  tweeking them).
 
 Hoo boy, a dump user.  Ok all you dump experts, jump right in. :-)
 Me, I'm a tar user, so I have no idea what all those options might 
 mean.

There's a very good discussion of dump options in W. Curtis Preston's
book (here's his example):

dump Ounbdsf 128 1 11500 /dev/rmt/0cbn /home

0-9 dump level
u   update the dumpdates file
n   notify the members of the operator group when 
dump is completed
b   blocking factor
ds  tape size info (see below)
f   device specification

The example above uses 

b   a blocking factor of 128
d   a density factor of  1
s   a size factor of 11500

density refers to how much data will fit on one inch of tape
sizerefers to the tape size in feet.

In actual practice these options are very difficult to use and yeild
very little value.

YMMV.

Good luck!

--Steve Lane   /\
  Doudna Lab   \ /  ASCII Ribbon Campaign
  U. C. BerkeleyX Against HTML Email
   / \



Re: level 0 of huge filesystem not working (tar returned 2, and thebackup fails)

2003-03-12 Thread Joshua Baker-LePain
On Wed, 12 Mar 2003 at 3:54pm, wab wrote

 One filesystem I'm trying to back up with AMANDA is really huge and I'm
 encountering errors:
 
 This filesystem is so huge, a level 0 is taking longer than 24 hours.
 Any ideas on what could be going wrong? My best guesses:
 
 1. The filesystem is just too big for TAR.
 2. The filesystem is so big, its contents are changing during the tar
 process and confusing it or amanda.

I backup several DLEs with tar that are rather large -- I think the 
biggest one is nearly 80GB.  That one takes about 3 hours (no 
compression).  Of course, that Linux server is rather fast.

 /-- server /usr lev 0 FAILED [/usr/local/bin/tar returned 2]
 sendbackup: start [server:/usr level 0]
 sendbackup: info BACKUP=/usr/local/bin/tar
 sendbackup: info RECOVER_CMD=/usr/local/bin/gzip -dc |/usr/local/bin/tar
 -f... -
 sendbackup: info COMPRESS_SUFFIX=.gz
 sendbackup: info end
 ? gtar: Read error at byte 53808128, reading 10240 bytes, in file
 ./archive/www/access.0203.gz: I/O error

An I/O error is bad.  Look in your system logs for more info on that.

 ./opt/freeware/apache/share/htdocs/Library/easmenu.lbi.LCK: No such file
 or directory

The rest of the stuff, yes, has to do with tarring an active filesystem.

 Any ideas as to what might be causing this?

Look into that I/O error.  Also, is this Solaris?  For whatever reason, 
tar seems rather slow on Solaris (at least a lot of questions on this 
list seem to point that way).  If that's a filesystem, could you try 
dump?

-- 
Joshua Baker-LePain
Department of Biomedical Engineering
Duke University






Re: level 0 of huge filesystem not working (tar returned 2, and the backup fails)

2003-03-12 Thread Jon LaBadie
On Wed, Mar 12, 2003 at 03:54:09PM -0500, wab wrote:
 One filesystem I'm trying to back up with AMANDA is really huge and I'm
 encountering errors:
 
 This filesystem is so huge, a level 0 is taking longer than 24 hours.
 Any ideas on what could be going wrong? My best guesses:
 
 1. The filesystem is just too big for TAR.
 2. The filesystem is so big, its contents are changing during the tar
 process and confusing it or amanda.

No I don't think this is the situation.  

 /-- server /usr lev 0 FAILED [/usr/local/bin/tar returned 2]
 sendbackup: start [server:/usr level 0]
 sendbackup: info BACKUP=/usr/local/bin/tar
  [[ snip ]]
 | Total bytes written: 30747043840
 ? gtar: Error exit delayed from previous errors
 sendbackup: error [/usr/local/bin/tar returned 2]

My past reading of tar source showed this error when one or several
files could not be backed up but most of the backup was ok.  You
had several individual file errors.

Go to your config/config.h file and add a line

#define IGNORE_TAR_ERRORS

and recompile.  It will then continue after this and several other
specific errors.


-- 
Jon H. LaBadie  [EMAIL PROTECTED]
 JG Computing
 4455 Province Line Road(609) 252-0159
 Princeton, NJ  08540-4322  (609) 683-7220 (fax)


Gene Heskett's amanda build script

2003-03-12 Thread Deb Baddorf
On Sun February 23 2003 08:23, Carsten Rezny wrote:
Thanks for your reply, Jay.

On Sat, 2003-02-22 at 21:57, Jay Lessert wrote:
 [Posted and Cc'ed]

 On Sat, Feb 22, 2003 at 08:09:16PM +0100, Carsten Rezny wrote:
  I have installed Amanda 2.4.2p2 on a SuSE 8.0 box. The machine
  is server and client.
 
  When I run amcheck I get the following result
  ERROR: /dev/nst0: no tape online
 (expecting tape maphy-d05 or a new tape)

 I assume you understand this and will fix it, right?

Right, that's not the problem.

  
  WARNING: localhost: selfcheck request timed out.  Host down?
  Client check: 1 host checked in 30.006 seconds, 1 problem
  found

 You always hate to see localhost here, so many ways that can
 go wrong.

 Change the DLE (disklist entry) from localhost to the true
 hostname, double check ~amanda/.amandahosts according to
 docs/INSTALL, and try again.

OK, I replaced localhost with the real hostname, checked
~amanda/.amandahosts and still get the same result. Here is what I
 think is the problem:

[amandad debug file]
got packet:

Amanda 2.4 REQ HANDLE 000-20B90708 SEQ 1046003786
SECURITY USER amanda
SERVICE selfcheck
OPTIONS ;
GNUTAR /mirror 0 OPTIONS

|;bsd-auth;index;exclude-list=/usr/local/lib/amanda/exclude.gtar;

GNUTAR /home 0 OPTIONS

|;bsd-auth;index;exclude-list=/usr/local/lib/amanda/exclude.gtar;



sending ack:

Amanda 2.4 ACK HANDLE 000-20B90708 SEQ 1046003786


amandad: dgram_send_addr: sendto(0.0.0.0.875) failed: Invalid
 argument ^ amandad: sending
 REP packet:

Amanda 2.4 REP HANDLE 000-20B90708 SEQ 1046003786
ERROR [addr 0.0.0.0: hostname lookup failed]
^^^


It looks like amandad doesn't know the server's IP address. Both
 client and server run on the same machine and the machine knows
 its hostname. Any more ideas?

Thanks, Carsten
First off, 2.4.2p2 is pretty ancient these days.  Second, this looks
as if it wasn't told the host machines address when it was
configured.
There have been some changes since 2.4.2p2, most notably in how
excludes are handled, and in the support for backups to disk, but
you should probably goto the amanda.org site, and down near the
bottom of the page you'll see a link to snapshots, follow it and
get 2.4.4b1-20030220.  Then follow the build it directions.  They
are basicly, become the user amanda after making amanda a member of
the group disk(or some other equally high ranking group), unpack it
in /home/amanda (makes perms easier to track), cd into the
resultant directory and configure and make it.  Then become root,
and install it.
As one needs an anchor point so that a newer version can be built to
the same configuration as the older one, thereby maintaining
continuity of its characteristics, I've been using a script to do
that configuration, one that gets copied to each new incarnation of
amanda as I unpack it.
At risk of boring the rest of the list, here it is again, modify to
suit where needed of course but read the docs for the details,
always a good idea.
gh.cf, run as ./gh.cf after setting execute perms---
#!/bin/sh
# since I'm always forgetting to su amanda...
if [ `whoami` != 'amanda' ]; then
echo
echo  Warning 
echo Amanda needs to be configured and built by the user amanda,
echo but must be installed by user root.
echo
exit 1
fi
make clean
rm -f config.status config.cache
./configure --with-user=amanda \
--with-group=disk \
--with-owner=amanda \
--with-tape-device=/dev/nst0 \
--with-changer-device=/dev/sg1 \
--with-gnu-ld --prefix=/usr/local \
--with-debugging=/tmp/amanda-dbg/ \
--with-tape-server=192.168.1.3 \
--with-amandahosts \
--with-configdir=/usr/local/etc/amanda
--
By using this script, I have built and used with only a couple of
problems, nearly every snapshot released since 2.4.2p2, probably
close to 40 snapshots since I started using amanda.
If you installed from rpm's, remove all traces of the rpm's first
before installing the tarball built version.  I'd found that when
using RH's up2date, if it thought there was a fingerprint of amanda
installed, it would cheerfully proceed to update it, thoroughly
mucking up your carefully crafted local install.  I'd expect
something similar might occur with Suse's update tool if given half
a chance.
Does your distribution use inetd, or xinetd?

HTH

--
Cheers, Gene
AMD [EMAIL PROTECTED] 320M
[EMAIL PROTECTED]  512M
99.23% setiathome rank, not too shabby for a WV hillbilly
---
Deb Baddorf [EMAIL PROTECTED]  840-2289
You can't help getting older, but you don't have to get old.
- George Burns  IXOYE




amrecover file based backup and rewind

2003-03-12 Thread Gregor Ibic
Im trying to recover some file from file based backup.
Im using the changer for rotating backup folders.

The problem is that amrecover wants to rewind the tape, but it tries to
rewind the
file:/data/Daily
instead of
file:/data/Daily/backup/Daily03
which is the real file backup tape.

If I rewind it manually it still tries to do it and amrecover fail.

Regards,
Gregor



Re: amrecover file based backup and rewind

2003-03-12 Thread Jean-Louis Martineau
Hi Gregor,

You can set your tape drive to 'file:/data/Daily/backup/Daily03' in amrecover.

amrecover will not be able to use your changer if you use chg-multi, this
bug was fixed a few days after 2.4.4 was release. You can a try a snapshot
from http://www.iro.umontreal.ca/~martinea/amanda

Jean-Louis

On Thu, Mar 13, 2003 at 01:59:18AM +0100, Gregor Ibic wrote:
 Im trying to recover some file from file based backup.
 Im using the changer for rotating backup folders.
 
 The problem is that amrecover wants to rewind the tape, but it tries to
 rewind the
 file:/data/Daily
 instead of
 file:/data/Daily/backup/Daily03
 which is the real file backup tape.
 
 If I rewind it manually it still tries to do it and amrecover fail.
 
 Regards,
 Gregor

-- 
Jean-Louis Martineau email: [EMAIL PROTECTED] 
Departement IRO, Universite de Montreal
C.P. 6128, Succ. CENTRE-VILLETel: (514) 343-6111 ext. 3529
Montreal, Canada, H3C 3J7Fax: (514) 343-5834


Re: Xinetd not starting amanda

2003-03-12 Thread Adam Smith
On Mon, Mar 10, 2003 at 12:10:47PM -0600, Rebecca Pakish Crum said:

I am having some similar problems relating to this thread, in regards to
loading the three services below, and running 'amcheck config' on FreeBSD
5.0.  I have installed both amanda-client-2.4.3, and amanda-server-2.4.3.

 Can you do a chkconfig --list and see the amanda services listed under xinetd based 
 services and are they turned on? Do you have amanda, amandaidx and amidxtape files 
 in your xinetd.d directory, and do they all look something like this (respectively):

In regards to xinetd, I have not had any experience.  I looked at the
xinetd.conf man page, and it said the configs outlined below need to be in
the /usr/local/etc/xinetd.conf file.  If they are specified in that file,
xinetd can see them, because when any of the services are broken (ie an
invalid option specified) xinetd spits out errors.

My services are specified exactly as below, except the group is different
and the option 'disable = no' exists for all three.

xinetd appears to load without errors, and I can not see any amanda
processes loaded (but this appears to be the nature of Xinetd.)  I tried to
telnet to my amanda server on ports 10080, 10082 and 10083, but only ports
10082 and 10083 responded (amandaidx and amidxtape.)  Is this the correct
behaviour?  Amandad does not seem to work correctly (unless it's not
supposed to load.)

 service amanda
 {
 protocol= udp
 socket_type = dgram
 wait= yes
 user= amanda
 group   = disk
 groups  = yes
 server  = /usr/local/libexec/amandad
 }
 service amandaidx
 {
 protocol= tcp
 socket_type = stream
 wait= no 
 user= amanda
 group   = disk
 groups  = yes
 server  = /usr/local/libexec/amindexd
 }
 service amidxtape
 {
 protocol= tcp
 socket_type = stream
 wait= no
 user= amanda
 group   = disk
 groups  = yes
 server  = /usr/local/libexec/amidxtaped
 }

These are the results I now get from running amcheck:


[EMAIL PROTECTED] /data/amanda]$ amcheck normal
Amanda Tape Server Host Check
-
Holding disk /data/amanda/holdingdisk: 44031578 KB disk space available, that's plenty
amcheck-server: slot 1: date Xlabel tape00 (first labelstr match)
NOTE: skipping tape-writable test
Tape tape00 label ok
NOTE: info dir /data/amanda/normal/curinfo/testies.sageautomation.com: does not exist
NOTE: info dir /data/amanda/normal/curinfo/megatron.sageautomation.com: does not exist
Server check took 0.147 seconds

Amanda Backup Client Hosts Check

ERROR: testies.sageautomation.com: [addr 192.168.8.50: hostname lookup failed]
WARNING: megatron.sageautomation.com: selfcheck request timed out.  Host down?
Client check: 2 hosts checked in 30.053 seconds, 2 problems found

(brought to you by Amanda 2.4.3)



The host 'testies.sageautomation.com' exists, and is resolvable (internally.)
The host 'megatron.sageautomation.com' exists and resolves internally, 
but it has no amanda services loaded on it, so its error messages are
correct.

Why am I getting a hostname lookup error for a host that exists when the
host is resolvable?


Thanks for your help.


Regards,

-- 
Adam Smith
Information Technology Officer
SAGE Automation Ltd.

[EMAIL PROTECTED]
http://www.sageautomation.com


Re: ACLs

2003-03-12 Thread Adam Smith
On Mon, Mar 10, 2003 at 11:30:14AM -0500, Mitch Collinsworth said:
 
 On Mon, 10 Mar 2003, Adam Smith wrote:
 
  On FreeBSD 5.0 with UFS2 + ACLs, what is my best method for backing up my
  ACLs along with my files?
 
  I am only experimenting with Amanda at this point, but it seems to use the
  native tar utility, however tar does not support the backing up of ACLs.
  Can anyone show me what I need to do?
 
 I don't have a 5.0 system to look at, but looking briefly at the CVS
 tree, it appears their ACL system is designed to not require special
 consideration.  There seems to be more explanation of the UFS1
 implementation, which requires more manual setup, than the UFS2
 implementation, which is natively available.  Do your filesystems
 have a special directory at their root?  Possibly .attribute ?

No, with UFS2 the ACLs just 'exist' as part of the filesystem, yet I am not
sure how to export them out.


-- 
Adam Smith
Information Technology Officer
SAGE Automation Ltd.

[EMAIL PROTECTED]
http://www.sageautomation.com


Re: Xinetd not starting amanda

2003-03-12 Thread Gene Heskett
On Wed March 12 2003 22:01, Adam Smith wrote:
On Mon, Mar 10, 2003 at 12:10:47PM -0600, Rebecca Pakish Crum
 said:

I am having some similar problems relating to this thread, in
 regards to loading the three services below, and running 'amcheck
 config' on FreeBSD 5.0.  I have installed both
 amanda-client-2.4.3, and amanda-server-2.4.3.

 Can you do a chkconfig --list and see the amanda services listed
 under xinetd based services and are they turned on? Do you have
 amanda, amandaidx and amidxtape files in your xinetd.d
 directory, and do they all look something like this
 (respectively):

In regards to xinetd, I have not had any experience.  I looked at
 the xinetd.conf man page, and it said the configs outlined below
 need to be in the /usr/local/etc/xinetd.conf file.  If they are
 specified in that file, xinetd can see them, because when any of
 the services are broken (ie an invalid option specified) xinetd
 spits out errors.

My services are specified exactly as below, except the group is
 different and the option 'disable = no' exists for all three.

xinetd appears to load without errors, and I can not see any
 amanda processes loaded (but this appears to be the nature of
 Xinetd.)  I tried to telnet to my amanda server on ports 10080,
 10082 and 10083, but only ports 10082 and 10083 responded
 (amandaidx and amidxtape.)  Is this the correct behaviour? 
 Amandad does not seem to work correctly (unless it's not supposed
 to load.)

 service amanda
 {
 protocol= udp
 socket_type = dgram
 wait= yes
 user= amanda
 group   = disk
 groups  = yes
 server  = /usr/local/libexec/amandad
 }
 service amandaidx
 {
 protocol= tcp
 socket_type = stream
 wait= no
 user= amanda
 group   = disk
 groups  = yes
 server  = /usr/local/libexec/amindexd
 }
 service amidxtape
 {
 protocol= tcp
 socket_type = stream
 wait= no
 user= amanda
 group   = disk
 groups  = yes
 server  = /usr/local/libexec/amidxtaped
 }

These are the results I now get from running amcheck:


[EMAIL PROTECTED] /data/amanda]$ amcheck normal
Amanda Tape Server Host Check
-
Holding disk /data/amanda/holdingdisk: 44031578 KB disk space
 available, that's plenty amcheck-server: slot 1: date X   
 label tape00 (first labelstr match) NOTE: skipping tape-writable
 test
Tape tape00 label ok
NOTE: info dir
 /data/amanda/normal/curinfo/testies.sageautomation.com: does not
 exist NOTE: info dir
 /data/amanda/normal/curinfo/megatron.sageautomation.com: does not
 exist Server check took 0.147 seconds

Amanda Backup Client Hosts Check

ERROR: testies.sageautomation.com: [addr 192.168.8.50: hostname
 lookup failed] WARNING: megatron.sageautomation.com: selfcheck
 request timed out.  Host down? Client check: 2 hosts checked in
 30.053 seconds, 2 problems found

(brought to you by Amanda 2.4.3)

It appears you have everything covered with the possible exception 
of the .amandahosts file.  If you configured with it, then the 
allowable hosts must be listed in this file.  Its discussed in the 
docs.  Also, make sure that the reverse lookup is correct using 
dig -x 192.168.8.50.  If that fails, you'll need to fix your 
named records for that domain.

You should get something like this for that command:
---
[EMAIL PROTECTED] root]# dig -x 192.168.1.3

;  DiG 9.2.1  -x 192.168.1.3
;; global options:  printcmd
;; Got answer:
;; -HEADER- opcode: QUERY, status: NOERROR, id: 36320
;; flags: qr aa rd ra; QUERY: 1, ANSWER: 1, AUTHORITY: 1, 
ADDITIONAL: 1

;; QUESTION SECTION:
;3.1.168.192.in-addr.arpa.  IN  PTR

;; ANSWER SECTION:
3.1.168.192.in-addr.arpa. 86400 IN  PTR coyote.coyote.den.

;; AUTHORITY SECTION:
1.168.192.in-addr.arpa. 86400   IN  NS  gene.coyote.den.

;; ADDITIONAL SECTION:
gene.coyote.den.86400   IN  A   192.168.1.1

;; Query time: 18 msec
;; SERVER: 192.168.1.1#53(192.168.1.1)
;; WHEN: Wed Mar 12 23:00:36 2003
;; MSG SIZE  rcvd: 108
---

The host 'testies.sageautomation.com' exists, and is resolvable
 (internally.) The host 'megatron.sageautomation.com' exists and
 resolves internally, but it has no amanda services loaded on it,
 so its error messages are correct.

Why am I getting a hostname lookup error for a host that exists
 when the host is resolvable?


Thanks for your help.


Regards,

-- 
Cheers, Gene
AMD [EMAIL PROTECTED] 320M
[EMAIL PROTECTED]  512M
99.24% setiathome rank, not too shabby for a WV hillbilly


Re: Xinetd not starting amanda

2003-03-12 Thread Adam Smith
On Wed, Mar 12, 2003 at 11:02:15PM -0500, Gene Heskett said:

 It appears you have everything covered with the possible exception 
 of the .amandahosts file.  If you configured with it, then the 
 allowable hosts must be listed in this file.  Its discussed in the 
 docs.  Also, make sure that the reverse lookup is correct using 
 dig -x 192.168.8.50.  If that fails, you'll need to fix your 
 named records for that domain.

It was both of those problems.  I had only whacked in a DNS entry because
of the error that was being generated, and hadn't thought about reverse DNS
at the time.  After running amcheck again, I got the error about the
.amandahosts file, created it, and it all seems to be fine.

All I need to do now is run a test backup sequence and everything should be
good :-)


Thanks.

-- 
Adam Smith
Information Technology Officer
SAGE Automation Ltd.

[EMAIL PROTECTED]
http://www.sageautomation.com