Re: Testing tapes

2002-08-31 Thread Dietmar Goldbeck

On Sat, Aug 31, 2002 at 01:45:44PM +0200, Brian Jonnes wrote:
> Hi,
> 
> I think I have a faulty tape or two. What is the best recommended way of 
> testing this? Generate a file from /dev/urandom, write it to the tape and 
> md5sum it?
> 

If you use software compression with Amanda, one easy way
would be 

amrecover -c /dev/tape 
gzip -tv *.?

This checks the internal gzip CRC on all files.  

You could also run Amanda without tape, compute the md5sum of all
files on the holding disk, flush them and then recover and compare
md5. 

I personally would not just write one large file, because
the tape might have some special problem ocurring with Amanda
(writing lots of file marks, writing 32k blocks etc.)

I always used Amanda itself and checked _all_ gzip CRC. 

When testing a new Amanda server/new tape drive 
i also do some real restores on to some spare disk and compare m5sums
of the original tree and the restored tree.

> Also, what is the expected lifetime for Travan 4 tapes (each used once a 
> week)? When should I retire them?

I don't have experience with travan. My experience with several DDS
and DLT tape drives (and hundreds of tapes) suggests that problems
with more than _only_ _one_ tape are probably problems of the drive
:-((

-- 
 Alles Gute / best wishes  
 Dietmar GoldbeckE-Mail: [EMAIL PROTECTED]
Reporter (to Mahatma Gandhi): Mr Gandhi, what do you think of Western
Civilization?  Gandhi: I think it would be a good idea.



Re: Testing tapes

2002-08-31 Thread Gene Heskett

On Saturday 31 August 2002 07:45, Brian Jonnes wrote:
>Hi,
>
>I think I have a faulty tape or two. What is the best recommended
> way of testing this? Generate a file from /dev/urandom, write it
> to the tape and md5sum it?

Most drives do the equ of that themselves. its when they can't 
recover the error that you become aware that its doing re-read 
after re-read and reporting a failure.
>
>Also, what is the expected lifetime for Travan 4 tapes (each used
> once a week)? When should I retire them?

My experience with TR4's is that they will usually outlast the 
drive.  Thats not saying much, but we did have one in an NT system 
that probably accumulated in excess of 1500 passes (never changed 
the tape) when we retired the box it was in.  2 other TR4 drives 
failed, one of them ripping the tapes in two violently, in less 
than a year.  So generally speaking, TR4's aren't any more, or less 
dependable than a DDS2, but the DDSx format is slowly pulling ahead 
in my personal tally sheets.  Plus the DDS2 tapes are beaucoup 
cheaper...

-- 
Cheers, Gene
AMD K6-III@500mhz 320M
Athlon1600XP@1400mhz  512M
99.13% setiathome rank, not too shabby for a WV hillbilly



Testing tapes

2002-08-31 Thread Brian Jonnes

Hi,

I think I have a faulty tape or two. What is the best recommended way of 
testing this? Generate a file from /dev/urandom, write it to the tape and 
md5sum it?

Also, what is the expected lifetime for Travan 4 tapes (each used once a 
week)? When should I retire them?

..Brian
-- 
Init Systems  -  Linux consulting
031 767-0139082 769-2320[EMAIL PROTECTED]




Re: ontape onbar Amanda and single images

2002-08-31 Thread Gene Heskett

On Friday 30 August 2002 11:28, Quinn, Richard C. - Collinsville IT 
wrote:

First, I had to pick this message out of the trash because the 
return address is forged.

>Hi,
>
>We are running informix 7.3 with Amanda 2.4 on Solaris 2.6.
>
>We have a dilemma with regard to backing  up our Informix Dbase.
>
>We have a 120 Gig dbase we normally backup via the Informix
> ''ontape'' utility.
>
>Doing this gives us the 'roll forward' capability.  So that in the
> event of a crash.
>We can recover the database pretty much up to the minute of the
> last transaction.
>
>So now we have Amanda up and running and we wish to be able to
> back up our Database.
>
>From what I am told, Amanda won't back up a single image(which, I
> guess, means a file) on more than one tape.
>And, from what I understand, the informix dbase is backed up as a
> single image.
>
>This single image is far more than can be stored on one of our DLT
> 7K tapes(70 gig compressed).
>
>So the alternative would be to export the database to a filesystem
> and then back THAT up onto Amanda.
>Well, from what I am  told, if we do that, we'll lose the ''roll
>forward'' capability.
>That would not be acceptable to our users.
>
>That and doing it this way(the export method) would require
> another 130 gig of unused disk space so as to
>have a place to put the exported Dbase.
>
>We tried using a combo of ''onbar'' and using a FIFO, but that
> didn't seem to resolve our Dilemma.
>
>I think the Key issue is the word ''image'' and the fact that one
> cannot be written over more than one tape.
>
>Is there anyone who is  familiar with this problem?
>
>
>Rich

Unforch, this answer is gonna be offtopic, sorry.

Yes, and its an insurmountable problem for amanda unless you can 
break the database into smaller, will fit on a tape, pieces.  
Amanda has never been able to span a single filesystem across more 
than one tape and I don't believe doing that is even in the designs 
outline for reasons of dependability.  So I use tar, and split my 
disklist entries for /usr into subdirs that will fit.

But since most database's are basicly a "one door" model, I've no 
idea how to go about doing the subdir equivalent to a huge 
database.

One possible, non-amanda solution might be to setup a raid array of 
4 160 gig drives, giving you 320 gigs of recoverable storage and 
use rsync to do a nightly image.  This is good for a 1 drive 
failure and we've confirmed that it works by doing a shut down and 
exchanging one of the drives with a fresh one.  On startup of the 
md system in the reboot, the rebuilding begins, and can even be 
interrupted by yet another reboot without effecting the recovery, 
it just starts back up again at the point where it was interrupted.

We did this disk swap test half a dozen times without any problems 
before it was placed into service at the tv station where its now 
been doing its nightly thing to much of the system for over 6 
months with no hiccups, including the recovery of several crashed 
windows boxes from it during this time.  The elderly WD drives in 
them have about all self destructed by now though.

We are well aware that a 2 drive failure means everything is gone.
OTOH, this is much faster even over the network because rsync only 
moves that which has changed since the last such operation, making 
it effectively at least 10x faster than a tape drive since the raid 
has an hdparm -tT speed in the 50+ meg/second thruput.  So the 
100baseT is the bottleneck, not the tape drive.

We used promise 4 port cards, (20269's IIRC) 2 of them so each drive 
was the primary on its cable, in a software raid using mdtools on 
linux.

ISTR we did that for less, far less, than the 4 digit quote we got 
from Knox for Arkeia.  Having played with the single drive arkeia 
freebie, lemme tell you that amanda is one heck of a lot 
friendlier.

-- 
Cheers, Gene
AMD K6-III@500mhz 320M
Athlon1600XP@1400mhz  512M
99.13% setiathome rank, not too shabby for a WV hillbilly