Re: Dump larger than available tape space

2006-12-13 Thread Paul Bijnens
On 2006-12-13 11:08, imacat wrote:
 On Wed, 13 Dec 2006 09:09:14 +0100 (CET)
 Marc Muehlfeld [EMAIL PROTECTED] wrote:
 Marc Muehlfeld schrieb:
 Amanda is filling tapes almost to 100% with this option, but if I want to
  backup a mountpoint that is compressed larger then the space of an empty
  tape, I get a Dump larger than available tape space-Error.
 
 As far as I know, it is not possible to dump a disk that is larger
 than the tape after compress.  The split-tape only span multiple-tapes
 on the boundary of each individual resulted dump file.  It won't split
 the resulted dump file itself.  A compressed dump result has to be
 entirely on one tape.

Amanda can do that since 2.5.0, more than a year old now.

See:   http://wiki.zmanda.org/index.php/Splitting_dumps_across_tapes


 
 This is due to the fact that Amanda is a manager/wrapper of complex
 tar operations.  It does not do binary things like splitting files at
 all.

Well, actually, it does :-)



-- 
Paul Bijnens, xplanation Technology ServicesTel  +32 16 397.511
Technologielaan 21 bus 2, B-3001 Leuven, BELGIUMFax  +32 16 397.512
http://www.xplanation.com/  email:  [EMAIL PROTECTED]
***
* I think I've got the hang of it now:  exit, ^D, ^C, ^\, ^Z, ^Q, ^^, *
* F6, quit, ZZ, :q, :q!, M-Z, ^X^C, logoff, logout, close, bye, /bye, *
* stop, end, F3, ~., ^]c, +++ ATH, disconnect, halt,  abort,  hangup, *
* PF4, F20, ^X^X, :D::D, KJOB, F14-f-e, F8-e,  kill -1 $$,  shutdown, *
* init 0, kill -9 1, Alt-F4, Ctrl-Alt-Del, AltGr-NumLock, Stop-A, ... *
* ...  Are you sure?  ...   YES   ...   Phew ...   I'm out  *
***



Excluding with Samba

2006-12-13 Thread Patrick M. Hausen
Hello!

I just tried to add our Windows server to our Amanda backup.
Basically everything is working, the nightly dump fails
because of dumps way to big.

I want to backup this disklist entry:

hugo10.ka.punkt.de  //hugo11/c$ samba-tar

The samba-tar definition looks like this:

define dumptype samba-tar {
root-tar
comment user partitions dumped with tar
priority medium
exclude ./Virtual Machines
}

Obviously this does *not* correctly exclude the Virtual Machines
directory on drive C:, because otherwise the dumps would definitely
fit on the tape.

How to specify exclusions if one is using Samba? The above syntax
I tried is correct for Unix hosts with gnutar, but I could not
find an example for Windows.

Thanks,

Patrick M. Hausen
Leiter Netzwerke und Sicherheit
-- 
punkt.de GmbH Internet - Dienstleistungen - Beratung
Vorholzstr. 25Tel. 0721 9109 -0 Fax: -100
76137 Karlsruhe   http://punkt.de


Re: Problem after years of backing up successful: data timeout

2006-12-13 Thread Paul Bijnens
On 2006-12-13 01:48, Jobst Schmalenbach wrote:
 
 All over sudden I get a data timeout, e.g.:
   adminserver /var lev 0 FAILED [data timeout]
   adminserver /home lev 3 FAILED [data timeout]
[...]
 
 Looking at the sendbackup..debug I can see the following message:
 
   ...
   index tee cannot write [Broken pipe]
   ...

Is the problem described here:

http://wiki.zmanda.com/index.php/Amdump:_mesg_read:_Connection_reset_by_peer




-- 
Paul Bijnens, xplanation Technology ServicesTel  +32 16 397.511
Technologielaan 21 bus 2, B-3001 Leuven, BELGIUMFax  +32 16 397.512
http://www.xplanation.com/  email:  [EMAIL PROTECTED]
***
* I think I've got the hang of it now:  exit, ^D, ^C, ^\, ^Z, ^Q, ^^, *
* F6, quit, ZZ, :q, :q!, M-Z, ^X^C, logoff, logout, close, bye, /bye, *
* stop, end, F3, ~., ^]c, +++ ATH, disconnect, halt,  abort,  hangup, *
* PF4, F20, ^X^X, :D::D, KJOB, F14-f-e, F8-e,  kill -1 $$,  shutdown, *
* init 0, kill -9 1, Alt-F4, Ctrl-Alt-Del, AltGr-NumLock, Stop-A, ... *
* ...  Are you sure?  ...   YES   ...   Phew ...   I'm out  *
***



Re: Dump larger than available tape space

2006-12-13 Thread Paul Bijnens

Note that amanda-hackers is for developers.  This is clearly
a user question.  So I redirected the answer to the amanda-users list.


On 2006-12-05 14:29, Marc Muehlfeld wrote:
 Hi,
 
 I use amanda 2.5.1p2 and setup
 
 tape_splitsize 3072M
 fallback_splitsize 32M
 
 Amanda is filling tapes almost to 100% with this option, but if I want to
 backup a mountpoint that is compressed larger then the space of an empty
 tape, I get a Dump larger than available tape space-Error.
 
 What I am doing wrong?

That should work, if the parameters you gave are on the right tapetype
definition, and you use a changer and you set runtapes  1.

And ofcourse the total size of the dump should not be larger than
runtapes times tapecapacity (the one you specified, not the one physical
capacity of the tape).

What is the size?
What is runtapes?
What is the result of:
 amadmin yourconfig disklist thehost /the/large/disk
Des it show the tape_splitsize parameter above?


-- 
Paul Bijnens, xplanation Technology ServicesTel  +32 16 397.511
Technologielaan 21 bus 2, B-3001 Leuven, BELGIUMFax  +32 16 397.512
http://www.xplanation.com/  email:  [EMAIL PROTECTED]
***
* I think I've got the hang of it now:  exit, ^D, ^C, ^\, ^Z, ^Q, ^^, *
* F6, quit, ZZ, :q, :q!, M-Z, ^X^C, logoff, logout, close, bye, /bye, *
* stop, end, F3, ~., ^]c, +++ ATH, disconnect, halt,  abort,  hangup, *
* PF4, F20, ^X^X, :D::D, KJOB, F14-f-e, F8-e,  kill -1 $$,  shutdown, *
* init 0, kill -9 1, Alt-F4, Ctrl-Alt-Del, AltGr-NumLock, Stop-A, ... *
* ...  Are you sure?  ...   YES   ...   Phew ...   I'm out  *
***



Re: Problem after years of backing up successful: data timeout

2006-12-13 Thread Brian Cuttler

Jobst,

if your data grows you may actually run into an estimate timeout
after a long period of success, I did just the other day, had a
20 minute timeout and checking the /tmp/amanda logs on the client
I found that the estimate didn't finish for nearly 23 minutes.

I'm not saying you had the same problem I did, but the log files
on the client are a great place to confirm or disprove.

On Wed, Dec 13, 2006 at 11:48:19AM +1100, Jobst Schmalenbach wrote:
 
 Hi.
 
 All over sudden I get a data timeout, e.g.:
 
   ...
   ...
   adminserver /var lev 0 FAILED [data timeout]
   adminserver /home lev 3 FAILED [data timeout]
   ...
   ...
 
 I havent changed a thing on the machines involved for
 a while (I work on the basic principle if aint broken, dont fix)
 
 
 Now I have searched the net and found a few pointers,
 but all those I found do not help:
 
  * I do not use compression (I use hardware compression)
 
  * its NOT backing up another host, its the LOCAL machine
backing up itself, and I have never had any problems with this
 
  * the dtimeout already is 1800
 
  * since the last reboot of the machine I have done
lots of successfull backups.
 
  * I havent installed anything new for a while on that machine.
 
  * I havent hanged anything (xinet, hosts.allow, .amandahost, directories,
amanda, whatever).

 
 Looking at the sendbackup..debug I can see the following message:
 
   ...
   index tee cannot write [Broken pipe]
   ...
 
 The index file for the latest ones are missing, that is correct.
 
 
 I checked all the permissions on the amanda based directories, and they
 look fine to me.
 
 
 What can be the cause for the errors popping up?
 
 
 
 jobst
 
 
 
 
 
 -- 
 Learn the rules so you know how to break them properly. -F1
 
   | |0| |   Jobst Schmalenbach, [EMAIL PROTECTED], Technical Director
   | | |0|   Barrett Consulting Group P/L  The Meditation Room P/L
   |0|0|0|   +61 3 9532 7677, POBox 277, Caulfield South, 3162, Australia
---
   Brian R Cuttler [EMAIL PROTECTED]
   Computer Systems Support(v) 518 486-1697
   Wadsworth Center(f) 518 473-6384
   NYS Department of HealthHelp Desk 518 473-0773



hacker's digest 1104

2006-12-13 Thread Brian Cuttler

An interesting but confusing (for me) read, but the wiki page
was very helpful.

http://wiki.zmanda.com/index.php/Splitting_dumps_across_tapes

We are will likely be implementing this shortly, I have a number
of jukeboxes with large DLE or many small DLE where I'm only
partially filling multiple tapes, I have a related question.

Is there a value in trying to match the tape_slitsize to the chunksize ?

thanks,

Brian
---
   Brian R Cuttler [EMAIL PROTECTED]
   Computer Systems Support(v) 518 486-1697
   Wadsworth Center(f) 518 473-6384
   NYS Department of HealthHelp Desk 518 473-0773



Re: hacker's digest 1104

2006-12-13 Thread Paul Bijnens

Brian Cuttler schreef:

An interesting but confusing (for me) read, but the wiki page
was very helpful.

http://wiki.zmanda.com/index.php/Splitting_dumps_across_tapes

We are will likely be implementing this shortly, I have a number
of jukeboxes with large DLE or many small DLE where I'm only
partially filling multiple tapes, I have a related question.

Is there a value in trying to match the tape_slitsize to the chunksize ?


They are completely unrelated, and can be used orthogonal.

chunksize is a holdingdisk parameter mainly to overcome filesize
limitations on certain filesystems.  One additional benefit is that
when using many holdingdisk areas, one dump one holdingdisk can be
spread over all these disks, even if each of them would be too small
to hold one complete image.

tapesplit_size is the size of chunk on tape.  When writing such
a chunk to tape, and the tape bumps into EOT, the next tape is loaded,
and the complete chunk is rewritten again.  Compare this to the
alternative to restart the complete dumpimage on that tape:  it
avoids wasting too much tape (and time writing it).

Note also that tapesplit_size is a dumptype parameter:  you may
specify which DLE's should be split, and which not (e.g. not
splitting the DLE's that contain the amanda software makes
restores easier, when that disk itself was lost).


--
Paul Bijnens, XplanationTel  +32 16 397.511
Technologielaan 21 bus 2, B-3001 Leuven, BELGIUMFax  +32 16 397.512
http://www.xplanation.com/  email:  [EMAIL PROTECTED]
***
* I think I've got the hang of it now:  exit, ^D, ^C, ^\, ^Z, ^Q, F6, *
* quit,  ZZ, :q, :q!,  M-Z, ^X^C,  logoff, logout, close, bye,  /bye, *
* stop, end, F3, ~., ^]c, +++ ATH, disconnect, halt,  abort,  hangup, *
* PF4, F20, ^X^X, :D::D, KJOB, F14-f-e, F8-e,  kill -1 $$,  shutdown, *
* kill -9 1,  Alt-F4,  Ctrl-Alt-Del,  AltGr-NumLock,  Stop-A,  ...*
* ...  Are you sure?  ...   YES   ...   Phew ...   I'm out  *
***