bumpsize, bumpdays bumpmult
Hi all, howcan I customize the bumpsize, bumpdays and bumpmult parameters if I want to backup my systemeveryday with adifferent incremental level? Thanksin advance. Belén.
Re: WARNING: server.domain.co.uk: selfcheck request timed out. Host down? -Fixed!
Hi I did and it's working I had used the wrong path where my tar was located. Cheers Chuck On Tue, 2005-05-10 at 17:42 +0200, Stefan G. Weichinger wrote: Hi, Chuck, on Dienstag, 10. Mai 2005 at 15:57 you wrote to amanda-users: CA Here's my advance I will sort this alot out as it's self explanatory. and CA Amanda Backup Client Hosts Check CA CA ERROR: server.domain.co.uk: [GNUTAR program not available] Install gnutar. Re-run configure as amanda, make and make install as root so you get fresh new binaries that know about the location of your new gnutar-binary. Watch out for WARNINGs at the configure-step, there should be no warnings requesting gnutar ... -- Unix/ Linux Systems Administrator The Surgical Material Testing Laboratory (SMTL), Princess of Wales Hospital Coity Road Bridgend, United Kingdom, CF31 1RQ. Tel: +44 1656 752820 Fax: +44 1656 752830
Re: newbie questions about setting up amanda
Jon == Jon LaBadie [EMAIL PROTECTED] writes: Jon These are level 1 dumps. Maybe no changes? Did you get the Jon same results on the last level 0? If I recall, these are Jon mail dirs, is there stuff there? Last dump summary: DUMPER STATSTAPER STATS HOSTNAME DISKL ORIG-KB OUT-KB COMP% MMM:SS KB/s MMM:SS KB/s -- - omni / 0 13315801331580 --6:163543.9 6:163542.4 omni /boot 05020 5020 --0:0011510.0 0:041246.0 omni /home/ag27010 7010 --0:023301.9 0:023041.9 omni /home/hm1 109930 109930 --0:205490.9 0:382924.1 omni /home/nt2 25960 25960 --0:045938.1 0:102607.6 omni /home/uz0 25456402545640 --9:064660.3 14:033019.2 omni /root 0 393480 393480 --1:224826.4 2:132964.4 omni /usr0 35510003551000 -- 17:543305.3 13:364353.2 omni -ap/user/ag 0 10 10 --0:00 182.9 0:04 2.7 omni -ap/user/hm 0 10 10 --0:00 184.8 0:03 3.2 omni -ap/user/nt 0 10 10 --0:00 133.9 0:08 1.3 omni -ap/user/uz 0 15315201531520 -- 13:581828.5 7:523243.4 Now they are level 0, right? Still no dump. The latest one seems dumped ok, but I'm not sure. Check this interaction: -- # cd / # amrecover ISR AMRECOVER Version 2.4.4p4. Contacting server on omni ... 220 omni AMANDA index server (2.4.4p4) ready. 200 Access OK Setting restore date to today (2005-05-12) 200 Working date set to 2005-05-12. Scanning /var/amanda/dumps... 200 Config set to ISR. 200 Dump host set to omni. Trying disk / ... $CWD '/' is on disk '/' mounted at '/'. 200 Disk set to /. / amrecover listdisk 200- List of disk for host omni 201- / 201- /boot 201- /usr 201- /root 201- /home/ag 201- /home/hm 201- /home/nt 201- /home/uz 201- /var/spool/imap/user/ag 201- /var/spool/imap/user/hm 201- /var/spool/imap/user/nt 201- /var/spool/imap/user/uz 200 List of disk for host omni amrecover setdisk /var/spool/imap/user/uz 200 Disk set to /var/spool/imap/user/uz. amrecover ls 2005-05-12 . 2005-05-12 vab/ 2005-05-12 vale/ 2005-05-12 vodakura/ 2005-05-12 vsilva/ 2005-05-12 vtraver/ 2005-05-12 yoda/ 2005-05-12 zlatan/ amrecover setdisk /var/spool/imap/user/ag 200 Disk set to /var/spool/imap/user/ag. No index records for disk for specified date If date correct, notify system administrator amrecover ls amrecover -- Cheers, Rodrigo -- *** Rodrigo Martins de Matos Ventura [EMAIL PROTECTED] *** Web page: http://www.isr.ist.utl.pt/~yoda *** Teaching Assistant and PhD Student at ISR: ***Instituto de Sistemas e Robotica, Polo de Lisboa *** Instituto Superior Tecnico, Lisboa, PORTUGAL *** PGP fingerprint = 0119 AD13 9EEE 264A 3F10 31D3 89B3 C6C4 60C6 4585
Re: estimate timeout
McDonagh, Joe wrote: I have an estimate timeout of three hours, is there anyway to skip the estimate or what? It's getting estimate timeout, the fs is fine, it can be read from and everything, it just has loads of small files. You might want to consider upgrading the server and client involved to the current stable. It has provisions for doing server estimates. That should help. The server estimates seem to be conservative, to be on the safe side. I have some data to look through for level 0, level 1, level 2 estimates and I should be able to post it by the end of this week. Hope this helps. -- Jim Summers School of Computer Science-University of Oklahoma -
Still evaluating amanda, more questions
Hi, I received great suggestions from people on this list. Thanks to all. One of those suggestion involved using 3 or 4 sets of tapes to be able to keep a copy of the backup off site For example, if I use 5 tapes per week and my dumpcylce is one week, I could keep a set locally to do my backups on, another in a file cabinet, another at a remote site. I will probably have more than 4 sets of tapes. My question is: If I use indexing, is it easy to be able to recover a specific version of a faile ? Say, file xyz has been modified often and exists on 5 different tapes, all at different dates, and I need to restore files from a particular date (not the latest), is there an utility in amanda that can show me all the versions of the file so I can restore exactly the one I want ? Also, is there a way in amanda to erase a tape, and remove it from amanda's database inventory and amanda's index ? If, for example, I have introduced a lot of new tapes in the rotation, and I need to reduce it, can I do it ? Is there a way to determine which tape is out of date and can be safely removed from the rotation ? THANKS A LOT, AGAIN !
Re: Still evaluating amanda, more questions
On Thu, May 12, 2005 at 09:06:47AM -0400, Guy Dallaire enlightened us: I received great suggestions from people on this list. Thanks to all. One of those suggestion involved using 3 or 4 sets of tapes to be able to keep a copy of the backup off site For example, if I use 5 tapes per week and my dumpcylce is one week, I could keep a set locally to do my backups on, another in a file cabinet, another at a remote site. I will probably have more than 4 sets of tapes. My question is: If I use indexing, is it easy to be able to recover a specific version of a faile ? Say, file xyz has been modified often and exists on 5 different tapes, all at different dates, and I need to restore files from a particular date (not the latest), is there an utility in amanda that can show me all the versions of the file so I can restore exactly the one I want ? Yes, by using the amrecover command. This gives you an FTP-like interface to your index files and allows for the commands: sethost setdisk setdate To specify exactly the files you want :-) Also, is there a way in amanda to erase a tape, and remove it from amanda's database inventory and amanda's index ? If, for example, I have introduced a lot of new tapes in the rotation, and I need to reduce it, can I do it ? amrmtape Is there a way to determine which tape is out of date and can be safely removed from the rotation ? THANKS A LOT, AGAIN ! Well, you can run amadmin CONFIG find on a single DLE to get an idea. You can also look in the tapelist file for the config which has a list of all the tapes and the date the tape was last written to. Matt -- Matt Hyclak Department of Mathematics Department of Social Work Ohio University (740) 593-1263 pgpPTRzzTrf7t.pgp Description: PGP signature
Re: Still evaluating amanda, more questions
On Thu, 12 May 2005 at 9:06am, Guy Dallaire wrote If I use indexing, is it easy to be able to recover a specific version of a faile ? Say, file xyz has been modified often and exists on 5 different tapes, all at different dates, and I need to restore files from a particular date (not the latest), is there an utility in amanda that can show me all the versions of the file so I can restore exactly the one I want ? See 'man amrecover': setdate is the command you're looking for. Also, is there a way in amanda to erase a tape, and remove it from amanda's database inventory and amanda's index ? If, for example, I have introduced a lot of new tapes in the rotation, and I need to reduce it, can I do it ? amrmtape Is there a way to determine which tape is out of date and can be safely removed from the rotation ? You can do this on a per-DLE basis via amadmin. -- Joshua Baker-LePain Department of Biomedical Engineering Duke University
Re: newbie questions about setting up amanda
On Thu, May 12, 2005 at 11:40:21AM +0100, Rodrigo Ventura wrote:
Jon == Jon LaBadie [EMAIL PROTECTED] writes:
Jon These are level 1 dumps. Maybe no changes? Did you get the
Jon same results on the last level 0? If I recall, these are
Jon mail dirs, is there stuff there?
Last dump summary:
DUMPER STATSTAPER STATS
HOSTNAME DISKL ORIG-KB OUT-KB COMP% MMM:SS KB/s MMM:SS KB/s
-- -
omni / 0 13315801331580 --6:163543.9 6:163542.4
omni /boot 05020 5020 --0:0011510.0 0:041246.0
omni /home/ag27010 7010 --0:023301.9 0:023041.9
omni /home/hm1 109930 109930 --0:205490.9 0:382924.1
omni /home/nt2 25960 25960 --0:045938.1 0:102607.6
omni /home/uz0 25456402545640 --9:064660.3 14:033019.2
omni /root 0 393480 393480 --1:224826.4 2:132964.4
omni /usr0 35510003551000 -- 17:543305.3 13:364353.2
omni -ap/user/ag 0 10 10 --0:00 182.9 0:04 2.7
omni -ap/user/hm 0 10 10 --0:00 184.8 0:03 3.2
omni -ap/user/nt 0 10 10 --0:00 133.9 0:08 1.3
omni -ap/user/uz 0 15315201531520 -- 13:581828.5 7:523243.4
Now they are level 0, right? Still no dump. The latest one seems
dumped ok, but I'm not sure. Check this interaction:
--
# cd /
# amrecover ISR
AMRECOVER Version 2.4.4p4. Contacting server on omni ...
220 omni AMANDA index server (2.4.4p4) ready.
200 Access OK
Setting restore date to today (2005-05-12)
200 Working date set to 2005-05-12.
Scanning /var/amanda/dumps...
200 Config set to ISR.
200 Dump host set to omni.
Trying disk / ...
$CWD '/' is on disk '/' mounted at '/'.
200 Disk set to /.
/
amrecover listdisk
200- List of disk for host omni
201- /
201- /boot
201- /usr
201- /root
201- /home/ag
201- /home/hm
201- /home/nt
201- /home/uz
201- /var/spool/imap/user/ag
201- /var/spool/imap/user/hm
201- /var/spool/imap/user/nt
201- /var/spool/imap/user/uz
200 List of disk for host omni
amrecover setdisk /var/spool/imap/user/uz
200 Disk set to /var/spool/imap/user/uz.
amrecover ls
2005-05-12 .
2005-05-12 vab/
2005-05-12 vale/
2005-05-12 vodakura/
2005-05-12 vsilva/
2005-05-12 vtraver/
2005-05-12 yoda/
2005-05-12 zlatan/
amrecover setdisk /var/spool/imap/user/ag
200 Disk set to /var/spool/imap/user/ag.
No index records for disk for specified date
If date correct, notify system administrator
amrecover ls
amrecover
--
Does 'amadmin config disklist omni /var/spool/... ' show indexing
turned on?
Are there index files for those DLE's under your index dir?
Was there ever a successful backup of the DLE's in question?
Does the mailed to you report show anything of interest about
failures or strange results?
I presume the DLE's for /home/{ag|hm|nt} are similar to those for
/var/spool/imap/user/{ag|hm|nt}. Same similarity for the uz entries.
Yet all the /home ones are working, the include ones for /var... aren't.
What is different about the /home and /var/spool DLE's?
What is different about /home itself vs /var/spool/imap/user?
--
Jon H. LaBadie [EMAIL PROTECTED]
JG Computing
4455 Province Line Road(609) 252-0159
Princeton, NJ 08540-4322 (609) 683-7220 (fax)
amindexd no such file or directory
Hi All I have run the amdump and thus tried amrecover as root I got this error when I run less command server:/tmp/amanda-dbg # less 13:46 amindexd.20050512134638.debug 13:46: No such file or directory I dont have this utility in my /sbin/am* So what next I have seen the blurb about Amindex. Amindex was a collection of code that added dump indexing and more friendly recovery to amanda-2.3.0. It has since been fully integrated into amanda-2.3.0.X. An index of the files in each dump image is generated as part of the dump process and stored in a database. A tool, amrecover, is provided which lets users browse the database. Once a set of files to recover has been assembled, amrecover automates the restoration of these files. This file describes how the index files are generated and how amrecover is used. Cheers Chuck -- Unix/ Linux Systems Administrator The Surgical Material Testing Laboratory (SMTL), Princess of Wales Hospital Coity Road Bridgend, United Kingdom, CF31 1RQ. Tel: +44 1656 752820 Fax: +44 1656 752830
Re: newbie questions about setting up amanda
Jon == Jon LaBadie [EMAIL PROTECTED] writes:
Jon Does 'amadmin config disklist omni /var/spool/... ' show
Jon indexing turned on?
Yes.
Jon Are there index files for those DLE's under your index dir?
Yes, all gzipped; decompress to an empty file.
Jon Was there ever a successful backup of the DLE's in question?
No, I'm pretty sure there was never one.
Jon Does the mailed to you report show anything of interest about
Jon failures or strange results?
Only in the root partition, because of log files, sockets, and so
on. No strange results in the DLE's in question.
Jon I presume the DLE's for /home/{ag|hm|nt} are similar to those
Jon for /var/spool/imap/user/{ag|hm|nt}. Same similarity for the
Jon uz entries. Yet all the /home ones are working, the
Jon include ones for /var... aren't.
Jon What is different about the /home and /var/spool DLE's?
Not much. The latter was based on a copypaste of the former.
Jon What is different about /home itself vs /var/spool/imap/user?
There is a physical partition mounted on /home, and therefore /home
corresponds to the root directory of the partition in question. The
/var/spool/... are in the root (/) partition. I'm assuming (hoping)
that the include directive only works for directories in the root of
a mounted partition!!! I want to split the /var/spool/imap/user
directory in several dumps; do I have to create a physical partition
and mount it at /var/spool/imap/user? (that's unreasonable for my server)
I guess the central issue lies here: does a DLE have to correspond to
a filesystem? Does the include directive only works for directories at
the root of mounted filesystems?
If these are the constraints of amanda, how can find a workaround to
solve my problem of backing up subsets of directories deep in the
directory structure of a filesystem?
Cheers,
Rodrigo
--
*** Rodrigo Martins de Matos Ventura [EMAIL PROTECTED]
*** Web page: http://www.isr.ist.utl.pt/~yoda
*** Teaching Assistant and PhD Student at ISR:
***Instituto de Sistemas e Robotica, Polo de Lisboa
*** Instituto Superior Tecnico, Lisboa, PORTUGAL
*** PGP fingerprint = 0119 AD13 9EEE 264A 3F10 31D3 89B3 C6C4 60C6 4585
Re: amindexd no such file or directory
--On Thursday, May 12, 2005 16:17:57 +0100 Chuck Amadi [EMAIL PROTECTED] wrote: Hi All I have run the amdump and thus tried amrecover as root I got this error when I run less command server:/tmp/amanda-dbg # less 13:46 amindexd.20050512134638.debug 13:46: No such file or directory I dont have this utility in my /sbin/am* Lookes like you inadvertantly included the timestamp when you were pasting in the debug filename on your less command. The amindex command lives in libexec, wherever you install directory was (I think the default is /usr/local). Frank So what next I have seen the blurb about Amindex. Amindex was a collection of code that added dump indexing and more friendly recovery to amanda-2.3.0. It has since been fully integrated into amanda-2.3.0.X. An index of the files in each dump image is generated as part of the dump process and stored in a database. A tool, amrecover, is provided which lets users browse the database. Once a set of files to recover has been assembled, amrecover automates the restoration of these files. This file describes how the index files are generated and how amrecover is used. Cheers Chuck -- Unix/ Linux Systems Administrator The Surgical Material Testing Laboratory (SMTL), Princess of Wales Hospital Coity Road Bridgend, United Kingdom, CF31 1RQ. Tel: +44 1656 752820 Fax: +44 1656 752830 -- Frank Smith [EMAIL PROTECTED] Sr. Systems Administrator Voice: 512-374-4673 Hoover's Online Fax: 512-374-4501
Re: newbie questions about setting up amanda
On Thu, May 12, 2005 at 04:19:16PM +0100, Rodrigo Ventura wrote:
Jon == Jon LaBadie [EMAIL PROTECTED] writes:
Jon Was there ever a successful backup of the DLE's in question?
No, I'm pretty sure there was never one.
Jon I presume the DLE's for /home/{ag|hm|nt} are similar to those
Jon for /var/spool/imap/user/{ag|hm|nt}. Same similarity for the
Jon uz entries. Yet all the /home ones are working, the
Jon include ones for /var... aren't.
Jon What is different about the /home and /var/spool DLE's?
Not much. The latter was based on a copypaste of the former.
Jon What is different about /home itself vs /var/spool/imap/user?
There is a physical partition mounted on /home, and therefore /home
corresponds to the root directory of the partition in question. The
/var/spool/... are in the root (/) partition. I'm assuming (hoping)
that the include directive only works for directories in the root of
a mounted partition!!! I want to split the /var/spool/imap/user
directory in several dumps; do I have to create a physical partition
and mount it at /var/spool/imap/user? (that's unreasonable for my server)
I guess the central issue lies here: does a DLE have to correspond to
a filesystem? Does the include directive only works for directories at
the root of mounted filesystems?
If these are the constraints of amanda, how can find a workaround to
solve my problem of backing up subsets of directories deep in the
directory structure of a filesystem?
I don't recall there being any restriction like that. But I must admit,
the include code and capability is less solid than the exclude stuff.
Given that, how about a workaround that changes things to excludes?
The includes you have used seem like they should work (to me anyway).
Here would be some sample changes:
Current:
omni /var/spool/imap/user/ag /var/spool/imap/user {
comment omni mail accounts a-g
include file ./[a-g]*
global
}
Revised (if you know there is only a-z:
omni /var/spool/imap/user/ag /var/spool/imap/user {
comment omni mail accounts a-g
global
exclude file ./[h-z]*
}
Revised (if you 'might' have things like Rodrigo or
3ware or ~junkfile in /var/spool/imap):
omni /var/spool/imap/user/ag /var/spool/imap/user {
comment omni mail accounts a-g
global
exclude file ./[ -`h-~]*
}
Space (' ') is the first 'non-control' character (I'm assuming no
file/dirs in imap start with control chars) and Backquote, aka
accent grave ('`') is the last char before lower case 'a'. Tilde
('~') is the last printable ascii character.
BTW if I were setting this up I would not have dumptype 'global'
specify a backup program (gnutar). Someday I might want to use
the global properties with a different backup program. Instead
I'd setup a more general 'global' dumptype and two additional
dumptypes like gtarglobal and dumpglobal with first include
global then specify the dump program.
--
Jon H. LaBadie [EMAIL PROTECTED]
JG Computing
4455 Province Line Road(609) 252-0159
Princeton, NJ 08540-4322 (609) 683-7220 (fax)
Re: amindexd no such file or directory
On Thu, May 12, 2005 at 04:17:57PM +0100, Chuck Amadi wrote: Hi All I have run the amdump and thus tried amrecover as root I got this error when I run less command server:/tmp/amanda-dbg # less 13:46 amindexd.20050512134638.debug 13:46: No such file or directory what if you try: less amindexd.20050512134638.debug An 'ls' should show you what is there. -- Jon H. LaBadie [EMAIL PROTECTED] JG Computing 4455 Province Line Road(609) 252-0159 Princeton, NJ 08540-4322 (609) 683-7220 (fax)
Re: amindexd no such file or directory - Oops
--On Thursday, May 12, 2005 17:01:24 +0100 Chuck Amadi [EMAIL PROTECTED] wrote: Hi Great your right but why do I get this error no such file or directory when I run amrecover to test if I can recover what's in my amdump tape my amindexd does resides in my /amanda path/libexec . Cheers here's my debug log when I run less amindexd: debug 1 pid 7904 ruid 150 euid 150: start at Thu May 12 13:46:38 2005 amindexd: version 2.4.4p4 amindexd: time 0.000: 220 server AMANDA index server (2.4.4p4) ready. amindexd: time 0.000: SECURITY USER root amindexd: time 0.001: bsd security: remote host server.domain.co.uk user root local user amanda amindexd: time 0.001: check failed: [access as amanda not allowed from [EMAIL PROTECTED] amandahostsauth failed amindexd: time 0.001: 500 Access not allowed: [access as amanda not allowed from [EMAIL PROTECTED] amandahostsauth failed This is your problem ^^^ amindexd: time 0.001: 200 Good bye. amindexd: time 0.001: pid 7904 finish time Thu May 12 13:46:38 2005 I am using amanda as user and disk as group whats this user group. I run the command as Root. In order to run amrestore/amrecover your .amandahosts file on the server must allow root access from the client, so add server.domain.co.uk root to your .amandahosts file on the server. Frank Cheers Chuck On Thu, 2005-05-12 at 10:49 -0500, Frank Smith wrote: --On Thursday, May 12, 2005 16:17:57 +0100 Chuck Amadi [EMAIL PROTECTED] wrote: Hi All I have run the amdump and thus tried amrecover as root I got this error when I run less command server:/tmp/amanda-dbg # less 13:46 amindexd.20050512134638.debug 13:46: No such file or directory I dont have this utility in my /sbin/am* Lookes like you inadvertantly included the timestamp when you were pasting in the debug filename on your less command. The amindex command lives in libexec, wherever you install directory was (I think the default is /usr/local). Frank So what next I have seen the blurb about Amindex. Amindex was a collection of code that added dump indexing and more friendly recovery to amanda-2.3.0. It has since been fully integrated into amanda-2.3.0.X. An index of the files in each dump image is generated as part of the dump process and stored in a database. A tool, amrecover, is provided which lets users browse the database. Once a set of files to recover has been assembled, amrecover automates the restoration of these files. This file describes how the index files are generated and how amrecover is used. Cheers Chuck -- Unix/ Linux Systems Administrator The Surgical Material Testing Laboratory (SMTL), Princess of Wales Hospital Coity Road Bridgend, United Kingdom, CF31 1RQ. Tel: +44 1656 752820 Fax: +44 1656 752830 -- Unix/ Linux Systems Administrator The Surgical Material Testing Laboratory (SMTL), Princess of Wales Hospital Coity Road Bridgend, United Kingdom, CF31 1RQ. Tel: +44 1656 752820 Fax: +44 1656 752830 -- Frank Smith [EMAIL PROTECTED] Sr. Systems Administrator Voice: 512-374-4673 Hoover's Online Fax: 512-374-4501
Re: newbie questions about setting up amanda
Alexander == Alexander Jolk [EMAIL PROTECTED] writes: Alexander I'm pretty sure there's an error somewhere in your Alexander disklist config since your index files are empty. I Alexander don't remember whether you showed us already your Alexander relevant /tmp/amanda/ debug files; can you try to find Alexander one sendbackup.* file corresponding to an empty backup? I didn't know they exist! That's great. The sendbackup.* corresponding to the /var/spool/imap/user/* directories in question are empty. These are the include files generated from the DLE and fed into gnutar. The sendsize's are also empty. Cheers, Rodrigo -- *** Rodrigo Martins de Matos Ventura [EMAIL PROTECTED] *** Web page: http://www.isr.ist.utl.pt/~yoda *** Teaching Assistant and PhD Student at ISR: ***Instituto de Sistemas e Robotica, Polo de Lisboa *** Instituto Superior Tecnico, Lisboa, PORTUGAL *** PGP fingerprint = 0119 AD13 9EEE 264A 3F10 31D3 89B3 C6C4 60C6 4585
split disklist aphabetically
Hello Folks, What are your recommendations for spliting directories with excludes without having to reorganize directories in a partition that I want to backup? Basically, I want: client /foo/a* dumptype-a client /foo/b*dumptype-b . . . client /foo/z* dumptype-z Is this something that can be done? What are the problems associated with this aproach? Thanks in advance for any help you can offer. PS: I seem to remember someone else asking the same question on this mailing-list. However, I can't seem to find the reference. -- Luc Lalonde, analyste - Département de génie informatique: École polytechnique de Montréal (514) 340-4711 x5049 [EMAIL PROTECTED] - Never try to teach a pig to sing. It wastes your time, and it annoys the pig. -
Re: split disklist aphabetically
On Thu, May 12, 2005 at 12:50:02PM -0400, Luc Lalonde wrote:
Hello Folks,
What are your recommendations for spliting directories with excludes
without having to reorganize directories in a partition that I want to
backup?
Basically, I want:
client /foo/a* dumptype-a
client /foo/b*dumptype-b
.
client /foo/z* dumptype-z
define dumptype common-stuff {
...
}
client FooA/foo{
common-stuff
include file ./a*
}
client FooZ/foo{
common-stuff
include file ./z*
}
--
Jon H. LaBadie [EMAIL PROTECTED]
JG Computing
4455 Province Line Road(609) 252-0159
Princeton, NJ 08540-4322 (609) 683-7220 (fax)
Re: split disklist aphabetically
* Luc Lalonde [EMAIL PROTECTED] [20050512 12:51]:
Hello Folks,
What are your recommendations for spliting directories with excludes
without having to reorganize directories in a partition that I want to
backup?
Basically, I want:
client /foo/a* dumptype-a
client /foo/b*dumptype-b
.
.
.
client /foo/z* dumptype-z
Is this something that can be done? What are the problems associated
with this aproach?
Thanks in advance for any help you can offer.
PS: I seem to remember someone else asking the same question on this
mailing-list. However, I can't seem to find the reference.
Here's what I'm using on a 1.5TB partition /data/ma/ma1
to be backed up with an LTO1 Ultrium tape drive:
bullcalf ma1_f /data/ma/ma1/f {
high-tar
} 1
bullcalf ma1_l /data/ma/ma1/l {
high-tar
} 2
bullcalf ma1_m /data/ma/ma1/m {
high-tar
} 3
bullcalf ma1_s /data/ma/ma1/s {
high-tar
exclude append ./fil/*
exclude append ./jen/*
exclude append ./jorge/*
exclude append ./karine/*
exclude append ./repric/*
exclude append ./sandra/*
exclude append ./shirley/*
} 4
bullcalf ma1_s_fil /data/ma/ma1/s/fil {
high-tar
} 5
etc for the other excluded dirs in ma1_s.
The dumptype high-tar is gnutar with no compression
and with index and record turned on. Works for me!
jf
--
Luc Lalonde, analyste
-
Département de génie informatique:
École polytechnique de Montréal
(514) 340-4711 x5049
[EMAIL PROTECTED]
-
Never try to teach a pig to sing. It wastes your time, and it annoys
the pig.
-
Re: newbie questions about setting up amanda
The man page has this suspicious paragraph: diskdevice Default: same as diskname. The name of the disk device to be backed up. It may be a full device name, a device name without the /dev/ prefix, e.g. sd0a, or a mount point such as /usr. They say mount point rather than directory. I could change the diskdevice to the actual mount point (/). But then there is paragraph concerning include directive in DLE: All include expression are expanded by amanda and concatenated in one file and passed to gnutar as a --files-from argument. They must start with ./ and containing no other /. So setting the include file to ./var/spool/imap/user/[a-h]* would not work. Cheers, Rodrigo -- *** Rodrigo Martins de Matos Ventura [EMAIL PROTECTED] *** Web page: http://www.isr.ist.utl.pt/~yoda *** Teaching Assistant and PhD Student at ISR: ***Instituto de Sistemas e Robotica, Polo de Lisboa *** Instituto Superior Tecnico, Lisboa, PORTUGAL *** PGP fingerprint = 0119 AD13 9EEE 264A 3F10 31D3 89B3 C6C4 60C6 4585
RE: amrecover: Unexpected end of file
I specified the dump type as comp-root-tar. I added index yes in the dump type in amanda.conf file. When I ran amrecover -C Daily -s itchy.applimation.com, I got an error saying no indexing records. When I ran amrestore /dev/nst0 etc, I got end of file error. Attached, please find my amanda.conf and disklist files. Please help. Thank you, Lei -Original Message- From: Paul Bijnens [mailto:[EMAIL PROTECTED] Sent: Wednesday, May 11, 2005 6:55 PM To: Lei Zhong Cc: amanda-users@amanda.org Subject: Re: amrecover: Unexpected end of file Lei Zhong wrote: Sorry about that. Here is the amdump.1 file: [...] SETTING UP FOR ESTIMATES... planner: time 0.005: setting up estimates for itchy.applimation.com:/etc That means you have one line in disklist. itchy.applimation.com:/etc overdue 12914 days for level 0 setup_estimate: itchy.applimation.com:/etc: command 0, options: none last_level -1 next_level0 -12914 level_days 0getting estimates 0 (-2) -1 (-2) -1 (-2) planner: time 0.028: setting up estimates took 0.022 secs But in the next section, we never recieve anything!? GETTING ESTIMATES... reserving 296960 out of 296960 for degraded-mode dumps [...] planner: time 0.130: getting estimates took 0.101 secs FAILED QUEUE: empty DONE QUEUE: empty And the strange thing is that FAILED QUEUE just as well as DONE QUEUE is empty. I don't understand why (yet). Never seen that before... Maybe you have the new statistics based estimates enabled? I did not try those yet -- no time to test, no need in my environment. I wonder what happens when you enable this for a new DLE. ANALYZING ESTIMATES... INITIAL SCHEDULE (size 120): DELAYING DUMPS IF NEEDED, total_size 120, tape length 158467072 mark 28 delay: Total size now 120. PROMOTING DUMPS IF NEEDED, total_lev0 0, balanced_size 0... planner: time 0.130: analysis took 0.000 secs GENERATING SCHEDULE: But the schedule that planner generates is empty (there should be some lines like DUMP itchy... somehexflags /etc So it is correct that the tape just contains a label, but is empty otherwise. We need more information here. Like the dislist, and dumptype used for that DLE. -- Paul Bijnens, XplanationTel +32 16 397.511 Technologielaan 21 bus 2, B-3001 Leuven, BELGIUMFax +32 16 397.512 http://www.xplanation.com/ email: [EMAIL PROTECTED] *** * I think I've got the hang of it now: exit, ^D, ^C, ^\, ^Z, ^Q, F6, * * quit, ZZ, :q, :q!, M-Z, ^X^C, logoff, logout, close, bye, /bye, * * stop, end, F3, ~., ^]c, +++ ATH, disconnect, halt, abort, hangup, * * PF4, F20, ^X^X, :D::D, KJOB, F14-f-e, F8-e, kill -1 $$, shutdown, * * kill -9 1, Alt-F4, Ctrl-Alt-Del, AltGr-NumLock, Stop-A, ...* * ... Are you sure? ... YES ... Phew ... I'm out * *** amanda.conf Description: amanda.conf disklist Description: disklist
Amanda bandwidth usage
The default setting for the netusage parameter is 600 kbps. Correct me if I'm wrong, but a 100 Mbps ethernet interface is 10 000 kbps (roughly) Also, the defaut settings for the 10Mbps ethernet is 400 kbps (Ou of a possible total of approx 1000 kbps) Does this mean that with these defaults, amanda can not even in parallel absorb TWO hosts (2 x 400 kpbs) sending their backups at the same time ? I would tend to think that a reasonable setting for doing backups at night time (very low servers usage) N servers with all servers having AT LEAST 100 Mbps ethernet interfaces would be: netusage = 7000 (70% of all bandwidth) And for each of the interfaces, 7000 / N servers ? Am I right ?
RE: amrecover: Unexpected end of file
I ran amdump after I added index yes. I tried several times. I relabeled the tape using amlabel, then ran amdump. I am still getting no indexing records when running amrecover. -Original Message- From: Alexander Jolk [mailto:[EMAIL PROTECTED] Sent: Thursday, May 12, 2005 3:08 PM To: Lei Zhong Cc: amanda-users@amanda.org Subject: Re: amrecover: Unexpected end of file Lei Zhong wrote: I specified the dump type as comp-root-tar. I added index yes in the dump type in amanda.conf file. When I ran amrecover -C Daily -s itchy.applimation.com, I got an error saying no indexing records. Just to be sure, did you run an amdump *after* having added `index yes'? An index is only created during amdump. Alex -- Alexander Jolk * BUF Compagnie * [EMAIL PROTECTED] Tel +33-1 42 68 18 28 * Fax +33-1 42 68 18 29
Levels
I'm still having a hard time figuring out how levels work. Can someone confirm to me that each time amanda is run, it will backup a file if it has been modified during the day (or since the last run) In other words: does amanda guarantee that if a file is modified after a dump, it will be included in the next dump, whatever the level is used ? Thanks
Re: Levels
On Thu, 12 May 2005, Guy Dallaire wrote: I'm still having a hard time figuring out how levels work. Can someone confirm to me that each time amanda is run, it will backup a file if it has been modified during the day (or since the last run) In other words: does amanda guarantee that if a file is modified after a dump, it will be included in the next dump, whatever the level is used ? No. Amanda guarantees it will take all data your backup program sends it, put it onto the tape, and get it back off again, assuming the tape is still good at that time. Whether or not a modified file gets included in the next dump is the responsibility of whatever backup program you tell amanda to invoke. Typically dump or gnutar, but folks have managed to glue in a number of others as well. Amanda doesn't do backups, she only oversees the process. -Mitch
Re: Levels
On Thu, May 12, 2005 at 03:28:37PM -0400, Guy Dallaire enlightened us: I'm still having a hard time figuring out how levels work. Can someone confirm to me that each time amanda is run, it will backup a file if it has been modified during the day (or since the last run) In other words: does amanda guarantee that if a file is modified after a dump, it will be included in the next dump, whatever the level is used ? Yes, any modified file will be included. I posted a few days ago my attempt at explaining levels. You might re-read that and see if it makes any more sense. If you want me to try to explain it in a different way, I can, or stop by the #amanda IRC channel and we can talk in real time. Matt (a.k.a. euclid) -- Matt Hyclak Department of Mathematics Department of Social Work Ohio University (740) 593-1263 pgp4FMMzmQWNi.pgp Description: PGP signature
Re: Levels
On Thu, 12 May 2005, Guy Dallaire wrote:
I'm still having a hard time figuring out how levels work.
Can someone confirm to me that each time amanda is run, it will backup
a file if it has been modified during the day (or since the last run)
Yes.
In other words: does amanda guarantee that if a file is modified after
a dump, it will be included in the next dump, whatever the level is
used ?
Yes. Amanda always backs up all modified files.
The question is: does she always back up all _unmodified_ files? Here the
answer is: no, only when doing a level 0 backup.
Level 0 means a full backup (all modified and unmodified files).
Level n (n 0) means a backup of all files that were modified since the last
level n-1.
Hope this helps...
Gr{oetje,eeting}s,
Geert
--
Geert Uytterhoeven -- There's lots of Linux beyond ia32 -- [EMAIL PROTECTED]
In personal conversations with technical people, I call myself a hacker. But
when I'm talking to journalists I just say programmer or something like that.
-- Linus Torvalds
Re: amrecover: Unexpected end of file
Lei Zhong wrote: I specified the dump type as comp-root-tar. I added index yes in the dump type in amanda.conf file. When I ran amrecover -C Daily -s itchy.applimation.com, I got an error saying no indexing records. When I ran amrestore /dev/nst0 etc, I got end of file error. Attached, please find my amanda.conf and disklist files. Please help. The config seems correct. Are you really sure that in the report that the amanda user receives by mail, there is no error message? Also in the /tmp/amanda/ directory on client and server are some debug files. Can you send one of the sendsize.DATETIMESTAMP.debug files from the client? And if they don't exist, one of the amandad.*.debug files? -- Paul Bijnens, XplanationTel +32 16 397.511 Technologielaan 21 bus 2, B-3001 Leuven, BELGIUMFax +32 16 397.512 http://www.xplanation.com/ email: [EMAIL PROTECTED] *** * I think I've got the hang of it now: exit, ^D, ^C, ^\, ^Z, ^Q, F6, * * quit, ZZ, :q, :q!, M-Z, ^X^C, logoff, logout, close, bye, /bye, * * stop, end, F3, ~., ^]c, +++ ATH, disconnect, halt, abort, hangup, * * PF4, F20, ^X^X, :D::D, KJOB, F14-f-e, F8-e, kill -1 $$, shutdown, * * kill -9 1, Alt-F4, Ctrl-Alt-Del, AltGr-NumLock, Stop-A, ...* * ... Are you sure? ... YES ... Phew ... I'm out * ***
Re: Levels
[Please reply to amanda-users when asking questions on the list] On Thu, 12 May 2005, Guy Dallaire wrote: 2005/5/12, Mitch Collinsworth [EMAIL PROTECTED]: No. Amanda guarantees it will take all data your backup program sends it, put it onto the tape, and get it back off again, assuming the tape is still good at that time. Whether or not a modified file gets included in the next dump is the responsibility of whatever backup program you tell amanda to invoke. Typically dump or gnutar, but folks have managed to glue in a number of others as well. Amanda doesn't do backups, she only oversees the process. -Mitch Well... What I meant is that, provided I have a standard dump cycle, I use gnutar for some DLE's, and dump for other DLE's, and I run amanda at time x. Will amanda run dump or gnu-tar in a way that if a file is modified before time x, it will ALWAYS be included in the backup ? ALWAYS is a very strong word. I see others have been responding yes to this but nevertheless the answer is still no. Amanda makes a very good effort to always do the right thing but there are various ways in which things can still go wrong. The best you can really say is that amanda will ALWAYS try. For example if you have way too much data to fit on the tape, sometimes amanda will say [dumps way too big, must skip incremental dumps]. Now this is generally a very rare occurance and typically one that is not caused by any failing in amanda, only that you gave her more to do than is physically possible and she had to decide SOMETHING. Also note that there are ways to configure your amanda setup to make this highly unlikely. For example a tape loader with plenty of tapes available and a configuration that tells amanda she can use multiple tapes per run if necessary. etc. -Mitch
Re: Levels
On Thu, May 12, 2005 at 05:58:02PM -0400, Mitch Collinsworth wrote: On Thu, 12 May 2005, Guy Dallaire wrote: What I meant is that, provided I have a standard dump cycle, I use gnutar for some DLE's, and dump for other DLE's, and I run amanda at time x. Will amanda run dump or gnu-tar in a way that if a file is modified before time x, it will ALWAYS be included in the backup ? ALWAYS is a very strong word. I see others have been responding yes to this but nevertheless the answer is still no. Amanda makes a very good effort to always do the right thing but there are various ways in which things can still go wrong. The best you can really say is that amanda will ALWAYS try. For example if you have way too much data to fit on the tape, sometimes amanda will say [dumps way too big, must skip incremental dumps]. Now this is generally a very rare occurance and typically one that is not caused by any failing in amanda, only that you gave her more to do than is physically possible and she had to decide SOMETHING. I had a similar reaction to Mitch. And thus I'll just pass on some other examples of how always should never be specified :) Suppose the file(s) in question were on a file system or a laptop that at the time of backup were not available. A client of mine changed the system clock by a week, then by another week to avoid a license expiration. Really messed with the backups. Windows will not let you copy or backup a file already open for use by another application. So if it was modified, but in use, no backup. Note, these are all problems outside of amanda's control. And of the various backup programs amanda relies upon. But to answer your real concern, given the use of standard dump's and guntar, a file modified since the last run of amdump 'should' be in the backup file of the next run of amdump. Ahh, I just thought of an exception; I have two DiskListEntries that are for directories that almost never change. One is only CD images. I have set them up to skip-incrementals and only do level 0, full dumps of them every two weeks. If anything changes on the 13 days between full dumps I would not have a backup copy of it. But that is because I chose to not have a copy. -- Jon H. LaBadie [EMAIL PROTECTED] JG Computing 4455 Province Line Road(609) 252-0159 Princeton, NJ 08540-4322 (609) 683-7220 (fax)
Re: newbie questions about setting up amanda
Alexander Jolk wrote: Once again, your syntax seems right to all of us, but nobody really seems to be actively using `include' right now. I know for certain that using `exclude' works, for example. I see. My problem is that I have a /home full of users (34G used) and a /var/spool/imap/users full of mail accounts (21G). I'm using DDS 36/72 tapes (36G uncompressed), and it does not seem right to me to used it without spliting these directories in several DLE's. But if the include is so seldom used, maybe there better ways of doing backup. Cheers, Rodrigo
Re: newbie questions about setting up amanda
Alexander Jolk wrote: Ahm, sorry, I don't quite follow you there. Your sendbackup.* files are empty, zero bytes? That shouldn't be the case already. (Don't get caught by the fact that they are readable only to your amanda user, and root!) And which files are the include files? Could you elaborate a little bit? Yeah, zero bytes. In fact /var/spool/imap is not readable by amanda. But it is absurd that amanda has to read every file in the system... (mode=600 files are unbackupable???) Or maybe amanda only needs to be able to read the base directory of the dump. Cheers, Rodrigo
Re: newbie questions about setting up amanda
On Thu, May 12, 2005 at 09:37:09PM +0100, Rodrigo Ventura wrote: In fact /var/spool/imap is not readable by amanda. But it is absurd that amanda has to read every file in the system... (mode=600 files are unbackupable???) Or maybe amanda only needs to be able to read the base directory of the dump. Uhhh, I don't get why you feel it is absurd to need to read a file in order to back it up. How else does one backup, i.e. copy a file, without reading its contents? However, amanda does not do the backup, so the 'amanda user' does not need read permission. Root does the backups if you are using gnutar. Properly installed, the amanda program .../libexec/runtar is root owned and set-uid'ed. That is the program that invokes gnutar and thus gnutar runs with root privleges. Is your runtar (and several other amanda programs) set-uid'ed root? -- Jon H. LaBadie [EMAIL PROTECTED] JG Computing 4455 Province Line Road(609) 252-0159 Princeton, NJ 08540-4322 (609) 683-7220 (fax)
Re: newbie questions about setting up amanda
--On Thursday, May 12, 2005 21:37:09 +0100 Rodrigo Ventura [EMAIL PROTECTED] wrote: Alexander Jolk wrote: Ahm, sorry, I don't quite follow you there. Your sendbackup.* files are empty, zero bytes? That shouldn't be the case already. (Don't get caught by the fact that they are readable only to your amanda user, and root!) And which files are the include files? Could you elaborate a little bit? Yeah, zero bytes. In fact /var/spool/imap is not readable by amanda. But it is absurd that amanda has to read every file in the system... (mode=600 files are unbackupable???) Or maybe amanda only needs to be able to read the base directory of the dump. Did you run 'make install' as root as required? If not, you didn't get the SUID bits set on the appropriate binaries. Frank Cheers, Rodrigo -- Frank Smith [EMAIL PROTECTED] Sr. Systems Administrator Voice: 512-374-4673 Hoover's Online Fax: 512-374-4501
Re: newbie questions about setting up amanda
On Thu, 12 May 2005 at 9:34pm, Rodrigo Ventura wrote Alexander Jolk wrote: Once again, your syntax seems right to all of us, but nobody really seems to be actively using `include' right now. I know for certain that using `exclude' works, for example. I see. My problem is that I have a /home full of users (34G used) and a /var/spool/imap/users full of mail accounts (21G). I'm using DDS 36/72 tapes (36G uncompressed), and it does not seem right to me to used it without spliting these directories in several DLE's. But if the include is so seldom used, maybe there better ways of doing backup. I haven't been following this closely, I must admit, but I use include in several DLEs. -- Joshua Baker-LePain Department of Biomedical Engineering Duke University
amanda client version 2.4.5
Hi guys, Thank you all very much for the help. I finally figured out my problem. It was that I didn't remove the tape label properly. I didn't run amrmtape before I ran amlabel on the same tape. Can somebody tell me how to compile and install amanda client using amanda-2.4.5.tar.gz? I need to deploy clients on the machines I need to back up. Thanks, lei -Original Message- From: Paul Bijnens [mailto:[EMAIL PROTECTED] Sent: Thursday, May 12, 2005 4:22 PM To: Lei Zhong Cc: amanda-users@amanda.org Subject: Re: amrecover: Unexpected end of file Lei Zhong wrote: I specified the dump type as comp-root-tar. I added index yes in the dump type in amanda.conf file. When I ran amrecover -C Daily -s itchy.applimation.com, I got an error saying no indexing records. When I ran amrestore /dev/nst0 etc, I got end of file error. Attached, please find my amanda.conf and disklist files. Please help. The config seems correct. Are you really sure that in the report that the amanda user receives by mail, there is no error message? Also in the /tmp/amanda/ directory on client and server are some debug files. Can you send one of the sendsize.DATETIMESTAMP.debug files from the client? And if they don't exist, one of the amandad.*.debug files? -- Paul Bijnens, XplanationTel +32 16 397.511 Technologielaan 21 bus 2, B-3001 Leuven, BELGIUMFax +32 16 397.512 http://www.xplanation.com/ email: [EMAIL PROTECTED] *** * I think I've got the hang of it now: exit, ^D, ^C, ^\, ^Z, ^Q, F6, * * quit, ZZ, :q, :q!, M-Z, ^X^C, logoff, logout, close, bye, /bye, * * stop, end, F3, ~., ^]c, +++ ATH, disconnect, halt, abort, hangup, * * PF4, F20, ^X^X, :D::D, KJOB, F14-f-e, F8-e, kill -1 $$, shutdown, * * kill -9 1, Alt-F4, Ctrl-Alt-Del, AltGr-NumLock, Stop-A, ...* * ... Are you sure? ... YES ... Phew ... I'm out * ***
Re: amanda client version 2.4.5
--On Friday, May 13, 2005 01:08:24 -0400 Lei Zhong [EMAIL PROTECTED] wrote: Hi guys, Thank you all very much for the help. I finally figured out my problem. It was that I didn't remove the tape label properly. I didn't run amrmtape before I ran amlabel on the same tape. Can somebody tell me how to compile and install amanda client using amanda-2.4.5.tar.gz? I need to deploy clients on the machines I need to back up. Thanks, lei ont the client: tar -xzf amanda-2.4.5.tar.gz cd amanda-2.4.5 read through docs/INSTALL ./configure (with appropriate options, usually the same ones used for the server install, possibly adding --without-server) make su - make install Frank -Original Message- From: Paul Bijnens [mailto:[EMAIL PROTECTED] Sent: Thursday, May 12, 2005 4:22 PM To: Lei Zhong Cc: amanda-users@amanda.org Subject: Re: amrecover: Unexpected end of file Lei Zhong wrote: I specified the dump type as comp-root-tar. I added index yes in the dump type in amanda.conf file. When I ran amrecover -C Daily -s itchy.applimation.com, I got an error saying no indexing records. When I ran amrestore /dev/nst0 etc, I got end of file error. Attached, please find my amanda.conf and disklist files. Please help. The config seems correct. Are you really sure that in the report that the amanda user receives by mail, there is no error message? Also in the /tmp/amanda/ directory on client and server are some debug files. Can you send one of the sendsize.DATETIMESTAMP.debug files from the client? And if they don't exist, one of the amandad.*.debug files? -- Paul Bijnens, XplanationTel +32 16 397.511 Technologielaan 21 bus 2, B-3001 Leuven, BELGIUMFax +32 16 397.512 http://www.xplanation.com/ email: [EMAIL PROTECTED] *** * I think I've got the hang of it now: exit, ^D, ^C, ^\, ^Z, ^Q, F6, * * quit, ZZ, :q, :q!, M-Z, ^X^C, logoff, logout, close, bye, /bye, * * stop, end, F3, ~., ^]c, +++ ATH, disconnect, halt, abort, hangup, * * PF4, F20, ^X^X, :D::D, KJOB, F14-f-e, F8-e, kill -1 $$, shutdown, * * kill -9 1, Alt-F4, Ctrl-Alt-Del, AltGr-NumLock, Stop-A, ...* * ... Are you sure? ... YES ... Phew ... I'm out * *** -- Frank Smith[EMAIL PROTECTED] Sr. Systems Administrator Voice: 512-374-4673 Hoover's Online Fax: 512-374-4501
