Monthly config
Hello Folks, What can I say...WOW. Thanks for all the advice and warnings for creating a Montly backup concurrently with a Daily backup. I didn't expect to get an answer so quickly. John, FYI, I'm using 2.4.2p1. I try to keep up with the latest versions. I'll try the "strategic noinc". Cheers. -- Luc Lalonde, Responsable du reseau GIREF Telephone: (418) 656-2131 poste 6623 Courriel: [EMAIL PROTECTED] begin:vcard n:Lalonde;Luc x-mozilla-html:FALSE org:Universite Laval;GIREF adr:;; version:2.1 email;internet:[EMAIL PROTECTED] title:Administateur de reseau x-mozilla-cpt:;0 fn:Luc Lalonde end:vcard
Re: Monthly config
>If they're going to run at the same time, I would specify different >holding disks for the two configs. ... Good point. However, they cannot run at the same time because two amandad's cannot run on a single client. I have some local mods that make the service name an amanda.conf variable so I can get around this. >Joshua Baker-LePain John R. Jackson, Technical Software Specialist, [EMAIL PROTECTED]
Re: Will amrecover overwrite files?
>The most straightforward method appears to be to reinstall the operating
>system, use native utilities (tar or dump) or install amanda utilities, then
>restore the files.
That's the general theory.
>If I'm running amrecover onto a newly installed operating system, will it
>overwrite existing files? ...
You're asking the wrong question. Amrecover does not write files.
It runs a recover program for you based on what program was used to
create the dump image (tar, dump/restore, etc). You need to look at
the documentation for that program to see what it does about overwriting.
In general, I think most restore programs do overwrite, although I'm
pretty sure I remember someone posting about one of the free Unix ones
not doing so without some extra flag (sigh -- nothing like consistency).
I would not use amrecover (at the moment) to do a full recovery. It is
more oriented toward individual files/directories. Most recover programs
want different parameters to tell them this is a full recovery so they
can do things a bit differently (e.g. remove files that come back in
one image but have been removed in a later one).
I've thought (and have a TODO item) about adding a flag/feature to
amrecover to do this, but haven't had the energy to go around to all
the recover program variations and figuring out what they would want.
>Also, can someone give me an example of using tar or dump to restore a file
>off of a remote machine?
Starting from the client:
client $ rsh -n server mt -f /dev/whatever rewind
client $ rsh -n server mt -f /dev/whatever fsf NN # if desired
client $ rsh -n server /path/to/amrestore -p /dev/whatever client disk | \
/path/to/restore/pgm args ...
Is that close enough or do you want to see a real live example? Oh,
never mind :-). Here's one from one of my Solaris systems ("gandalf"
is the client, "fortress" is the server):
gandalf $ rsh -n fortress mt -f /dev/rmt/12mn rewind
gandalf $ rsh -n fortress mt -f /dev/rmt/12mn fsf 3
gandalf $ rsh -n fortress /opt/amanda/sbin/amrestore \
-p \
/dev/rmt/12mn \
gandalf.cc.purdue.edu \
/work \
| /usr/sbin/ufsrestore xbf 2 - \
/tmp/setiathome-3.03.sparc-sun-solaris2.6/state.sah
amrestore: WARNING: not at start of tape, file numbers will be offset
amrestore: 0: restoring gandalf.cc.purdue.edu._work.20010411.1
set owner/mode for '.'? [yn] n
FYI, I wrote some junk in the restored file and did this a second time,
and ufsrestore *does* overwrite the file if it exists.
>Ivan
John R. Jackson, Technical Software Specialist, [EMAIL PROTECTED]
Re: General Questions
>What exactly is the nature of the security risk in using a sudo script for >users to recover files with Amanda. ... They have access to everything, not just their own files. There are also tape mounting issues. Amrecover does not currently interface with the Amanda tape changers, so mounts have to be done "by hand". >On previous systems we had the Legato >Networker package for file recovery and it had a set of user tools that >seemed to check the owner, group and file permissions and compare with the >user's permissions to determine whether the user had permission to backup >the file. ... That's because Legato uses its own backup system. Amanda does not do backups. It manages other programs that do them (tar, dump, etc). It's those programs that would have to enforce the security issues (at least some of them), and Amanda has no control over that. >... Are any file attributes (permissions, owner, and/or group, >file location, etc) stored in the archives generated by Amanda? ... That information is not available to Amanda from the backup programs it runs. Tar might be able to provide it. Dump is hopeless because the vendors would have to change. >Randall John R. Jackson, Technical Software Specialist, [EMAIL PROTECTED]
Will amrecover overwrite files?
Not too long ago, I had some questions about recovering files, most importantly, rebuilding a crashed machine using backups. The most straightforward method appears to be to reinstall the operating system, use native utilities (tar or dump) or install amanda utilities, then restore the files. If I'm running amrecover onto a newly installed operating system, will it overwrite existing files? Will my archived /etc/inetd.conf overwrite the existing /etc/inetd.conf? Also, can someone give me an example of using tar or dump to restore a file off of a remote machine? Thanks, Ivan _ Get your FREE download of MSN Explorer at http://explorer.msn.com
Re: Monthly config
>I'd like to have a second config called "Monthly". ... I assume the goal is to do a full dump of everything? Will it all fit on one tape? >dumpcycle 0 weeks >runspercycle ??? >tapecycle 1000 tapes > >I want to keep the tapes and not overwrite them...hence the high number >in the tapecyle. ... OK. >Also, I want full dumps everytime. ... OK. There is another discussion going on here about that. Are you using 2.4.2? If so, you may want to do "strategy noinc" to ensure only full dumps are performed. Or you may want to use "amadmin Monthly force" before the run (make sure you run it as the Amanda user). >But what do I put as "runspercycle"? ... Nothing. It doesn't matter with dumpcycle set to zero. >"Daily" and "Monthly" running on two seperate configs, what >will there be conflicts with /etc/dumpdates and /etc/amandates? ... You will want to set "record no" in all the dumptypes in "Monthly" so it does not touch /etc/dumpdates. If they all refer back to "global", you can just set it there. >Is there an other potential conflicts that I should know about? You probably want separate index areas, if you've turned that on. If "Monthly" will not fit on a single tape, you'll need to do some other playing around: Set runtapes high enough so it will fit. If you don't have a changer, use chg-manual. or: Let Amanda do what it can to one tape, then edit the disklist to comment out those entries and run it again. Iterate until everything is processed. >Luc Lalonde John R. Jackson, Technical Software Specialist, [EMAIL PROTECTED]
Re: Monthly config
Luc Lalonde <[EMAIL PROTECTED]> wrote: >Hey folks, > >I've got a Daily config running fine with the following settings: > >dumpcycle 1 weeks >runspercycle 5 >tapecycle 17 tapes > >I'd like to have a second config called "Monthly". However, I'm not >sure what to put as values for the above parameters. Here's what I >was able to find from various information sources: > >dumpcycle 0 weeks >runspercycle ??? >tapecycle 1000 tapes > >I want to keep the tapes and not overwrite them...hence the high >number in the tapecyle. Also, I want full dumps everytime. But what >do I put as "runspercycle"? If I have the "Daily" and "Monthly" >running on two seperate configs, what will there be conflicts with >/etc/dumpdates and /etc/amandates? Is there an other potential >conflicts that I should know about? Here's what I have for our archival configuration: [...] dumpcycle6 weeks# a level 0 per filesystem every 6 weeks runspercycle 6 # 12 dailys + 2 archives / fortnight tapecycle1000 tapes # the number of tapes in rotation [...] (For yours, dumpcycle would be 4 weeks and runspercycle would be however often in that time that you ran the Monthly configuration; once/week for us.) Then in the dumptypes: [...] recordno skip-incr yes [...] The "record no" prevents updating /etc/dumpdates and the skip-incr limits it to full dumps. Tommy McGuire
Re: Monthly config
On Thu, 12 Apr 2001 at 2:14pm, Luc Lalonde wrote
> I'd like to have a second config called "Monthly". However, I'm not
> sure what to put as
> values for the above parameters. Here's what I was able to find from
> various information sources:
>
> dumpcycle 0 weeks
> runspercycle ???
> tapecycle 1000 tapes
>
> I want to keep the tapes and not overwrite them...hence the high number
> in the tapecyle. Also, I want full dumps
> everytime.But what do I put as "runspercycle"? If I have the
I use "1" in runspercycle for my Archive config.
> "Daily" and "Monthly" running on two seperate configs, what
> will there be conflicts with /etc/dumpdates and /etc/amandates? Is
In the dumptype for the Monthly config, set 'record no', which will tell
amanda not to update {dump|amanda}dates.
> there an other potential conflicts that I should know about?
If they're going to run at the same time, I would specify different
holding disks for the two configs. There's a possibility the two
processes could fill the holding space otherwise.
--
Joshua Baker-LePain
Department of Biomedical Engineering
Duke University
Re: General Questions
What exactly is the nature of the security risk in using a sudo script for users to recover files with Amanda. On previous systems we had the Legato Networker package for file recovery and it had a set of user tools that seemed to check the owner, group and file permissions and compare with the user's permissions to determine whether the user had permission to backup the file. I assume the security issue is that Amanda is not storing the file permissions so recovery is possible for any file on any system from the server. Are any file attributes (permissions, owner, and/or group, file location, etc) stored in the archives generated by Amanda? If so, then there may be a hope of putting a script together... Cheers, Randall On Thu, 12 Apr 2001, John R. Jackson wrote: > Date: Thu, 12 Apr 2001 12:37:50 -0500 > From: John R. Jackson <[EMAIL PROTECTED]> > Reply-To: [EMAIL PROTECTED] > To: Randall Skelton <[EMAIL PROTECTED]> > Cc: [EMAIL PROTECTED] > Subject: Re: General Questions > > >What I really would like to do is have an easy to maintain client-server > >system ... > > So far, Amanda will do everything you've mentioned quite nicely. > > >whereby normal users of the system can recover their own 'lost' > >files. ... > > But it won't do this. There are a lot of security issues Amanda has > never addressed that make this very difficult. > > >Randall > > John R. Jackson, Technical Software Specialist, [EMAIL PROTECTED] >
Monthly config
Hey folks, I've got a Daily config running fine with the following settings: dumpcycle 1 weeks runspercycle 5 tapecycle 17 tapes I'd like to have a second config called "Monthly". However, I'm not sure what to put as values for the above parameters. Here's what I was able to find from various information sources: dumpcycle 0 weeks runspercycle ??? tapecycle 1000 tapes I want to keep the tapes and not overwrite them...hence the high number in the tapecyle. Also, I want full dumps everytime.But what do I put as "runspercycle"? If I have the "Daily" and "Monthly" running on two seperate configs, what will there be conflicts with /etc/dumpdates and /etc/amandates? Is there an other potential conflicts that I should know about? Cheers. -- Luc Lalonde, Responsable du reseau GIREF Telephone: (418) 656-2131 poste 6623 Courriel: [EMAIL PROTECTED] begin:vcard n:Lalonde;Luc x-mozilla-html:FALSE org:Universite Laval;GIREF adr:;; version:2.1 email;internet:[EMAIL PROTECTED] title:Administateur de reseau x-mozilla-cpt:;0 fn:Luc Lalonde end:vcard
Re: General Questions
>What I really would like to do is have an easy to maintain client-server >system ... So far, Amanda will do everything you've mentioned quite nicely. >whereby normal users of the system can recover their own 'lost' >files. ... But it won't do this. There are a lot of security issues Amanda has never addressed that make this very difficult. >Randall John R. Jackson, Technical Software Specialist, [EMAIL PROTECTED]
Re: Holding Disk Question
>Im currently using a single (big) holding disk. >I have 2 smaller disks, that I'd like to use as holding disks. > >But the samller disks will not be able to hold the big 0 dumps. > >According to the docs, the holding disks are used in a round-robin way >(dump 1 to HD1, dump 2 -> HD 2, dump3 -> HD3, dump4 -> HD1 &c &c ) According to the code (you actually read and believed the docs? :-): /* find the holdingdisk with the fewest active dumpers and among * those the one with the biggest free space So you should not have any trouble using all three as a "pool". It might work even better if you set the holding disk chunksize down so they can be split up into pieces and scattered around. What "docs" did you find the round-robin described? I seem to remember seeing that, too, but can't find it now and would like to get it updated. > Gerhard John R. Jackson, Technical Software Specialist, [EMAIL PROTECTED]
General Questions
Hello, I have some rather general questions regarding Amanda that I could not find the answers to on the online documentation. I am contemplating an 'upgrade' to my existing backup system (currently a collection of perl scripts tied to a postgres database). I backup a moderate amount of data on a DAT drive from 8 client computers and caching of backups can be done on the server. What I really would like to do is have an easy to maintain client-server system whereby normal users of the system can recover their own 'lost' files. From what I read, it is only possible for root users to recover files from the Amanda system. Is this still the case? My OS of choice is FreeBSD for the server but the clients are RedHat 6.x-7. What other free packages would people suggest as alternatives? Many thanks, Randall
Re: want only full dumps (strategy noinc)
>I've seen it happen when planner thinks the tape is full, and it >decides to switch to incrementals for some of the disks. ... Yeah, I guess that would do it. I always give Amanda an insanely large number of tapes (runtapes) to work with for archival to make sure this situation doesn't happen. >Paul Bijnens John R. Jackson, Technical Software Specialist, [EMAIL PROTECTED]
Re: want only full dumps (strategy noinc)
>... I will try upgrading to 2.4.2. Note that the current release is 2.4.2p2, and there is a patch beyond that on the patches web page which may or may not apply to your site. >... the appended amdump output shows incremental dumps. You didn't post the whole report, so it's a little hard to tell what happened, but I note that ~12 GBytes got backed up and you don't appear to have runtapes set in your amanda.conf. Aside from not doing incrementals, what did you expect Amanda to do with the dumps that would not fit on your single tape? Defer them until the next run? >Julian John R. Jackson, Technical Software Specialist, [EMAIL PROTECTED]
Re: want only full dumps (strategy noinc)
John and Paul, Thanks for your responses.
>>Sadly the Amanda 2.4.1 change log (fragment appended) shows
>>"strategy noinc" is not implemented yet (see below).
>John R. Jackson, Technical Software Specialist, [EMAIL PROTECTED]
>But it does appear to be in 2.4.2.
Great. I will try upgrading to 2.4.2.
>>Using "dumpcycle 0" I still see incrementals in the archive backup.
>Really?
Yes really, the appended amdump output shows incremental dumps.
>Under what circumstances? This is usually all I do to get an
>archive such as you're trying to do.
I have also appended the config. We have ~120Gb to dump, have an
18Gb holding disk and use software compression to dump to 12Gb
(native ie uncompressed) DDS3 DAT tapes.
>From: "Bort, Paul" <[EMAIL PROTECTED]>
>Date: Wed, 11 Apr 2001 15:48:02 -0400
>Just to hazard a guess: You might have set dumpcycle 0 in one dumptype, and
>then used another. I set dumpcycle 0 at the beginning of the amanda.conf
>file, and all backups (for that configuration) always run level 0 backups.
>I'm using a beta of 2.4.2 that I've heard is similar to 2.4.1.
I can confirm that I set dumpcycle 0 (both globally and in the
dumptype). I will try upgrading to 2.4.2.
I have appended config and amdump report:
Julian
--
Subject: archive AMANDA MAIL REPORT FOR April 12, 2001
...
DUMP SUMMARY:
DUMPER STATS TAPER STATS
HOSTNAME DISK L ORIG-KB OUT-KB COMP% MMM:SS KB/s MMM:SS KB/s
-- -- --
cedar / 1 2079 448 21.51:185.70:00 1789.7
cedar /export2 FAILED
cedar /var 1 FAILED
cedar /var/mail 1 423039 192352 45.5 13:36 235.73:50 834.7
hazel / 08649530880 35.70:40 768.30:57 544.9
hazel /export425023 3392 13.62:14 25.40:04 878.4
hazel /export0 1 FAILED
hazel /export1 16166332672 53.05:31 98.70:38 869.5
hazel /usr 2 1023 224 21.90:20 11.10:00 2276.0
hazel /var 322815 2112 9.30:46 46.20:02 862.0
u2/ 1 1663 352 21.20:457.80:00 1887.1
u2/export338527 2880 7.53:11 15.10:03 916.4
u2/export0 4 426047 168384 39.5 16:07 174.23:18 850.3
u2/export1 36073529728 48.94:27 111.40:34 866.0
u2/export2 1 339 1952640 57.4 94:01 346.2 38:03 855.5
u2/export3 18303924736 29.82:01 204.90:29 847.1
u2/export4 1 FAILED
u2/export5 2 640447 260352 40.7 16:49 257.9N/AN/A
u2/export6 0 10603423 9977792 94.1 304:58 545.3N/AN/A
u2/var 348735 3648 7.50:57 64.20:04 996.3
--
bumpsizeinf #try to stop incremental dumps (JRCB11-apr-01)
bumpmult2 #factor by which bumpsize increases per level
dumpcycle 0 # Setting this to zero forces a full backup
each run
infofile"/var/adm/amanda/archive/curinfo"
inparallel 99 #ensure this not limiting
labelstr"archive[0-9]*"
logdir "/var/log/amanda/archive"
indexdir"/var/adm/amanda/archive/index"
mailto "backup"
maxdumps6 # low else connection to u2 fails
netusage10 mbps #Mbytes/s
org "archive"
tapedev "/dev/rmt/0bn" #bsd (see above), hardware compression off
tapetypeDDS3#tape params tuned with tapetype (JRCB
5-jun-00)
tapecycle 100 #at least 100, maybe more (JRCB 10-apr-01)
reserve 0 #use all holding-disk for level 0 dumps
holdingdisk sun3-6 {
directory "/dumps/archive"
chunksize inf #max file size is >> size of holding disk
}
#DUMPTYPE SECTION
define dumptype dcs {
# compress#use default (client fast)
dumpcycle 0 # Setting this to zero forces a full backup
each run
holdingdisk yes
index yes
record no #do not update /etc/dumpdates
}
#TAPETYPE SECTION
define tapetype DDS3 {
comment "HP C1537A: internal DDS3 DAT drive"
filemark 0 kbytes # integrated into data
length 11 gigabytes# 125 m tape (no har
Re: Holding Disk Question
* Alexandre Oliva <[EMAIL PROTECTED]> (Thu, Apr 12, 2001 at 07:45:31AM -0300) >> What happens if my dump is supposed to go to HD1, but is way too big for >> HD1, but would easily fit on HD3 ? >> Will amanda use the big Holding disk ? > I suppose so. Now that's what I call a honest and fair answer ;) Kind regards, -- Gerhard den Hollander Phone +31-10.280.1515 Technical Support Jason Geosystems BV Fax +31-10.280.1511 (When calling please note: we are in GMT+1) [EMAIL PROTECTED] POBox 1573 visit us at http://www.jasongeo.com 3000 BN Rotterdam JASON...#1 in Reservoir CharacterizationThe Netherlands This e-mail and any attachment is/are intended solely for the named addressee(s) and may contain information that is confidential and privileged. If you are not the intended recipient, we request that you do not disseminate, forward, distribute or copy this e-mail message. If you have received this e-mail message in error, please notify us immediately by telephone and destroy the original message.
Re: Holding Disk Question
On Apr 12, 2001, Gerhard den Hollander <[EMAIL PROTECTED]> wrote:
> What happens if my dump is supposed to go to HD1, but is way too big for
> HD1, but would easily fit on HD3 ?
> Will amanda use the big Holding disk ?
I suppose so.
--
Alexandre Oliva Enjoy Guarana', see http://www.ic.unicamp.br/~oliva/
Red Hat GCC Developer aoliva@{cygnus.com, redhat.com}
CS PhD student at IC-Unicampoliva@{lsd.ic.unicamp.br, gnu.org}
Free Software Evangelist*Please* write to mailing lists, not to me
Re: Holding Disk Question
raid 0 them? Steven Gerhard den Hollander wrote: > Im currently using a single (big) holding disk. > I have 2 smaller disks, that I'd like to use as holding disks. > > But the samller disks will not be able to hold the big 0 dumps. > > According to the docs, the holding disks are used in a round-robin way > (dump 1 to HD1, dump 2 -> HD 2, dump3 -> HD3, dump4 -> HD1 &c &c ) > > What happens if my dump is supposed to go to HD1, but is way too big for > HD1, but would easily fit on HD3 ? > > Will amanda use the big Holding disk ? > > Currently listening to: Flying Frog Brigade - Here's to the Man (August 29 - New >York City) > > Gerhard, <@jasongeo.com> == The Acoustic Motorbiker == > -- >__O Some say the end is near. > =`\<, Some say we'll see armageddon soon > (=)/(=) I certainly hope we will > I could use a vacation
Holding Disk Question
Im currently using a single (big) holding disk. I have 2 smaller disks, that I'd like to use as holding disks. But the samller disks will not be able to hold the big 0 dumps. According to the docs, the holding disks are used in a round-robin way (dump 1 to HD1, dump 2 -> HD 2, dump3 -> HD3, dump4 -> HD1 &c &c ) What happens if my dump is supposed to go to HD1, but is way too big for HD1, but would easily fit on HD3 ? Will amanda use the big Holding disk ? Currently listening to: Flying Frog Brigade - Here's to the Man (August 29 - New York City) Gerhard, <@jasongeo.com> == The Acoustic Motorbiker == -- __O Some say the end is near. =`\<, Some say we'll see armageddon soon (=)/(=) I certainly hope we will I could use a vacation
Re: want only full dumps (strategy noinc)
"John R. Jackson" wrote: > >Using "dumpcycle 0" I still see incrementals in the archive backup. > > Really? Under what circumstances? This is usually all I do to get an > archive such as you're trying to do. I've seen it happen when planner thinks the tape is full, and it decides to switch to incrementals for some of the disks. It warns you then with a "planner: Dump too big for tape: full dump of ... delayed". (It seems indeed the best thing it can do given the constraints of a overflowing tape and the order to keep as much as it can.) -- Paul Bijnens, Lant Tel +32 16 40.51.40 Interleuvenlaan 15 H, B-3001 Leuven, BELGIUM Fax +32 16 40.49.61 http://www.lant.com/ email: [EMAIL PROTECTED] *** * I think I've got the hang of it now: exit, ^D, ^C, ^\, ^Z, ^Q, F6, * * quit, ZZ, :q, :q!, M-Z, ^X^C, logoff, logout, close, bye, /bye, * * stop, end, F3, ~., ^]c, +++ ATH, disconnect, halt, abort, hangup, * * PF4, F20, ^X^X, :D::D, KJOB, F14-f-e, F8-e, kill -1 $$, shutdown, * * kill -9 1, Alt-F4, Ctrl-Alt-Del, AltGr-NumLock, Stop-A, ...* * ... "Are you sure?" ... YES ... Phew ... I'm out * ***
