FW: amrecover bug?
Hi Dustin Just before you drop the ball completely, have you or someone else had time to look at the debug files -Original Message- From: owner-amanda-us...@amanda.org [mailto:owner-amanda-us...@amanda.org] On Behalf Of Titl Erich Sent: Wednesday, September 22, 2010 6:23 PM To: amanda-users@amanda.org Subject: RE: amrecover bug? Hi Dustin -Original Message- From: djmit...@gmail.com [mailto:djmit...@gmail.com] On Behalf Of Dustin J. Mitchell Sent: Wednesday, September 22, 2010 4:58 PM To: Titl Erich Cc: amanda-users@amanda.org Subject: Re: amrecover bug? On Wed, Sep 22, 2010 at 3:17 AM, Titl Erich erich.t...@ruf.ch wrote: A few weeks ago I reported in the forum a problem with amrecover and compressed dump files. Meanwhile I changed to uncompressed backup, still no luck and, unfortunately not much replies either. So please bear with me when I repeat this here. No worries about the repetition - this mailing list is the more actively-monitored spot. My first guess is that Amanda is not seeking to the required file appropriately. Can you let us know what OS you're using, what type of tape, and also send along the amrecover debug log file from the client and the amidxtaped debug log file (with matching datestamp) from the server? OS Linux Debian Lenny Tape is an overland REO 9000 virtual tape library iSCSI connected Have a look at the FSF_AFTER_FILEMARK property in amanda-devices(7), as that's my first guess for what's going wrong. OK, looking at my config this is not defined so false at the current OS, now I set this to true subversion:/backup/amanda# amrecover AMRECOVER Version 3.1.2. Contacting server on amanda.ruf.ch ... 220 amanda AMANDA index server (3.1.2) ready. Setting restore date to today (2010-09-22) 200 Working date set to 2010-09-22. 200 Config set to DailySet1. 501 Host subversion is not in your disklist. Trying host subversion ... 501 Host subversion is not in your disklist. Trying host subversion.ruf.ch ... 200 Dump host set to subversion.ruf.ch. Use the setdisk command to choose dump disk to recover amrecover listdisk 200- List of disk for host subversion.ruf.ch 201- / 201- /home 201- /var 201- /usr 201- /data 200 List of disk for host subversion.ruf.ch amrecover setdisk /data 200 Disk set to /data. amrecover ls 2010-09-22-01-00-02 svn/ 2010-09-22-01-00-02 lost+found/ 2010-09-22-01-00-02 amanda/ 2010-09-22-01-00-02 . amrecover add svn Added dir /svn/ at date 2010-09-21-08-23-12 Added dir /svn/ at date 2010-09-22-01-00-02 amrecover extract Extracting files using tape drive changer on host amanda.ruf.ch. The following tapes are needed: amanda-0004 amanda-0005 Extracting files using tape drive changer on host amanda.ruf.ch. Load tape amanda-0004 now Continue [?/Y/n/s/d]? tar: ./svn: Not found in archive tar: Error exit delayed from previous errors Extractor child exited with status 2 Extracting files using tape drive changer on host amanda.ruf.ch. Load tape amanda-0005 now Continue [?/Y/n/s/d]? tar: ./svn: Not found in archive tar: Error exit delayed from previous errors Extractor child exited with status 2 amrecover I infer from this that tar found a reasonable archive, but was unable to extract the svn directory. Herre is some debugging from the client Wed Sep 22 17:14:28 2010: amrecover: user command: 'ls' Wed Sep 22 17:14:34 2010: amrecover: user command: 'add svn' Wed Sep 22 17:14:34 2010: amrecover: add_glob (svn) - ^svn$ Wed Sep 22 17:14:34 2010: amrecover: add_file: Looking for svn[/]*$ Wed Sep 22 17:14:34 2010: amrecover: add_file: Converted path=svn[/]*$ to path_on_disk=/svn[/]*$ Wed Sep 22 17:14:34 2010: amrecover: add_file: Pondering ditem-path=/svn/ Wed Sep 22 17:14:34 2010: amrecover: sending: ORLD /svn^M Wed Sep 22 17:14:34 2010: amrecover: add_file: (Successful) Added dir /svn/ at date 2010-09-21-08-23-12 Wed Sep 22 17:14:35 2010: amrecover: add_file: (Successful) Added dir /svn/ at date 2010-09-22-01-00-02 Wed Sep 22 17:14:35 2010: amrecover: add_file: Pondering ditem-path=/lost+found/ Wed Sep 22 17:14:35 2010: amrecover: add_file: Pondering ditem-path=/amanda/ Wed Sep 22 17:14:35 2010: amrecover: add_file: Pondering ditem-path=/. Wed Sep 22 17:14:46 2010: amrecover: user command: 'extract' Wed Sep 22 17:14:46 2010: amrecover: append_to_tapelist(tapelist=(nil), label='amanda-0004', file=-1, partnum=-1, isafile=0) Wed Sep 22 17:14:46 2010: amrecover: append_to_tapelist(tapelist=0xde0910, label='amanda-0004', file=13, partnum=-1, isafile=0) Wed Sep 22 17:14:46 2010: amrecover: append_to_tapelist(tapelist=(nil), label='amanda-0005', file=-1, partnum=-1, isafile=0) Wed Sep 22 17:14:46 2010: amrecover: append_to_tapelist(tapelist=0xde0910, label='amanda-0005', file=6, partnum=-1, isafile=0) Wed Sep 22 17:14:46
Re: FW: amrecover bug?
On Mon, Sep 27, 2010 at 1:12 AM, Titl Erich erich.t...@ruf.ch wrote: Just before you drop the ball completely, have you or someone else had time to look at the debug files I had skimmed it briefly, and didn't see anything obvious. I suspect that you've fixed the basic problem by changing FSF_AFTER_FILEMARK. With that in place, can you try running amfetchdump (which is basically a command-line version of amidxtaped) for that dump and see what comes out? Is the result a truncated version of the dumpfile? Is there any extra data in the dumpfile? Dustin -- Open Source Storage Engineer http://www.zmanda.com
Re: FW: amrecover bug?
On Mon, Sep 27, 2010 at 12:05 PM, Titl Erich erich.t...@ruf.ch wrote: Here for your reference the outcome of amfetchdump does not look good subversion:/backup# amrecover that's amrecover. Is there any extra data in the dumpfile? Not that I know of. During amrecover I can observe the data stream and I _hope_ it is not garbled to an extent that it is not processable. It takes the amount of time I would expect to extract the file and send it across the network to the client. On the server I can extract the respective file easily and also feed it successfully to tar (I have not tried dump/restore anymore). Meaning with 'mt' and 'dd'? That's good to know! Dustin -- Open Source Storage Engineer http://www.zmanda.com
RE: FW: amrecover bug?
Hi Dustin -Original Message- From: djmit...@gmail.com [mailto:djmit...@gmail.com] On Behalf Of Dustin J. Mitchell Sent: Monday, September 27, 2010 6:01 PM To: Titl Erich Cc: amanda-users@amanda.org Subject: Re: FW: amrecover bug? On Mon, Sep 27, 2010 at 1:12 AM, Titl Erich erich.t...@ruf.ch wrote: Just before you drop the ball completely, have you or someone else had time to look at the debug files I had skimmed it briefly, and didn't see anything obvious. I suspect that you've fixed the basic problem by changing FSF_AFTER_FILEMARK. Unforunately without success. Typically I would send positive feedback ;-) With that in place, can you try running amfetchdump (which is basically a command-line version of amidxtaped) for that dump and see what comes out? Is the result a truncated version of the dumpfile? Here for your reference the outcome of amfetchdump does not look good subversion:/backup# amrecover AMRECOVER Version 3.1.2. Contacting server on amanda.ruf.ch ... 220 amanda AMANDA index server (3.1.2) ready. Setting restore date to today (2010-09-27) 200 Working date set to 2010-09-27. 200 Config set to DailySet1. 501 Host subversion is not in your disklist. Trying host subversion ... 501 Host subversion is not in your disklist. Trying host subversion.ruf.ch ... 200 Dump host set to subversion.ruf.ch. Use the setdisk command to choose dump disk to recover amrecover listdisk 200- List of disk for host subversion.ruf.ch 201- / 201- /home 201- /var 201- /usr 201- /data 200 List of disk for host subversion.ruf.ch amrecover setdisk /data 200 Disk set to /data. amrecover ls 2010-09-25-01-00-02 svn/ 2010-09-25-01-00-02 lost+found/ 2010-09-25-01-00-02 amanda/ 2010-09-25-01-00-02 . amrecover add svn Added dir /svn/ at date 2010-09-25-01-00-02 amrecover extract Extracting files using tape drive changer on host amanda.ruf.ch. The following tapes are needed: amanda-0008 Extracting files using tape drive changer on host amanda.ruf.ch. Load tape amanda-0008 now Continue [?/Y/n/s/d]? Y Restoring files into directory /backup/amanda All existing files in /backup/amanda can be deleted Continue [?/Y/n]? Y tar: ./svn: Not found in archive tar: Error exit delayed from previous errors Extractor child exited with status 2 Is there any extra data in the dumpfile? Not that I know of. During amrecover I can observe the data stream and I _hope_ it is not garbled to an extent that it is not processable. It takes the amount of time I would expect to extract the file and send it across the network to the client. On the server I can extract the respective file easily and also feed it successfully to tar (I have not tried dump/restore anymore). I will run fetchdump during the night and report tomorrow. Thanks Erich smime.p7s Description: S/MIME cryptographic signature
amanda and selinux
Has anyone attempted to create selinux ?rules/policies? suitable for an amanda installation? After installing user amandabackup with a home dir of /var/lib/amanda, I get a lot of warning notices about how an ordinary user app should not need to be accessing things in /var. Never mind that it is accessing things in its own home directory :) Jon -- Jon H. LaBadie j...@jgcomp.com JG Computing 12027 Creekbend Drive (703) 787-0884 Reston, VA 20194 (703) 787-0922 (fax)
Re: amanda and selinux
On Tuesday, September 28, 2010 12:48:54 am Jon LaBadie did opine: Has anyone attempted to create selinux ?rules/policies? suitable for an amanda installation? After installing user amandabackup with a home dir of /var/lib/amanda, I get a lot of warning notices about how an ordinary user app should not need to be accessing things in /var. Never mind that it is accessing things in its own home directory :) Jon I have run that headache of and on for 2 or 3 years Jon, and IMO, it is a solution in search of a problem that has been disabled in my local kernel builds since at least a year ago. There is a mailing list for it on the fedora site where the advice is generally spot on. Here, I'm sitting behind a dd-wrt based router, so I don't worry too much about outsiders getting in. Its a darned good firewall. So I don't run it here since it annoys me far more than the attacker since there hasn't been a successful attack in about 4 years of running dd-wrt. I don't even run iptables on this box. It has 3 modes, off (0), permissive(1) where it reports as if it has denied so and so but allows it anyway, and enforcing(3) where it actually works. The first thing to do is touch /.autorelabel and reboot. It will attempt to relabel things. But I have no idea about /var/lib/amanda as a home dir. I have amanda's home dir in /home/amanda. Are you building from tarballs, or package manager compatible, like rpms or debs? -- Cheers, Gene There are four boxes to be used in defense of liberty: soap, ballot, jury, and ammo. Please use in that order. -Ed Howdershelt (Author) Quid me anxius sum? [ What? Me, worry? ]
Re: amanda and selinux
On Tue, Sep 28, 2010 at 01:01:52AM -0400, Gene Heskett wrote: On Tuesday, September 28, 2010 12:48:54 am Jon LaBadie did opine: Has anyone attempted to create selinux ?rules/policies? suitable for an amanda installation? After installing user amandabackup with a home dir of /var/lib/amanda, I get a lot of warning notices about how an ordinary user app should not need to be accessing things in /var. Never mind that it is accessing things in its own home directory :) Jon I have run that headache of and on for 2 or 3 years Jon, and IMO, it is a solution in search of a problem that has been disabled in my local kernel builds since at least a year ago. There is a mailing list for it on the fedora site where the advice is generally spot on. ... It has 3 modes, off (0), permissive(1) where it reports as if it has denied so and so but allows it anyway, and enforcing(3) where it actually works. The first thing to do is touch /.autorelabel and reboot. It will attempt to relabel things. Yeah, I'm using permissive mode on the one Fedora box. But I have no idea about /var/lib/amanda as a home dir. I have amanda's home dir in /home/amanda. Are you building from tarballs, or package manager compatible, like rpms or debs? I went the ?easier? way this time and got the prebuilt binaries. They create user amandabackup with home dir /var/lib/amanda. Including appropriate selinux policies for Fedora builds might be another feature enhancement request or nitpick. Jon -- Jon H. LaBadie j...@jgcomp.com JG Computing 12027 Creekbend Drive (703) 787-0884 Reston, VA 20194 (703) 787-0922 (fax)
Windows partition incrementals
I backing up several windows partitions on a few hosts. I'm using the community ZWC versions 3.1.1 and 3.1.2. I've yet to see anything except level 0 dumps of the windows DLEs. The documentation says ZWC does do incrementals, but apparently I've not cast the magic spell. Suggestions? jl -- Jon H. LaBadie j...@jgcomp.com JG Computing 12027 Creekbend Drive (703) 787-0884 Reston, VA 20194 (703) 787-0922 (fax)
Re: amanda and selinux
On Tue, Sep 28, 2010 at 12:21 AM, Jon LaBadie j...@jgcomp.com wrote: Including appropriate selinux policies for Fedora builds might be another feature enhancement request or nitpick. I'd like to see them, too, but I'm not sure how quickly they'd get out of date. They'd need someone savvy in the ways of selinux who was willing to write them in a maximally flexible way, and keep them up to date. That's probably more than just using the permissive mode and recording what Amanda does. Dustin -- Open Source Storage Engineer http://www.zmanda.com
