Re: [Bacula-users] Tape drive mount problems
On Mon, 26 Feb 2007, Kern Sibbald wrote: On Sunday 25 February 2007 09:42, Michael Brennen wrote: Hello again, The long weekend backups started running Friday night. This is a 4 drive 60 slot autochanger. The bacula version is archive-dir Version: 2.1.4 (21 February 2007) to get the encryption patch. Consistent with what I posted a couple of days ago the tape drives are still a bit confused, and I've had to manually unmount and mount tapes to accomodate the needs of a few jobs. I now have a job that is waiting for a particular mount on drive 0, but thd drive is unmountable. I unmounted a volume FNI0005 in drive 0, used by a different job, and unmounted volume FNI0006 in drive 3 in order to mount FNI0006 on drive 0, which is what the waiting job wanted. That process left drive 0 in the following state, taken with debug 200: === Device Drive-0 (/dev/nst0) is not open. Device is BLOCKED. User unmounted during wait for media/mount. Drive 0 status unknown. Configured device capabilities: EOF BSR BSF FSR FSF EOM REM !RACCESS AUTOMOUNT !LABEL !ANONVOLS ALWAYSOPEN Device state: !OPENED TAPE !LABEL !MALLOC !APPEND !READ !EOT !WEOT !EOF !NEXTVOL !SHORT !MOUNTED num_writers=1 block=5 === If I read this correctly, the lack of a bang in front of TAPE indicates that bacula thinks there is a tape in the drive. There is not; a raw mtx status query shows drive 0 empty. Trying to unmount FNI0005 left the drive in this state, and it is now impossible to mount another drive, as a mount command results in trying to unmount a non-existent tape into an already full slot 1, which of course fails. When I try to mount FNI0006 on drive 0, this is the result: === forked processes: /bin/sh /path/to/bacula/mtx-changer /dev/sg3 unload 1 /dev/nst0 0 \_ mt -f /dev/nst0 offline ... eventual timeout... 3995 Bad autochanger unload slot 1, drive 0: ERR=Child exited with code 1 Results=/dev/nst0: No medium found Storage Element 1 is Already Full 3901 open device failed: ERR=dev.c:424 Unable to open device Drive-0 (/dev/nst0): ERR=No medium found === Every time I try to mount a tape to the drive it tries to unload a non existent tape and will go no further. I've tried releasing the drive, unmounting it, etc. and nothing has succeeded so far. I've had no results googling for a resolution either; this drive status does not come up much in searches. The autochanger and drive 0 config are below; the other drives are identical with appropriate name changes. This configuration has been working for weeks, and it just began showing problems. The pools just now began recycling volumes, and it seems to be the low numbered recycled tapes that are problematic. I do not know if that has anything to do with this or not. Autochanger { Name = Q47 Device = Drive-0, Drive-1, Drive-2, Drive-3 Changer Command = /path/to/bacula/mtx-changer %c %o %S %a %d Changer Device = /dev/sg3 } Device { Name = Drive-0 Drive Index = 0 Media Type = DLT-7000 Archive Device = /dev/nst0 AutomaticMount = yes; AlwaysOpen = yes; RemovableMedia = yes; RandomAccess = no; AutoChanger = yes LabelMedia = no # Enable the Alert command only if you have the mtx package loaded Alert Command = sh -c 'tapeinfo -f %c |grep TapeAlert|cat' SpoolDirectory = /some/dir } If anyone has any insight on how to clear this up, or how it got in this state, I would appreciate it. For now I will muddle through the long backups and manually rerun the failed/blocked jobs after I can restart things to get it to an unblocked state. Thanks... The first thing to do is to get back on a stable Bacula. I have not tested the trunk with a tape drive for well over a month, and yet there have been some *major* modifications to the device handling. If you don't know how to get onto Branch-2.0, then I recommend going back to the released 2.0.2. (Sorry I don't have the proper command just in front of me). Hopefully that will clear up all your problems. If you need the fix for the encryption problem, download the updated restore.c file from the bug. By the end of next week, I hope to have version 2.0.3 ready for release ... I went back to 2.0.2 source with the filed restore.c, and all is working well now. I did not know the difference between the branch and trunk; this is my first exposure to an svn tree. That's what I get for working with things I don't fully understand. :) -- Michael - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http
Re: [Bacula-users] Tape drive mount problems resolved (svn source bug, I think)
On Mon, 26 Feb 2007, Kern Sibbald wrote: On Monday 26 February 2007 03:17, Michael Brennen wrote: I have a resolution to the mount problems of which I wrote last night, in which bacula attempts to unload a phantom tape from an empty drive before loading the needed tape. I went back to the latest released source, 2.0.2, and all is working again. The changer is a 4 drive, 60 slot unit that has been working well for months. Essentially the problem is that the latest svn source tries to unload a non-existent tape from a drive before it tries to load the real tape from the changer. 2.0.2 works correctly. The following errors were in working/log after the failed operations on current svn source. Drive 0 was empty when these were attempted. = 25-Feb 19:06 archive-dir: Using Volume FNI0002 from 'Scratch' pool. 25-Feb 19:06 archive-sd: 3307 Issuing autochanger unload slot 1, drive 0 command. 25-Feb 19:08 archive-sd: 3995 Bad autochanger unload slot 1, drive 0: ERR=Child exited with code 1 Results=/dev/nst0: No medium found Storage Element 1 is Already Full 25-Feb 19:08 archive-sd: 3307 Issuing autochanger unload slot 1, drive 0 command. 25-Feb 19:10 archive-sd: 3995 Bad autochanger unload slot 1, drive 0: ERR=Child exited with code 1 Results=/dev/nst0: No medium found Storage Element 1 is Already Full = Reviewing the technotes file, I wonder if this wasn't broken when the virtual autochanger changes were made a few days ago. Yes, quite likely. Thanks for doing some nice debugging for me. :-) I'm very sorry that you got hit with these problems and that I was offline at FOSDEM while they were happening :-( No problem; at least some good came out of it. :) Thanks for the responses. -- Michael - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Tape drive mount problems
Hello again, The long weekend backups started running Friday night. This is a 4 drive 60 slot autochanger. The bacula version is archive-dir Version: 2.1.4 (21 February 2007) to get the encryption patch. Consistent with what I posted a couple of days ago the tape drives are still a bit confused, and I've had to manually unmount and mount tapes to accomodate the needs of a few jobs. I now have a job that is waiting for a particular mount on drive 0, but thd drive is unmountable. I unmounted a volume FNI0005 in drive 0, used by a different job, and unmounted volume FNI0006 in drive 3 in order to mount FNI0006 on drive 0, which is what the waiting job wanted. That process left drive 0 in the following state, taken with debug 200: === Device Drive-0 (/dev/nst0) is not open. Device is BLOCKED. User unmounted during wait for media/mount. Drive 0 status unknown. Configured device capabilities: EOF BSR BSF FSR FSF EOM REM !RACCESS AUTOMOUNT !LABEL !ANONVOLS ALWAYSOPEN Device state: !OPENED TAPE !LABEL !MALLOC !APPEND !READ !EOT !WEOT !EOF !NEXTVOL !SHORT !MOUNTED num_writers=1 block=5 === If I read this correctly, the lack of a bang in front of TAPE indicates that bacula thinks there is a tape in the drive. There is not; a raw mtx status query shows drive 0 empty. Trying to unmount FNI0005 left the drive in this state, and it is now impossible to mount another drive, as a mount command results in trying to unmount a non-existent tape into an already full slot 1, which of course fails. When I try to mount FNI0006 on drive 0, this is the result: === forked processes: /bin/sh /path/to/bacula/mtx-changer /dev/sg3 unload 1 /dev/nst0 0 \_ mt -f /dev/nst0 offline ... eventual timeout... 3995 Bad autochanger unload slot 1, drive 0: ERR=Child exited with code 1 Results=/dev/nst0: No medium found Storage Element 1 is Already Full 3901 open device failed: ERR=dev.c:424 Unable to open device Drive-0 (/dev/nst0): ERR=No medium found === Every time I try to mount a tape to the drive it tries to unload a non existent tape and will go no further. I've tried releasing the drive, unmounting it, etc. and nothing has succeeded so far. I've had no results googling for a resolution either; this drive status does not come up much in searches. The autochanger and drive 0 config are below; the other drives are identical with appropriate name changes. This configuration has been working for weeks, and it just began showing problems. The pools just now began recycling volumes, and it seems to be the low numbered recycled tapes that are problematic. I do not know if that has anything to do with this or not. Autochanger { Name = Q47 Device = Drive-0, Drive-1, Drive-2, Drive-3 Changer Command = /path/to/bacula/mtx-changer %c %o %S %a %d Changer Device = /dev/sg3 } Device { Name = Drive-0 Drive Index = 0 Media Type = DLT-7000 Archive Device = /dev/nst0 AutomaticMount = yes; AlwaysOpen = yes; RemovableMedia = yes; RandomAccess = no; AutoChanger = yes LabelMedia = no # Enable the Alert command only if you have the mtx package loaded Alert Command = sh -c 'tapeinfo -f %c |grep TapeAlert|cat' SpoolDirectory = /some/dir } If anyone has any insight on how to clear this up, or how it got in this state, I would appreciate it. For now I will muddle through the long backups and manually rerun the failed/blocked jobs after I can restart things to get it to an unblocked state. Thanks... -- Michael - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Director died, no active jobs
Hello all, Sometime last night the director died. The last entry in working/log is this: 25-Feb 08:02 archive-dir: Error: open mail pipe /path/to/bacula/bsmtp -h localhost -f (Bacula) [EMAIL PROTECTED] -s Bacula daemon message [EMAIL PROTECTED] failed: ERR=Cannot allocate memory The system has a gig of ram, and 2 gig of swap. At the moment there is about 35 meg in swap, not unusual for a linux system that has been up some time. Perhaps the system was out of memory, perhaps not; I will have to look further in the system logs. Of more immediate import is that I restarted just the director, and now it reports no active jobs. The SD however is still running and happily spooling data from the two jobs that were running a few hours ago when I last checked it. I've not seen this before so don't know what to expect. Are those spooling jobs lost? Will the SD have to be stopped and the jobs rerun? For the moment I may let them run out and see what happens. -- Michael - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Director died, no active jobs
On Sun, 25 Feb 2007, Michael Brennen wrote: Sometime last night the director died. The last entry in working/log is this: 25-Feb 08:02 archive-dir: Error: open mail pipe /path/to/bacula/bsmtp -h localhost -f (Bacula) [EMAIL PROTECTED] -s Bacula daemon message [EMAIL PROTECTED] failed: ERR=Cannot allocate memory Never mind, the system really did exhaust ram. I've cancelled and will rerun the jobs. -- Michael - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Tape drive mount problems resolved (svn source bug, I think)
I have a resolution to the mount problems of which I wrote last night, in which bacula attempts to unload a phantom tape from an empty drive before loading the needed tape. I went back to the latest released source, 2.0.2, and all is working again. The changer is a 4 drive, 60 slot unit that has been working well for months. Essentially the problem is that the latest svn source tries to unload a non-existent tape from a drive before it tries to load the real tape from the changer. 2.0.2 works correctly. The following errors were in working/log after the failed operations on current svn source. Drive 0 was empty when these were attempted. = 25-Feb 19:06 archive-dir: Using Volume FNI0002 from 'Scratch' pool. 25-Feb 19:06 archive-sd: 3307 Issuing autochanger unload slot 1, drive 0 command. 25-Feb 19:08 archive-sd: 3995 Bad autochanger unload slot 1, drive 0: ERR=Child exited with code 1 Results=/dev/nst0: No medium found Storage Element 1 is Already Full 25-Feb 19:08 archive-sd: 3307 Issuing autochanger unload slot 1, drive 0 command. 25-Feb 19:10 archive-sd: 3995 Bad autochanger unload slot 1, drive 0: ERR=Child exited with code 1 Results=/dev/nst0: No medium found Storage Element 1 is Already Full = Reviewing the technotes file, I wonder if this wasn't broken when the virtual autochanger changes were made a few days ago. -- Michael - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Mount confusion
Hello all, This is on a bacula configuration that has been running fine for a couple of months. It has run through about 45 or so tapes in the changer, so I think I have some confidence in the basic configuration. Last weekend a long running network archive hung, and after 3 days I cancelled it. That never returned to a prompt from bconsole, though opening a second bconsole and running 'stat dir' said it was cancelled, and the spool file continued to accumulate data. After a couple of hours I finally stopped bacula. That seems to have left bacula in something in a confused state. From that time I now have two jobs that will only run on drive 0. This is a 4 drive autochanger, and other jobs use other drives fine. However, two jobs will only run on drive 0, and if another tape is in that drive the job(s) simply block waiting for a mount. When the two jobs are started one after the other, when the first finishes the tapes are not rotated out and the second job continues to emit mount requests. The first job completing changes nothing; it remains in the drive. If I manually unmount the mounted tape of the completed first job to make room for the other, the following messages are displayed: 3307 Issuing autochanger unload slot 1, drive 0 command. 3995 Bad autochanger unload slot 1, drive 0: ERR=Child exited with code 1 Results=Storage Element 1 is Already Full However, the mounted tape did not come from slot 1, but slot 4. It should not be trying to unload the tape into slot 1. When starting one of the jobs alone, with no tapes in the drive and after running 'update slots', there is a message that is issued that does not mean much to me, and I cannot find much of it on google, an invalid slot defined message. 22-Feb 21:15 archive-sd: Invalid slot=0 defined, cannot autoload Volume. 22-Feb 21:15 archive-sd: Invalid slot=0 defined, cannot autoload Volume. 22-Feb 21:15 archive-sd: Please mount Volume FNI0003 on Storage Device Drive-1 (/dev/nst1) for Job Host-Archive.2007-02-22_21.15.56 I have stopped bacula, emptied the drives, started bacula, and then run 'update slots'. I've done that several times, and it has changed nothing. I started bacula with -d400 and dumped the output to a file; that file is about 190k so I will not be sending it to the list. :) I'm sure the answer is somewhere in there, but I don't know enough of what I'm reading to sort it out quickly. I suppose my basic question is just where in the database it might be requiring that particular drive for these two jobs, and how might I clear that up? I think the unload to the wrong slot and the invalid slot messages may be important, but I am not sure just what condition that is indicating. I am running current CVS, as of yesterday, in order get the encryption patch. Thanks for any help someone might have. -- Michael - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Follow up on the mount problem
Hello again, This is a followup of my earlier post this evening. One of the problem jobs just started again. It is looking for the volume 'FNI0003' to be in drive 0. It was mounted in drive 1, but would not use it. The status of the autochanger is this; FNI0003 is loaded in drive 1. Data Transfer Element 0:Empty Data Transfer Element 1:Full (Storage Element 4 Loaded):VolumeTag = FNI0003 Data Transfer Element 2:Empty Data Transfer Element 3:Empty Storage Element 1:Full :VolumeTag=FNI Storage Element 2:Full :VolumeTag=FNI0001 Storage Element 3:Full :VolumeTag=FNI0002 Storage Element 4:Empty Storage Element 5:Full :VolumeTag=FNI0004 The command 'stat sd=Q47' gave this status: Autochanger Q47 with devices: Drive-0 (/dev/nst0) Drive-1 (/dev/nst1) Drive-2 (/dev/nst2) Drive-3 (/dev/nst3) Device Drive-0 (/dev/nst0) is not open. Device is BLOCKED waiting for media. Drive 0 status unknown. Device Drive-1 (/dev/nst1) is mounted with Volume= Pool=FishNet-Daily Drive 1 status unknown. Total Bytes=14,781,634,560 Blocks=229,129 Bytes/block=64,512 Positioned at File=23 Block=0 Device Drive-2 (/dev/nst2) is not open. Drive 2 status unknown. Device Drive-3 (/dev/nst3) is not open. Drive 3 status unknown. Note the Volume=; I don't know why that was blank. To move the tape I issued an unmount command on drive 1, and the result was this: 3307 Issuing autochanger unload slot 1, drive 1 command. 3995 Bad autochanger unload slot 1, drive 1: ERR=Child exited with code 1 Results=Storage Element 1 is Already Full Why was the unmount attempted to slot 1? The tape in the drive came from slot 4. The mounted Volume= seems to indicate that bacula clearly thought it had a mounted tape in drive 1, but for some reason it appears to have lost which one. I manually issued the mtx commands to move the FNI0003 volume to drive one, and the blocked job took off and ran. Now I have a blocked drive from the manual unmount of 1, but the mounted volume now has the correct name. Device Drive-0 (/dev/nst0) is mounted with Volume=FNI0003 Pool=FishNet-Daily Drive 0 status unknown. Total Bytes=14,781,763,584 Blocks=229,131 Bytes/block=64,512 Positioned at File=23 Block=2 Device Drive-1 (/dev/nst1) is not open. Device is BLOCKED. User unmounted. Drive 1 status unknown. I really do not know how the drive allocations became so scrambled. It just started happening after the cancellation confusion after the hung network backup last weekend. If anyone has insight on where it might be confused or how to surgically modify the database to un-confuse I am open to trying it. For the moment I will continue to execute the mounts by hand until these volumes are filled and bacula goes on to others. Thanks... -- Michael - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Compression issue with a VXA drive (Ecrix)
You may want to get the VXA tools from the web site, probably exabyte.com, since they bought Ecrix. The vxaTool is the best way to control compression; I am not sure that mt will do that. I know that here mt does not work to eject tapes where vxaTool does. -- -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier. Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] GUI interface
On Wednesday 17 January 2007 17:39, Geoff Tolley wrote: Frontula anyone? Or 'baculart'? -- -- Michael pgp6qvdHF0weI.pgp Description: PGP signature - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula-rescue problem : static-bacula-fd Segmentation fault when authenticating
On Wed, 6 Dec 2006, Ëﺣ³É wrote: when I'm working on get bacula-rescue run in my redhat 8.0. when i compile bacula-1.36.3 source ... 1.36 is very old and you may not get any help on it. Have you tried the latest 1.38, or better 1.39, release? If you need stability, try 1.38.11 (or whatever the latest is); if you can tolerate a bit of change at release, try the latest 1.39. -- Michael- Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula-rescue problem : static-bacula-fdSegmentation fault when authenticating
On Wed, 6 Dec 2006, 孙海成 wrote: to Michael: Thank you . I tryed bacula-1.38.11 ,but the problem still there,I think maybe it is lack of some library ? A segfault would not be the lack of a library; that would tend more toward a compilation failure. The runtime segfault may indicate a library incompatibility of some sort. I think there was a glibc change between RH8 and RH9, and there certainly has been on between RH8 and current releases. Unless someone else has some specific insight your best bet may be to debug with strace (or gdb?) to see just where the fault is. On Wed, 6 Dec 2006, 孙海成 wrote: when I'm working on get bacula-rescue run in my redhat 8.0. when i compile bacula-1.36.3 source ... 1.36 is very old and you may not get any help on it. Have you tried the latest 1.38, or better 1.39, release? If you need stability, try 1.38.11 (or whatever the latest is); if you can tolerate a bit of change at release, try the latest 1.39.- Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] dlt7000 .conf files
On Wednesday 08 November 2006 10:20, Mike King wrote: can someone please send me their conf files - passwords... i cant this overland autochanger working correctly! I've an Overland 10 slot / 2 drive changer and it is working quite well with normal configurations. What is not working on yours? -- -- Michael - SF.net email is sponsored by: A Better Job is Waiting for You - Find it Now. Check out Slashdot's new job board. Browse through tons of technical jobs posted by companies looking to hire people just like you. http://jobs.slashdot.org/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restoring archives on windows systems, compression+encryption
On Wednesday 08 November 2006 00:56, Michael Brennen wrote: On Tue, 7 Nov 2006, Robert Nelson wrote: You aren't going to have any luck with 1.39.26 on Windows since it doesn't have any of the fixes. Ah... somewhere I must have missed the .27 for Windows. I will install/test it, and thanks. Checking the SF site, 1.39.26 is the last release for Windows; that is running as the FD. I am running 1.39.27 on linux as the DIR/SD. Is there a missing Windows 1.39.27, or do I have the latest code in which compression+encryption should work? -- -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restoring archives on windows systems, compression+encryption
On Wednesday 08 November 2006 11:44, Robert Nelson wrote: Generally, released versions have even numbers; odd numbers are built from the CVS. This would seem to refer to the '.39' component, while the final .26/.27 difference under discussion here is simply a sequential CVS release; correct? It looks like you built your own Linux version from CVS but not your Windows software. True. I've never tried to build the Windows side. My only means to do so is the cygwin suite, and up until now there has not been the need, as the Windows releases on SF have not been dependent on precise coordination with the CVS code in the same way as this set of compression+encryption fixes. Since this fix was very recent there are no released versions available incorporating it. Kern will be releasing a new version in the next week or so. If you are unable to build it AND your email server allows large attachments ( 15MB) I can send you an Installer binary. My mail server can take that sort of attachment, and I would be happy to test it for you. Thanks much yet again. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Michael Brennen Sent: Wednesday, November 08, 2006 9:32 AM To: bacula-users@lists.sourceforge.net Cc: Robert Nelson Subject: Re: [Bacula-users] Restoring archives on windows systems,compression+encryption On Wednesday 08 November 2006 00:56, Michael Brennen wrote: On Tue, 7 Nov 2006, Robert Nelson wrote: You aren't going to have any luck with 1.39.26 on Windows since it doesn't have any of the fixes. Ah... somewhere I must have missed the .27 for Windows. I will install/test it, and thanks. Checking the SF site, 1.39.26 is the last release for Windows; that is running as the FD. I am running 1.39.27 on linux as the DIR/SD. Is there a missing Windows 1.39.27, or do I have the latest code in which compression+encryption should work? -- -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Good news on Windows compression+encryption archive/restore
It worked. :) I installed Robert's 1.39.27 beta on a Windows 2k server, touched some files, archived and restored them, all without problems. PKI signatures were on. The sparse option was enabled, and compression was at GZIP6. That has been a long time coming, but it is finally working. -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Restoring archives on windows systems, compression+encryption
Last Sunday night I restarted my archive set with current CVS, as checked in by Robert with the compression+encryption fixes. I can archive and restore from a linux system successfully now; thanks much, Robert. :) Archiving windows systems is working with compression+encryption without error messages, similar FD key configurations to the linux systems, etc. but I cannot restore to the same windows system from which an archive was made. Given the problems with wx-console I am using bconsole for the restore. I go through the restore process, and the process errors out as below. Robert, others, any ideas? -- Michael --- 07-Nov 13:57 archive-dir: Start Restore Job Restore-Somehost.2006-11-07_13.56.58 07-Nov 13:57 archive-sd: Ready to read from volume FNI0001 on device Drive-0 (/dev/nst0). 07-Nov 13:57 archive-sd: Forward spacing to file:block 0:1. 07-Nov 14:11 archive-sd: End of file 4 on device Drive-0 (/dev/nst0), Volume FNI0001 07-Nov 14:12 somehost.com: Restore-Somehost.2006-11-07_13.56.58 Fatal error: ../../filed/restore.c:876 Decryption error for /backup/bacula/bacula-restores/C/bin/more 07-Nov 14:12 foghorn.fni.com: Restore-Somehost.2006-11-07_13.56.58 Error: ../../filed/restore.c:580 Missing cryptographic signature for /backup/bacula/bacula-restores/C/bin/newmysql 07-Nov 14:12 archive-sd: Restore-Somehost.2006-11-07_13.56.58 Fatal error: read.c:126 Error sending to File daemon. ERR=Connection reset by peer 07-Nov 14:12 archive-sd: Restore-Somehost.2006-11-07_13.56.58 Error: bnet.c:426 Write error sending 19808 bytes to client:123.123.123.123:36643: ERR=Connection reset by peer 07-Nov 14:12 archive-dir: Restore-Somehost.2006-11-07_13.56.58 Error: Bacula 1.39.27 (24Oct06): 07-Nov-2006 14:12:14 JobId: 44 Job:Restore-Somehost.2006-11-07_13.56.58 Client: somehost.com Start time: 07-Nov-2006 13:57:00 End time: 07-Nov-2006 14:12:14 Files Expected: 87 Files Restored: 26 Bytes Restored: 0 Rate: 0.0 KB/s FD Errors: 1 FD termination status: Error SD termination status: Error Termination:*** Restore Error *** --- - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restoring archives on windows systems, compression+encryption
On Tue, 7 Nov 2006, Robert Nelson wrote: Can you try the restore with the PKI Signatures = Yes commented out? I had problems with signatures on my system, but it only showed up as Invalid Signatures rather than missing ones. There was a follow-up thread with Landon on Bacula-devel about the signatures but no resolution yet. See below. I'll change the severity from M_FATAL to M_ERROR so that the restore continues. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Michael Brennen Sent: Tuesday, November 07, 2006 1:53 PM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] Restoring archives on windows systems,compression+encryption Last Sunday night I restarted my archive set with current CVS, as checked in by Robert with the compression+encryption fixes. I can archive and restore from a linux system successfully now; thanks much, Robert. :) Archiving windows systems is working with compression+encryption without error messages, similar FD key configurations to the linux systems, etc. but I cannot restore to the same windows system from which an archive was made. Given the problems with wx-console I am using bconsole for the restore. I go through the restore process, and the process errors out as below. Robert, others, any ideas? -- Michael --- 07-Nov 13:57 archive-dir: Start Restore Job Restore-Somehost.2006-11-07_13.56.58 07-Nov 13:57 archive-sd: Ready to read from volume FNI0001 on device Drive-0 (/dev/nst0). 07-Nov 13:57 archive-sd: Forward spacing to file:block 0:1. 07-Nov 14:11 archive-sd: End of file 4 on device Drive-0 (/dev/nst0), Volume FNI0001 07-Nov 14:12 somehost.com: Restore-Somehost.2006-11-07_13.56.58 Fatal error: ../../filed/restore.c:876 Decryption error for /backup/bacula/bacula-restores/C/bin/more 07-Nov 14:12 foghorn.fni.com: Restore-Somehost.2006-11-07_13.56.58 Error: ../../filed/restore.c:580 Missing cryptographic signature for /backup/bacula/bacula-restores/C/bin/newmysql 07-Nov 14:12 archive-sd: Restore-Somehost.2006-11-07_13.56.58 Fatal error: read.c:126 Error sending to File daemon. ERR=Connection reset by peer 07-Nov 14:12 archive-sd: Restore-Somehost.2006-11-07_13.56.58 Error: bnet.c:426 Write error sending 19808 bytes to client:123.123.123.123:36643: ERR=Connection reset by peer 07-Nov 14:12 archive-dir: Restore-Somehost.2006-11-07_13.56.58 Error: Bacula 1.39.27 (24Oct06): 07-Nov-2006 14:12:14 JobId: 44 Job:Restore-Somehost.2006-11-07_13.56.58 Client: somehost.com Start time: 07-Nov-2006 13:57:00 End time: 07-Nov-2006 14:12:14 Files Expected: 87 Files Restored: 26 Bytes Restored: 0 Rate: 0.0 KB/s FD Errors: 1 FD termination status: Error SD termination status: Error Termination:*** Restore Error *** --- 07-Nov 23:48 somehost.com: Restore-Somehost.2006-11-07_23.31.17 Error: Uncompression error on file /backup/bacula/bacula-restores/C/bin/file1. ERR=Zlib data error 07-Nov 23:48 somehost.com: Restore-Somehost.2006-11-07_23.31.17 Error: Uncompression error on file /backup/bacula/bacula-restores/C/bin/file3. ERR=Zlib data error 07-Nov 23:48 somehost.com: Restore-Somehost.2006-11-07_23.31.17 Error: Uncompression error on file /backup/bacula/bacula-restores/C/bin/file3. ERR=Zlib data error Now the zlib errors are back; I saw these a week or so ago. The only difference is that I commented the PKI signature line, touched the files in a directory, ran a fresh archive, and tried to restore from it. The Windows FD configuration is below; it is 1.3.26. -- Michael FileDaemon { Name = somehost.com FDport = 9102 WorkingDirectory = C:\\Documents and Settings\\All Users\\Application Data\\Bacula\\Work Pid Directory = C:\\Documents and Settings\\All Users\\Application Data\\Bacula\\Work Maximum Concurrent Jobs = 2 PKI Signatures = yes PKI Encryption = yes PKI Keypair = C:/Documents and Settings/All Users/Application Data/Bacula/fd_somehost.pem } - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restoring archives on windows systems, compression+encryption
On Tue, 7 Nov 2006, Robert Nelson wrote: You aren't going to have any luck with 1.39.26 on Windows since it doesn't have any of the fixes. Ah... somewhere I must have missed the .27 for Windows. I will install/test it, and thanks. -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problems with BaculaSD
On Mon, 6 Nov 2006, Matti Jormakka wrote: We have configured a Director and a Storage Daemon on a machine called host in our local network. In addition to a local test File Daemon (running on host) we have a File Daemon on a machine outside our local network. We have set up a domain name host.domain.com for host that is visible to outside. We also have configured port forwarding on our router to forward incoming connections to Storage Daemon's default port (9103) to host. The following picture illustrates the port forwarding setup: The director's storage configuration is set up to connect to Storage Daemon located at host.domain.com and port 9103. Also the Storage Daemon is configured to listen on address host.domain.com and port 9103. However, when trying even to check the status of the Storage Daemon, the following error message is displayed: 02-Nov 14:25 host-dir: *Console*.2006-11-02_14.23.55 Fatal error: bnet.c:775 Unable to connect to Storage daemon on host.domain.com:9103. ERR=Connection refused That the connection was refused seems significant. At least on a Centos4 system with a default firewall configured, ports that are not explicitely permitted are rejected. You don't say what OS you are running, but you might check if firewall software is running locally and open the appropriate ports, with source address controls as necessary. The significant parts of the configuration files are as follows: bacula-dir.conf: Storage { Name = File Address = host.domain.com Password = password Device = FileStorage Media Type = File } bacula-sd.conf: Storage { Name = host-sd SDAddress = host.domain.com SDPort = 9103 WorkingDirectory = /var/lib/bacula Pid Directory = /var/run/bacula Maximum Concurrent Jobs = 20 } Director { Name = host-dir Password = password } Can the problem be in our Bacula configurations or in our network setup? Note that we are also interested in receiving professional support. - Matti Jormakka -- Michael- Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] Encryption/Compression Conflict in CVS
On Friday 03 November 2006 18:39, Kern Sibbald wrote: This code is backwards compatible for everything except encrypted data. Previously compressed backups will still work fine. I'm not 100% sure what you mean, but here are my thoughts: If it breaks something that previously worked, then it is does not fit with the Bacula philosophy of always being able to read Volumes written by prior versions. If something was previously broken -- i.e. could not be read -- then we should attempt to fix it, if at all possible. Maintaining backward Volume compatibility and fixing the problem is the best solution. Hopefully this is what you can do ... If we *must* create an incompatibility with Volumes written by prior versions of Bacula, then we need to think really hard about how to handle it because to the best of my knowledge this has never happened. If certain combinations of options created data that cannot be read under any conditions, then we need to carefully document it and inform the users. The conservative approach is much appreciated. That said, in this particular case it sounds like nothing is lost because the combination of encryption and compression never really worked right. Data might be written to the media, but without Robert's mods it is impossible to get it back because there isn't enough information to recover it. And, we were rightly warned that encryption formats might change before release; that the format warning did not foresee this particular case does not invalidate it. :) From my understanding, I am fine with Robert's changes. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Kern Sibbald Sent: Friday, November 03, 2006 4:15 PM To: Robert Nelson Cc: [EMAIL PROTECTED]; 'Landon Fuller'; bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Encryption/Compression Conflict in CVS Landon, I've changed the code so that the encryption code prefixes the data block with a block length prior to encryption. The decryption code accumulates data until a full data block is decrypted before passing it along to the decompression code. The code now works for all four scenarios with encryption and compression: none, encryption, compression, and encryption + compression. Unfortunately the code is no longer compatible for previously encrypted backups. I could add some more code to make the encryption only case work like before. However, since this is a new feature in 1.39 and there shouldn't be a lot of existing backups, I would prefer to invalidate the previous backups and keep the code simpler. Also I think we should have a design rule that says any data filters like encryption, compression, etc must maintain the original buffer boundaries. This will allow us to define arbitrary, dynamically extensible filter stacks in the future. What do you think? I'm unfortuntely not in a good position to examine this problem in detail, but I suggest that we should do our best to keep the old data readable by any kludge necessary. One possible solution for the new code that you have implemented is to put the new compressed data in a new stream -- i.e. a different one from the old compressed data -- this could possibly allow old Volumes to be read and any new data written to Volumes will be written correctly. One thing to be very careful about is to make sure the length that you store is bigendian-littlendian independent. Probably you have already done this, but if not you need to use the serialization code that is also used for sparse file length. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Landon Fuller Sent: Wednesday, November 01, 2006 7:08 PM To: Michael Brennen Cc: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Encryption/Compression Conflict in CVS On Nov 1, 2006, at 2:20 PM, Michael Brennen wrote: On Wednesday 01 November 2006 15:33, Arno Lehmann wrote: This sounds like compression should be automatically disabled when encrypton is enabled. Should be useless anyway as encrypted data should no longer be compressible. Not if compression happens prior to encryption. :) Theoretically - yes, but I'm quite sure that encryption usually also compresses data. This is completely unverified and refers to encryption programs that are rather outdated by now, though... But I suppose you could inform us if encryption in Bacula also compresses :-) Landon, what is your take on this? Since you wrote the code you seem to be the best source on whether the openssl functions you are using compress data. Howdy, The encryption does not include compression -- It made more sense to piggyback on the existing compression code. Also, thanks for catching this! I'm embarrassed that I forgot to test backup
Re: [Bacula-users] Encryption/Compression Conflict in CVS
On Thursday 02 November 2006 10:30, Robert Nelson wrote: The code now works for all four scenarios with encryption and compression: none, encryption, compression, and encryption + compression. Unfortunately the code is no longer compatible for previously encrypted backups. Excellent. Is this committed to CVS yet? I see that src/filed/restore.c changed. When you have it committed let me know and I will run some tests here as well. I could add some more code to make the encryption only case work like before. However, since this is a new feature in 1.39 and there shouldn't be a lot of existing backups, I would prefer to invalidate the previous backups and keep the code simpler. FWIW I concur. I would rather restart my archive pool (again, this is still testing after all... right?!?!? :) and set for the long term. -- -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Encryption/Compression Conflict in CVS
On Wednesday 01 November 2006 05:43, Arno Lehmann wrote: So... in my testing the combination of encryption and compression is either not writing files correctly to tape (in which case there is a lot of tape space taken up needlessly :) or the files are being corrupted in the restore process; it appears to me to be the latter. This sounds like compression should be automatically disabled when encrypton is enabled. Should be useless anyway as encrypted data should no longer be compressible. Not if compression happens prior to encryption. :) -- -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Encryption/Compression Conflict in CVS
On Wednesday 01 November 2006 06:04, Robert Nelson wrote: Actually this bug is quite simple to fix. The problem is that the backup and restore both do them in the same order instead of inverting the order on restore. Current Code: compress - encrypt - decompress - decrypt It should be: compress - encrypt - decrypt - decompress I can change the restore order so that existing backups will become readable and new backups will work whether created by the old software or the new. I wondered if it weren't something exactly that simple. :) I'll commit the fix once I've finished testing it. Thanks much, I will test it when you have committed it. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Arno Lehmann Sent: Wednesday, November 01, 2006 3:43 AM To: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Encryption/Compression Conflict in CVS Hi, On 11/1/2006 5:43 AM, Michael Brennen wrote: I posted a couple of days ago that restoring files from 1.39.27 (current CVS) with both encryption and compression turned on resulted in 0 length files being restored. I was able to test that further tonight by archiving and restoring a file in the 4 combinations of encryption/compression off/on. Running neither, compression alone or encryption alone I was able to archive and restore a file correctly. Running the two together I was able to reproduce the problem of 0 length restores, with no apparent errors. So... in my testing the combination of encryption and compression is either not writing files correctly to tape (in which case there is a lot of tape space taken up needlessly :) or the files are being corrupted in the restore process; it appears to me to be the latter. This sounds like compression should be automatically disabled when encrypton is enabled. Should be useless anyway as encrypted data should no longer be compressible. Arno -- -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula over Wan
On Wednesday 01 November 2006 13:46, Lonnie Cumberland wrote: I am wondering how to use Bacula to backup client systems across a Wan that may be on a different subnet (possibly masquraged) and perhaps even behind a firewall in some cases. Adding to the good comments already made by others, I suggest enabling at least compression, and very soon encryption, for the WAN systems. Bacula has both compression and encryption done in the client, so you both spread the CPU workload and reduce the data transferred across the relatively slow connection. YMMV, but as an example we have one system that uncompressed is in the 18-19 GB range, after compression it only transfers just under 3 GB across the wire. I found last night that the combination of encryption and compression is not working at the moment in CVS, but after reporting it to the list last night Robert Nelson thinks he has an easy fix, which should be committed very soon. -- -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Encryption/Compression Conflict in CVS
On Wednesday 01 November 2006 15:33, Arno Lehmann wrote: This sounds like compression should be automatically disabled when encrypton is enabled. Should be useless anyway as encrypted data should no longer be compressible. Not if compression happens prior to encryption. :) Theoretically - yes, but I'm quite sure that encryption usually also compresses data. This is completely unverified and refers to encryption programs that are rather outdated by now, though... But I suppose you could inform us if encryption in Bacula also compresses :-) Landon, what is your take on this? Since you wrote the code you seem to be the best source on whether the openssl functions you are using compress data. -- -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Encryption/Compression Conflict in CVS
On Wed, 1 Nov 2006, Landon Fuller wrote: Landon, what is your take on this? Since you wrote the code you seem to be the best source on whether the openssl functions you are using compress data. The encryption does not include compression -- It made more sense to piggyback on the existing compression code. Also, thanks for catching this! I'm embarrassed that I forgot to test backup+restore with both compression and encryption enabled. No problem, thanks for contributing the code. :) -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Encryption/Compression Conflict in CVS
On Wed, 1 Nov 2006, Robert Nelson wrote: On top of the issue with the reversed processing during restore that I previously mentioned, there is a fundamental flaw in the processing of compressed+gzipped data. The problem is that boundaries aren't preserved across encrypt/decrypt. What happens is that after the block is compressed it is encrypted. However since the encryption engine processes data in blocks there may still be bytes from the compressed block in the pipeline when the block is sent to the Storage Daemon. As a result, when the same block is decrypted it may result in only part of the compressed block. Unfortunately there is no way to tell how much decrypted data is required by the decompression engine with the current design. I think the algorithm would have to be changed to pass along the compressed data size with each compressed block. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Landon Fuller The encryption does not include compression -- It made more sense to piggyback on the existing compression code. Also, thanks for catching this! I'm embarrassed that I forgot to test backup+restore with both compression and encryption enabled. Landon, does it make sense to use OpenSSL compression in lieu of Bacula's compression, such that one should use one or the other but not both? I have no idea how good OpenSSL's internal compression is, but that might be a straightforward way around what sounds like a block cipher issue??? -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Encryption/Compression Conflict in CVS
I posted a couple of days ago that restoring files from 1.39.27 (current CVS) with both encryption and compression turned on resulted in 0 length files being restored. I was able to test that further tonight by archiving and restoring a file in the 4 combinations of encryption/compression off/on. Running neither, compression alone or encryption alone I was able to archive and restore a file correctly. Running the two together I was able to reproduce the problem of 0 length restores, with no apparent errors. So... in my testing the combination of encryption and compression is either not writing files correctly to tape (in which case there is a lot of tape space taken up needlessly :) or the files are being corrupted in the restore process; it appears to me to be the latter. This is on a Linux Centos 4.4 system, dir/sd/fd running on the same system. The relevant configurations are below. -- Michael FileSet { Name = Somehost-Archive Include { Options { signature = MD5 compression = GZIP6 } File = ... } FileDaemon { Name = somehost-fd FDport = 9102 WorkingDirectory = /path/to/bacula/working Pid Directory = /path/to/bacula/working Maximum Concurrent Jobs = 20 PKI Signatures = Yes PKI Encryption = Yes PKI Keypair = /path/to/bacula/keys/key.pem } - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Restore failing on current CVS
I did a clean restart of the entire backup set over the weekend. I relabeled the tapes, started with a new database, etc. This is on a current Centos 4.4 system. I carefully configured the windows client systems on 1.39.26, and they can successfully archive data without error. The director / sd are running on a linux system, on 1.39.27. All clients are running encryption, and the FileSet has option GZIP6. The FileSet and client records for the host I am trying to restore follow. All Jobs are spooled to disk before being written to tape. FileSet { Name = SomeHost-Archive Include { Options { signature = MD5 compression = GZIP6 } File = /backup/somehost } Exclude { File = *gz } } FileDaemon { Name = archive-fd FDport = 9102 WorkingDirectory = /path/to/bacula/working Pid Directory = /path/to/bacula/working Maximum Concurrent Jobs = 20 PKI Signatures = Yes PKI Encryption = Yes PKI Keypair = /path/to/bacula/keys/fd_archive.pem } Testing restores tonight with bconsole (on windows and linux systems), all appears to work well, but the files are being restored as length 0. I specifically ran a test where I touched a file to make sure it was archived, ran an archive, and then ran a restore. The restore listing shows the file as archived, but the restore still puts the file back as 0 length. No errors are generated, and the following typical messages are logged; this was from a linux bconsole client job. Essentially the same messages are logged on any restores. 30-Oct 20:39 archive-sd: Ready to read from volume FNI on device Drive-0 (/dev/nst0). 30-Oct 20:39 archive-sd: Forward spacing to file:block 14:1. 30-Oct 20:42 archive-sd: End of Volume at file 14 on device Drive-0 (/dev/nst0), Volume FNI 30-Oct 20:42 archive-sd: End of all volumes. 30-Oct 20:42 archive-dir: Bacula 1.39.27 (24Oct06): 30-Oct-2006 20:42:32 JobId: 43 Job:Restore-Archive.2006-10-30_20.37.56 Client: archive.fni.com Start time: 30-Oct-2006 20:37:58 End time: 30-Oct-2006 20:42:32 Files Expected: 1 Files Restored: 1 Bytes Restored: 0 Rate: 0.0 KB/s FD Errors: 0 FD termination status: OK SD termination status: OK Termination:Restore OK I am not sure where to go from here, as there are no apparent errors. I wonder if it might be encryption related, but I thought I would ask if anyone else might have any ideas before redoing everything again without encryption. TIA for any assistance/directions to begin looking that someone can give. -- -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Authorization error
On Thu, 26 Oct 2006, jpg wrote: However bconsole fails with: /etc/bacula # bconsole Connecting to Director hpcvsjpg:9101 26-Oct 13:50 bconsole: Fatal error: bnet.c:859 Unable to connect to Director daemon on hpcvsjpg:9101. ERR=Connection refused Do you have a firewall in place that is blocking access? The command below should show you the rule sets in place. iptables -L -n | less -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Can't write to the tape
On Thursday 26 October 2006 12:15, Greg Little wrote: 3306 Issuing autochanger list command. Invalid Slot number: /var/lib/bacula/mtx-changer: line 156: MTX: command not found Invalid Slot number: /var/lib/bacula/mtx-changer: line 156: -f: command not found I think you have the buggy version of mtx-changer in 1.38. One of the lines below in your script will only have MTX, not ${MTX} or $MTX, I don't remember which one by now. Edit the installed mtx-changer and fix that and see if that helps. It may not fix your mount problem, but it needs to be fixed in any case. # Enable the following if you are using barcodes and need an inventory ${MTX} -f $ctl inventory ${MTX} -f $ctl status ${TMPFILE} rtn=$? -- -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Capacity planning
On Tue, 24 Oct 2006, G. Armour Van Horn wrote: I've finally decided that I need to do something about network backup. I've been incredibly lucky, but I'm old enough to realize that probably won't last forever. Bacula looks like the way to go, so I'm diving in. I picked up a pair of DLT7000 drives off eBay, and went diving in the boneyard for parts. It looks like I've got an Adaptec 29160 to drive the tape drives and a 36GB hard drive, an Athlon (around 2GHz), a half gig of RAM, and a surprisingly clean case big enough to hold it all. (Alas, I blew out the power supply during Fedora Core 5 installation, larger PS arrives tomorrow for the next try.) You might take care about the 29160, as that is an LVD controller. If you bought SCSI/DIFF drives off of ebay they are probably HVD drives. For that you will need something like an Adaptec 2944 or 3944, or similar. I mention this because I didn't find anything related to capacity issues on the bacula.org website. I'll want to backup my own stuff (two smallish servers, my XP machine, two Macs), my web servers, and then I've got some clients who would really enjoy having their systems backed up remotely. Is my proposed hardware a laughable toy? Or can I really accomplish a fair amount with this, and presumably move to a loader when the volume requires it? I think it should do fine. Bacula does compression and encryption on the client machines, so the 2 GHz processor for the director should be plenty, at least in my estimation. I would very much recommend that you use spooling on the way to tape, so your 36G drive may not be enough. Drives are cheap enough now that that should not be a problem though; if it is used only for spooling and is not part of the archival storage, the reliability of a spool drive is less critical. Also, I'm no expert but I'm under the impression that PostgreSQL is the more robust option for a database, and this is definitely a case where reliability is more important than speed. Is there a significant and specific advantage of PostgreSQL or MySQL in this project? Postgres is much heavier in its requirements in my experience. For what you are doing I would think that Mysql would be more than sufficient. -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Can't write to the tape
On Wednesday 25 October 2006 17:47, Greg Little wrote: So I have installed bacula-1.38.11 I have a gentoo box with a Dell 124-T attached, LTO-2, two magazines ... SNIP ... I have tried changing sg0 to nst0 and st0, the best I can get is a 3903 ERR. For some reason I can't write to the tape. I am running udev, and with the config set to sg0/sg1, bacula waits for a mount request and then times out. Keep the changer on the sg1 device, but do change the tapes to nst?. If you are getting a 3903, you probably need to work with the installed mtx-changer script. I must apply the attached patch to the installed mtx-changer to get it to work with one of my autochangers. YMMV, but you might want to try these changes to see if that helps. This patch is against 1.39.26, which incidentally is recommended by now, so the lines may be off a bit but it will give you an idea of the changes. -- -- Michael --- mtx-changer.orig 2006-10-15 11:13:00.0 -0500 +++ mtx-changer 2006-10-15 11:15:55.0 -0500 @@ -152,7 +152,7 @@ debug Doing mtx -f $ctl unload $slot $drive # # enable the following line if you need to eject the cartridge -# mt -f $device offline + mt -f $device offline # sleep 10 ${MTX} -f $ctl unload $slot $drive ;; @@ -164,8 +164,8 @@ # # Increase the sleep time if you have a slow device # or remove the sleep and add the following: -# wait_for_drive $device - sleep 15 + wait_for_drive $device +# sleep 60 exit $rtn ;; @@ -173,7 +173,7 @@ debug Doing mtx -f $ctl -- to list volumes make_temp_file # Enable the following if you are using barcodes and need an inventory -# ${MTX} -f $ctl inventory + ${MTX} -f $ctl inventory ${MTX} -f $ctl status ${TMPFILE} rtn=$? cat ${TMPFILE} | grep *Storage Element [0-9]*:.*Full | awk {print \$3 \$4} | sed s/Full *\(:VolumeTag=\)*// - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula, Jobs and Pools
On Fri, 20 Oct 2006, Russell Sutherland wrote: 1. Are there any documented backup methodologies given the notion of full, differential and incremental backups? There are different such sample schema in the docs. 2. Given a different Pool for each client, is it possible for the Director to process two jobs, from two different clients to two different Volumes on separate pools at the same time? See 'Maximum Concurrent Jobs'. 3. Given a disk/directory of size N Gb and and a tape that can store M Gb (where N M ), how would one go about devising some backup regime, given say that it is impossible to go back B months in time to retrieve data? That depends on how far you want to go back, how many tapes you want to commit to archive, how often you keep a full, etc. There are not any simple answers to this, it all depends on what you decide you want. The genius of Bacula is that it is flexible enough to do what you want, but you have to define what you want. -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] 1.39.26 Windows zlib errors
Trying to restore some files to a Windows client, running wx-console on the Windows client, from an archive a few days ago I am seeing these errors. I am running 1.39.26. The director has the directive compression = GZIP6, and the archive was created with compressed data. I have run the sysinternals psmonitor on the Windows system and the bacula daemon is running with the zlib1.dll. I am not sure what this might mean or how to go about debugging it. Has anyone else seen this? -- Michael 19-Oct 01:11 somehost..com: Restore-Someclient.2006-10-19_01.06.37 Error: Uncompression error on file /bacula/bacula-restores/C/Program Files/somefile ERR=Zlib data error 19-Oct 01:11 somehost.com: Restore-Someclient.2006-10-19_01.06.37 Error: Uncompression error on file /bacula/bacula-restores/C/Program Files/otherfile ERR=Zlib data error - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Multiple drives / Prefer Mounted Volumes
On Wednesday 18 October 2006 10:46, John Drescher wrote: On 9/25/06, Michael Brennen [EMAIL PROTECTED] wrote: I am running current CVS. Per discussion a day or so ago, I added 'Prefer Mounted Volumes = no' to my JobDefs tonight, reloaded, and ran a couple of backups that I know use different volumes. The new parameter made no difference; drive 0 was unloaded each time and only it was used. Snippets from two job runs showing the unload/load of drive 0 are below. Have you found the solution to this as I have the same problem with a recent cvs (10-16-2006) and I find it very annoying. In a 2 drive changer with 2 volumes loaded (both for jobs that run every day) with the needed volume in the second drive bacula unloaded both tapes and then loaded the second volume to the first drive. Kern responded to this a week or two ago and explained that the current behavior we are seeing is normal, if not optimal. I have found it to be timing dependent between jobs but there isn't a good way to predict/control it. For now there isn't much choice but to accept what it is doing and hope it is optimized later. -- -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Multi-drive regress: found the problem
On Tuesday 17 October 2006 11:05, Kern Sibbald wrote: The problem with the timeout on my earlier regress tests was the AlwaysOpen parameter in the SD configuration. In the early days of my working with Bacula I had set that to off for some reason I don't remember. In my earlier regress tests I had copied my current configuration, which had AlwaysOpen as off. Your regress tests have it on. I can reproduce the problem merely by setting AlwaysOpen to off in your standard regress configuration scripts/bacula-sd-2drive.conf and running 2drive-incremental-2tape. There may be something to look at in the Bacula source but at least now I know what is causing it. Yes, this is interesting. If you have AlwaysOpen off, it is clear that Bacula depending on the timing will be *much* more likely to use only the first drive since with AlwaysOpen off and an offline in mtx-changer, the tapes are not going to stay in the drive as much. The 'mt offline' in mtx-changer until now (because I had not understood the option you describe below) has been necessary to work with the Q47, as it does not take the drive offline before issuing the unload to the changer. I've taken a quick look at the code and see no obvious reason why things should break if AlwaysOpen is off. You might try moving the offline request into Bacula code by turning if off in the mtx-changer script and and enabling OfflineOnClose (or whatever the directive is really called) in the SD. This will give better coordination with Bacula. Please let me know if you do try this. Hmmm... I had not seen that SD option and will definitely try it. I'm glad that at least you found a workaround, and a much more efficient one at that. I have been able to run a clean regress 'all-non-root-tape-tests' on the Overland, with no change to the regress scripts. I can run a clean regress on the Q47 with one mod to scripts/prepare-two-tapes to uncomment an offline. == #!/bin/sh # # Create two blank tapes # mt -f /dev/nst0 offline === uncommented /usr/sbin/mtx -f /dev/sg2 unload ... == I will keep you posted on the status of the SD changes, and thanks again. -- -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula status
On Sun, 15 Oct 2006, Kern Sibbald wrote: I'm sending this email for several reasons. One is to remind you that I will be on vacation (a real one this time) beginning now until when I am scheduled to return late the 9th of November. Bonnes vacances... et bon retour... :) 1. I have requested help setting up more community participation in testing, bug fixing, and builds of more platforms such as Solaris, FreeBSD, ... This is to ensure that all important platforms are supported better than I could do alone. Now that I understand something of the regress testing environment I can certainly participate with autochanger hardware. I only run Linux so cannot participate in alternate platforms. 2. I am working on setting up some official structure or structures for Bacula, possibly a Swiss Association, perhaps a Foundation. This will be so that in the near term (1-6 months) Bacula will have a charter and a governing board, and equally important, I plan to transfer the source and documentation copyrights, which are currently held in my name into such a permanent neutral entity. I believe this will help ensure the health, and long term survival of Bacula as Free Software, as well as to ensure that the project is less (no longer) dependent on one person (me). Rest assured, this does not at all mean that I envision decreasing my participation with the project. This all sounds reasonable to me and is encouraging that Bacula will have a long life. -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] An identical two drive failure
On Sat, 14 Oct 2006, Kern Sibbald wrote: The problem again is that Bacula does the following: * loads slot 2 into drive 1 * unloads slot 1 from drive 0 * tries to load slot 2 into drive 0 The problem is that there is no unload of slot 2 from drive 1 prior to attempting to load slot 2 into drive 0. I do not see how this can be related to mtx-changer, as mtx-changer only does what it is told. In this case mtx-changer was never told to unload slot 2 from drive 1. The mtx-changer log segments are below. These are contiguous lines in the original file; I have interleaved a few comments to try and make it easy to read. Can you email me as an attachment a regression script that does the above? Or are you saying that one of my current scripts already does this? If so, which one? The standard 2drive-incremental-2tape regression. I understand what you are saying happens, and it certainly is a bug. What I need now is to be able to reproduce it here. As I posted in the bugnotes on 687, I wonder if the simulator is not responding the same way as actual hardware to the lack of an unload. Because it is not having to move actual hardware, it might not block the same way. By the way, yes, I can read your attachments, but it is a real pain. I have to download them first. This takes time (and I have been particularly busy lately). It also makes it very hard to keep track of what is going on since it makes it hard with several attachments to have them all on the screen at the same time displayed in different tabs. You have had trouble with attachments posted from OSX and Linux, and I have not (indeed cannot!) do anything any differently. Can you read attachments posted by others from either of those systems? If not, I wonder if it might not be something in Mantis or its environment itself??? Over the past two days I put in many hours fighting a bug that in the end was fixed simply by moving from an apache v.1 to an apache v.2 server, apparently because apache2 managed the utf-8 character set better. -- Michael 20061013-17:32:23 Parms: /dev/sg14 loaded 1 /dev/nst8 0 20061013-17:32:23 Doing mtx -f /dev/sg14 0 -- to find what is loaded 20061013-17:32:34 Parms: /dev/sg14 loaded 0 /dev/nst8 0 20061013-17:32:35 Doing mtx -f /dev/sg14 0 -- to find what is loaded 20061013-17:32:44 Parms: /dev/sg14 loaded 2 /dev/nst9 1 20061013-17:32:44 Doing mtx -f /dev/sg14 1 -- to find what is loaded 20061013-17:32:44 Parms: /dev/sg14 load 2 /dev/nst9 1 20061013-17:32:44 Doing mtx -f /dev/sg14 load 2 1 20061013-17:33:03 Device /dev/nst9 - not ready, retrying 0... 20061013-17:33:04 Device /dev/nst9 - not ready, retrying 1... ... 20061013-17:33:34 Device /dev/nst9 - not ready, retrying 30... 20061013-17:33:35 Device /dev/nst9 - not ready, retrying 31... 20061013-17:33:36 Parms: /dev/sg14 loaded 2 /dev/nst9 1 *** Slot 2 successfully loaded into drive 1. 20061013-17:33:36 Doing mtx -f /dev/sg14 1 -- to find what is loaded 20061013-17:33:47 Parms: /dev/sg14 loaded 0 /dev/nst9 1 20061013-17:33:47 Doing mtx -f /dev/sg14 1 -- to find what is loaded 20061013-17:33:58 Parms: /dev/sg14 loaded 1 /dev/nst8 0 20061013-17:33:58 Doing mtx -f /dev/sg14 0 -- to find what is loaded 20061013-17:34:00 Parms: /dev/sg14 loaded 2 /dev/nst9 1 20061013-17:34:00 Doing mtx -f /dev/sg14 1 -- to find what is loaded 20061013-17:34:05 Parms: /dev/sg14 loaded 2 /dev/nst8 0 20061013-17:34:05 Doing mtx -f /dev/sg14 0 -- to find what is loaded 20061013-17:34:05 Parms: /dev/sg14 unload 1 /dev/nst8 0 20061013-17:34:05 Doing mtx -f /dev/sg14 unload 1 0 *** Slot 1 successfully unloaded from drive 0. 20061013-17:34:58 Parms: /dev/sg14 loaded 1 /dev/nst9 1 20061013-17:34:58 Doing mtx -f /dev/sg14 1 -- to find what is loaded 20061013-17:34:58 Parms: /dev/sg14 load 2 /dev/nst8 0 20061013-17:34:58 Doing mtx -f /dev/sg14 load 2 0 *** And now there is an attempt to load slot 2 into drive 0, without an intervening unload of slot 2 from drive 1. 20061013-17:34:58 Device /dev/nst8 - not ready, retrying 0... 20061013-17:34:59 Device /dev/nst8 - not ready, retrying 1... 20061013-17:35:00 Device /dev/nst8 - not ready, retrying 2... ... eventually times out ... - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly
Re: [Bacula-users] An identical two drive failure
On Sat, 14 Oct 2006, Kern Sibbald wrote: I should have specified more clearly in previous email that I am having problems distinguishing between two bug reports that you have filed. One is bug #687, which is not very clear to me, but seems to be similar to bug #689. For bug 689, I do know which test you are referring to since you explicitly mention it in the bug report, but I just would like to know if it is the problem you are referring to in this email, or if there is another test/problem. It would be helpful if I could understand which of the two bug reports (or both) that what you write here applies to -- i.e. which of the two bugs are still giving you problems? Is either one fixed? Please add the response to each of the bug reports as a bug note, then it will be clear to me if I can close one of the bugs or work on both of them. They are essentially the same bug. One was running two-pool-tape, the other 2drive-incremental-2tape, but the mtx logs show the same failure. Consolidating to #687 is fine. My apologies for the confusion; it took me some time to sort out what I was seeing and get the debug logs right to finally see the real problem with the missing unload. -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] An identical two drive failure
On Sun, 15 Oct 2006, Kern Sibbald wrote: They are essentially the same bug. One was running two-pool-tape, the other 2drive-incremental-2tape, but the mtx logs show the same failure. Consolidating to #687 is fine. Well, two-pool-tape runs fine here too, but I didn't realize it was what is failing for you so I didn't explicitly run it a bunch of times as I did for 2drive-incremental-2tape. My apologies for the confusion; it took me some time to sort out what I was seeing and get the debug logs right to finally see the real problem with the missing unload. As I mentioned, please look into the possibility that a loaded? request is returning a 0 rather than the correct value. This could explain everything. If Bacula thinks nothing is in drive 1 and drive 0 it will feel free to load any slot into either drive. This should be easy to confirm one way or another. I've not looked at the loaded? requests from my log snippets to see if these are present but will know to look for them. I am starting over with a fresh regress checkout and current bacula cvs. I will pay attention to every detail so as to try and duplicate your test conditions. I may have to change the mtx-changer script to enable the tape offline and inventory but will only uncomment what is already there. -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] An identical two drive failure
On Sun, 15 Oct 2006, Kern Sibbald wrote: On Sunday 15 October 2006 17:48, Michael Brennen wrote: I am starting over with a fresh regress checkout and current bacula cvs. I will pay attention to every detail so as to try and duplicate your test conditions. I may have to change the mtx-changer script to enable the tape offline and inventory but will only uncomment what is already there. OK. This sounds like a good approach. By the way, it is possible that the tape offline is causing some crazy timing or wierd state in the changer or in the communications between Bacula and the changer. It might be wise to look at it in detail too because here I have not enabled tape offline. I suppose I should try it, but when I get back -- at least got half of my packing done -- a real pain when you cannot take much carry-on. It has been some months since I enabled the offline, but as I recall at least the Q47 will not unload a tape that has not first been made offline. That may be a difference between DDS4 and DLT drives. A test just now on the Overland shows that it will unload a tape without the offline. I tested that just by issuing mtx load and unload commands. The same test on the Q47 shows that it does require the mt offline. An mtx unload alone will not unload a loaded tape. The difference may be whether the changer itself issues an offline if it thinks a tape is loaded, but adding the mt offline seems harmless on the Overland though it is not strictly needed. I have now run the 2drive-incremental-2tape test a couple of times without error on the Overland. This was with my standard patch to mtx-changer for the offline and wait_for_drive. I have now also run the same test a couple of times on the Q47 without error, same patch to mtx-changer. Drat... I hate needlessly taking up someone else's time. I think the only substantive difference remaining between this set and my previous tests is that I am using your DDS-4 configuration unmodified. My drives are not DDS-4, but the DDS-4 label seems to be strictly descriptive for humans, that is, Bacula does not semantically understand that as meaning a certain type of tape. I will work with this some more on my own to see if I can isolate a difference in the device configurations that causes the failures. If I find such I will post it. At least we have a reasonable conclusion before you leave. :) Thanks again, and enjoy your vacation in peace. -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Multi-drive regress: found the problem
This is primarily for Kern, though I don't know when he might see it. Hopefully by now he's already gone. The problem with the timeout on my earlier regress tests was the AlwaysOpen parameter in the SD configuration. In the early days of my working with Bacula I had set that to off for some reason I don't remember. In my earlier regress tests I had copied my current configuration, which had AlwaysOpen as off. Your regress tests have it on. I can reproduce the problem merely by setting AlwaysOpen to off in your standard regress configuration scripts/bacula-sd-2drive.conf and running 2drive-incremental-2tape. There may be something to look at in the Bacula source but at least now I know what is causing it. -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] concurrent jobs on 2 drives
On Tuesday 10 October 2006 14:50, Alan Davis wrote: Short version: What combination of directives will make bacula choose to use both drives defined in the autochanger at the same time? My short answer is that I am running different Jobs that run more or less concurrently with different Pools, thus to different Volumes. There may be other or better ways to do this, so the responses to this thread should be interesting. -- -- Michael - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Finally... a multi-drive failure
Kern, I finally have a logged logic failure. I worked with the mtx-changer script on logging, and I have a log that shows Bacula trying to load a tape into a tape drive when that tape had already been loaded into another drive, without an intervening unload. The relevant snippets from the mtx-changer log are below. I modified the mtx-changer script slightly to add the seconds count in the retrying message so I could tell where the timeout occurred. The following lines are from a single contiguous log. I have interrupted it with my own lines at *** to note the error, and I eliminated some of the many 'not ready' messages with ellipses to improve readability. No lines have been deleted except the 'not ready'. I will be glad to make available both the Bacula log and the mtx-changer log. Since I cannot seem to update into Mantis in a way that you can read, I can mail them directly or put them on an ftp site, as you wish, if you wish. -- Michael 20061010-20:34:15 Doing mtx -f /dev/sg2 0 -- to find what is loaded 20061010-20:34:15 Parms: /dev/sg2 loaded 2 /dev/nst1 1 20061010-20:34:15 Doing mtx -f /dev/sg2 1 -- to find what is loaded 20061010-20:34:16 Parms: /dev/sg2 load 2 /dev/nst1 1 20061010-20:34:16 Doing mtx -f /dev/sg2 load 2 1 *** Above is the load of slot 2 into drive 1 20061010-20:34:59 Device /dev/nst1 - not ready, retrying 0... 20061010-20:35:00 Device /dev/nst1 - not ready, retrying 1... 20061010-20:35:01 Device /dev/nst1 - not ready, retrying 2... 20061010-20:35:02 Device /dev/nst1 - not ready, retrying 3... 20061010-20:36:05 Device /dev/nst1 - not ready, retrying 65... 20061010-20:36:06 Device /dev/nst1 - not ready, retrying 66... *** At this point, slot 2 has been loaded into drive 1. 20061010-20:36:07 Parms: /dev/sg2 loaded 2 /dev/nst1 1 20061010-20:36:07 Doing mtx -f /dev/sg2 1 -- to find what is loaded 20061010-20:36:25 Parms: /dev/sg2 loaded 2 /dev/nst0 0 20061010-20:36:25 Doing mtx -f /dev/sg2 0 -- to find what is loaded 20061010-20:36:26 Parms: /dev/sg2 unload 1 /dev/nst0 0 20061010-20:36:26 Doing mtx -f /dev/sg2 unload 1 0 20061010-20:36:59 Parms: /dev/sg2 load 2 /dev/nst0 0 20061010-20:36:59 Doing mtx -f /dev/sg2 load 2 0 *** Above is the attempt is made to load slot 2 into drive 0, without an intervening unload of slot 2. 20061010-20:37:00 Device /dev/nst0 - not ready, retrying 0... 20061010-20:37:01 Device /dev/nst0 - not ready, retrying 1... 20061010-20:37:02 Device /dev/nst0 - not ready, retrying 2... 20061010-20:37:03 Device /dev/nst0 - not ready, retrying 3... 20061010-20:37:04 Device /dev/nst0 - not ready, retrying 4... ... timeout - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bad response to Append Data command
On Monday 09 October 2006 13:53, Robert Keidel wrote: I try to get bacula running on a Centos 4 running. I have VXA2 autochanger. I went through the manuals, and everything seems to work fine. I started backup job and it looked very good. After the test run, I changed my bacula-dir.conf to add another client and change what has to be backed up. After i made those changes as soon I will run a backup I get the following message. The same message appears if I use my old files. I hope someone can help me. If you need more information let me know. Robert Job started. JobId=44 09-Oct 11:48 server1-dir: Start Backup JobId 44, Job=Client1.2006-10-09_11.48.56 09-Oct 11:49 server1-sd: 3301 Issuing autochanger loaded drive 0 command. 09-Oct 11:49 server1-sd: 3302 Autochanger loaded drive 0, result: nothing loaded. 09-Oct 11:49 server1-sd: 3304 Issuing autochanger load slot 1, drive 0 command. 09-Oct 11:49 server1-fd: Client1.2006-10-09_11.48.56 Fatal error: job.c:1617 Bad response to Append Data command. Wanted 3000 OK data , got 3903 Error append data 09-Oct 11:49 server1-sd: Client1.2006-10-09_11.48.56 Fatal error: 3992 Bad autochanger load slot 1, drive 0: ERR=Child exited with code 1. 09-Oct 11:49 server1-dir: Client1.2006-10-09_11.48.56 Error: Bacula 1.38.11 (28Jun06): 09-Oct-2006 11:49:00 Welcome to the club. I am having the same trouble, perhaps coincidentally, on a Centos 4.4 system. Is yours a multi or single tape drive? Mine is a 4 drive system; I thought the problem might be related to the multiple drives, but perhaps not. I am working some with Kern on this to try to reproduce and fix it. You might look at the bug reports 687 and 689 on bugs.bacula.org; you can at least see if what you are seeing tracks my errors. -- -- Michael - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Update on single / multi drive problems
Kern, this is a brief update to the list but primarily with you in mind. Curiously, as of cvs a few days ago the system is now using multiple tape drives again, without any change at all in the configuration. For the last few days bacula is not forcing multiple jobs destined to different volumes to all go through tape drive 0. Since I always note these things after the fact it is difficult to correlate with certainty to a given update, but it *might* have been the 1.39.24 cvs. I updated cvs today to 1.39.25. I am still looking at the regression tests (against current bacula 1.39.25 cvs) and trying to understand why a particular tape load is failing but the regression test sometimes goes on to run successfully anyway. Understanding that may well take some time, as testing is interleaved with everything else going on, but I am trying to be respectful of your time. Thanks again... -- Michael - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problem with PKI Signatures
On Sun, 8 Oct 2006, Landon Fuller wrote: On Oct 2, 2006, at 11:16 PM, Michael Brennen wrote: I have not been able to run with the PKI Master Key directive; the error is something about not being able to load the private key. Your error is different, which makes me wonder if you are really running the cvs version, but you might try starting without the master key directive. Hurm. The code should only try to load the private key from a master key file if one is available. Are you sure that the master key file only contains the public key? Very sure. I exactly followed the instructions on your web site (for which thank you. :) The error is below from a current Cento4 system. ERROR in openssl.c:63 Unable to read private key from file: ERR=error:0906D06C:PEM routines:PEM_read_bio:no start line There is one key in the file, bracketed as follows. -BEGIN CERTIFICATE- the stuff -END CERTIFICATE- -- Michael - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] I need to configure two drives in oneself robot with the same archive device
On Thu, 5 Oct 2006, Pedro Sepúlveda wrote: I have a robotic library Storagetek L40 with twho drives Ultrium LTO 2. In my server I have a network card scsii. I have Red Hat Advanced Server 3.0 With this scsii I have connected the robot as the two drives in such a way that the first drive is /dev/nst0 0 and the second is /dev/nst0 1. I use this commands for example: /bacula/etc/mtx-changer / dev/sg2 loaded 0 / dev/nst1 0 and for the other one /bacula/etc/mtx-changer / dev/sg2 loaded 0 / dev/nst1 1 I don't know as configuring this in the bacula-sd.conf so that it works. Can they help me? This looks like it should work. Just be sure to reference only the 'STK-L40' device in the Storage configuration in the director, not the drives directly. You may have to modify the installed mtx-changer script per the attached patch; the patch may at least give you an idea of what might need to be changed. -- Michael # # An autochanger device with two drives # Autochanger { Name = STK-L40 Device = STK-L40-1, STK-L40-2 Changer Command = /bacula/etc/mtx-changer %c %o %S %a %d Changer Device = /dev/sg2 } Device { Name = STK-L40-1 Drive Index = 0 Media Type = Ultrium2 Archive Device = /dev/nst1 AutomaticMount = yes; AlwaysOpen = yes; RemovableMedia = yes; RandomAccess = no; AutoChanger = yes } Device { Name = STK-L40-2 Drive Index = 1 Media Type = Ultrium2 Archive Device = /dev/nst1 AutomaticMount = yes; AlwaysOpen = yes; RemovableMedia = yes; RandomAccess = no; AutoChanger = yes }--- mtx-changer 2006-09-05 12:02:54.0 -0500 +++ mtx-changer.good2006-08-11 14:37:56.0 -0500 @@ -2,7 +2,7 @@ # # Bacula interface to mtx autoloader # -# $Id: mtx-changer.in,v 1.27 2006/08/06 01:46:59 junkmale Exp $ +# $Id: mtx-changer.in,v 1.26 2006/04/21 11:25:15 kerns Exp $ # # If you set in your Device resource # @@ -132,8 +132,8 @@ debug Doing mtx -f $ctl unload $slot $drive # # enable the following line if you need to eject the cartridge -# mt -f $device offline -# sleep 10 + mt -f $device offline + sleep 10 ${MTX} -f $ctl unload $slot $drive ;; @@ -144,8 +144,8 @@ # # Increase the sleep time if you have a slow device # or remove the sleep and add the following: -# wait_for_drive $device - sleep 15 + wait_for_drive $device +# sleep 60 exit $rtn ;; @@ -153,7 +153,7 @@ debug Doing mtx -f $ctl -- to list volumes make_temp_file # Enable the following if you are using barcodes and need an inventory -# ${MTX} -f $ctl inventory + ${MTX} -f $ctl inventory ${MTX} -f $ctl status ${TMPFILE} rtn=$? cat ${TMPFILE} | grep *Storage Element [0-9]*:.*Full | awk {print \$3 \$4} | sed s/Full *\(:VolumeTag=\)*// - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula BETA 1.39.24.20061002 source + Win32 binaries release to Source Forge
On Thursday 05 October 2006 08:14, Kern Sibbald wrote: I have just released Bacula BETA 1.39.24.20061002 source and the Win32 binaries to Source Forge. This is very likely to be the last beta release or next to last release before the official 1.40 production release in the second half of November. Sorry to be a nag... :-/ I just installed 1.39.24 on a windows system and brought the director up to current cvs. I tried a restore and it failed with the same insufficient permissions that I have been seeing. The relevant configuration pieces are below. The error returned is No authorization. Pool FishNet-Daily. The problem seems to be that the Pool in the restore-archive job is not being overridden. In the configuration below, FishNet-Daily is the specified Pool. The client that I am trying to restore is in a different Pool, Another-Daily. If I set the Pool in the restore-archive job to Another-Daily the restore works. Perhaps a second restore Job is needed to specify the different Pool, but that is not described in the docs that I have found so far. -- -- Michael JobDefs { Name = DefaultJob Type = Backup Schedule = FishNet-Schedule Storage = Q47 Messages = Standard Priority = 10 SpoolData = yes } Job { Name = An-Archive JobDefs = DefaultJob Type = Backup Client = anotherhost.com FileSet = An-Archive Messages = Standard Pool = Another-Daily Storage = Q47 Schedule = Another-Schedule Maximum Concurrent Jobs = 20 } Job { Name = restore-archive Type = Restore Client= somehost.com FileSet = FishNet-Archive Storage = Q47 Pool = FishNet-Daily=== THIS IS NOT BEING OVERRIDDEN Messages = Standard Where = /backup/bacula/bacula-restores } Client { Name = anotherhost.com Address = anotherhost.com FDPort = 9102 Catalog = FishNet-Catalog Password = ?? File Retention = 30 days Job Retention = 6 months AutoPrune = yes Maximum Concurrent Jobs = 20 } Console { Name = anotherhost-user Password = ?? JobACL = An-Archive,restore-archive ClientACL = anotherhost.com StorageACL = Q47 ScheduleACL = Another-Schedule PoolACL = Another-Monthly PoolACL = Another-Weekly PoolACL = Another-Daily FileSetACL = An-Archive CatalogACL = Fishnet-Catalog CommandACL = restore } - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Regress scripts / Multi-drive use
Per Kern's request I've been trying to get the regress scripts set up to find a bug in multi-drive usage. In a 4 tape autochanger library only one tape is being used. Up to and including the 9/9/2006 beta multiple drives were being used for archives in different Pools That seems have been lost in recent versions, with no configuration changes. This is a status report on diagnosing the multi-drive problem. Kern, you mention in your README that running on a production system will overwrite the database, unless a different engine is used. I've set up with sqlite to avoid conflict with the mysql production system. What you didn't note is that the regression tests will overwrite tapes loaded in an autochanger! I saw what it was doing and stopped the test in time. You might want to add a warning about running regress on an autochanger with live archive tapes; it will use what is there without asking which ones to use. I now have a test system running with some scratch tapes. After a couple of hours I have the regress scripts built against sqlite and they are trying to run. The default test tape scripts are hard coded in many different places to run against a single drive 'DDS-4' device setup. I am modifying the various scripts and configurations to put in my 4 drive library configuration. That is slow sledding but is starting to come together. When I have something that looks like like the bug I am seeing I will turn in a bug report. -- -- Michael - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problem with PKI Signatures
On Tue, 3 Oct 2006, Albert Ferran wrote: I've tried with CVS snapshot and I've got the same error FileDaemon { # this is me Name = client-fd FDport = 9102 # where we listen for the director WorkingDirectory = /var/bacula Pid Directory = /var/run Maximum Concurrent Jobs = 20 PKI Signatures = Yes# Enable Data Signing PKI Encryption = Yes# Enable Data Encryption PKI Keypair = /etc/bacula/fd-example.pem# Public and Private Key PKI Master Key = /etc/bacula/master.cert# ONLY the Public Key } I have encryption running with 1.39.22 with the following encryption settings: FileDaemon { Name = somehost FDport = 9102 WorkingDirectory = /some/path/working Pid Directory = /some/path/working PKI Signatures = yes PKI Encryption = yes PKI Keypair = /some/path/fd_somekey.pem } I have not been able to run with the PKI Master Key directive; the error is something about not being able to load the private key. Your error is different, which makes me wonder if you are really running the cvs version, but you might try starting without the master key directive. -- Michael - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] CVS multiple drives (was Console messages and ACLs)
On Sat, 30 Sep 2006, Kern Sibbald wrote: On Saturday 30 September 2006 00:26, Michael Brennen wrote: On Friday 29 September 2006 04:36 pm, Kern Sibbald wrote: I am glad you were finally able to resolve the kernel crash; that sort of non-self-induced bug is really frustrating and disfocusing. Just for information so these are not lost, I will note again a couple of cvs bugs that I reported a few days ago. Yes, thanks. In addition to consuming an enormous amount of time, it almost killed me off. When I have a serious bug like that I cannot sleep until it is resolved -- unfortunately, I didn't recognize it as a kernel problem soon enough -- of course, I recognized the kernel was crashing, but I thought that Bacula was doing something bizarre, which seems not to be the case. What was misleading was that the last beta works fine, the current code fails. I suspect it has to do with memory placement (bigger/smaller program, I/O that crosses a page boundry, paging ...). I fully understand, as do probably many on this list. I have passed many erratic hours with situations similar to yours. Once a problem gets to that stage there is not much for it except to drive it to completion. You mentioned a few days ago that I might need to supply some sort of regression script test to demonstrate that. I don't know what such a regression script would look like or where to find examples. If you can point me to a section in the docs I will be glad to supply what information need. Yes, anything involving multiple drives is so terribly complicated that I'm obligated to ask for a test case. The first thing to do is to pull down the rescue module from the Bacula CVS. If would be *much* better if you can check it out of the CVS since you will be able to easily get any changes I make. If that doesn't work, let me know and I'll send you a tar file. Once you get it, read the README. It should be relatively self-explanatory. At that point, you should be able to run the regression scripts. Most likely you will see how easy it is to write one, if not, let me know and I'll explain some more. I'd recommend that you submit your multiple drive problem as a bug report, and attach a listing as a xxx.txt file with the SD set to debug level 50 (this should show us what the reservation system is doing). I have the CVS of 'regress' pulled down. Since it destroys the tables I will have to set up a test system for this. I am willing to do so and have the equipment but it will take a bit. In the interim, would it be helpful to simply run the SD on the current system with a debug level of 50 and send the logs? If not that's okay, I'll set up the test. -- Michael - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Console messages and ACLs
I just logged into Bacula from a client machine that has tighly restricted access. It can only access its own pools, jobs, etc. When I logged in with wx-console I was surprised by a sudden flood of queued console messages for all jobs from last night. Those messages of course give quite a bit of detail that I do not want to be seen by the typical client. Offhand I don't see a good way in the Console resource to restrict message access. Is the best option for the moment simply to disable console message support and depend on email and the logs? -- -- Michael - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Console messages and ACLs
On Friday 29 September 2006 04:41 pm, Kern Sibbald wrote: On Friday 29 September 2006 23:19, Michael Brennen wrote: Offhand I don't see a good way in the Console resource to restrict message access. Is the best option for the moment simply to disable console message support and depend on email and the logs? I just looked at the code, and this problem is very likely *much* easier to solve than I thought, in fact, I would classify it as a bug since to receive messages, the restricted console should have a messages ACL, and if it does not, it should not receive any messages. This will be fixed shortly. I just disabled all console messages in the Messages resources in the director and for the moment that will do what I need. Good news on the source ACL fixes. :) -- -- Michael - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] CVS multiple drives (was Console messages and ACLs)
On Friday 29 September 2006 04:36 pm, Kern Sibbald wrote: By the way, the current CVS has ACLs covering all the various restore options. I noted today on current cvs that the last 20 jobs list in the wx console now gives a message about sql access denied or something like that. Thanks, that will help restrict information. I am glad you were finally able to resolve the kernel crash; that sort of non-self-induced bug is really frustrating and disfocusing. Just for information so these are not lost, I will note again a couple of cvs bugs that I reported a few days ago. One problem I still see in CVS is that only one drive is used on a four drive autochanger. A couple of days ago I did send the output of some jobs showing that drive 0 was always used. You mentioned a few days ago that I might need to supply some sort of regression script test to demonstrate that. I don't know what such a regression script would look like or where to find examples. If you can point me to a section in the docs I will be glad to supply what information need. Another problem that I reported recently is that I cannot restore from an ACL restricted windows wx console. After going through the file select process and submitting the job, a message is returned that access is denied to a pool other than the one that is selected for restore. Thanks again, -- -- Michael - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] CVS multiple drives (was Console messages and ACLs)
On Friday 29 September 2006 17:39, m listus wrote: You mentioned a few days ago that I might need to supply some sort of regression script test to demonstrate that. I don't know what such a regression script would look like or where to find examples. If you can point me to a section in the docs I will be glad to supply what information need. basically, you build a script that does the operation you experience problems with. then you run it on a working version of bacula, and then on the cvs version that shows the regression. Thanks, I checked out the regress cvs and will look at it. -- -- Michael - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] CVS warning
On Wednesday 27 September 2006 04:07 pm, Kern Sibbald wrote: If for some reason you are using the current CVS, I recommend not using a bscan built from it on a Linux system (actually on any system, though it seems to run fine on Solaris and FreeBSD) until I pin point and fix the problem. For what it's worth, CVS as of yesterday is running reasonably well. As always, I will be glad to supply more information as needed. There are three known exceptions so far. As reported a couple of weeks ago in the client side encryption on a Windows system, I cannot use the master key configuration; a message is issued that complains about the private key not being found. The fd key works, the master key does not. There remains the problem I reported a few days ago of only using drive 0 of my 4 drive autochanger. I've not tried a restore from windows in the past couple of days, but as posted a few days ago I was having trouble with an incorrect pool selection after going through the file selection. -- -- Michael - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Update on CVS as of yesterday
[originally posted privately, now moving to the list] On Monday 25 September 2006 02:13 am, Kern Sibbald wrote: On Sunday 24 September 2006 20:59, Michael Brennen wrote: Yesterday midday, late evening in Europe, I pulled the latest CVS and saw that a number of files in /src had been updated. I installed the CVS version and it does appear to be working better. At least I am not getting the autochanger control faults that I was last week when I sent my log file. Well, that is good news. What does seem to be happening is that only the first drive is being used. I've included below a couple of jobs that show the tapes being changed out on drive 0, not using the others. Below those I've included the SD configuration showing the autochanger and the 4 drives. Thank you again, if you wish more information I will be happy to supply it. Whether or not Bacula uses multiple drives depends in part on your setting of Prefer Mounted Volumes (if I remember the name right), which is set in the bacula-dir.conf file. If you have this set to yes (I think that is the default), it is not going to use the other drives unless it has no choice (i.e. different pools or something that forces it). I defined Monthly, Weekly and Daily pools for each major client that I am archiving. Part of that was specifically to be able to use multiple drives to overlap backups, part of it was to be able to segregate tapes by client. Multiple drive selection and overlapped backup has been working previously without any change to the configuration scripts, certainly without changes to 'Prefer Mounted Volumes'. What I am seeing now is that if a volume is mounted in drive 0, it is unmounted and the new volume mounted in drive 0. Previously it would leave drive 0 alone and place the new volume in drive 1, etc. Unless, you can make it really obvious what is going on here, and currently, it isn't, the only real solution is to write a regression script and submit it. This is regrettable, but the SD has become so complicated now and there is only one of me for the moment, so I don't have much choice. I found the 'Prefer Mounted Volumes' parameter. I'm not certain I understand its implications about multiple Volumes, since I already have those defined, but I will work with it to see what it does. -- -- Michael - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Multiple drives / Prefer Mounted Volumes
I am running current CVS. Per discussion a day or so ago, I added 'Prefer Mounted Volumes = no' to my JobDefs tonight, reloaded, and ran a couple of backups that I know use different volumes. The new parameter made no difference; drive 0 was unloaded each time and only it was used. Snippets from two job runs showing the unload/load of drive 0 are below. This only changed in the past week or so; prior to that multiple drives were being used. Hopefully that will help isolate just what changed. Again, as always, I will be glad to supply additional information as needed. -- -- Michael 25-Sep 22:22 archive-dir: Start Backup JobId 51, Job=C-Archive.2006-09-25_22.22.24 25-Sep 22:22 someclient-fd: DIR and FD clocks differ by 6 seconds, FD automatically adjusting. 25-Sep 22:22 archive-sd: 3307 Issuing autochanger unload slot 11, drive 0 command. 25-Sep 22:23 archive-sd: 3304 Issuing autochanger load slot 10, drive 0 command. 25-Sep 22:24 archive-sd: 3305 Autochanger load slot 10, drive 0, status is OK. 25-Sep 22:24 archive-sd: 3301 Issuing autochanger loaded? drive 0 command. 25-Sep 22:24 archive-sd: 3302 Autochanger loaded? drive 0, result is Slot 10. 25-Sep 22:24 archive-sd: Volume FNI0009 previously written, moving to end of data. 25-Sep 22:26 archive-sd: Ready to append to end of Volume FNI0009 at file=18. 25-Sep 22:26 archive-sd: Spooling data ... 25-Sep 22:30 archive-dir: Start Backup JobId 52, Job=L-Archive.2006-09-25_22.30.38 25-Sep 22:30 someotherclient-fd: DIR and FD clocks differ by -12 seconds, FD automatically adjusting. 25-Sep 22:30 archive-sd: 3301 Issuing autochanger loaded? drive 0 command. 25-Sep 22:30 archive-sd: 3302 Autochanger loaded? drive 0, result is Slot 10. 25-Sep 22:30 archive-sd: 3307 Issuing autochanger unload slot 10, drive 0 command. 25-Sep 22:33 archive-sd: 3304 Issuing autochanger load slot 11, drive 0 command. 25-Sep 22:34 archive-sd: 3305 Autochanger load slot 11, drive 0, status is OK. 25-Sep 22:34 archive-sd: 3301 Issuing autochanger loaded? drive 0 command. 25-Sep 22:34 archive-sd: 3302 Autochanger loaded? drive 0, result is Slot 11. 25-Sep 22:34 archive-sd: Volume FNI0010 previously written, moving to end of data. 25-Sep 22:35 archive-sd: Ready to append to end of Volume FNI0010 at file=1. 25-Sep 22:35 archive-sd: Spooling data ... - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula client permissions
Arno Lehmann wrote: On 9/21/2006 5:03 AM, Roy Vestal wrote: Does anyone know how to keep a client from being able to restore data from another client? Specifically Windows clients? Specifics: I have 2 clients I'm testing with. Client1 is a linux machine, Client2 is a Windows machine. When I do a restore from Client2, it can see and restore data from Client1 and vice versa. How do we stop this? Use ACLs. They are set up in the console resource. As far as I know, there are some holes in them in the 1.38 versions, but the current development versions should support ACLs correctly and without leaving holes. A couple of days ago I posted on a restore not working from a windows clients running the latest CVS for director and storage daemons, and the latest windows beta client. That client is tightly ACL restricted, only 'restore' permitted and access only to the relevant pools etc., and when run in command mode the client still can see too other information that is not its own. Perhaps I've missed something, but I don't think the problems raised by Jo Rhett have been fixed yet? -- -- Michael - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Manual ejection of tape confuses bacula
On Thursday 21 September 2006 12:08 pm, Sarath Jayewardena wrote: I am experimenting to see whether bacula would be a good system for me to backup our department's servers. I am running bacula director and storage daemon on a Debian (sarge) machine which has a scsi DLT tape drive attached to it. The version of bacula is 1.36.2. It looks promising, except for one annoying, and in my view, serious problem: As a perhaps poor analogy, think of a bacula mounted medium as a mounted filesystem. You want to manually unmount a filesystem before taking it down. It isn't that the mount isn't recoverable if it gets out of sync, but things work more cleanly that way. From what I've seen over the past few weeks, bacula is an excellent choice for multi-system backup. It does take some time to learn to admin it, but that is part of why it is a good choice. The tape drive allows me to eject the tape by pressing an 'unload' button. However, afterwards, when I re-insert the tape, bacula cannot read it, so all the backup data is useless. (Of course, if I have 'unmounted' the tape from within bconsole before ejecting, bacula has no problem accessing the data afterwards.) The question is, is there any way to make bacula accept the tape if the tape was accidientally, 'improperly' ejected? In your described case it might well be as simple as mounting the drive with bconsole if you manually eject/reinsert it. Kern has emphasized to me that in the 1.39.+ releases it will be more important than ever to only make media changes with bconsole. With an autochanger that (nominally) locks closed, I find it easy enough to use bconsole to manage media in the drives; that way I can manage it all running gconsole from my linux desktop. -- -- Michael - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Manual ejection of tape confuses bacula
On Thursday 21 September 2006 01:01 pm, Sarath Jayewardena wrote: On Thu, 21 Sep 2006, Michael Brennen wrote: In your described case it might well be as simple as mounting the drive with bconsole if you manually eject/reinsert it. Thank you all you nice people offering help. This is really wonderfull. Now Michael, I also agree with your analogy with a mounted filesystem. But the problem is that even if I mounted with bconsole afterwards, it is still blocked. Bacula is waiting for appendable media to do next backups. ... I am just wondering, whether there shouldn't be a way to fix the problem if something like the above happens. With a single drive I am not sure. With an autochanger I generally use mtx to remove all the tapes from the drives back into the magazines, then run 'update slots'. There probably is an easy way to do this with a single drive, but I am not sure what it is. Perhaps someone else can help. -- -- Michael - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula client permissions
On Thursday 21 September 2006 03:34 pm, Arno Lehmann wrote: A couple of days ago I posted on a restore not working from a windows clients running the latest CVS for director and storage daemons, and the latest windows beta client. That client is tightly ACL restricted, only 'restore' permitted and access only to the relevant pools etc., and when run in command mode the client still can see too other information that is not its own. Perhaps I've missed something, but I don't think the problems raised by Jo Rhett have been fixed yet? It seems to be so. I somehow had the impression that the restrictions worked correctly, except in cases where you use multiple catalogs. Also, when I upgraded to 1.39.whatever, I had to modify the check_bacula source to take the messages regarding restrictions application into account. Running wx-console things do look tighter; I had not picked up that it is that much better, my bad. That said, if I enter 'restore' and choose option 1, I do see a list of the last 20 jobs run across all clients. This the latest 1.3.22 windows wx-console and the latest released (not cvs) director/sd on SF. -- -- Michael - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problem with Autochanger, no slots
On Tue, 19 Sep 2006, Arno Lehmann wrote: On 9/16/2006 12:19 PM, Ralf Cremer wrote: Hello, I'm new to bacula and have a problem with my autochanger. I use an AMD64 3000+ with Debian Etch AMD64 and 4GB Ram. Bacula with mysql is from this distri installed. update slots give me this error: update slots Automatically selected Storage: DLT-8k Connecting to Storage daemon DLT-8k at berlin:9103 ... 3306 Issuing autochanger slots command. Device DLT-8k has 0 slots. No slots in changer to scan. ... Then, as the user Bacula runs as, can you use the mtx-changer script? You can simply run it from the shell, the parameters are explained in the script (or implicitly in your Changer Command definition). You might look at the mtx-changer script itself; I must modify mine before it will work. A few days ago I send a patch file to the list that fixes the script for me; your mileage of course may vary. In particular it adds 'mtx inventory' to the script to read what is in the changer. If you cannot find the patch in the archives let me know off-list and I'll send it to you. -- Michael - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula Windows Fatal Error (cygwin)
On Tue, 19 Sep 2006, Abe Hernandez wrote: Have been using Bacula for about year and just started getting the following Windows error: Fatal error: c:\cygwin\home\kern\bacula\k\src\win32\filed\../../filed/backup.c:526 Network send er ror to SD. ERR=Input/output error Anyone have any ideas on how to fix this? As I read the error there isn't anything to fix here, at least from a Bacula view. The Bacula client side program cannot read that file for some reason and this is an error indicating that. This is probably permissions on the above file; depending on the windows version you may be able to read some open files, some open files may throw a similar error. -- Michael - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] 1.39.2[23] Windows restore problems
This may need to go to bacula-devel, if so please remove it as best fits. I thought to send it to bacula-users to see if others could corroborate or expand on this. I am running 1.39.22 client on a W2003 system, with the director and sd on linux, Version: 1.39.23 (16 September 2006). The backups are working fine with this machine. FWIW the backup is encrypted and client side compressed; that all ran fine last night after relabeling the tapes in uncompressed mode. The commands below are being run against a console configuration that is ACL restricted to this particular client. This is the same restricted console setup that has worked to restore in 1.38 a few weeks ago. The wx-console is not working in graphic mode in the 'restore' tab. This worked several weeks ago with the 1.38 windows client, but not with the above 1.39 versions. In wx-console restore tab graphic mode I can scan the file tree okay, select the files to restore, and when I finally click the 'restore' tab across the top to submit the job, a blank popup comes up with 'wx-console: unexpected restore question'. By then I cannot switch to the 'console' tab to see what is needed. Nothing I have entered blindly, such as pool or file name, has apparently been correct, and wx-console quickly dies. The event viewer only logs an exception c005 at address 0044fb17. So... starting up bconsole, I select: option 9: find the jobids of the most recent backup for a client. That shows the proper client and job, LD-Archive, with the correct volume FNI. I then choose option 7: enter a list of files to restore, and I enter a file, C:/bin/delete_me. That shows a bootstrap message, then shows that the proper volume FNI will be used, and 1 file is selected to be restored. Then the message below is shown and the restore aborts. No authorization. Pool FishNet-Daily. I get the same results if I choose option 5, select the most recent backup, cd to the correct area, mark the file and enter done. The problem seems to be that the wrong pool is being chosen when the job is submitted. The 'no authorization' is expected, as the ACL does not permit access to that pool. However, it should never be showing that pool. 'list media' from a fully enabled console shows FNI in a different pool, not the FishNet-Daily pool. It appears that something is wrong in the final pool select logic. I am not sure what else is needed to help isolate this. I will be glad to supply more information as required. -- -- Michael - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] RunBeforeJob / tape compression off
On Monday 18 September 2006 03:37 am, Arno Lehmann wrote: On 9/18/2006 6:30 AM, Michael Brennen wrote: It appears that the only way to turn off hardware tape compression is to have RunBeforeJob execute a script that turns off h/w tape compression with 'mt'. I did not see in either released or development documentation that there is a %? substitution for the tape device to be used for the Job about to run; for an autochanger this would allow turning off compression on just the drive to be used. Is that perhaps available but undocumented? To my knowledge - which covers DDS and DLT drives under linux better than other combinations - compression is usually enabled on a per-tape-basis. Meaning that, once the drive encounters a tape with compressed data on it, it will continue compressing data. You have to turn of compression before writing the first blocks of data to any tape to disable compression. What you set with mt is more or less only the default mode for new tapes loaded into the drive. That occurred to me sometime in the middle of the night, but only for tapes to which Bacula had already written data. I had not seen the implications that Bacula having labeled a tape in compressed mode precludes ever writing uncompressed data to it. So, it seems that using encryption with Bacula changes the way that one must think about encryption. That is fine, I just had not seen it before. I am at a reasonable point to start over by relabeling everything with h/w compression off, so that is the approach I will take. Thanks much for the thoughtful followup. -- -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Proper Autochanger configuration with different drives in same changer
On Monday 18 September 2006 12:27 pm, Pietari Hyvärinen wrote: Our Autochcanger ( dell136T) is connected to four tape drives. Two of the are older LTO-2 and the rest are LTO-3 capable drives. How I define bacula-dir to understand that there are two of each drives in same autochanger? We are using bacula version 1.38.11-3. I'm not certain, but if you want to direct different backups to different tape drives, I think you might want to define two autochanger configurations, each of which contains two tape drive devices. I doubt that there would be, but others would have to answer whether or not there might be a locking conflict referencing the same SCSI device in the two autochanger configurations. -- -- Michael - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Tape compression and encryption
I enabled encryption on 1.39.23 using the FD keys on Friday. During a full backup over the weekend I noticed that the 35/70 DLT tapes seemed to hold less than I have seen before, about 35G in one case and somewhat over 30G in another. I am wondering if the encrypted data might conflict with automatic tape hardware compression. Would it be better to turn off tape compression with encrypted data? -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Tape compression and encryption
Frank Sweetser wrote: On Sun, Sep 17, 2006 at 07:36:46PM -0500, Michael Brennen wrote: I enabled encryption on 1.39.23 using the FD keys on Friday. During a full backup over the weekend I noticed that the 35/70 DLT tapes seemed to hold less than I have seen before, about 35G in one case and somewhat over 30G in another. I am wondering if the encrypted data might conflict with automatic tape hardware compression. Would it be better to turn off tape compression with encrypted data? Given that well encrypted data should be statistically equivalent to completely random data, therefore with none of the redundancy that compression typically takes advantage of, it's unlikely that any post-encryption compression would produce signifigant results. If fd side compression is applied before encryption, that would produce good results (at the cost of even more FD cpu cycles), but tape compression probably won't buy you much of anything in either case. That was my intuition. I'll find the Bacula config to turn off hardware compression and see how that goes. Thanks much, -- -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] RunBeforeJob / tape compression off
It appears that the only way to turn off hardware tape compression is to have RunBeforeJob execute a script that turns off h/w tape compression with 'mt'. I did not see in either released or development documentation that there is a %? substitution for the tape device to be used for the Job about to run; for an autochanger this would allow turning off compression on just the drive to be used. Is that perhaps available but undocumented? It is not a problem in this case as I will simply run a script that disables compression on all four drives. I don't think it will hurt to hit each drive every time a job is run. -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Tape drive blocked / cleared
I think I can recount this accurately; again, it is a situation that came up before I was aware of it, so I'm not quite sure how I got there. I think I have cleared it up, so I thought I would post this for comment. Last night after the FNI0016 tape would not mount, apparently due to a label problem, I ended up with one of the four tape drives blocked. A stat showed this message, and bacula would not use the drive. Device is BLOCKED. User unmounted. After consulting the google oracle, the manual and list archives I did not find an exact answer to how to unblock it, but I think I finally figured it out. From a bacula console I manually mounted the relabeled FNI0016 tape into the blocked drive, which was successful. I will not know for certain until tomorrow morning, but the drive appears to be back in service now. My question is this: why did a problem with a particular tape cartridge block the tape drive? Do I understand correctly that this is what blocked the tape drive? Or is it that any user initiated umount blocks a tape drive? Sorry if this obvious or has a documented answer somewhere, I've just not been able to find it. Thanks again, one of these days I will be in a position to help answer someone else's questions. :-/ -- -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] New to Tapes
On Thursday 14 September 2006 05:01 pm, Jack wrote: I have been using bacula for over six months now to dump backups to disk. I have recently aquired a EZ17 autoloader with the AIT2 tape drive in it (a SDX500 if I'm not mistaken). ... *mount ... 3301 Issuing autochanger loaded drive 0 command. 3302 Autochanger loaded drive 0, result is Slot 2. block.c:944 Read error at file:blk 0:0 on device SDX500 (/dev/nst0). ERR=Input/output error. block.c:944 Read error at file:blk 0:0 on device SDX500 (/dev/nst0). ERR=Input/output error. This appears to be a problem with device permissions rather than bacula. What are the permissions on /dev/nst0? Does the user under which you are running bacula have sufficient permissions? Have you run the tape drive verification procedure in the bacula manual? Perhaps you have and I am coming in late on a thread, ignore if you've done all this. -- -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] New to Tapes
On Thu, 14 Sep 2006, Jack wrote: I didnt see the tape verification stuff, I'll try that now. Also I'd like to report that i got the tape to unmount successfully by putting in the mt -f $4 offline in the mtx-changer :) For what it's worth, the attached patch is one that I must apply to mtx-changer each time I install bacula, this for a Breece Hill Q47. Perhaps it will be of use to others as well for other changers, at least as a reference. Standard disclaimers apply; if you bork your script you can undo the patch. :) -- Michael--- mtx-changer 2006-09-05 12:02:54.0 -0500 +++ mtx-changer.good2006-08-11 14:37:56.0 -0500 @@ -132,8 +132,8 @@ debug Doing mtx -f $ctl unload $slot $drive # # enable the following line if you need to eject the cartridge -# mt -f $device offline -# sleep 10 + mt -f $device offline + sleep 10 ${MTX} -f $ctl unload $slot $drive ;; @@ -144,8 +144,8 @@ # # Increase the sleep time if you have a slow device # or remove the sleep and add the following: -# wait_for_drive $device - sleep 15 + wait_for_drive $device +# sleep 60 exit $rtn ;; @@ -153,7 +153,7 @@ debug Doing mtx -f $ctl -- to list volumes make_temp_file # Enable the following if you are using barcodes and need an inventory -# ${MTX} -f $ctl inventory + ${MTX} -f $ctl inventory ${MTX} -f $ctl status ${TMPFILE} rtn=$? cat ${TMPFILE} | grep *Storage Element [0-9]*:.*Full | awk {print \$3 \$4} | sed s/Full *\(:VolumeTag=\)*// - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Waiting to mount
I upgraded bacula via cvs to 1.39.23 today, restarted everything fresh, ran 'update slots', and started a job that wants volume FNI0016. It does issue the autochanger command to load the tape, it does load it and it is in the drive. bacula knows about it, but it also wants it to be mounted. I ran another job that wants another tape, and it worked without problem. I've posted some info below, glad to post more as helpful. -- Michael Device status: Autochanger Q47 with devices: Drive-0 (/dev/nst0) Drive-1 (/dev/nst1) Drive-2 (/dev/nst2) Drive-3 (/dev/nst3) Device FileStorage (/backup/bacula) is not open. Device Drive-0 (/dev/nst0) open but no Bacula volume is mounted. Device is BLOCKED waiting for mount of volume FNI0016. Slot 20 is loaded in drive 0. Total Bytes Read=0 Blocks Read=0 Bytes/block=0 Positioned at File=0 Block=0 Device Drive-1 (/dev/nst1) is not open. Drive 1 status unknown. Device Drive-2 (/dev/nst2) is not open. Drive 2 status unknown. Device Drive-3 (/dev/nst3) is not open. Drive 3 status unknown. In Use Volume status: FNI0016 on device Drive-0 (/dev/nst0) 13-Sep 16:35 archive-sd: 3305 Autochanger load slot 20, drive 0, status is OK. 13-Sep 16:35 archive-sd: 3301 Issuing autochanger loaded? drive 0 command. 13-Sep 16:35 archive-sd: 3302 Autochanger loaded? drive 0, result is Slot 20. 13-Sep 16:35 archive-sd: 3301 Issuing autochanger loaded? drive 0 command. 13-Sep 16:35 archive-sd: 3302 Autochanger loaded? drive 0, result is Slot 20. 13-Sep 16:35 archive-sd: 3301 Issuing autochanger loaded? drive 0 command. 13-Sep 16:35 archive-sd: 3302 Autochanger loaded? drive 0, result is Slot 20. 13-Sep 16:35 archive-sd: 3301 Issuing autochanger loaded? drive 0 command. 13-Sep 16:35 archive-sd: 3302 Autochanger loaded? drive 0, result is Slot 20. 13-Sep 16:35 archive-sd: 3301 Issuing autochanger loaded? drive 0 command. 13-Sep 16:35 archive-sd: 3302 Autochanger loaded? drive 0, result is Slot 20. 13-Sep 16:35 archive-sd: 3301 Issuing autochanger loaded? drive 0 command. 13-Sep 16:35 archive-sd: 3302 Autochanger loaded? drive 0, result is Slot 20. 13-Sep 16:35 archive-sd: 3301 Issuing autochanger loaded? drive 0 command. 13-Sep 16:35 archive-sd: 3302 Autochanger loaded? drive 0, result is Slot 20. 13-Sep 16:35 archive-sd: 3301 Issuing autochanger loaded? drive 0 command. 13-Sep 16:35 archive-sd: 3302 Autochanger loaded? drive 0, result is Slot 20. 13-Sep 16:35 archive-sd: 3301 Issuing autochanger loaded? drive 0 command. 13-Sep 16:35 archive-sd: 3302 Autochanger loaded? drive 0, result is Slot 20. 13-Sep 16:35 archive-sd: Please mount Volume FNI0016 on Storage Device Drive-0 (/dev/nst0) for Job NN-Archive.2006-09-13_16.33.14 - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Followup on mount request
A quick followup on the mount request mail I just sent... Using the console I unmounted and remounted that volume, and it still asks for a mount. Current status is below. -- Michael Running Jobs: JobId Level Name Status == 138 Increme NN-Archive.2006-09-13_16.33.14 is waiting for a mount request Device status: Autochanger Q47 with devices: Drive-0 (/dev/nst0) Drive-1 (/dev/nst1) Drive-2 (/dev/nst2) Drive-3 (/dev/nst3) Device FileStorage (/backup/bacula) is not open. Device Drive-0 (/dev/nst0) open but no Bacula volume is mounted. Device is BLOCKED waiting for mount of volume FNI0016. Slot 20 is loaded in drive 0. Total Bytes Read=0 Blocks Read=0 Bytes/block=0 Positioned at File=0 Block=0 Device Drive-1 (/dev/nst1) is not open. Drive 1 status unknown. Device Drive-2 (/dev/nst2) is not open. Drive 2 status unknown. Device Drive-3 (/dev/nst3) is not open. Drive 3 status unknown. In Use Volume status: FNI0016 on device Drive-0 (/dev/nst0) - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Followup on mount request
On Wednesday 13 September 2006 05:16 pm, Arno Lehmann wrote: Hi, On 9/13/2006 11:59 PM, Michael Brennen wrote: A quick followup on the mount request mail I just sent... Using the console I unmounted and remounted that volume, and it still asks for a mount. Current status is below. Could you give the outout from the unmount and mount commands, and from 'sta sd=Q47'? The current status command output was already below. :) I will add the full set of messages at the end of this mail. A question: how can I verify the volume label on this tape, FNI0016? Perhaps that is not correct? If Bacula really is aware that the correct tape is loaded and everything else - media types, pool, slot, etc. - fits I'd be astonished. I suspect that either the tape loaded from slot 20 is not the volume requested ('update slots' command in that case!), that the tape label can not be read, that the slot number is wrong 0-based vs. 1-based?) or something like this. In an earlier mail I noted that I had run 'update slots' from a fresh bacula start, so that should match. Might be a bug, too, and then you'd need more details for the report anyway :-) Fair enough. :) Running Jobs: JobId Level Name Status == 138 Increme NN-Archive.2006-09-13_16.33.14 is waiting for a mount request Device status: Autochanger Q47 with devices: Drive-0 (/dev/nst0) Drive-1 (/dev/nst1) Drive-2 (/dev/nst2) Drive-3 (/dev/nst3) Device FileStorage (/backup/bacula) is not open. Device Drive-0 (/dev/nst0) open but no Bacula volume is mounted. Device is BLOCKED waiting for mount of volume FNI0016. Slot 20 is loaded in drive 0. Total Bytes Read=0 Blocks Read=0 Bytes/block=0 Positioned at File=0 Block=0 Device Drive-1 (/dev/nst1) is not open. Drive 1 status unknown. Device Drive-2 (/dev/nst2) is not open. Drive 2 status unknown. Device Drive-3 (/dev/nst3) is not open. Drive 3 status unknown. In Use Volume status: FNI0016 on device Drive-0 (/dev/nst0) Device status: Autochanger Q47 with devices: Drive-0 (/dev/nst0) Drive-1 (/dev/nst1) Drive-2 (/dev/nst2) Drive-3 (/dev/nst3) Device FileStorage (/backup/bacula) is not open. Device Drive-0 (/dev/nst0) open but no Bacula volume is mounted. Device is BLOCKED waiting for mount of volume FNI0016. Slot 20 is loaded in drive 0. Total Bytes Read=0 Blocks Read=0 Bytes/block=0 Positioned at File=0 Block=0 Device Drive-1 (/dev/nst1) is not open. Drive 1 status unknown. Device Drive-2 (/dev/nst2) is not open. Drive 2 status unknown. Device Drive-3 (/dev/nst3) is not open. Drive 3 status unknown. In Use Volume status: FNI0016 on device Drive-0 (/dev/nst0) umount The defined Storage resources are: 1: LocalDisk 2: Q47 Select Storage resource (1-2): 2 Enter autochanger drive[0]: 0 3307 Issuing autochanger unload slot 20, drive 0 command. 3001 Device Drive-0 (/dev/nst0) unmounted. mount The defined Storage resources are: 1: LocalDisk 2: Q47 Select Storage resource (1-2): 2 Enter autochanger drive[0]: 0 Enter autochanger slot: 20 3301 Issuing autochanger loaded? drive 0 command. 3302 Autochanger loaded? drive 0, result: nothing loaded. 3304 Issuing autochanger load slot 20, drive 0 command. 3305 Autochanger load slot 20, drive 0, status is OK. 3301 Issuing autochanger loaded? drive 0 command. 3302 Autochanger loaded? drive 0, result is Slot 20. 3905 Device Drive-0 (/dev/nst0) open but no Bacula volume is mounted. If this is not a blank tape, try unmounting and remounting the Volume. 13-Sep 17:29 archive-sd: 3301 Issuing autochanger loaded? drive 0 command. 13-Sep 17:29 archive-sd: 3302 Autochanger loaded? drive 0, result is Slot 20. 13-Sep 17:29 archive-sd: 3301 Issuing autochanger loaded? drive 0 command. 13-Sep 17:29 archive-sd: 3302 Autochanger loaded? drive 0, result is Slot 20. 13-Sep 17:30 archive-sd: Please mount Volume FNI0016 on Storage Device Drive-0 (/dev/nst0) for Job Labdepotinc-Archive.2006-09-13_16.33.14 stat storage=Q47 Device status: Autochanger Q47 with devices: Drive-0 (/dev/nst0) Drive-1 (/dev/nst1) Drive-2 (/dev/nst2) Drive-3 (/dev/nst3) Device FileStorage (/backup/bacula) is not open. Device Drive-0 (/dev/nst0) open but no Bacula volume is mounted. Device is BLOCKED waiting for mount of volume FNI0016. Slot 20 is loaded in drive 0. Total Bytes Read=0 Blocks Read=0 Bytes/block=0 Positioned at File=0 Block=0 Device Drive-1 (/dev/nst1) is not open. Drive 1 status unknown. Device Drive-2 (/dev/nst2) is not open. Drive 2 status unknown. Device Drive-3 (/dev/nst3) is not open. Drive 3 status unknown. In Use Volume status: FNI0016 on device Drive-0 (/dev/nst0) - Using Tomcat
[Bacula-users] Tape mount problem update/resolution
I was able just now to work further with the FNI0016 tape that was not mounting. I purged and relabeled that particular tape, and now it is mounting. All I can figure is that the tape label was lost somehow. I don't remember a specific incident where that would have happened, but I have had a couple of SCSI events that may have done something I did not understand at the time. Kern, thank you again; I hate to waste time with non-problems, and as I learn more about administering Bacula I will know much more quickly how to work with specific situations. The more I work with Bacula the more I come to respect its depth. -- Michael Device status: Autochanger Q47 with devices: Drive-0 (/dev/nst0) Drive-1 (/dev/nst1) Drive-2 (/dev/nst2) Drive-3 (/dev/nst3) Device FileStorage (/backup/bacula) is not open. Device Drive-0 (/dev/nst0) is mounted with Volume=FNI0016 Pool=NN-Daily Slot 20 is loaded in drive 0. Total Bytes Read=129,024 Blocks Read=2 Bytes/block=64,512 Positioned at File=0 Block=0 Device Drive-1 (/dev/nst1) is not open. Drive 1 status unknown. Device Drive-2 (/dev/nst2) is not open. Drive 2 status unknown. Device Drive-3 (/dev/nst3) is not open. Drive 3 status unknown. In Use Volume status: FNI0016 on device Drive-0 (/dev/nst0) - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] fatal error--Bacula wants tape to be in the other drive in autochanger
[EMAIL PROTECTED] wrote: I'm running into a frequent situation where Bacula wants a given volume to be in one drive of our autochanger, and it doesn't seem to find the volume when it's already in the other drive. This is with Bacula 1.38.9, under Linux (FC1), with a 23-slot, 2 drive autochanger and mysql5. I have seen the same thing and posted to that effect last week. I am running CVS, and last week's post would have been about 1.39.20. -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] FD Encryption
Configuring for encryption in current CVS, I've followed Landon's web page and set up a master key/cert pair and a fd pem file for a particular host. If I only specify the fd key with 'PKI Keypair' Bacula loads and starts. If I include the 'PKI Master Key' directive with just the public key, the FD will not start; it gives an error: Unable to read private key from file: ERR=error:0906D06C:PEM routines:PEM_read_bio:no start line Anyone have any ideas what to fix here? -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Multi-tape drive status mismatch
I am seeing some inconsistency between what the SD thinks it has loaded in the tape drives and what is actually loaded. The 'stat storage=Q47' output below shows that Drive-2 has slot 11 loaded. That drive is not in fact loaded and volume FNI0010, which corresponds to slot 11, is in the magazine. I noticed a similar situation a couple of days ago, and it took some tinkering to get Bacula to show that there was no tape loaded in Drive-2 in order to load another volume and continue the backup. I have not yet collected enough information to be able to say just what is happening, but I will stay with it. This is more to see if anyone else is seeing similar results. In last night's logs I do see attempts to unload slot 11 from drive 1, both of which resulted in an error exit. I know that when I left last night all tape drives were empty, all tapes were in the magazine, and I had run an 'update slots' so Bacula would know where everything was. In the state in which I left it, I do not think it should have tried to unload slot 11 from drive 1. If I am not doing something correctly I will happily learn what it is, or post config files as needed to help sort it out. I am running CVS as of a few days ago. I just updated CVS and noticed that a number of files have changed; I may try upgrading today and watching results tonight. Thanks again, this is nice software. -- Michael Current 'stat storage=Q47' command: Autochanger Q47 with devices: Drive-1 (/dev/nst0) Drive-2 (/dev/nst1) Drive-3 (/dev/nst2) Device FileStorage (/backup/bacula) is not open. Device Drive-1 (/dev/nst0) is mounted with Volume=FNI0015 Pool=FishNet-Daily Slot 16 is loaded in drive 0. Total Bytes=754,790,400 Blocks=11,699 Bytes/block=64,517 Positioned at File=1 Block=29 Device Drive-2 (/dev/nst1) is not open. Slot 11 is loaded in drive 1. Device Drive-3 (/dev/nst2) is not open. Slot -1 is loaded in drive 2. References to slot 11 in the logs from last night: 08-Sep 03:53 archive-sd: 3307 Issuing autochanger unload slot 11, drive 1 command. 08-Sep 03:55 archive-sd: 3995 Bad autochanger unload slot 11, drive 1: ERR=Child exited with code 1. 08-Sep 03:55 archive-sd: 3301 Issuing autochanger loaded? drive 0 command. 08-Sep 03:55 archive-sd: 3302 Autochanger loaded? drive 0, result: nothing loaded. 08-Sep 03:55 archive-sd: 3301 Issuing autochanger loaded? drive 0 command. 08-Sep 03:55 archive-sd: 3302 Autochanger loaded? drive 0, result: nothing loaded. 08-Sep 03:55 archive-sd: 3301 Issuing autochanger loaded? drive 0 command. 08-Sep 03:55 archive-sd: 3302 Autochanger loaded? drive 0, result: nothing loaded. 08-Sep 03:55 archive-sd: 3307 Issuing autochanger unload slot 11, drive 1 command. 08-Sep 03:57 archive-sd: 3995 Bad autochanger unload slot 11, drive 1: ERR=Child exited with code 1. 08-Sep 03:57 archive-sd: Please mount Volume FNI0010 on Storage Device Drive-1 (/dev/nst0) for Job BackupCatalog.2006-09-08_03.50.00 - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Scratch Pool Question
On Tue, 5 Sep 2006, Uwe Schuerkamp wrote: I have a question regarding the scratch pool: The docs note that a volume from the scratch pool will be used whenever no other volume is available. Will this work for a tape-based pool (storage=DLT8000), too? Yes. i'd like bacula to switch to a disk-based full backup whenever no tape volume is either available nor eligible for recycling, so I was wondering if the scratch pool definition could be used for something like this. I do not think that Bacula has this capability to switch media, but others will know that much better than me. -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] list volumes / list media shows volumes and media from other catalogs
On Thu, 17 Aug 2006, Kern Sibbald wrote: On Thursday 17 August 2006 18:41, Jo Rhett wrote: On Wed, Aug 16, 2006 at 08:49:19AM +0200, Kern Sibbald wrote: On Wednesday 16 August 2006 00:48, Jo Rhett wrote: After using bacula a lot today to do cleanup of some testing I did, I've found that ALL Pools *always* show up everywhere. No matter what command you use, or what catalog you are in. In there any way to associate pools with catalogs, such that pools don't show up in the list if they have no media in that catalog? Or am I thinking about Pools and Catalogs all wrong? I agree this should be changed as it could be very confusing to users at least at first, but it will require someone to write some code. I'm your huckleberry :-) Anything jump out of your mind on things to avoid? No, it seems to me to be straight forward: when Bacula is iterating through the list of Pool resources, it just needs to be made smart enough to skip pools that are defined in a different catalog. That should solve the confusion problem. I had not made the connection between Jo's recent post and my request yesterday about restricting clients to certain areas; I am new enough to Bacula that I am still learning to think about all the Bacula entities and their relationships. I think Jo's desired mod would address my question as well, if I've understood correctly. I am running the CVS version and would be very willing to test out any fixes posted. -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] label command works, but not label barcodes
On Thu, 17 Aug 2006, Erik Dykema wrote: Everything is working normally in all respects but one: When I issue the label command, and give bacula a tape name, a slot number, and a drive number, it successfully labels tapes. Example pasted below (example 1 - working). However, when I use the 'label barcodes' command, everything seems to be about to work, but then a weird error pops up which looks like: 3301 Issuing autochanger loaded drive 0 command. 3991 Bad autochanger loaded drive 0 command: ERR=Child exited with code 1. FWIW... I must modify the installed mtx-changer script to enable the 'inventory' command; it is commented by default. You might check to see if enabling this in your installed script helps. -- Michael list) debug Doing mtx -f $ctl -- to list volumes make_temp_file # Enable the following if you are using barcodes and need an inventory ${MTX} -f $ctl inventory this line ${MTX} -f $ctl status ${TMPFILE} - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Autochanger problem
On Fri, 18 Aug 2006, Daniel Vesely wrote: i have an VXA2 10U autochanger with 10 slots 1-10 but bacula think that slots is 0-9 - so where i have setup that the slots start from slot 1? My autochanger numbers from one, and Bacula is working with it without problem. -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Securing backups from inappropriate restores
On Fri, 18 Aug 2006, Simon Tomlinson wrote: I would like to configure Bacula so that individual clients can only restore their own data (using bconsole on their own machines). At the moment the setup I have seems to allow restore of backups originating from any machine. What is the best way to restrict the restores? There was a recent discussion on this. Presently Bacula does not restrict client access, as you have seen. There may be an addition to the development version soon that, if I've understood correctly, will restrict access by a given client to archives within its Catalog. With this design, when the code is available you would define one Catalog per client. -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] restricted consoles doesn't limit restores?
On Sat, 19 Aug 2006, Jo Rhett wrote: But when I try to run a restore, I see the following. Note that none of these jobs are even in the same catalog as this client: On Sat, Aug 19, 2006 at 01:53:14PM -0500, Michael Brennen wrote: Have you tried setting the FileSetACL to only the FileSet for that particular client, instead of *all*? I set the FileSetACL to only the FileSet for that particular client, and that is the only one visible from the restricted client. Yep, and list last 20 jobs still shows unrelated jobs that use different filesets. I finally understand the difference that you and I were seeing. I was using the wx-console on windows. When in restore mode it only shows that particular client's job and file set. When using bconsole, restricted to the 'restore' command, the last 20 jobs shows jobs not from that particular client. While not foolproof, for now I will only install the wx-console on the client side systems for now. -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] restricted consoles doesn't limit restores?
On Sat, 19 Aug 2006, Jo Rhett wrote: In a previous message, Kern said: Maybe I am misunderstanding the request, because Bacula has since quite some time had very fine grain control of Client access. There is perhaps some need for improvement of where the user can restore the files so that he/she is not able to clobber other users files, but other than that, as far as I know it all works fine. Restricted Consoles and Bacula Director Access control lists ... So I did some testing using the examples from the documentation and came up with this test of my personal machine: Console { Name = triceratops.lizardarts.com-console Password = *removed* JobACL = triceratops.lizardarts.com ClientACL = triceratops.lizardarts.com-fd StorageACL = Disk_clients ScheduleACL = *all* PoolACL = clients_Pool FileSetACL = *all* CatalogACL = clientsCatalog CommandACL = restore } This works fine on the surface. I can connect only if the passwords are right. I can only run the commands that are listed in the command acl. If I use the run command it immediately goes directly to my one and only backup job. Good so far. But when I try to run a restore, I see the following. Note that none of these jobs are even in the same catalog as this client: Have you tried setting the FileSetACL to only the FileSet for that particular client, instead of *all*? I set the FileSetACL to only the FileSet for that particular client, and that is the only one visible from the restricted client. -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Autochanger problem
On Fri, 18 Aug 2006, Daniel Vesely wrote: i have an VXA2 10U autochanger with 10 slots 1-10 but bacula think that slots is 0-9 - so where i have setup that the slots start from slot 1? My autochanger numbers from one, and Bacula is working with it without problem. -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Securing backups from inappropriate restores
On Fri, 18 Aug 2006, Simon Tomlinson wrote: I would like to configure Bacula so that individual clients can only restore their own data (using bconsole on their own machines). At the moment the setup I have seems to allow restore of backups originating from any machine. What is the best way to restrict the restores? There was a recent discussion on this. Presently Bacula does not restrict client access, as you have seen. There may be an addition to the development version soon that, if I've understood correctly, will restrict access by a given client to archives within its Catalog. With this design, when the code is available you would define one Catalog per client. -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Securing backups from inappropriate restores
On Fri, 18 Aug 2006, Kern Sibbald wrote: Maybe I am misunderstanding the request, because Bacula has since quite some time had very fine grain control of Client access. There is perhaps some need for improvement of where the user can restore the files so that he/she is not able to clobber other users files, but other than that, as far as I know it all works fine. Restricted Consoles and Bacula Director Access control lists ... On Friday 18 August 2006 16:58, Michael Brennen wrote: On Fri, 18 Aug 2006, Simon Tomlinson wrote: I would like to configure Bacula so that individual clients can only restore their own data (using bconsole on their own machines). At the moment the setup I have seems to allow restore of backups originating from any machine. What is the best way to restrict the restores? There was a recent discussion on this. Presently Bacula does not restrict client access, as you have seen. There may be an addition to the development version soon that, if I've understood correctly, will restrict access by a given client to archives within its Catalog. With this design, when the code is available you would define one Catalog per client. http://www.bacula.org/rel-manual/Console_Configuration.html#SECTION000184000 Nice I just set up a configuration per the above instructions, and it will do exactly what I wanted. I was able to restrict a client to just its own archive set and the monthly/weekly/daily pools. I didn't know that these controls existed until now. Thanks much for the followup. -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] list volumes / list media shows volumes and media from other catalogs
On Thu, 17 Aug 2006, Kern Sibbald wrote: On Thursday 17 August 2006 18:41, Jo Rhett wrote: On Wed, Aug 16, 2006 at 08:49:19AM +0200, Kern Sibbald wrote: On Wednesday 16 August 2006 00:48, Jo Rhett wrote: After using bacula a lot today to do cleanup of some testing I did, I've found that ALL Pools *always* show up everywhere. No matter what command you use, or what catalog you are in. In there any way to associate pools with catalogs, such that pools don't show up in the list if they have no media in that catalog? Or am I thinking about Pools and Catalogs all wrong? I agree this should be changed as it could be very confusing to users at least at first, but it will require someone to write some code. I'm your huckleberry :-) Anything jump out of your mind on things to avoid? No, it seems to me to be straight forward: when Bacula is iterating through the list of Pool resources, it just needs to be made smart enough to skip pools that are defined in a different catalog. That should solve the confusion problem. I had not made the connection between Jo's recent post and my request yesterday about restricting clients to certain areas; I am new enough to Bacula that I am still learning to think about all the Bacula entities and their relationships. I think Jo's desired mod would address my question as well, if I've understood correctly. I am running the CVS version and would be very willing to test out any fixes posted. -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] list volumes / list media shows volumes and media from other catalogs
On Thu, 17 Aug 2006, Jo Rhett wrote: On Thu, Aug 17, 2006 at 01:54:55PM -0500, Michael Brennen wrote: I had not made the connection between Jo's recent post and my request yesterday about restricting clients to certain areas; I am new enough to Bacula that I am still learning to think about all the Bacula entities and their relationships. I think Jo's desired mod would address my question as well, if I've understood correctly. I am running the CVS version and would be very willing to test out any fixes posted. Hm. This matters to me, but I'm leaving for vacation next week so don't hold your breath on this fix. I understand, will be glad to help with whatever you pull together whenever that is. -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Separating archives from each other
I am fairly new to Bacula. I have it running well with multiple jobs and clients with a Breece Hill Q47 (4 DLT / 60 slot) autochanger. I am running the latest CVS code, as I want to be able to work with some of the new options as of 1.39. In restoring an archived file from a windows system wx console recently, I noticed that the full set of jobs, for all clients, is available to choose from. I did not actually try to restore a file from a different job/client, but it appears that it would be possible to do so. Would grouping systems into different catalogs restrict a given client to see only what is in that catalog? I cannot tell from the docs what creating different catalogs does, and right now I don't want to disrupt the operation by creating different experimental configurations. Thanks much, -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Archive over slow links / job migration
For several years I have been doing my own D2D2T scheme based on rsync/tar. I have a large capacity disk system in the office that archives systems with rsync across a T1 to the colo cabinets. That is where rsync really is useful, as its differential transfer is so efficient. I am maintaining give or take 150 GB over the T1, with seldom more than 2-3 hours of transfer time in the middle of the night. From the disk I was then spinning things off to tape in my own scheme. For the unix systems I think I will continue to use the rsync method to first stage the archive to disk, then using Bacula to maintain a standard set of full/incremental archives of the disk snapshots. With this system the transfer over the T1 is always a differential transfer, but I can also maintain a hierarchical tape archive set with Bacula. I really like that Bacula has a windows client that can archive ownership and ACLs. However, to archive the windows systems with Bacula means that I must now do the full/incremental archives within the native Bacula scheme of things, which will require that full archives happen periodically over the T1 (or 6 mbit DSL, or whatever relatively much-slower-than-LAN link I pull in to the office). My question is this: will Bacula job migration allow the sort of split use that I am doing for the unix systems? That is, will it be possible, once a full transfer is done, to always do an incremental archive D2D across the T1, then a hierarchical full/incremental D2T scheme on the office LAN? Said another way, I do not see that a job can mount a Bacula disk archive as a client file set to then spin to tape. Again, thanks for any insight that someone can give. -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Archive over slow links / job migration
On Wed, 16 Aug 2006, Matt Cowger wrote: On Aug 16, 2006, at 12:20 PM, Michael Brennen wrote: Said another way, I do not see that a job can mount a Bacula disk archive as a client file set to then spin to tape. This could be possible using a 'RunBeforeJob' script that would loopback mount the disk archive, run the backup with the mount point set as the File Include paramter (and onefs=yes), then a RunAfterJob script the unmount it. I thought about that but dismissed it because I didn't think the Bacula disk archive file would have a file system type that mount would understand. What is the filesystem type? If this works it might well be an excellent answer, thanks. -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Archive over slow links / job migration
On Wed, 16 Aug 2006, Mike wrote: On Wed, 16 Aug 2006, Michael Brennen might have said: My question is this: will Bacula job migration allow the sort of split use that I am doing for the unix systems? That is, will it be possible, once a full transfer is done, to always do an incremental archive D2D across the T1, then a hierarchical full/incremental D2T scheme on the office LAN? What about a linux or aix box mounting a cifs filesystem, then using rsync from that filesystem to your local disk store? The problem with that is that if the file is ever stored on a unix disk system it loses the windows native ownership and ACLS. If I didn't care about ownership and ACLs I could just run rsync as a service on the remote windows boxes. I already do that in a couple of cases just to preserve the data, but it does lose ACLs and ownership. However... you did trigger a possible different approach. I've implemented the new free VMware server in a couple of internal projects. http://www.vmware.com/products/server/ I think I have a spare windows nt license that I could run on a VM, then rsync between the windows systems. That might preserve the ACLs. I'll have to play with that. Thanks for the response. -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Q47 works / small syntax fix
Hello, I am new to the list as I just recently began using Bacula a couple of weeks ago. I am using Bacula with a Breece Hill Q47 with four DLT7000 drives; it is working well, so that can be added to the list of autochangers that work with Bacula. Since I am not really in production yet I decided to do a fresh installation of the 1.39 test release. I will know tonight if it works, will keep the list posted on problems I see. I found a small syntax error on line 156 of mtx-changer. This is the inventory line, and it is normally commented. The MTX variable is wrapped in () rather than {}. -- Michael - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users