Re: [Bacula-users] data error... buffer discarded
Hi, 11.07.2007 03:30,, Charles Sprickman wrote:: Hi all, I'm doing my first live backup and the first host seems to have gone alright, but there's one error in the run that is not clear to me: 10-Jul 20:40 devel2-sd: devel2.2007-07-10_20.39.56 Error: block.c:275 Volume data error at 0:0! Wanted ID: BB02, got . Buffer discarded. I'm guessing it's not fatal since the job continued, but what is that error telling me? I've got bacula set to spool everything before going to tape since I'm running most of my data off a slow wan link. Here's the message in context: 10-Jul 20:39 devel2-dir: No prior Full backup Job record found. 10-Jul 20:39 devel2-dir: No prior or suitable Full backup found in catalog. Doing FULL backup. 10-Jul 20:39 devel2-dir: Start Backup JobId 3, Job=devel2.2007-07-10_20.39.56 10-Jul 20:40 devel2-dir: Created new Volume Monthly0001 in catalog. 10-Jul 20:40 devel2-sd: devel2.2007-07-10_20.39.56 Error: block.c:275 Volume data error at 0:0! Wanted ID: BB02, got . Buffer discarded. 10-Jul 20:40 devel2-sd: Labeled new Volume Monthly0001 on device TapeStorage (/dev/nsa0). 10-Jul 20:40 devel2-sd: Wrote label to prelabeled Volume Monthly0001 on device TapeStorage (/dev/nsa0) 10-Jul 20:40 devel2-sd: Spooling data ... Any ideas on this? That's just Bacula labeling a new volume. I tries to verify if the volume in question is already a Bacula-labeled volume, and doesn't find it's header. This is normal and expected when labeling volumes. Arno Thanks, Charles - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Arno Lehmann IT-Service Lehmann www.its-lehmann.de - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] confused by automatic purging
On Tue, 10 Jul 2007 10:50:46 -0700, Craig White said: I have a 3 week rotation with a full backup each Friday and differential backups every weekday. Last night, upon execution, the 1_Monday_Week_1 AND 1_Monday_Week_2 were both purged and it shouldn't have purged 1_Monday_Week_2 from my backup logs... 09-Jul 20:00 SRV1: Start Backup JobId 91, Job=SRV1Backup.2007-07-09_20.00.00 09-Jul 20:00 SRV1: Pruned 3 Jobs on Volume 1_Monday_Week_1 from catalog. 09-Jul 20:00 SRV1: ua_purge.c:611 All records pruned from Volume 1_Monday_Week_1; marking it Purged 09-Jul 20:00 SRV1: ua_purge.c:611 All records pruned from Volume 1_Monday_Week_2; marking it Purged 09-Jul 20:00 SRV1: Recycled volume 1_Monday_Week_1 09-Jul 20:00 SRV1: Recycled volume 1_Monday_Week_1 on device DDS-4 (/dev/nst0), all previous data lost. My MondayPool is defined as... Pool { Name = MondayPool Pool Type = Backup Recycle = yes AutoPrune = yes Volume Retention = 19d Volume Use Duration = 4d Maximum Volume Jobs = 5 } and according to list media... | MediaId | VolumeName | VolStatus | Enabled | VolBytes | VolFiles | VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten | +-+-+---+-++--+--+-+--+---+---+-+ | 2 | 1_Monday_Week_2 | Purged| 1 | 25,815,250,944 | 26 |1,641,600 | 1 |0 | 1 | DDS-4 | 2007-06-25 22:07:04 | My 1_Monday_Week_2 was last written on 6/25/2007 which is clearly not 19 days of Volume Retention. Is there something wrong with my understanding of this? # rpm -qa|grep bacula bacula-mysql-2.0.3-1 bacula-mtx-2.0.3-1 bacula-wxconsole-2.0.3-1 bacula-gconsole-2.0.3-1 Do you have previous logs still? If so, check for other messages about 1_Monday_Week_2, because it looks like all the jobs had been removed before it ran the above. Also, maybe they were removed with the delete command? __Martin - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Nasty Gotcha with bacula
John Huttley wrote: No DNS, no connect, no bacula, no restoring dns files! Tip #1: All infrastructure needed for a correct backup/restore should go in /etc/hosts on all clients beeing backed up. Make this a documented routine as you roll out your backup software on all the clients. Tip #2: If possible, use a dedicated internal network for backup (and surveilance). regards, -- Infogate AB [EMAIL PROTECTED] Storgatan 29 tel: 035-171970 Box 345fax: 035-171979 301 08 Halmstadwww.infogate.se - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] baffled - fbsd and arcvault12 issues
On Mon, 9 Jul 2007, Ken Gunderson wrote: Sorry to follow up twice but one more thing here. Any ideas why btape fill is writing only 200GB when hardware compression is turned on? Fil generates random (non-compressible) data so it should give very close to the tape's native capacity. Marketers love to upsell capacity and use unrealistic typical compression ratios to multiply their claims. That's why it's very important to find out the REAL capacity of whatever media you're buying. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] baffled - fbsd and arcvault12 issues
Hello, Building my first rescue CD on a linux machine (RHEL4 Update3) i have seen that the VLAN tag support was not included. The scripts that made the CD does not read the vlans that we have created on the server. My case: [EMAIL PROTECTED] bacula-maquina23]# ll total 104 -rw-r--r-- 1 500 pegasus 163 Apr 11 2005 backup.etc.list drwxr-xr-x 4 500 pegasus 4096 Jul 11 12:21 bacula drwxr-xr-x 2 500 pegasus 4096 Jul 11 12:01 bin -rwxr-xr-x 1 500 pegasus 296 Aug 29 2006 copy_static_bacula -rwxr-xr-x 1 500 pegasus 201 Apr 11 2005 copy_to_roottree -rwxr-xr-x 1 root root 287 Jul 11 12:01 create-lv -rwxr-xr-x 1 root root 412 Jul 11 12:01 create-pv -rwxr-xr-x 1 root root 375 Jul 11 12:01 create-vg drwxr-xr-x 2 root root 4096 Jul 11 12:01 diskinfo -rwxr-xr-x 1 root root 748 Jul 11 12:01 format.sda -rwxr-xr-x 1 500 pegasus 13026 Jul 1 2006 getdiskinfo -rw-r--r-- 1 root root 2229 Jul 11 12:00 Makefile -rw-r--r-- 1 500 pegasus 1113 Dec 30 2006 Makefile.in -rwxr-xr-x 1 500 pegasus 1065 Jun 3 2006 make_rescue_disk -rwxr-xr-x 1 500 pegasus 2051 Sep 13 2006 make_static_bacula -rwxr-xr-x 1 root root 319 Jul 11 12:01 mount_drives -rwxr-xr-x 1 root root 711 Jul 11 12:01 partition.sda -rwxr-xr-x 1 500 pegasus 212 Oct 28 2005 restore_bacula -rwxr-xr-x 1 500 pegasus 265 Dec 27 2006 restore_etc -rwxr-xr-x 1 500 pegasus 573 Apr 11 2005 run_grub -rwxr-xr-x 1 500 pegasus 126 Apr 11 2005 run_lilo -rwxr-xr-x 1 root root 189 Jul 11 12:01 start_network -rwxr-xr-x 1 500 pegasus 154 Jul 11 12:01 umount_drives [EMAIL PROTECTED] bacula-maquina23]# more start_network #!/bin/sh # # Start network -- created by getdiskinfo # ip= dev=eth0 ifconfig lo up ifconfig $dev up $ip ip1= dev1=eth1 ifconfig $dev1 up $ip1 route add default gw 10.0.27.124 dev eth0.23 [EMAIL PROTECTED] bacula-maquina23]# ls /etc/sysconfig/network-scripts/ ifcfg-eth0 ifcfg-eth1.51 ifdown-ippp ifup-ib ifup-routes ifcfg-eth0.23 ifcfg-eth1.52 ifdown-ipsec ifup-ippp ifup-sit ifcfg-eth0.25 ifcfg-loifdown-ipv6 ifup-ipsec ifup-sl ifcfg-eth0.50 ifcfg-lo:23 ifdown-isdn ifup-ipv6 ifup-wireless ifcfg-eth0.51 ifcfg-lo:25 ifdown-post ifup-ipxinit.ipv6-global ifcfg-eth0.52 ifcfg-lo:50 ifdown-ppp ifup-isdn network-functions ifcfg-eth1 ifcfg-lo:51 ifdown-sit ifup-plip network-functions-ipv6 ifcfg-eth1.23 ifcfg-lo:52 ifdown-sl ifup-plusb route-eth0.23 ifcfg-eth1.25 ifdown ifup ifup-post route-eth1.23 ifcfg-eth1.50 ifdown-aliases ifup-aliases ifup-ppp [EMAIL PROTECTED] bacula-maquina23]# Is there any patch to make this work automatically, that is, without having to make the changes manually and compilling the iso again? Regards. NOTES: I have used bacula-rescue-2.0.0.tar.gz and bacula-2.0.3.tar.gz. The installation of bacula is working fine, and the compiling of the bacula rescue cd was: [EMAIL PROTECTED] bacula-rescue-2.0.0]# ./configure \ --with-static-fd=/opt/bacula/rescue \ --with-bacula-scripts=/opt/bacula/rescue checking for true... /bin/true checking for false... /bin/false checking for gawk... gawk checking for gawk... /bin/gawk configuring for Rescue 2.0.0 (4 January 2007) checking for a BSD-compatible install... /usr/bin/install -c checking for mv... /bin/mv checking for rm... /bin/rm checking for cp... /bin/cp checking for echo... /bin/echo checking for ar... /usr/bin/ar checking for cdrecord... cdrecord checking build system type... i686-pc-linux-gnu checking host system type... i686-pc-linux-gnu checking for Operating System Distribution... done configure: creating ./config.status config.status: creating autoconf/Make.common config.status: WARNING: autoconf/Make.common.in seems to ignore the --datarootdir setting config.status: creating Makefile config.status: creating linux/Makefile config.status: creating linux/cdrom/Makefile config.status: creating linux/cdrom/bacula/Makefile config.status: creating linux/cdrom/cdtree/boot/isolinux/boot.msg config.status: creating knoppix/cdrom/Makefile config.status: creating knoppix/cdrom/bacula/Makefile config.status: creating freebsd/Makefile config.status: creating solaris/Makefile config.status: executing default commands Configuration on Wed Jul 11 12:00:21 CEST 2007: Host: i686-pc-linux-gnu -- redhat Enterprise release Rescue version: 2.0.0 (4 January 2007) Bacula scripts location:/opt/bacula/rescue Source code location: Static FD location: /opt/bacula/rescue Specific kernel version: CDROM device: ATA:3,0,0 The make: [EMAIL PROTECTED] cdrom]# make
Re: [Bacula-users] btape and bsr sd.conf tweaks
On Tue, 10 Jul 2007 18:15:06 -0600, Ken Gunderson said: On Tue, 10 Jul 2007 18:59:37 +0100 Martin Simmons [EMAIL PROTECTED] wrote: On Tue, 10 Jul 2007 09:10:24 -0600, Ken Gunderson said: On Tue, 10 Jul 2007 11:12:35 +0100 Martin Simmons [EMAIL PROTECTED] wrote: On Mon, 9 Jul 2007 20:27:23 -0600, Ken Gunderson said: Greetings: Since my baffled post I've been doing some testing w/various sd.conf tweaks. btape results and fbsd ports message initially recommended: Due to lack of some features in the FreeBSD tape driver implementation you MUST add some OS dependent options to the bacula-sd.conf file: Hardware End of Medium = no; Backward Space Record = no; Backward Space File= no; With 2 filemarks at EOT (see man mt): Fast Forward Space File = no; BSF at EOM = yes; TWO EOF= yes; While btape completes w/above no problem, from man mt it looks like FBSD supports bsr, however, and a few tests from command line seem to confirm so I trimmed sd.conf down thusly: Hardware End of Medium = no; Fast Forward Space File = no; BSF at EOM = yes; TWO EOF = yes; btape test completes fine and no longer recommend the bsr related tweaks. Maybe they're not necessary and btape should be modified? Don't know about fill results yet - running now. Hopefully I'll encounter the magic incantation to get my autochanger to actually change tapes... In the current Bacula tape driver, Backward Space Record is only used to verify that the last block has been written correctly when a tape gets full, it is not strictly necessary. In addition, the setting of Backward Space File is ignored (bsf must work). You might be able to use these settings on some FBSD tape drives: Fast Forward Space File = yes BSF at EOM = no TWO EOF = no __Martin Thanks. I know that it's optional and not needed. But it seems btape's suggestions regarding sd.conf tweaks may be a bit inconsistent depending upon what flags are already set. This is all a bit confusing on FBSD because per mtio man page various calls referenced in sd.conf docs are supported, e.g. mtiocget, mtbsr, mtfsf, etc. Whether they're supported by SCSI device/driver remains uncertain, as I don't know how to test. In this case I'm using LSI controller and mpt driver. My assumption was that since btape said I needed sd flags such as Backward Space Record, etc. that it did not. But it looks like it does. So I'm wondering whether the issue is with btape erroneously reporting or the mpt driver. To recap, btape and manual backups and restores work but Autochanger is not changing tapes when it should so I suspected something was not quite right in sd.conf. AFAIK, problems with the mechanics of tape changing in the autochanger will not be affected by any of the mtio options. The changer is a separate device with its own protocol. __Martin But is not the drive itself responsible for sending eom so that changer device knows it's time to swap tapes? Yes, but you said that the btape fill test worked, so that suggests eom handling is working. I don't think you ever posted any logs showing exactly what doesn't work! Also, does a backup load the correct tape at the start? __Martin - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Change from 1.38 to 2.0.3: VolumetoCatalog 'Verify differ'
Hello, Do somebody have an idea why my 'VolumetoCatalog' verify differ (I think on each file) on the AIX4 machine while the other machines (linux, windows) are ok? I got 'MD5 digest differs' or 'SHA1 digest differs' all the time. But when I restore such a file and make a 'diff' the files are equal. I read on the news-section regarding 'InitCatalog' however it seems this does not help... Greetings, user100 - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Winows fd random shutdowns debunked
On 7/10/07, Mantas M. [EMAIL PROTECTED] wrote: Hi John, Yes, it would be great if You could email the executable or upload it somewhere. Did you try the new bacula? Did it fix the problem? John - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Random Backup Failures
Since I've introduced FreeBSD snapshots into my Bacula plan, I've started getting random backup failures. A server will fail one day, and back up just fine the next. A server will back up fine one day and fail the next. ...all with no changes to the Bacula configuration. Below, I've posted pertinent portions of configuration files and message logs. Please let me know if I need to supply any further information to help troubleshoot this down. bacula-dir.conf pertinent portions only...sensitive information removed with: *REMOVED* JobDefs { Name = BSD Type = Backup FileSet = defaultBSD Storage = storage01 Messages = Standard Pool = Default ClientRunBeforeJob = /usr/local/bin/sudo /usr/local/sbin/snapshot make -g1 /var:autogen_bkup ClientRunBeforeJob = /usr/local/bin/sudo /usr/local/sbin/snapshot make -g1 /usr:autogen_bkup ClientRunBeforeJob = /usr/local/bin/sudo /usr/local/sbin/snapshot mount /var:autogen_bkup /mnt/var ClientRunBeforeJob = /usr/local/bin/sudo /usr/local/sbin/snapshot mount /usr:autogen_bkup /mnt/usr ClientRunAfterJob = /usr/local/bin/sudo /usr/local/sbin/snapshot umount /mnt/var ClientRunAfterJob = /usr/local/bin/sudo /usr/local/sbin/snapshot umount /mnt/usr Priority = 10 } Typical job, as they are all nearly identical: Job { Name = app06_BSD Client = app06-fd Schedule = MonCycle JobDefs = BSD Write Bootstrap = /var/db/bacula/app06.bsr } Typical client, as they are all nearly identical: Client { Name = app06-fd Address = app06 FDPort = 9102 Catalog = MyCatalog Password = *REMOVED* # password for FileDaemon File Retention = 30 days # 30 days Job Retention = 6 months # six months AutoPrune = yes # Prune expired Jobs/Files } My primary FileSet resource: FileSet { Name = defaultBSD Include { Options { signature = MD5 compression = GZIP } File = / File = /mnt/usr File = /mnt/var } Exclude { File = /proc File = /tmp File = /.journal File = /.fsck } } Finally, I get the same message from my /var/log/messages file at every failure. The lines before and after this have nothing to do with the backup. Jul 11 08:19:07 app11 sudo: *REMOVED* : TTY=unknown ; PWD=/usr/local/etc/rc.d ; USER=root ; COMMAND=/usr/local/sbin/snapshot make -g1 /var:autogen_bkup Jul 11 08:21:34 app11 kernel: fsync: giving up on dirty Jul 11 08:21:34 app11 kernel: 0xff005b07cd90: tag devfs, type VCHR Jul 11 08:21:34 app11 kernel: usecount 1, writecount 0, refcount 604 mountedhere 0xff011f1ba200 Jul 11 08:21:34 app11 kernel: flags () Jul 11 08:21:34 app11 kernel: v_object 0xff005d3a ref 0 pages 8572 Jul 11 08:21:34 app11 kernel: lock type devfs: EXCL (count 1) by thread 0xff00abc57980 (pid 46772) Jul 11 08:21:34 app11 kernel: dev da0s1d Jul 11 08:22:03 app11 sudo: *REMOVED* : TTY=unknown ; PWD=/usr/local/etc/rc.d ; USER=root ; COMMAND=/usr/local/sbin/snapshot make -g1 /usr:autogen_bkup Jul 11 08:24:13 app11 sudo: *REMOVED* : TTY=unknown ; PWD=/usr/local/etc/rc.d ; USER=root ; COMMAND=/usr/local/sbin/snapshot mount /var:autogen_bkup /mnt/var Jul 11 08:24:13 app11 kernel: g_vfs_done():md0[READ(offset=65536, length=8192)]error = 5 -- S i x F e e t U p | Nowhere to go but open source Silicon Valley: +1 (650) 401-8579 x609 Midwest: +1 (317) 861-5948 x609 Toll-Free: 1-866-SIX-FEET mailto:[EMAIL PROTECTED] http://www.sixfeetup.com | Zope/Plone Custom Development - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] bconsole status dir slow
Hi, I'm using Bacula 1.38.11-7 on Debian Sid with a PostgreSQL 8.1 catalog. We backup about 3TB of data per month over a dozen machines. When i run the bconsole, status dir command, it's really slow; specifically the Scheduled Jobs: section. It takes about 3 minutues to repond. I check to see if the proper indexes were created, and they were. So i turn on statement logging in Postgres. During that one status dir command, Bacula issued over 93,000 select queries. Now that just doesn't seem right. Strange how there are only 1,000 unique commands issues, and even that seems outrageously high. Most of them had the form SELECT VolSessionId,VolSessionTime,PoolId,StartTime,EndTime,JobFiles,JobBytes, JobTDate,Job,JobStatus,Type,Level,ClientId,Name FROM Job WHERE JobId=2431 Any idea what's going on here or why bconsole is so slow? Is this a bug? I couldn't find anything in Mantis. thanks, Brian -- Brian DeRocher @ Noblis This email was signed using OpenPGP. signature.asc Description: This is a digitally signed message part. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Help with backup plan
Onsdag 11 juli 2007 05:21 skrev Charles Sprickman: On Tue, 10 Jul 2007, Steen wrote: On Friday 06 July 2007 06:23:22 Charles Sprickman wrote: What I'd like to do is the following: -Full backup each sunday, keeping the tapes for a year. After that I would likely manually relabel all the tapes but one. These tapes would all be in one pool. -Differential backup each following sunday, with 3 tapes that get recycled each month. These tapes are also in their own pool. -Incrementals mon-fri, with 5 tapes that get recycled each week. Again, in their own pool. Does this seem like a sane plan? I use almost the same pattern - but only diskbased I am running a test over about 20 machines right now, and I *think* I kind of have this down after looking at the Volume Retention section a few more times.. I'm on the fence about the differentials Don't really get that Never dealt with them before... But I do have a slightly unique(?) situation. Most of the boxes are in another state, so I want to avoid full backups when possible since they generally seem to need more than 12 hours to run. So I figure instead of doing a full + incrementals each week, I'll do one full per month plus a differential each weekend except for the first to save some time/bandwidth. We don't (yet) have an autochanger or reliable remote hands at the datacenter... oh I see as we very rarely go back to backups for anything... I'm also wondering how these choices will impact the general ease of restoring something if we need to. Again, I'm coming from Amanda, and there's not much thinking there. When you restore, you just keep feeding it the tapes it wants. Here it graps the disk volumes automatically - guess that would be identical to your experience with Amanda with tapes Good. I assume it's just going to spit out a message when the next tape is needed. Another big question since the fact that catalog retention can be set in various places. Do I need any retention settings in my client configs? I see there are File Retention and Job Retention settings that can go in a client config. Based on what's below do I need anything in my individual client configs (or elsewhere) to make sure things get purged out of the catalog properly? Yes - File Job retention Here's what I've tentatively got in my bacula-dir config. I'm just going to add what I think I'm doing after each pool... pools: Pool { Name = Monthly Pool Type = Backup Recycle = no# Bacula can automatically recycle Volumes AutoPrune = yes # Prune expired volumes Volume Retention = 365 days # one year Volume Use Duration = 23h Maximum Volumes = 12 LabelFormat = Monthly } Don't ever recycle these, request a new tape each full run, keep info from the fulls in the catalog for a year. Would there be any point to keeping catalog on these fulls for longer or should I just rely on bscan to get data off older full tapes? I don't keep mine because I don't think I will ever need them. If disaster strikes, I rely on Bscan I assume after a year, I will have to manually relabel(?) or purge these tapes to use them again after I put one away for long term storage? You could also maybe have recycling and then copy the volumes after a year Pool { Name = Weekly Pool Type = Backup Recycle = yes # Bacula can automatically recycle Volumes Recycle Oldest Volume = yes AutoPrune = yes # Prune expired volumes Volume Retention = 1 month # one month Volume Use Duration = 6 days Maximum Volumes = 3 LabelFormat = Weekly } This is my differential, and I expect it to request a new tape each week. It should keep info in the catalog for one month. It will automatically recycle tapes each month, starting with the oldest volume. Do I have that right? Seems so to me I'm also considering just using one tape/month for this. I would change Volume Use Duration to 1 month to accomplish that, correct? Yes, providing enough space on the tape Pool { Name = Daily Pool Type = Backup Recycle = yes # Bacula can automatically recycle Volumes Recycle Oldest Volume = yes AutoPrune = yes # Prune expired volumes Volume Retention = 5 days # 5 days Volume Use Duration = 23h Maximum Volumes = 5 LabelFormat = Daily } These are the daily incrementals. I'm expecting these to do incrementals based on the last differential, I don't think so - I think incremental is since the last backup whatever, and by the way differential is since the last full - so they will get bigger during the month - you may check the manual here. and for Bacula to ask for a new tape each day, with a max of 5 tapes. Each week the catalog will be purged of these records.
Re: [Bacula-users] Random Backup Failures
On 11 Jul 2007 at 11:15, Chris Morris wrote: Since I've introduced FreeBSD snapshots into my Bacula plan, I've started getting random backup failures. A server will fail one day, and back up just fine the next. A server will back up fine one day and fail the next. ...all with no changes to the Bacula configuration. Below, I've posted pertinent portions of configuration files and message logs. Please let me know if I need to supply any further information to help troubleshoot this down. You say the jobs fail. What is the failure? Error message? bacula-dir.conf pertinent portions only...sensitive information removed with: *REMOVED* JobDefs { Name = BSD Type = Backup FileSet = defaultBSD Storage = storage01 Messages = Standard Pool = Default ClientRunBeforeJob = /usr/local/bin/sudo /usr/local/sbin/snapshot make -g1 /var:autogen_bkup ClientRunBeforeJob = /usr/local/bin/sudo /usr/local/sbin/snapshot make -g1 /usr:autogen_bkup ClientRunBeforeJob = /usr/local/bin/sudo /usr/local/sbin/snapshot mount /var:autogen_bkup /mnt/var ClientRunBeforeJob = /usr/local/bin/sudo /usr/local/sbin/snapshot mount /usr:autogen_bkup /mnt/usr ClientRunAfterJob = /usr/local/bin/sudo /usr/local/sbin/snapshot umount /mnt/var ClientRunAfterJob = /usr/local/bin/sudo /usr/local/sbin/snapshot umount /mnt/usr I suggest creating scripts on the client, and moving these commands into those scripts. It makes the JobDefs easier to read. Sure, you have to copy stuff to the client, but I think that's cleaner. YMMV. Priority = 10 } Typical job, as they are all nearly identical: Job { Name = app06_BSD Client = app06-fd Schedule = MonCycle JobDefs = BSD Write Bootstrap = /var/db/bacula/app06.bsr } Typical client, as they are all nearly identical: Client { Name = app06-fd Address = app06 FDPort = 9102 Catalog = MyCatalog Password = *REMOVED* # password for FileDaemon File Retention = 30 days # 30 days Job Retention = 6 months # six months AutoPrune = yes # Prune expired Jobs/Files } My primary FileSet resource: FileSet { Name = defaultBSD Include { Options { signature = MD5 compression = GZIP } File = / File = /mnt/usr File = /mnt/var } Exclude { File = /proc File = /tmp File = /.journal File = /.fsck } } Finally, I get the same message from my /var/log/messages file at every failure. The lines before and after this have nothing to do with the backup. Jul 11 08:19:07 app11 sudo: *REMOVED* : TTY=unknown ; PWD=/usr/local/etc/rc.d ; USER=root ; COMMAND=/usr/local/sbin/snapshot make -g1 /var:autogen_bkup Jul 11 08:21:34 app11 kernel: fsync: giving up on dirty Jul 11 08:21:34 app11 kernel: 0xff005b07cd90: tag devfs, type VCHR Jul 11 08:21:34 app11 kernel: usecount 1, writecount 0, refcount 604 mountedhere 0xff011f1ba200 Jul 11 08:21:34 app11 kernel: flags () Jul 11 08:21:34 app11 kernel: v_object 0xff005d3a ref 0 pages 8572 Jul 11 08:21:34 app11 kernel: lock type devfs: EXCL (count 1) by thread 0xff00abc57980 (pid 46772) Jul 11 08:21:34 app11 kernel: dev da0s1d Jul 11 08:22:03 app11 sudo: *REMOVED* : TTY=unknown ; PWD=/usr/local/etc/rc.d ; USER=root ; COMMAND=/usr/local/sbin/snapshot make -g1 /usr:autogen_bkup Jul 11 08:24:13 app11 sudo: *REMOVED* : TTY=unknown ; PWD=/usr/local/etc/rc.d ; USER=root ; COMMAND=/usr/local/sbin/snapshot mount /var:autogen_bkup /mnt/var Jul 11 08:24:13 app11 kernel: g_vfs_done():md0[READ(offset=65536, length=8192)]error = 5 This looks like an OS issue, not a Bacula issue. I suggest following up on the FreeBSD maling lists. -- Dan Langille - http://www.langille.org/ - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bconsole status dir slow
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 My understanding is that what it is doing there is checking to see what tapes might be used for these scheduled jobs that are going to occur in the future. How it arrives at that conclusion and what kind of statements it needs to establish that are not things with which I'm familiar. Brian DeRocher wrote: Hi, I'm using Bacula 1.38.11-7 on Debian Sid with a PostgreSQL 8.1 catalog. We backup about 3TB of data per month over a dozen machines. When i run the bconsole, status dir command, it's really slow; specifically the Scheduled Jobs: section. It takes about 3 minutues to repond. I check to see if the proper indexes were created, and they were. So i turn on statement logging in Postgres. During that one status dir command, Bacula issued over 93,000 select queries. Now that just doesn't seem right. Strange how there are only 1,000 unique commands issues, and even that seems outrageously high. Most of them had the form SELECT VolSessionId,VolSessionTime,PoolId,StartTime,EndTime,JobFiles,JobBytes, JobTDate,Job,JobStatus,Type,Level,ClientId,Name FROM Job WHERE JobId=2431 Any idea what's going on here or why bconsole is so slow? Is this a bug? I couldn't find anything in Mantis. thanks, Brian - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - -- _ _ _ _ ___ _ _ _ |Y#| | | |\/| | \ |\ | | |Ryan Novosielski - Systems Programmer III |$| |__| | | |__/ | \| _| |[EMAIL PROTECTED] - 973/972.0922 (2-0922) \__/ Univ. of Med. and Dent.|IST/AST - NJMS Medical Science Bldg - C630 -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFGlPnzmb+gadEcsb4RAqy5AKCqtV/l/Yay+ivwo5Zc75VzFwnyiACdEI5I xF6mi5PiSo6O6+bozIxKr6k= =hFC3 -END PGP SIGNATURE- - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Random Backup Failures
Dan Langille wrote: You say the jobs fail. What is the failure? Error message? Below, I've pasted in a failure notification email that Bacula automatically sends. 11-Jul 07:18 admin01-dir: Start Backup JobId 255, Job=app11_BSD.2007-07-10_23.35.04 11-Jul 01:19 app11-fd: DIR and FD clocks differ by -21547 seconds, FD automatically adjusting. 11-Jul 01:19 app11-fd: ClientRunBeforeJob: run command /usr/local/bin/sudo /usr/local/sbin/snapshot make -g1 /var:autogen_bkup 11-Jul 01:22 app11-fd: ClientRunBeforeJob: mount: /var/.snap/autogen_bkup.0: Resource temporarily unavailable 11-Jul 01:22 app11-fd: ClientRunBeforeJob: run command /usr/local/bin/sudo /usr/local/sbin/snapshot make -g1 /usr:autogen_bkup 11-Jul 01:24 app11-fd: ClientRunBeforeJob: run command /usr/local/bin/sudo /usr/local/sbin/snapshot mount /var:autogen_bkup /mnt/var 11-Jul 01:24 app11-fd: ClientRunBeforeJob: mount: /dev/md0: Input/output error 11-Jul 01:24 app11-fd: ClientRunBeforeJob: snapshot:ERROR: unable to mount /dev/md0 under /mnt/var 11-Jul 01:24 app11-fd: app11_BSD.2007-07-10_23.35.04 Error: Runscript: ClientRunBeforeJob returned non-zero status=1. ERR=Child exited with code 1 11-Jul 07:23 admin01-dir: app11_BSD.2007-07-10_23.35.04 Fatal error: Bad response to ClientRunBeforeJob command: wanted 2000 OK RunBefore , got 2905 Bad RunBeforeJob command. 11-Jul 07:23 admin01-dir: app11_BSD.2007-07-10_23.35.04 Error: Bacula 2.0.3 (06Mar07): 11-Jul-2007 07:23:21 JobId: 255 Job:app11_BSD.2007-07-10_23.35.04 Backup Level: Differential, since=2007-07-10 07:32:06 Client: app11-fd 2.0.3 (06Mar07) amd64-portbld-freebsd6.2,freebsd,6.2-RC1 FileSet:defaultBSD 2007-07-09 23:05:00 Pool: Default (From Job resource) Storage:storage01 (From Job resource) Scheduled time: 10-Jul-2007 23:35:03 Start time: 11-Jul-2007 07:18:09 End time: 11-Jul-2007 07:23:21 Elapsed time: 5 mins 12 secs Priority: 10 FD Files Written: 0 SD Files Written: 0 FD Bytes Written: 0 (0 B) SD Bytes Written: 0 (0 B) Rate: 0.0 KB/s Software Compression: None VSS:no Encryption: no Volume name(s): Volume Session Id: 95 Volume Session Time:1183747854 Last Volume Bytes: 403,356,186,192 (403.3 GB) Non-fatal FD errors:0 SD Errors: 0 FD termination status: SD termination status: OK Termination:*** Backup Error *** -- S i x F e e t U p | Nowhere to go but open source Silicon Valley: +1 (650) 401-8579 x609 Midwest: +1 (317) 861-5948 x609 Toll-Free: 1-866-SIX-FEET mailto:[EMAIL PROTECTED] http://www.sixfeetup.com | Zope/Plone Custom Development - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Please mount volume...but volume is already mounted.
It happened again today. This time I unmounted the tape, and mounted it again Brian Debelius wrote: elkton-dir Version: 2.1.22 (26 June 2007) Linux Cross-compile Win32 Hey, I am still getting this mounting problem. Bacula loads the correct tape, but then says that I need to mount it. After which I release, and mount the same tape, and it then proceed to backup. brian- 10-Jul 09:28 elkton-dir: Recycled volume A009 10-Jul 09:28 elkton-sd: 3307 Issuing autochanger unload slot 3, drive 0 command. 10-Jul 09:29 elkton-sd: 3304 Issuing autochanger load slot 4, drive 0 command. 10-Jul 09:31 elkton-sd: 3305 Autochanger load slot 4, drive 0, status is OK. 10-Jul 09:31 elkton-sd: 3301 Issuing autochanger loaded? drive 0 command. 10-Jul 09:31 elkton-sd: 3302 Autochanger loaded? drive 0, result is Slot 4. 10-Jul 09:31 elkton-sd: Please mount Volume A009 or label a new one for: Job: Elkton_D-drive.2007-07-10_00.01.25 Storage: VXA-172 (Tape0) Pool: Tape-daily Media type: X10 *update slots Automatically selected Catalog: MyCatalog Using Catalog MyCatalog The defined Storage resources are: 1: Disk0 2: Disk1 3: Tape Select Storage resource (1-3): 3 Connecting to Storage daemon Tape at elkton.intelesys.local:9103 ... 3306 Issuing autochanger slots command. Device Packetloader0 has 10 slots. Connecting to Storage daemon Tape at elkton.intelesys.local:9103 ... 3306 Issuing autochanger list command. Catalog record for Volume A004 updated to reference slot 1.*release The defined Storage resources are: 1: Disk0 2: Disk1 3: Tape Select Storage resource (1-3): 3 3307 Issuing autochanger unload slot 4, drive 0 command. 3922 Device VXA-172 (Tape0) waiting for sysop. *mount The defined Storage resources are: 1: Disk0 2: Disk1 3: Tape Select Storage resource (1-3): 3 Enter autochanger slot: 4 3001 OK mount. Device=VXA-172 (Tape0) Catalog record for Volume A003 updated to reference slot 2. Catalog record for Volume A008 updated to reference slot 3. Catalog record for Volume B006 updated to reference slot 5. Catalog record for Volume A001 updated to reference slot 6. Catalog record for Volume CLNA0002 updated to reference slot 10. Catalog record for Volume A009 updated to reference slot 4. 10-Jul 10:50 elkton-sd: 3301 Issuing autochanger loaded? drive 0 command. 10-Jul 10:50 elkton-sd: 3302 Autochanger loaded? drive 0, result: nothing loaded. 10-Jul 10:50 elkton-sd: 3304 Issuing autochanger load slot 4, drive 0 command. 10-Jul 10:51 elkton-sd: 3305 Autochanger load slot 4, drive 0, status is OK. 10-Jul 10:51 elkton-sd: 3301 Issuing autochanger loaded? drive 0 command. 10-Jul 10:51 elkton-sd: 3302 Autochanger loaded? drive 0, result is Slot 4. 10-Jul 10:51 elkton-sd: Recycled volume A009 on device VXA-172 (Tape0), all previous data lost. 10-Jul 10:51 elkton-sd: New volume A009 mounted on device VXA-172 (Tape0) at 10-Jul-2007 10:51. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Random Backup Failures
On 7/11/07, Chris Morris [EMAIL PROTECTED] wrote: Dan Langille wrote: You say the jobs fail. What is the failure? Error message? Below, I've pasted in a failure notification email that Bacula automatically sends. 11-Jul 07:18 admin01-dir: Start Backup JobId 255, Job=app11_BSD.2007-07-10_23.35.04 11-Jul 01:19 app11-fd: DIR and FD clocks differ by -21547 seconds, FD automatically adjusting. 11-Jul 01:19 app11-fd: ClientRunBeforeJob: run command /usr/local/bin/sudo /usr/local/sbin/snapshot make -g1 /var:autogen_bkup 11-Jul 01:22 app11-fd: ClientRunBeforeJob: mount: /var/.snap/autogen_bkup.0: Resource temporarily unavailable 11-Jul 01:22 app11-fd: ClientRunBeforeJob: run command /usr/local/bin/sudo /usr/local/sbin/snapshot make -g1 /usr:autogen_bkup 11-Jul 01:24 app11-fd: ClientRunBeforeJob: run command /usr/local/bin/sudo /usr/local/sbin/snapshot mount /var:autogen_bkup /mnt/var 11-Jul 01:24 app11-fd: ClientRunBeforeJob: mount: /dev/md0: Input/output error 11-Jul 01:24 app11-fd: ClientRunBeforeJob: snapshot:ERROR: unable to mount /dev/md0 under /mnt/var 11-Jul 01:24 app11-fd: app11_BSD.2007-07-10_23.35.04 Error: Runscript: ClientRunBeforeJob returned non-zero status=1. ERR=Child exited with code 1 11-Jul 07:23 admin01-dir: app11_BSD.2007-07-10_23.35.04 Fatal error: Bad response to ClientRunBeforeJob command: wanted 2000 OK RunBefore , got 2905 Bad RunBeforeJob command. This says your ClientRunBeforeJob is has failed as it could not perform the mount of /dev/md0 to /mnt/var. Have you checked into that? Is bacula-fd running as user bacula? Possibly this is a permissions issue. John - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Please mount volume...but volume is already mounted.
On 7/11/07, Brian Debelius [EMAIL PROTECTED] wrote: It happened again today. This time I unmounted the tape, and mounted it again I have seen this happen in the past and usually the solution is to just do a mount on the drive that it is asking for. John - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] confused by automatic purging
On Wed, 2007-07-11 at 10:15 +0100, Martin Simmons wrote: On Tue, 10 Jul 2007 10:50:46 -0700, Craig White said: I have a 3 week rotation with a full backup each Friday and differential backups every weekday. Last night, upon execution, the 1_Monday_Week_1 AND 1_Monday_Week_2 were both purged and it shouldn't have purged 1_Monday_Week_2 from my backup logs... 09-Jul 20:00 SRV1: Start Backup JobId 91, Job=SRV1Backup.2007-07-09_20.00.00 09-Jul 20:00 SRV1: Pruned 3 Jobs on Volume 1_Monday_Week_1 from catalog. 09-Jul 20:00 SRV1: ua_purge.c:611 All records pruned from Volume 1_Monday_Week_1; marking it Purged 09-Jul 20:00 SRV1: ua_purge.c:611 All records pruned from Volume 1_Monday_Week_2; marking it Purged 09-Jul 20:00 SRV1: Recycled volume 1_Monday_Week_1 09-Jul 20:00 SRV1: Recycled volume 1_Monday_Week_1 on device DDS-4 (/dev/nst0), all previous data lost. My MondayPool is defined as... Pool { Name = MondayPool Pool Type = Backup Recycle = yes AutoPrune = yes Volume Retention = 19d Volume Use Duration = 4d Maximum Volume Jobs = 5 } and according to list media... | MediaId | VolumeName | VolStatus | Enabled | VolBytes | VolFiles | VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten | +-+-+---+-++--+--+-+--+---+---+-+ | 2 | 1_Monday_Week_2 | Purged| 1 | 25,815,250,944 | 26 |1,641,600 | 1 |0 | 1 | DDS-4 | 2007-06-25 22:07:04 | My 1_Monday_Week_2 was last written on 6/25/2007 which is clearly not 19 days of Volume Retention. Is there something wrong with my understanding of this? # rpm -qa|grep bacula bacula-mysql-2.0.3-1 bacula-mtx-2.0.3-1 bacula-wxconsole-2.0.3-1 bacula-gconsole-2.0.3-1 Do you have previous logs still? If so, check for other messages about 1_Monday_Week_2, because it looks like all the jobs had been removed before it ran the above. Also, maybe they were removed with the delete command? I don't - but I think I figured out why this happened. Two weeks ago, I ended up running a 'Full' backup on Monday instead of the Differential because I changed the FileSet selectors (actually the 'Exclude' portion) and that made it run onto a second tape. After I had another 'Full' backup on Friday, I deleted 2_Monday_Week_2 and internally, Bacula must have figured that since the continuation tape for that particular 'Full' set was deleted, then the first tape of that set was worthless too so it just purged it. I guess I don't mind, but it was clearly unexpected. I did notice that the same thing didn't happen last night on the TuesdayPool nor did it happen at any other time so it definitely caught me by surprise. That Bacula had reached ahead a week in time and 'purged' a backup without cause didn't make sense given the objective of Bacula to hold on to all possible backups as long as needed which is also why I have set the 'retention period' to be 19 days on a 3 week rotation. Thanks -- Craig White [EMAIL PROTECTED] - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] jobs block execution if one FD times out
Dear all, If one of my FD is unreachable (due to network problems) then bacula blocks all other jobs with the message: [job] is waiting for Client [client-name] to connect to Storage File I've tried concurrent jobs, max wait time, everything but it takes a VERY long time for bacula to realize that the FD is unreachable. all the other clients/jobs would say: [job] is waiting on Storage File Concurrent jobs work fine (if all FDs are reachable). I have configured upto 5 concurrent jobs and there are no issues with that. If I can : 1. have bacula continue and process the other jobs even if one FD is unreachable OR 2. some parameter that I can adjust which will timeout bacula faster on unreachable FDs. My network is such that remote offices may well be unreachable and I have to deal with that. Any pointers appreciated. Thanks! -- Faraz R Khan Emergen Consulting Pvt Ltd +92.21.111.111.320 x200 www.emergen.biz - NOTICE: If received in error, please destroy and notify sender. Sender does not intend to waive confidentiality or privilege. Use of this email is prohibited when received in error. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Random Backup Failures
For the benefit of list readers and those that may still be trying to assist me with troubleshooting. I have finally been able to duplicate the errors on my own terms. I could never duplicate this before, because I would sit at a terminal window and make the snapshot, mount the snapshot, browse the snapshot, and umount the snapshot in that order. Finally, I decided to try to *behave* more like I expect a script to work. I opened two terminal windows. In one, I started the snapshot generation process. In the other, I tried to mount the snapshot before it was finished. It, of course, didn't work. More importantly, however, _I got the exact errors that I would randomly get in my automated overnight backups. _Now that I can reproduce the error, fixing and implementing is trivial. Many thanks to you those that provided assistance with this matter. Thank you, Chris Morris -- S i x F e e t U p | Nowhere to go but open source Silicon Valley: +1 (650) 401-8579 x609 Midwest: +1 (317) 861-5948 x609 Toll-Free: 1-866-SIX-FEET mailto:[EMAIL PROTECTED] http://www.sixfeetup.com | Zope/Plone Custom Development John Drescher wrote: On 7/11/07, *Chris Morris* [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] wrote: Dan Langille wrote: You say the jobs fail. What is the failure? Error message? Below, I've pasted in a failure notification email that Bacula automatically sends. 11-Jul 07:18 admin01-dir: Start Backup JobId 255, Job=app11_BSD.2007-07-10_23.35.04 11-Jul 01:19 app11-fd: DIR and FD clocks differ by -21547 seconds, FD automatically adjusting. 11-Jul 01:19 app11-fd: ClientRunBeforeJob: run command /usr/local/bin/sudo /usr/local/sbin/snapshot make -g1 /var:autogen_bkup 11-Jul 01:22 app11-fd: ClientRunBeforeJob: mount: /var/.snap/autogen_bkup.0: Resource temporarily unavailable 11-Jul 01:22 app11-fd: ClientRunBeforeJob: run command /usr/local/bin/sudo /usr/local/sbin/snapshot make -g1 /usr:autogen_bkup 11-Jul 01:24 app11-fd: ClientRunBeforeJob: run command /usr/local/bin/sudo /usr/local/sbin/snapshot mount /var:autogen_bkup /mnt/var 11-Jul 01:24 app11-fd: ClientRunBeforeJob: mount: /dev/md0: Input/output error 11-Jul 01:24 app11-fd: ClientRunBeforeJob: snapshot:ERROR: unable to mount /dev/md0 under /mnt/var 11-Jul 01:24 app11-fd: app11_BSD.2007-07-10_23.35.04 Error: Runscript: ClientRunBeforeJob returned non-zero status=1. ERR=Child exited with code 1 11-Jul 07:23 admin01-dir: app11_BSD.2007-07-10_23.35.04 Fatal error: Bad response to ClientRunBeforeJob command: wanted 2000 OK RunBefore , got 2905 Bad RunBeforeJob command. This says your ClientRunBeforeJob is has failed as it could not perform the mount of /dev/md0 to /mnt/var. Have you checked into that? Is bacula-fd running as user bacula? Possibly this is a permissions issue. John - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] bacula beta can't find qt on compile
I think I did something wrong. I have a centos 4.5 server. I compiled then installed QT from qt-x11-opensource-src-4.3.0 with all defaults. It installed in /usr/local/Rtolltech/Qt-4.3.0. I added /usr/local/Trolltech/Qt-4.3.0/bin to root's path and /usr/local/Trolltech/Qt-4.3.0/lib to /etc/ld.so.conf. Then I ran configure for bacula-2.1.24 as root with the --enable-bat flag. I get the following: . . . checking whether NLS is requested... yes checking for GNU gettext in libc... yes checking whether to use NLS... yes checking where the gettext function comes from... libc checking for msgfmt... (cached) /usr/bin/msgfmt configure: error: Unable to find Qt4 installation needed by bat Do I need to do something with Qt4 after a fresh install? Is there a flag in bacula configure that I need to set for it to see Qt? -Megan - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Tape Recycling/rotation question
Ok, I have a question about tape recycling and rotation. I have 9 tapes in a rotation. Each tape has a retention period of 2 months. The tapes are switched out when they are full. When I get to tape 9 and bacula then wants to goto the next available appendable volume, which should be tapes 1-3 or so, when I pop in tape 1, shouldn't bacula just write over the data that is on that tape as if the tape where a new unused tape? And shouldn't that tape have a status of recycle or appendable or something when its retention period is over? I'm having some issues with recycled tapes not filling up with the same amount of data as before. They aren't even filling up with the native amount of data (uncompressed). I'd appreciate any assistance. Jason - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] confused by automatic purging
On Wed, 11 Jul 2007 08:53:22 -0700, Craig White said: On Wed, 2007-07-11 at 10:15 +0100, Martin Simmons wrote: On Tue, 10 Jul 2007 10:50:46 -0700, Craig White said: I have a 3 week rotation with a full backup each Friday and differential backups every weekday. Last night, upon execution, the 1_Monday_Week_1 AND 1_Monday_Week_2 were both purged and it shouldn't have purged 1_Monday_Week_2 from my backup logs... 09-Jul 20:00 SRV1: Start Backup JobId 91, Job=SRV1Backup.2007-07-09_20.00.00 09-Jul 20:00 SRV1: Pruned 3 Jobs on Volume 1_Monday_Week_1 from catalog. 09-Jul 20:00 SRV1: ua_purge.c:611 All records pruned from Volume 1_Monday_Week_1; marking it Purged 09-Jul 20:00 SRV1: ua_purge.c:611 All records pruned from Volume 1_Monday_Week_2; marking it Purged 09-Jul 20:00 SRV1: Recycled volume 1_Monday_Week_1 09-Jul 20:00 SRV1: Recycled volume 1_Monday_Week_1 on device DDS-4 (/dev/nst0), all previous data lost. My MondayPool is defined as... Pool { Name = MondayPool Pool Type = Backup Recycle = yes AutoPrune = yes Volume Retention = 19d Volume Use Duration = 4d Maximum Volume Jobs = 5 } and according to list media... | MediaId | VolumeName | VolStatus | Enabled | VolBytes | VolFiles | VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten | +-+-+---+-++--+--+-+--+---+---+-+ | 2 | 1_Monday_Week_2 | Purged| 1 | 25,815,250,944 | 26 |1,641,600 | 1 |0 | 1 | DDS-4 | 2007-06-25 22:07:04 | My 1_Monday_Week_2 was last written on 6/25/2007 which is clearly not 19 days of Volume Retention. Is there something wrong with my understanding of this? # rpm -qa|grep bacula bacula-mysql-2.0.3-1 bacula-mtx-2.0.3-1 bacula-wxconsole-2.0.3-1 bacula-gconsole-2.0.3-1 Do you have previous logs still? If so, check for other messages about 1_Monday_Week_2, because it looks like all the jobs had been removed before it ran the above. Also, maybe they were removed with the delete command? I don't - but I think I figured out why this happened. Two weeks ago, I ended up running a 'Full' backup on Monday instead of the Differential because I changed the FileSet selectors (actually the 'Exclude' portion) and that made it run onto a second tape. After I had another 'Full' backup on Friday, I deleted 2_Monday_Week_2 and internally, Bacula must have figured that since the continuation tape for that particular 'Full' set was deleted, then the first tape of that set was worthless too so it just purged it. Ah, yes, that explains it. Deleting 2_Monday_Week_2 would have removed all the job ids from 1_Monday_Week_2 that were also on 2_Monday_Week_2. If that left nothing on 1_Monday_Week_2, then the next autopruning would mark is purged. __Martin - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] btape and bsr sd.conf tweaks
On Wed, 11 Jul 2007 13:23:47 +0100 Martin Simmons [EMAIL PROTECTED] wrote: On Tue, 10 Jul 2007 18:15:06 -0600, Ken Gunderson said: On Tue, 10 Jul 2007 18:59:37 +0100 Martin Simmons [EMAIL PROTECTED] wrote: On Tue, 10 Jul 2007 09:10:24 -0600, Ken Gunderson said: On Tue, 10 Jul 2007 11:12:35 +0100 Martin Simmons [EMAIL PROTECTED] wrote: On Mon, 9 Jul 2007 20:27:23 -0600, Ken Gunderson said: Greetings: [snip] But is not the drive itself responsible for sending eom so that changer device knows it's time to swap tapes? Yes, but you said that the btape fill test worked, so that suggests eom handling is working. Yes, it works with btape but wasn't when running actual backups. I don't think you ever posted any logs showing exactly what doesn't work! Just kept writing and writing to same tape, well over 1TB of data to LTO-2 drive. Didn't bother testing any restores on these though. Also, does a backup load the correct tape at the start? Yes. Also, I think I've got it working now. Testing now. Will know before too long. -- Best regards, Ken Gunderson GPG Key -- 9F5179FD Never hold discussions with the monkey when the organ grinder is in the room. - Sir Winston Churchill - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Any FileSet change determine a Full backup
Hi Every time when I'm doing a change in the FileSet for a client, the next backup is upgraded to Full from Incremental. There is any posibility to avoid this behavior? Sometimes the changes are really small but the full backup takes a lot of space and time. Any idea will be appreciated. Thanks. Daniel - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Any FileSet change determine a Full backup
On Wed, 2007-07-11 at 12:59 -0500, Zeratul wrote: Hi Every time when I'm doing a change in the FileSet for a client, the next backup is upgraded to Full from Incremental. There is any posibility to avoid this behavior? Sometimes the changes are really small but the full backup takes a lot of space and time. Any idea will be appreciated. having recently experienced that same issue, I can answer that one...no Therefore, I only make changes to the FileSet on days that the 'Full' backup set is to be run and restart the bacula-dir daemon prior to the time. That behavior affects changes to the FileSet whether they are Include or Exclude selectors. -- Craig White [EMAIL PROTECTED] - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] 2.0.3 agents with 1.36 backend
is it possible to use 2.0.3 (or even 2.2) agents with 1.36 director/sd ? this is intended only as a temporary solution until serverside is upgraded (1.36 agent fails to compile on a recent system) -- Rich - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] 2.0.3 agents with 1.36 backend
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Rich wrote: is it possible to use 2.0.3 (or even 2.2) agents with 1.36 director/sd ? this is intended only as a temporary solution until serverside is upgraded (1.36 agent fails to compile on a recent system) Well the strict answer would be: No. The more lenient one is: Maybe. You'll really have to test it on your own. These things are not tested in the normal Bacula release cycle and pretty much unsupported. So it may work or it may just fail. Your best bet is to try and see what happens. (you can always try to get back to the old version later) Greetings, Michel -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.7 (MingW32) iD8DBQFGlSCu2Vs+MkscAyURAk1+AKCPVOGGFtbBW6LIH3z1Kcil1R9/ogCgp7qh JQhCe3pE1oTlAtySJ4Zmj44= =yo0m -END PGP SIGNATURE- - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Any FileSet change determine a Full backup
this is one of the first lines in the chapter The FileSet Resource of the manual: Ignore FileSet Changes = yes|no Normally, if you modify the FileSet Include or Exclude lists, the next backup will be forced to a Full so that Bacula can guarantee that any additions or deletions are properly backed up. If this directive is set to yes, any changes you make to the FileSet Include or Exclude lists will be ignored and not cause Bacula to immediately perform a Full backup. The default is no, in which case, if you change the Include or Exclude, Bacula will force a Full backup to ensure that everything is properly backed up. It is not recommended to set this directive to yes. :) Craig White schrieb: On Wed, 2007-07-11 at 12:59 -0500, Zeratul wrote: Hi Every time when I'm doing a change in the FileSet for a client, the next backup is upgraded to Full from Incremental. There is any posibility to avoid this behavior? Sometimes the changes are really small but the full backup takes a lot of space and time. Any idea will be appreciated. having recently experienced that same issue, I can answer that one...no Therefore, I only make changes to the FileSet on days that the 'Full' backup set is to be run and restart the bacula-dir daemon prior to the time. That behavior affects changes to the FileSet whether they are Include or Exclude selectors. -- IC3S Information, Computer und Solartechnik AG Baekerbarg 6, 22889 Tangstedt, Germany Telefon+49.4109.555.121 Telefax+49.4109.555.57 E-Mail [EMAIL PROTECTED] Webhttp://www.ic3s.de/ Vorstand: Jan Behrmann (Vorsitzender), Stefan Fehlauer Aufsichtsrat: Sven Niklasson (Vorsitzender) Dresdner Bank (200 800 00), Kto. 0123 9582 00 Commerzbank (200 400 00), Kto. 8540 288 Amtsgericht Kiel HRB 7590 UST.IdNr. DE184532766 - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Any FileSet change determine a Full backup
from the docs: Ignore FileSet Changes = yes|no Normally, if you modify the FileSet Include or Exclude lists, the next backup will be forced to a Full so that Bacula can guarantee that any additions or deletions are properly saved. If this directive is set to yes, any changes you make to the FileSet Include or Exclude lists, will not force a Full during subsequent backups. The default is no, in which case, if you change the Include or Exclude, Bacula will force a Full backup to ensure that everything is properly backed up. We strongly recommend against setting this directive to yes, since doing so may cause you to have an incomplete set of backups. On Wed, 2007-07-11 at 11:04 -0700, Craig White wrote: On Wed, 2007-07-11 at 12:59 -0500, Zeratul wrote: Hi Every time when I'm doing a change in the FileSet for a client, the next backup is upgraded to Full from Incremental. There is any posibility to avoid this behavior? Sometimes the changes are really small but the full backup takes a lot of space and time. Any idea will be appreciated. having recently experienced that same issue, I can answer that one...no Therefore, I only make changes to the FileSet on days that the 'Full' backup set is to be run and restart the bacula-dir daemon prior to the time. That behavior affects changes to the FileSet whether they are Include or Exclude selectors. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Imitate Veritas behaviour
Hello List, my company is using bacula for quite a while and we find it is a really cool piece of software! So thanks to Kern and everybody else involved. I would like to know if anybody managed to imitate the behaviour of Veritas as close as possible for the following scenario: - Customers do full backups in multiple jobs every night - Customers sometime forget to change the tape, so it shall be overwritten in that case - Sometimes customers take out the monthly tape and put it away - Some customers have autochanger's, some just a normal TapeDrive but i think that does not matter for this question Now the behaviour of most commercial backup applications (like Veritas) is to overwrite the tape in case it has been left in the drive from the previous day. Only if the tape is overwritten, the records are being purged from the database otherwise the configured retention periods apply. I tried to imitate this behaviour with Bacula v1.36, v1.38 and v2.01 without success. Here is the relevant config of a simple DLT drive. Pool { Name = WeeklyPool Pool Type = Backup AutoPrune = yes Volume Retention = 15h Volume Use Duration = 15h Recycle = yes Recycle Current Volume = yes Maximum Volumes = 0 } This works nicely, but obviously the only gotcha is, that records are being purged from the database every 15 hours (daily). But without specifying Volume Retention AND Volume Use Duration together it does not work either. I thought of using Maximum Volume Jobs, but this is unhandy, since the database has to be adjusted every time a job is added or deleted. Another option would be to set AutoPrune to no and drop the records manually. The best directive would probably be Use Volume Once, but this is to be deprecated. I am looking for some lean solution without helper scripts, cronjobs and just one pool. Any ideas? regards GeE - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] data error... buffer discarded
On Wed, 11 Jul 2007, Arno Lehmann wrote: Hi, 11.07.2007 03:30,, Charles Sprickman wrote:: Hi all, I'm doing my first live backup and the first host seems to have gone alright, but there's one error in the run that is not clear to me: 10-Jul 20:40 devel2-sd: devel2.2007-07-10_20.39.56 Error: block.c:275 Volume data error at 0:0! Wanted ID: BB02, got . Buffer discarded. I'm guessing it's not fatal since the job continued, but what is that error telling me? I've got bacula set to spool everything before going to tape since I'm running most of my data off a slow wan link. Here's the message in context: 10-Jul 20:39 devel2-dir: No prior Full backup Job record found. 10-Jul 20:39 devel2-dir: No prior or suitable Full backup found in catalog. Doing FULL backup. 10-Jul 20:39 devel2-dir: Start Backup JobId 3, Job=devel2.2007-07-10_20.39.56 10-Jul 20:40 devel2-dir: Created new Volume Monthly0001 in catalog. 10-Jul 20:40 devel2-sd: devel2.2007-07-10_20.39.56 Error: block.c:275 Volume data error at 0:0! Wanted ID: BB02, got . Buffer discarded. 10-Jul 20:40 devel2-sd: Labeled new Volume Monthly0001 on device TapeStorage (/dev/nsa0). 10-Jul 20:40 devel2-sd: Wrote label to prelabeled Volume Monthly0001 on device TapeStorage (/dev/nsa0) 10-Jul 20:40 devel2-sd: Spooling data ... Any ideas on this? That's just Bacula labeling a new volume. I tries to verify if the volume in question is already a Bacula-labeled volume, and doesn't find it's header. This is normal and expected when labeling volumes. Thanks so much for clarifying this. I just wanted to make sure I wasn't starting out with some error that would later end up causing me problems during the test restore. Thanks again, Charles Arno Thanks, Charles - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Arno Lehmann IT-Service Lehmann www.its-lehmann.de - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] btape test works;backup works;restore doesn't
On Tue, 10 Jul 2007 16:36:59 -0500 Michael Hughes [EMAIL PROTECTED] wrote: I have loaded Bacula 2.0.3 from source on my FreeBSD system. I ran btape test and it passed all the tests. Also ran the autoloader test and that passed. I did a full backup which fit on one DLT IV tape. Then I wanted to do a test restore to make sure things are working before I stop doing my dump(8). When I do a restore, I picked a couple of files and the restore started. I have search the web and having been able to find anything like this. I have also noticed that the drive seems to go offline right after the restore job starts. Then it loads the tape again, but gets the error. Here are the errors I get: Forward spacing Volume AI0011 to file:block 5:0. RestoreFiles.2007-07-10_13.00.18 Error: block.c:993 Read error on fd=6 at file:blk 5:2563 on device DLT_9 (/dev/nsa1). ERR=Operation not permitted. RestoreFiles.2007-07-10_13.00.18 Error: Unexpected Tape is Off-line Here is my bacula-sd.conf for the device: Autochanger { Name= Autochanger Device = DLT_9 Changer Command = /mnt4/mdh/bacula-2.0.3/examples/autochangers/rc chio-changer %c %o %S %a %d Changer Device = /dev/ch0 } Device { Name= DLT_9 Drive Index = 0 Media Type = DLT Archive Device = /dev/nsa1 AutomaticMount = yes; LabelMedia = yes; RemovableMedia = yes; AutoChanger = yes Offline On Unmount = no Hardware End of Medium = no BSF at EOM = yes Backward Space Record = no Backward Space File = no Fast Forward Space File = no TWO EOF = yes } -- Michael Hughes Log Home living is the best [EMAIL PROTECTED] Temperatures: Outside: 77.9 House: 71.2 Computer room: 69.7 Well I think I figured out what my problem was. It turned out to be a SCSI cable problem. I got to looking in the logs and found this error: /kernel: sym0: unexpected disconnect After doing some re-cabling, it start to work without any errors. I don't understand why restore(8) was able to read from that drive and both dunp(8) and Bacula were able to write to the drive. -- Michael Hughes Log Home living is the best [EMAIL PROTECTED] Temperatures: Outside: 77.4 House: 71.4 Computer room: 69.8 - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Reuse old tapes not working correctly
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Jason King wrote: I have 8 tapes in a cycle. Bacula is suppose to run until the tape is full. I have the volume retention set to 4 months, then after that 4 months the tape should then be in recycle or append mode and I should be able to write data to it fresh. But now each tape is only holding a fraction of what is use to be able to hold. Example, I have 200/400 LTO tapes. The first tape that came back into rotation held about 300G the first time around, this time it held about 150G. The next tape held only about 140G and the next one only held 600Meg before it was labeled full. Am I not recycling my tapes correctly? Please assist. I would say that is suspicious. It is normal, if you are using compression, to see varying amounts of data (even amounts smaller than the native capacity). In this case, though, it almost sounds like there is some sort of problem (not rewinding or something like that). You're sure these tapes have gone through a Used and then Recycled state? I'm assuming you've done the btape tests prior to using this device? - -- _ _ _ _ ___ _ _ _ |Y#| | | |\/| | \ |\ | | |Ryan Novosielski - Systems Programmer III |$| |__| | | |__/ | \| _| |[EMAIL PROTECTED] - 973/972.0922 (2-0922) \__/ Univ. of Med. and Dent.|IST/AST - NJMS Medical Science Bldg - C630 -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFGlZ6xmb+gadEcsb4RAo/YAJ4yFO2Xocpk2lGPKVbnUTyHjioTCgCgnn/K 9Vp5BXHfx6dyoUOHA7I9wMU= =gem6 -END PGP SIGNATURE- begin:vcard fn:Ryan Novosielski n:Novosielski;Ryan org:UMDNJ;IST/AST adr;dom:MSB C630;;185 South Orange Avenue;Newark;NJ;07103 email;internet:[EMAIL PROTECTED] title:Systems Programmer III tel;work:(973) 972-0922 tel;fax:(973) 972-7412 tel;pager:(866) 20-UMDNJ x-mozilla-html:FALSE version:2.1 end:vcard - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Tape Recycling/rotation question
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Jason King wrote: Ok, I have a question about tape recycling and rotation. I have 9 tapes in a rotation. Each tape has a retention period of 2 months. The tapes are switched out when they are full. When I get to tape 9 and bacula then wants to goto the next available appendable volume, which should be tapes 1-3 or so, when I pop in tape 1, shouldn't bacula just write over the data that is on that tape as if the tape where a new unused tape? And shouldn't that tape have a status of recycle or appendable or something when its retention period is over? I'm having some issues with recycled tapes not filling up with the same amount of data as before. They aren't even filling up with the native amount of data (uncompressed). I'd appreciate any assistance. The progression ought to be that that tape is marked Full if full, or Used if it goes above one of your configured thresholds. After that, it should eventually prune all of the jobs off that tape and then you'll be able to write to it again (and it will be in the states you've described). If your tapes stay Appendable (sounds like not the case, since you've been filling them), they will never recycle. - -- _ _ _ _ ___ _ _ _ |Y#| | | |\/| | \ |\ | | |Ryan Novosielski - Systems Programmer III |$| |__| | | |__/ | \| _| |[EMAIL PROTECTED] - 973/972.0922 (2-0922) \__/ Univ. of Med. and Dent.|IST/AST - NJMS Medical Science Bldg - C630 -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFGlZ9Ymb+gadEcsb4RAqQeAJ4g31+Lq6pmfldT8N8miqpY7+U8+wCgog5m wBtIDiaoenbumHP24VgVg4o= =M6Zp -END PGP SIGNATURE- begin:vcard fn:Ryan Novosielski n:Novosielski;Ryan org:UMDNJ;IST/AST adr;dom:MSB C630;;185 South Orange Avenue;Newark;NJ;07103 email;internet:[EMAIL PROTECTED] title:Systems Programmer III tel;work:(973) 972-0922 tel;fax:(973) 972-7412 tel;pager:(866) 20-UMDNJ x-mozilla-html:FALSE version:2.1 end:vcard - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Restore question
Hi, I have been using bacula for 5 years now and finally comes the first time I need to do a major restore from our tapes. I read the tutorial, tried the instructions and it seemingly worked as designed (I haven't run actual restore yet) but I am not sure which exactly files it was going to restore. I have two pools of tapes: one for full backups (run monthly) and another one for incremental (run every night). The 'restore all' command, when instructed to find JobIds of the most recent backup for a client, correctly located and listed all relevant full backups plus all incremental ones. It then proceeded creating directory tree and in the process went through both latest full backup and all incrementals since. So I assume this tree contains the latest snapshot? Or should I actually run two restores to get all the latest files: one for last full set and another one for all incrementals? I guess this is a stupid question but I'd really appreciate if someone could enlighten me since going through 50,000+ files manually to check the versions restored is really not an option. Thanks, Ivan - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Any FileSet change determine a Full backup
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Has anyone done a test that verifies exactly what this does? If I add a new directory to my fileset, and I have this directive turns on, do the new files get backed up as part of the incremental? I have personally been doing as Craig said -- adding new major fileset changes near the full backup... but it seems to me that this is not dangerous in all of the cases that I can think of... Here's one I am just about to encounter: 1. Add new FS to machine 2. Add new FS to Bacula FileSet 3. Next day, IgnoreFileSetChanges = yes, does my new filesystem get backed up or does it not? Julien wrote: from the docs: Ignore FileSet Changes = yes|no Normally, if you modify the FileSet Include or Exclude lists, the next backup will be forced to a Full so that Bacula can guarantee that any additions or deletions are properly saved. If this directive is set to yes, any changes you make to the FileSet Include or Exclude lists, will not force a Full during subsequent backups. The default is no, in which case, if you change the Include or Exclude, Bacula will force a Full backup to ensure that everything is properly backed up. We strongly recommend against setting this directive to yes, since doing so may cause you to have an incomplete set of backups. On Wed, 2007-07-11 at 11:04 -0700, Craig White wrote: On Wed, 2007-07-11 at 12:59 -0500, Zeratul wrote: Hi Every time when I'm doing a change in the FileSet for a client, the next backup is upgraded to Full from Incremental. There is any posibility to avoid this behavior? Sometimes the changes are really small but the full backup takes a lot of space and time. Any idea will be appreciated. having recently experienced that same issue, I can answer that one...no Therefore, I only make changes to the FileSet on days that the 'Full' backup set is to be run and restart the bacula-dir daemon prior to the time. That behavior affects changes to the FileSet whether they are Include or Exclude selectors. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - -- _ _ _ _ ___ _ _ _ |Y#| | | |\/| | \ |\ | | |Ryan Novosielski - Systems Programmer III |$| |__| | | |__/ | \| _| |[EMAIL PROTECTED] - 973/972.0922 (2-0922) \__/ Univ. of Med. and Dent.|IST/AST - NJMS Medical Science Bldg - C630 -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFGlaEPmb+gadEcsb4RAs6NAJ9PNAAdZR7e/w76Ggz5k/CvFoM0hACdHK5N WsNJFTsDHeY+O/sMCMQ8IJ4= =/zbJ -END PGP SIGNATURE- begin:vcard fn:Ryan Novosielski n:Novosielski;Ryan org:UMDNJ;IST/AST adr;dom:MSB C630;;185 South Orange Avenue;Newark;NJ;07103 email;internet:[EMAIL PROTECTED] title:Systems Programmer III tel;work:(973) 972-0922 tel;fax:(973) 972-7412 tel;pager:(866) 20-UMDNJ x-mozilla-html:FALSE version:2.1 end:vcard - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] data error... buffer discarded
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 This one comes up now and again. Probably would be good to add it to the wiki, but another thing might be to get this error message clarified or expanded upon. Probably wouldn't be hard to make it say something that's less scary, if it can determine that it's not a bad case (ie. I just figured out there's no label, mention to the user No initial label or something non-scary). But, then, I never even noticed this, so... I guess it hasn't scared me. :) Charles Sprickman wrote: On Wed, 11 Jul 2007, Arno Lehmann wrote: Hi, 11.07.2007 03:30,, Charles Sprickman wrote:: Hi all, I'm doing my first live backup and the first host seems to have gone alright, but there's one error in the run that is not clear to me: 10-Jul 20:40 devel2-sd: devel2.2007-07-10_20.39.56 Error: block.c:275 Volume data error at 0:0! Wanted ID: BB02, got . Buffer discarded. I'm guessing it's not fatal since the job continued, but what is that error telling me? I've got bacula set to spool everything before going to tape since I'm running most of my data off a slow wan link. Here's the message in context: 10-Jul 20:39 devel2-dir: No prior Full backup Job record found. 10-Jul 20:39 devel2-dir: No prior or suitable Full backup found in catalog. Doing FULL backup. 10-Jul 20:39 devel2-dir: Start Backup JobId 3, Job=devel2.2007-07-10_20.39.56 10-Jul 20:40 devel2-dir: Created new Volume Monthly0001 in catalog. 10-Jul 20:40 devel2-sd: devel2.2007-07-10_20.39.56 Error: block.c:275 Volume data error at 0:0! Wanted ID: BB02, got . Buffer discarded. 10-Jul 20:40 devel2-sd: Labeled new Volume Monthly0001 on device TapeStorage (/dev/nsa0). 10-Jul 20:40 devel2-sd: Wrote label to prelabeled Volume Monthly0001 on device TapeStorage (/dev/nsa0) 10-Jul 20:40 devel2-sd: Spooling data ... Any ideas on this? That's just Bacula labeling a new volume. I tries to verify if the volume in question is already a Bacula-labeled volume, and doesn't find it's header. This is normal and expected when labeling volumes. Thanks so much for clarifying this. I just wanted to make sure I wasn't starting out with some error that would later end up causing me problems during the test restore. Thanks again, Charles Arno Thanks, Charles - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Arno Lehmann IT-Service Lehmann www.its-lehmann.de - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - -- _ _ _ _ ___ _ _ _ |Y#| | | |\/| | \ |\ | | |Ryan Novosielski - Systems Programmer III |$| |__| | | |__/ | \| _| |[EMAIL PROTECTED] - 973/972.0922 (2-0922) \__/ Univ. of Med. and Dent.|IST/AST - NJMS Medical Science Bldg - C630 -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD4DBQFGlaV6mb+gadEcsb4RAn9nAJQKtHcz+M+x2y6+uAAKVivqTD5hAKCo+mik q0xbSV+xpA1wd5DNEFnjLw== =krmo -END PGP SIGNATURE- begin:vcard fn:Ryan Novosielski n:Novosielski;Ryan org:UMDNJ;IST/AST adr;dom:MSB C630;;185 South Orange Avenue;Newark;NJ;07103 email;internet:[EMAIL PROTECTED] title:Systems Programmer III tel;work:(973) 972-0922 tel;fax:(973) 972-7412 tel;pager:(866) 20-UMDNJ x-mozilla-html:FALSE version:2.1 end:vcard - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net
Re: [Bacula-users] bacula beta can't find qt on compile
This is from the Dev List and straight from Kern... It may address the issue you are experiencing. Hello, Scott Barninger brought my attention to the fact that the way I was dealing with including the third party qwt Graphic library for Qt into bat doesn't play well with rpms and such. As a consequence, in the current SVN, I have removed the code that builds that library within the Bacula source code tree during the ./configure process. In order to build Bacula with bat, you either need to build and install the qwt packages on your system, or alternatively, you can download the latest depkgs package (depkgs-11Jul07.tar.gz) and build it. It now includes the qwt package. In addition, you will need to add a new ./configure option, which is: --with-qwt=directory where directory is replaced by the directory under which Bacula can find lib/... and include/... that include the files for qwt. For example, if you have installed qwt on your system, it will by default install in /usr/include and /usr/lib. In that case, you would use: --with-qwt=/usr If you use depkgs, you would use: --with-qwt=.../depkgs/qwt e.g. I use: --with-qwt=$HOME/bacula/depkgs/qwt Currently, if Bacula does not find qwt, or you don't supply the above option, bat will not be built. Please don't forget that you also need --enable-bat on the ./ configure line. Best regards, Kern On Jul 11, 2007, at 12:15 PM, Megan Kispert wrote: I think I did something wrong. I have a centos 4.5 server. I compiled then installed QT from qt-x11-opensource-src-4.3.0 with all defaults. It installed in /usr/local/Rtolltech/Qt-4.3.0. I added /usr/local/Trolltech/Qt-4.3.0/bin to root's path and /usr/local/Trolltech/Qt-4.3.0/lib to /etc/ld.so.conf. Then I ran configure for bacula-2.1.24 as root with the --enable- bat flag. I get the following: . . . checking whether NLS is requested... yes checking for GNU gettext in libc... yes checking whether to use NLS... yes checking where the gettext function comes from... libc checking for msgfmt... (cached) /usr/bin/msgfmt configure: error: Unable to find Qt4 installation needed by bat Do I need to do something with Qt4 after a fresh install? Is there a flag in bacula configure that I need to set for it to see Qt? -Megan -- --- This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users