[Bacula-users] Bacula public key import fails
Hi folks, I've downloaded 9.4.0 source (same problem for 9.2.2) and cannot import the Bacula public key. I've tried copy/pasting, made sure I don't have any trailing or leading spaces. I tried downloading the main public key link via wget and editing the resulting file with vi to extract the key in case there was some weird copy/paste problem. I've also tried doing a wget of the public key straight from the link to the key itself but that fails with a 404. No joy on any of them. Any ideas? I'm running Ubuntu Server 18.04 and gpg 2.2.4 as shown below Error: $ gpg --import bacula_pub.key gpg: no valid OpenPGP data found. gpg: Total number processed: 0 $ gpg --version gpg (GnuPG) 2.2.4 libgcrypt 1.8.1 ... Relevant links: https://blog.bacula.org/bacula-distribution-verification-public-keys/ Gives a 404: https://blog.bacula.org/www.bacula.org/downloads/Bacula-4096-Distribution-Verification-key.asc Note that the old public key from July 2017 I download from here will import, but as expected, it does not verify 9.4.0 https://sourceforge.net/projects/bacula/files/Bacula%20Public%20Key/Current%20Public%20Key/Bacula4096Distribution.asc/download Thanks, Mike ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula-dir run failure on Ubuntu 12.04.02 - FIXED
On 8/3/2013 2:52 AM, lst_ho...@kwsoft.de wrote: > > Zitat von uhog-v...@spamex.com: > >> Hi folks, >> >> For what it's worth, I tried compiling Bacula 5.0.3 on Ubuntu 12.0.4 >> today. I currently have Bacula 5.0.3 running on Ubuntu 10.0.4 on >> another server. The compilation failed on 12.0.4 for the director >> though the SD and FD both compiled. I played around a bit but then >> decided just for kicks to reinstall this new machine back to 10.0.4 >> and try that. After that, I did an update, and then loaded the >> build-essential, libncurses5-dev, and libmysqlclient-dev packages. I >> then built 5.2.13 and it builds and runs with no problem. So >> whatever is going on must be related to something happening with >> Ubuntu packaging at 12.0.4 that causes Bacula to not link in >> everything it needs. >> >> Since my primary goal is to get moved to different hardware, I'm >> just going to continue running on 10.0.4 on the new hardware with >> the 5.2.13 Bacula since 10.0.4 is supported until midway through >> 2015. After I get everything migrated and stabilized, maybe I'll >> play with debugging this 12.0.4 problem again in a virtual machine >> or something in my spare time. >> >> Thanks again for the ideas, I learned a bit more about digging >> around in the symbols on linux so it was worth that anyway. If I do >> get back to it and find a solid answer, I'll update the list. >> >> Mike > > Some time ago i build 5.2.13 the Debian/Ubuntu way as .deb packages on > Ubuntu 12.04. I can provide you a link for download without any > warranty of course. Maybe i can even dig out the thing which have to > be done to get the deb compiled. > > Regards > > Andreas A bit more reading and thinking and poking around on the web and I found this: http://bacula.10910.n7.nabble.com/director-fails-with-quot-undefined-symbol-mysql-thread-safe-quot-td73835.html Too bad the last response in that thread did not make it out to the mailing list! The short answer to the problem is that with the default Makefile for the src/cats diretory, the build cannot find the libmysqlclient_r on Ubuntu 12.04. I'm not exactly sure why the configure works but the Makefile is not built properly but I am really out of my element when I get deep into building software on linux. At any rate, to get Bacula to build on Ubuntu 12.04.02 with mysql, use the proper configure file and make sure that works as expected. Then edit the src/cats/Makefile produced and change the line MYSQL_LIBS = to MYSQL_LIBS = -L/usr/lib/i386-linux-gnu -lmysqlclient_r Note that this was the proper path for my Ubuntu 12.04.02 LTS 32 bit installation, but you may have a different path). The directory now runs with no problems. Hope this helps and thanks for all the help folks. Mike -- Get your SQL database under version control now! Version control is standard for application code, but databases havent caught up. So what steps can you take to put your SQL databases under version control? Why should you start doing it? Read more to find out. http://pubads.g.doubleclick.net/gampad/clk?id=49501711&iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula-dir run failure on Ubuntu 12.04.02
Hi folks, For what it's worth, I tried compiling Bacula 5.0.3 on Ubuntu 12.0.4 today. I currently have Bacula 5.0.3 running on Ubuntu 10.0.4 on another server. The compilation failed on 12.0.4 for the director though the SD and FD both compiled. I played around a bit but then decided just for kicks to reinstall this new machine back to 10.0.4 and try that. After that, I did an update, and then loaded the build-essential, libncurses5-dev, and libmysqlclient-dev packages. I then built 5.2.13 and it builds and runs with no problem. So whatever is going on must be related to something happening with Ubuntu packaging at 12.0.4 that causes Bacula to not link in everything it needs. Since my primary goal is to get moved to different hardware, I'm just going to continue running on 10.0.4 on the new hardware with the 5.2.13 Bacula since 10.0.4 is supported until midway through 2015. After I get everything migrated and stabilized, maybe I'll play with debugging this 12.0.4 problem again in a virtual machine or something in my spare time. Thanks again for the ideas, I learned a bit more about digging around in the symbols on linux so it was worth that anyway. If I do get back to it and find a solid answer, I'll update the list. Mike On 8/1/2013 10:21 PM, uhog-v...@spamex.com wrote: > > > > On 8/1/2013 10:12 AM, Martin Simmons wrote: >>>>>>> On Wed, 31 Jul 2013 13:52:10 -0400, uhog-v9e4 said: >>> >>> On 7/31/2013 10:33 AM, Martin Simmons wrote: >>>> >>>>>>>>> On Tue, 30 Jul 2013 11:55:43 -0400, uhog-v9e4 said: >>>>> >>>>> Hi folks, >>>>> >>>>> I'm trying to build and run Bacula 5.2.13 on Ubuntu server 12.04.02. I >>>>> have downloaded source and bacula builds with no problem but the director >>>>> fails to start with the following error: >>>>> >>>>> node1:~# /opt/bacula/bin/bacula-dir -f >>>>> /opt/bacula/bin/bacula-dir: symbol lookup error: >>>>> /opt/bacula/lib/libbaccats-5.2.13.so: undefined symbol: mysql_thread_safe >>>>> node1:~# dpkg --list |grep libmysqlclient >>>>> ii libmysqlclient-dev 5.5.32-0ubuntu0.12.04.1 >>>>> MySQL database development files >>>>> ii libmysqlclient18 5.5.32-0ubuntu0.12.04.1 >>>>> MySQL database client library >>>>> node1:~# >>>> >>>> What is the output of >>>> >>>> ldd /opt/bacula/lib/libbaccats-5.2.13.so >>>> >>>> It might be an Ubuntu packaging bug like this one: >>>> >>>> https://bugs.launchpad.net/ubuntu/+source/bacula/+bug/949508 >>>> >>>> __Martin >>> >>> Hi Martin, >>> >>> Thanks. I believe this is the problem, but I'm not sure how to fix it. >> >> Is the machine fully updated? >> > Yes, the machine was installed via the Ubuntu server CD with LAMPs, then I > added build-essential, libmysqlclient-dev, and xubuntu-desktop just to get a > basic gui. Then apt-update and apt-get dist-upgrade to get it all current. > Then I downloaded the bacula 5.2.13 tar ball and did the configure and build. > >> >>> node1:~# ldd /opt/bacula/lib/libbaccats-5.2.13.so >>> linux-gate.so.1 => (0xb7772000) >>> libstdc++.so.6 => /usr/lib/i386-linux-gnu/libstdc++.so.6 >>> (0xb7675000) >>> libc.so.6 => /lib/i386-linux-gnu/libc.so.6 (0xb74cc000) >>> libm.so.6 => /lib/i386-linux-gnu/libm.so.6 (0xb749f000) >>> /lib/ld-linux.so.2 (0xb7773000) >>> libgcc_s.so.1 => /lib/i386-linux-gnu/libgcc_s.so.1 (0xb7481000) >>> node1:~# >>> >>> So there is no mysql library here. I found the mysql_thread_safe symbol >>> defined in /usr/lib/i386-linux-gnu/libmysqlclient_r.a on my system but the >>> libmysqlclient.so file is stripped. >>> >>> node1:~# find /usr -name libmysqlclient.so*|xargs ls -l >>> lrwxrwxrwx 1 root root 20 Jul 24 01:32 >>> /usr/lib/i386-linux-gnu/libmysqlclient.so -> libmysqlclient.so.18 >>> lrwxrwxrwx 1 root root 24 Jul 24 01:32 >>> /usr/lib/i386-linux-gnu/libmysqlclient.so.18 -> libmysqlclient.so.18.0.0 >>> -rw-r--r-- 1 root root 3237128 Jul 24 01:32 >>> /usr/lib/i386-linux-gnu/libmysqlclient.so.18.0.0 >>> node1:~# nm /usr/lib/i386-linux-gnu/libmysqlclient.so.18.0.0 >>> nm: /usr/lib/i386-linux-gnu/libmysqlclient.so.18.0.0: no symbols >>> node1:~#
Re: [Bacula-users] bacula-dir run failure on Ubuntu 12.04.02
On 8/1/2013 10:12 AM, Martin Simmons wrote: >>>>>> On Wed, 31 Jul 2013 13:52:10 -0400, uhog-v9e4 said: >> >> On 7/31/2013 10:33 AM, Martin Simmons wrote: >>> >>>>>>>> On Tue, 30 Jul 2013 11:55:43 -0400, uhog-v9e4 said: >>>> >>>> Hi folks, >>>> >>>> I'm trying to build and run Bacula 5.2.13 on Ubuntu server 12.04.02. I >>>> have downloaded source and bacula builds with no problem but the director >>>> fails to start with the following error: >>>> >>>> node1:~# /opt/bacula/bin/bacula-dir -f >>>> /opt/bacula/bin/bacula-dir: symbol lookup error: >>>> /opt/bacula/lib/libbaccats-5.2.13.so: undefined symbol: mysql_thread_safe >>>> node1:~# dpkg --list |grep libmysqlclient >>>> ii libmysqlclient-dev 5.5.32-0ubuntu0.12.04.1 >>>> MySQL database development files >>>> ii libmysqlclient18 5.5.32-0ubuntu0.12.04.1 >>>> MySQL database client library >>>> node1:~# >>> >>> What is the output of >>> >>> ldd /opt/bacula/lib/libbaccats-5.2.13.so >>> >>> It might be an Ubuntu packaging bug like this one: >>> >>> https://bugs.launchpad.net/ubuntu/+source/bacula/+bug/949508 >>> >>> __Martin >> >> Hi Martin, >> >> Thanks. I believe this is the problem, but I'm not sure how to fix it. > > Is the machine fully updated? > Yes, the machine was installed via the Ubuntu server CD with LAMPs, then I added build-essential, libmysqlclient-dev, and xubuntu-desktop just to get a basic gui. Then apt-update and apt-get dist-upgrade to get it all current. Then I downloaded the bacula 5.2.13 tar ball and did the configure and build. > >> node1:~# ldd /opt/bacula/lib/libbaccats-5.2.13.so >> linux-gate.so.1 => (0xb7772000) >> libstdc++.so.6 => /usr/lib/i386-linux-gnu/libstdc++.so.6 >> (0xb7675000) >> libc.so.6 => /lib/i386-linux-gnu/libc.so.6 (0xb74cc000) >> libm.so.6 => /lib/i386-linux-gnu/libm.so.6 (0xb749f000) >> /lib/ld-linux.so.2 (0xb7773000) >> libgcc_s.so.1 => /lib/i386-linux-gnu/libgcc_s.so.1 (0xb7481000) >> node1:~# >> >> So there is no mysql library here. I found the mysql_thread_safe symbol >> defined in /usr/lib/i386-linux-gnu/libmysqlclient_r.a on my system but the >> libmysqlclient.so file is stripped. >> >> node1:~# find /usr -name libmysqlclient.so*|xargs ls -l >> lrwxrwxrwx 1 root root 20 Jul 24 01:32 >> /usr/lib/i386-linux-gnu/libmysqlclient.so -> libmysqlclient.so.18 >> lrwxrwxrwx 1 root root 24 Jul 24 01:32 >> /usr/lib/i386-linux-gnu/libmysqlclient.so.18 -> libmysqlclient.so.18.0.0 >> -rw-r--r-- 1 root root 3237128 Jul 24 01:32 >> /usr/lib/i386-linux-gnu/libmysqlclient.so.18.0.0 >> node1:~# nm /usr/lib/i386-linux-gnu/libmysqlclient.so.18.0.0 >> nm: /usr/lib/i386-linux-gnu/libmysqlclient.so.18.0.0: no symbols >> node1:~# file /usr/lib/i386-linux-gnu/libmysqlclient.so.18.0.0 >> /usr/lib/i386-linux-gnu/libmysqlclient.so.18.0.0: ELF 32-bit LSB shared >> object, Intel 80386, version 1 (SYSV), dynamically linked, >> BuildID[sha1]=0x23cf2ee7f1d6d66c6095cedf7fb067708cc9c5eb, stripped > > Stripped is normal -- try objdump -T to see the dynamic symbols. > Looks good. node1:~# objdump -T /usr/lib/i386-linux-gnu/libmysqlclient.so.18.0.0|grep thread_safe 0001c990 gDF .text 000a Basemysql_thread_safe node1:~# > >> >> And I can see this in the bacula config.log >> --- >> configure:24471: checking for mysql_thread_safe in -lmysqlclient_r >> configure:24496: gcc -o conftest -g -O2 -Wall -L/usr/lib conftest.c >> -lmysqlclient_r -ldl -ldl -lz >&5 >> configure:24496: $? = 0 >> configure:24505: result: yes >> --- >> >> So I'm not sure what's going on here, but it looks like progress. Also, if >> it makes any difference, this is the 32-bit flavor of Ubuntu running on >> 32-bit hardware. > > Check the command line used to link libbaccats-5.2.13.so (run make with > NO_ECHO='' to see it). Does it mention -lmysqlclient_r? > It appears it does not. Output captured using make NO_ECHO='' Making libbaccats.la ... /home/mrc/bacula-build/bacula-5.2.13/libtool --silent --tag=CXX --mode=link /usr/bin/g++ -D_BDB_PRIV_INTERFACE_ -o libbaccats.la cats_dummy.lo -export-dynamic -rpath /opt/bacula/lib -release 5.2.13 Compiling mysql.c /home/mrc/bacula-build/bacu
Re: [Bacula-users] bacula-dir run failure on Ubuntu 12.04.02
On 7/31/2013 10:33 AM, Martin Simmons wrote: > >>>>>> On Tue, 30 Jul 2013 11:55:43 -0400, uhog-v9e4 said: >> >> Hi folks, >> >> I'm trying to build and run Bacula 5.2.13 on Ubuntu server 12.04.02. I have >> downloaded source and bacula builds with no problem but the director fails >> to start with the following error: >> >> node1:~# /opt/bacula/bin/bacula-dir -f >> /opt/bacula/bin/bacula-dir: symbol lookup error: >> /opt/bacula/lib/libbaccats-5.2.13.so: undefined symbol: mysql_thread_safe >> node1:~# dpkg --list |grep libmysqlclient >> ii libmysqlclient-dev 5.5.32-0ubuntu0.12.04.1 >> MySQL database development files >> ii libmysqlclient18 5.5.32-0ubuntu0.12.04.1 >> MySQL database client library >> node1:~# > > What is the output of > > ldd /opt/bacula/lib/libbaccats-5.2.13.so > > It might be an Ubuntu packaging bug like this one: > > https://bugs.launchpad.net/ubuntu/+source/bacula/+bug/949508 > > __Martin Hi Martin, Thanks. I believe this is the problem, but I'm not sure how to fix it. node1:~# ldd /opt/bacula/lib/libbaccats-5.2.13.so linux-gate.so.1 => (0xb7772000) libstdc++.so.6 => /usr/lib/i386-linux-gnu/libstdc++.so.6 (0xb7675000) libc.so.6 => /lib/i386-linux-gnu/libc.so.6 (0xb74cc000) libm.so.6 => /lib/i386-linux-gnu/libm.so.6 (0xb749f000) /lib/ld-linux.so.2 (0xb7773000) libgcc_s.so.1 => /lib/i386-linux-gnu/libgcc_s.so.1 (0xb7481000) node1:~# So there is no mysql library here. I found the mysql_thread_safe symbol defined in /usr/lib/i386-linux-gnu/libmysqlclient_r.a on my system but the libmysqlclient.so file is stripped. node1:~# find /usr -name libmysqlclient.so*|xargs ls -l lrwxrwxrwx 1 root root 20 Jul 24 01:32 /usr/lib/i386-linux-gnu/libmysqlclient.so -> libmysqlclient.so.18 lrwxrwxrwx 1 root root 24 Jul 24 01:32 /usr/lib/i386-linux-gnu/libmysqlclient.so.18 -> libmysqlclient.so.18.0.0 -rw-r--r-- 1 root root 3237128 Jul 24 01:32 /usr/lib/i386-linux-gnu/libmysqlclient.so.18.0.0 node1:~# nm /usr/lib/i386-linux-gnu/libmysqlclient.so.18.0.0 nm: /usr/lib/i386-linux-gnu/libmysqlclient.so.18.0.0: no symbols node1:~# file /usr/lib/i386-linux-gnu/libmysqlclient.so.18.0.0 /usr/lib/i386-linux-gnu/libmysqlclient.so.18.0.0: ELF 32-bit LSB shared object, Intel 80386, version 1 (SYSV), dynamically linked, BuildID[sha1]=0x23cf2ee7f1d6d66c6095cedf7fb067708cc9c5eb, stripped And I can see this in the bacula config.log --- configure:24471: checking for mysql_thread_safe in -lmysqlclient_r configure:24496: gcc -o conftest -g -O2 -Wall -L/usr/lib conftest.c -lmysqlclient_r -ldl -ldl -lz >&5 configure:24496: $? = 0 configure:24505: result: yes --- So I'm not sure what's going on here, but it looks like progress. Also, if it makes any difference, this is the 32-bit flavor of Ubuntu running on 32-bit hardware. Mike -- Get your SQL database under version control now! Version control is standard for application code, but databases havent caught up. So what steps can you take to put your SQL databases under version control? Why should you start doing it? Read more to find out. http://pubads.g.doubleclick.net/gampad/clk?id=49501711&iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] bacula-dir run failure on Ubuntu 12.04.02
Hi folks, I'm trying to build and run Bacula 5.2.13 on Ubuntu server 12.04.02. I have downloaded source and bacula builds with no problem but the director fails to start with the following error: node1:~# /opt/bacula/bin/bacula-dir -f /opt/bacula/bin/bacula-dir: symbol lookup error: /opt/bacula/lib/libbaccats-5.2.13.so: undefined symbol: mysql_thread_safe node1:~# dpkg --list |grep libmysqlclient ii libmysqlclient-dev 5.5.32-0ubuntu0.12.04.1 MySQL database development files ii libmysqlclient18 5.5.32-0ubuntu0.12.04.1 MySQL database client library node1:~# I went back and double checked my configure and make output and all looks good. checking for mysql_thread_safe in -lmysqlclient_r... yes checking for pthread_create in -lpthread... yes ... C Compiler: gcc 4.6.3-1ubuntu5) C++ Compiler: /usr/bin/g++ 4.6.3-1ubuntu5) Compiler flags:-g -O2 -Wall -fno-strict-aliasing -fno-exceptions -fno-rtti Linker flags: Libraries:-lpthread -ldl -ldl ... Making libbaccats-mysql.la ... /home/mrc/bacula-build/bacula-5.2.13/libtool --silent --tag=CXX --mode=link /usr/bin/g++ -D_BDB_PRIV_INTERFACE_ -o libbaccats-mysql.la mysql.lo -export-dynamic -rpath /opt/bacula/lib -release 5.2.13 \ -soname libbaccats-5.2.13.so Make of sqllibs is good ... /home/mrc/bacula-build/bacula-5.2.13/libtool --silent --tag=CXX --mode=link /usr/bin/g++ -L../lib -L../cats -L../findlib -o bacula-dir dird.o admin.o authenticate.o autoprune.o backup.o bsr.o catreq.o dir_plugins.o dird_conf.o expand.o fd_cmds.o getmsg.o inc_conf.o job.o jobq.o migrate.o mountreq.o msgchan.o next_vol.o newvol.o pythondir.o recycle.o restore.o run_conf.o scheduler.o ua_acl.o ua_cmds.o ua_dotcmds.o ua_query.o ua_input.o ua_label.o ua_output.o ua_prune.o ua_purge.o ua_restore.o ua_run.o ua_select.o ua_server.o ua_status.o ua_tree.o ua_update.o vbackup.o verify.o \ -lbacfind -lbacsql -lbaccats -lbacpy -lbaccfg -lbac -lm -lpthread -ldl -ldl \ Make of dird is good I'm fairly experienced running and building Bacula on Ubuntu server going back to the 3.x days and Ubuntu 8.04 but I'm not really a programmer, realy more of an admin that knows how to use google and follow instructions and just enough programming to get myself into trouble. I can't figure this one out. Anyone have any ideas? My ./configure file is the example from the 5.2.13 ReleaseNotes minus the --enable-bat because I don't have Qt loaded. Is this more of a question for the bacula-devel list? Any help or ideas are greatly appreciated. Thanks, Mike -- Get your SQL database under version control now! Version control is standard for application code, but databases havent caught up. So what steps can you take to put your SQL databases under version control? Why should you start doing it? Read more to find out. http://pubads.g.doubleclick.net/gampad/clk?id=49501711&iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Vista 64 bit and sparse files
OK, I may have just found this. Running another 3rd party tool "windirstat" with admin privileges uncovered a bunch of files in the /tmp/bacula-restore/System Volume Information directory, about 34Gb to be exact. I have never excluded this dir on my 32-bit XP clients and have not had a problem and obviously there's something strange going on here because if I run the same tool on the production client with admin priv it reports /System Volume Information consuming practically no space. Very odd. Anyway, I will exclude these and run another backup this weekend and see how it goes. Thanks everyone. Mike On 3/29/2010 7:33 PM, James Harper wrote: >> >> Hi everyone, >> >> >> >> I am using Bacula 3.02 client and server to backup several machines on my >> >> home network. It has been working great. Recently, I added my first Vista >> >> machine which also happens to be 64-bit and now, although the backups >> >> complete, it takes hours and the statistics are nonsense. I can only >> >> guess that sparse files are at the root cause here, but cannot figure out >> >> how to track this down. >> >> > > > > A backup of a Windows computer uses the BackupRead API to generate the > > data to go to the SD. BackupRead reads a single stream of data that > > includes the file attributes, ownership, acls, data, Alternate Data > > Streams, and sparse information. Bacula shouldn't need to know or care > > if the file is sparse or not, it just backs up the data that BackupRead > > returns. > > > > I wouldn't expect that 'sparse=yes' would have any useful impact unless > > there is a bug in which case it will probably break things. > > > > Can you restore the job somewhere else (another windows machine) and see > > if the restored files match up with the backed up files? Look out for > > any restore errors that say that the file sizes don't match. > > > > James OK, what I ended up doing here was creating a new 64-bit Vista virtual machine from scratch and restored my production client to this VM in the /tmp/bacula-restores directory. Before the restore ran, I was using just a touch over 10Gb. When the restore was complete I had over half the disk showing used but only about one fourth showing allocated. The /tmp/bacula-restores directory shows about 9Gb in use which is about what I expect, but look at this output from TreeSize Free TreeSize Free Report, 4/1/2010 10:08 PM V 2.4 Drive: Local Disk (C:) Drive: C:\ Size: 107,503.0 MB Used: 59,869.3 MB Free: 47,633.7 MB 4096 Bytes per Cluster (NTFS) This Folder: Size: 22,316.2 MB Allocated: 22,594.4 MB Percent of Drive: 21 %Objects: 139,299 Wasted Space: 300.5 MB And if you don't want to believe that, here is what Windows chkdsk shows from a command prompt: Windows has checked the file system and found no problems. 110083071 KB total disk space. 61306064 KB in 124887 files. 64936 KB in 21539 indexes. 0 KB in bad sectors. 252575 KB in use by the system. 65536 KB occupied by the log file. 48459496 KB available on disk. 4096 bytes in each allocation unit. 27520767 total allocation units on disk. 12114874 allocation units available on disk. But yet, I do not see any actual file that is reporting a large size in Windows Explorer. 01-Apr 19:13 pendual-dir JobId 504: Bacula pendual-dir 3.0.2 (18Jul09): +01-Apr-2010 19:13:13 Build OS: i686-pc-linux-gnu ubuntu 8.04 JobId: 504 Job:RestoreFiles.2010-04-01_11.25.26_47 Restore Client: vtest-fd Start time: 01-Apr-2010 11:25:28 End time: 01-Apr-2010 19:13:13 Files Expected: 82,062 Files Restored: 81,207 Bytes Restored: 49,562,616,479 Rate: 1766.0 KB/s FD Errors: 0 FD termination status: OK SD termination status: OK Termination:Restore OK -- warning file count mismatch The restore completed OK other than a file count mismatch, but no errors about sizes or anything like that. And it thinks it restored 49Gb, which matches up pretty much exactly with the 59Gb I appear to be using now(49Gb restored +10Gb originally on the disk). Ideas? Thanks, Mike -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Vista 64 bit and sparse files
The mystery deepens. On 3/29/2010 7:33 PM, James Harper wrote: >> Hi everyone, >> >> I am using Bacula 3.02 client and server to backup several machines on my >> home network. It has been working great. Recently, I added my first Vista >> machine which also happens to be 64-bit and now, although the backups >> complete, it takes hours and the statistics are nonsense. I can only guess >> that sparse files are at the root cause here, but cannot figure out how to >> track this down. >> > > A backup of a Windows computer uses the BackupRead API to generate the > data to go to the SD. BackupRead reads a single stream of data that > includes the file attributes, ownership, acls, data, Alternate Data > Streams, and sparse information. Bacula shouldn't need to know or care > if the file is sparse or not, it just backs up the data that BackupRead > returns. > > I wouldn't expect that 'sparse=yes' would have any useful impact unless > there is a bug in which case it will probably break things. > > Can you restore the job somewhere else (another windows machine) and see > if the restored files match up with the backed up files? Look out for > any restore errors that say that the file sizes don't match. > > James OK, what I ended up doing here was creating a new 64-bit Vista virtual machine from scratch and restored my production client to this VM in the /tmp/bacula-restores directory. Before the restore ran, I was using just a touch over 10Gb. When the restore was complete I had over half the disk showing used but only about one fourth showing allocated. The /tmp/bacula-restores directory shows about 9Gb in use which is about what I expect, but look at this output from TreeSize Free TreeSize Free Report, 4/1/2010 10:08 PM V 2.4 Drive: Local Disk (C:) Drive: C:\ Size: 107,503.0 MB Used: 59,869.3 MB Free: 47,633.7 MB 4096 Bytes per Cluster (NTFS) This Folder: Size: 22,316.2 MB Allocated: 22,594.4 MB Percent of Drive: 21 %Objects: 139,299 Wasted Space: 300.5 MB And if you don't want to believe that, here is what Windows chkdsk shows from a command prompt: Windows has checked the file system and found no problems. 110083071 KB total disk space. 61306064 KB in 124887 files. 64936 KB in 21539 indexes. 0 KB in bad sectors. 252575 KB in use by the system. 65536 KB occupied by the log file. 48459496 KB available on disk. 4096 bytes in each allocation unit. 27520767 total allocation units on disk. 12114874 allocation units available on disk. But yet, I do not see any actual file that is reporting a large size in Windows Explorer. 01-Apr 19:13 pendual-dir JobId 504: Bacula pendual-dir 3.0.2 (18Jul09): +01-Apr-2010 19:13:13 Build OS: i686-pc-linux-gnu ubuntu 8.04 JobId: 504 Job:RestoreFiles.2010-04-01_11.25.26_47 Restore Client: vtest-fd Start time: 01-Apr-2010 11:25:28 End time: 01-Apr-2010 19:13:13 Files Expected: 82,062 Files Restored: 81,207 Bytes Restored: 49,562,616,479 Rate: 1766.0 KB/s FD Errors: 0 FD termination status: OK SD termination status: OK Termination:Restore OK -- warning file count mismatch The restore completed OK other than a file count mismatch, but no errors about sizes or anything like that. And it thinks it restored 49Gb, which matches up pretty much exactly with the 59Gb I appear to be using now(49Gb restored +10Gb originally on the disk). Ideas? Thanks, Mike -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Vista 64 bit and sparse files
Hi everyone,
I am using Bacula 3.02 client and server to backup several machines on my home
network. It has been working great. Recently, I added my first Vista machine
which also happens to be 64-bit and now, although the backups complete, it
takes hours and the statistics are nonsense. I can only guess that sparse files
are at the root cause here, but cannot figure out how to track this down.
Here is my fileset definition:
FileSet {
Name = fb-802-fileset
Include {
Options {
signature = MD5
sparse = yes
Exclude = yes
IgnoreCase = yes
checkfilechanges = yes
# Exclude directories full of lots and lots of useless little files
WildDir = "[A-Z]:/Users/*/Cookies"
...
}
File = "C:/"
File = "C:/WINDOWS/system32/drivers/etc/hosts"
File = "E:/"
}
I added the "sparse = yes" statement hoping it would help but it has not.
The strange thing is that the "estimate" command does not show the excessive
space consumed.
And here is what a #list media pool=90m shows. Note that these are 120m DDS
tapes with a native storage capacity of 4Gb so obviously this can not be
correct.
#list media pool=90m
...
| 38 | 120m_1_2 | Full | 1 | 8,555,774,976 | 68 |
7,776,000 | 1 |2 | 1 | DDS-3 | 2010-03-01 14:59:13 |
| 39 | 120m_1_3 | Full | 1 | 13,363,144,704 | 44 |
7,776,000 | 1 |3 | 1 | DDS-3 | 2010-03-10 22:02:52 |
| 40 | 120m_1_4 | Full | 1 | 66,590,705,664 | 99 |
7,776,000 | 1 |4 | 1 | DDS-3 | 2010-03-19 20:08:02 |
| 41 | 120m_1_5 | Full | 1 | 37,345,867,776 | 58 |
7,776,000 | 1 |5 | 1 | DDS-3 | 2010-03-26 17:05:10 |
This is pretty typical of one of the backups I am talking about:
#list jobid=457
+---+---+-+--+---+--++---+
| JobId | Name | StartTime | Type | Level | JobFiles |
JobBytes | JobStatus |
+---+---+-+--+---+--++---+
| 457 | fb-802-backup | 2010-03-23 17:30:03 | B| I |1,422 |
15,581,607,358 | T |
+---+---+-+--+---+--++---+
#
Yet here is the estimate which is about what I would expect.
#estimate job=fb-802-backup fileset=fb-802-fileset level=Incremental
storage=C1557A pool=90m
Using Catalog "MyCatalog"
Connecting to Client fb-802-fd at fb-802.mydomain.mrc:9102
2000 OK estimate files=1424 bytes=1,088,634,152
Doing an "estimate listing ..." does not really show anything unusual. The
biggest files I can see in the list are related to my email at about 250Mb so I
am not even sure how to identify the file(s) I might exclude if there is no way
around the sparse file issue. Again, assuming this IS a sparse file issue which
it really looks like it is to me.
Any ideas???
Thanks,
Mike
--
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] backup error - Network send error to SD
Hi everyone. I have a new problem with a particular backup in my environment. I'm using bacula 3.0.2 across all components. This has been running fine for some time however this particular laptop used to be running linux(recently it was switched over to XP). This laptop is recently routinely getting the following backup error: 09-Dec 14:04 pendual-dir JobId 9: Start Backup JobId 9, +Job=ncs6320-backup.2009-12-09_14.04.49_03 09-Dec 14:04 pendual-dir JobId 9: Using Device "Drive-1" 09-Dec 14:04 pendual-sd JobId 9: Volume "125m_1_1" previously written, moving to +end of data. 09-Dec 14:06 pendual-sd JobId 9: Ready to append to end of Volume "125m_1_1" at +file=16. 09-Dec 14:06 pendual-sd JobId 9: Spooling data ... 09-Dec 14:06 ncs6320-fd JobId 9: Generate VSS snapshots. Driver="VSS WinXP", +Drive(s)="C" 09-Dec 14:17 ncs6320-fd JobId 9: Fatal error: +/home/kern/bacula/k/src/filed/backup.c:964 Network send error to SD. +ERR=Input/output error 09-Dec 14:19 ncs6320-fd JobId 9: VSS Writer (BackupComplete): "Microsoft Writer +(Bootable State)", State: 0x1 (VSS_WS_STABLE) 09-Dec 14:19 ncs6320-fd JobId 9: VSS Writer (BackupComplete): "MSDEWriter", +State: 0x1 (VSS_WS_STABLE) 09-Dec 14:19 ncs6320-fd JobId 9: VSS Writer (BackupComplete): "WMI Writer", +State: 0x1 (VSS_WS_STABLE) 09-Dec 14:19 ncs6320-fd JobId 9: VSS Writer (BackupComplete): "Microsoft Writer +(Service State)", State: 0x1 (VSS_WS_STABLE) 09-Dec 14:19 pendual-sd JobId 9: Job ncs6320-backup.2009-12-09_14.04.49_03 +marked to be canceled. 09-Dec 14:19 pendual-dir JobId 9: Error: Bacula pendual-dir 3.0.2 (18Jul09): +09-Dec-2009 14:19:10 estimate jobs run fine. Short test backup jobs run fine(like just backing up a single file). The point in the backup that it fails at seems to be random. 8 Full 1,65650.53 M Error09-Dec-09 13:52 ncs6320-backup 9 Full 20,8311.030 G Error09-Dec-09 14:27 ncs6320-backup 11 Full 2,29460.65 M Error09-Dec-09 14:28 ncs6320-backup 12 Full 9,080357.6 M Error09-Dec-09 14:52 ncs6320-backup I have turned on debug in the SD and the FD and see this: SD Date label written: 07-Dec-2009 14:13^M pendual-sd: label.c:236-0 Call reserve_volume=125m_1_1^M pendual-sd: bnet.c:670-0 who=client host=192.168.25.100 port=36643^M pendual-sd: cram-md5.c:73-0 send: auth cram-md5 <223312495.1260387...@pendual-sd > ssl=0^M pendual-sd: cram-md5.c:133-0 cram-get received: auth cram-md5 <788566849.1260387 9...@pendual-dir> ssl=0^M pendual-sd: cram-md5.c:152-0 sending resp to challenge: en+f7Vhrsw8IjS/4V3/A4B^M pendual-sd: dircmd.c:211-0 Message channel init completed.^M for the FD I see this: ncs6320-fd: /home/kern/bacula/k/src/win32/compat/compat.cpp:123-12 Enter convert _unix_to_win32_path ncs6320-fd: /home/kern/bacula/k/src/win32/compat/compat.cpp:174-12 path=C:\Docum ents and Settings\mrc\My Documents\mwm4-49.mp3 ncs6320-fd: /home/kern/bacula/k/src/win32/compat/compat.cpp:183-12 Leave cvt_u_t o_win32_path path=\\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy1\Documents and Settings\mrc\My Documents\mwm4-49.mp3 ncs6320-fd: /home/kern/bacula/k/src/win32/compat/compat.cpp:123-12 Enter convert _unix_to_win32_path ncs6320-fd: /home/kern/bacula/k/src/win32/compat/compat.cpp:174-12 path=C:\Docum ents and Settings\mrc\My Documents\mwm4-49.mp3 ncs6320-fd: /home/kern/bacula/k/src/win32/compat/compat.cpp:183-12 Leave cvt_u_t o_win32_path path=\\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy1\Documents and Settings\mrc\My Documents\mwm4-49.mp3 ncs6320-fd: /home/kern/bacula/k/src/findlib/bfile.c:480-12 === NO plugin ncs6320-fd: /home/kern/bacula/k/src/findlib/bfile.c:572-12 Read CreateFileW=\\?\ GLOBALROOT\Device\HarddiskVolumeShadowCopy1\Documents and Settings\mrc\My Docume nts\mwm4-49.mp3 ncs6320-fd: /home/kern/bacula/k/src/filed/heartbeat.c:96-0 wait_intr=0 stop=0 ncs6320-fd: /home/kern/bacula/k/src/filed/heartbeat.c:96-0 wait_intr=0 stop=0 ncs6320-fd: /home/kern/bacula/k/src/filed/heartbeat.c:96-0 wait_intr=0 stop=0 ncs6320-fd: /home/kern/bacula/k/src/filed/heartbeat.c:96-0 wait_intr=0 stop=0 ncs6320-fd: /home/kern/bacula/k/src/filed/heartbeat.c:96-0 wait_intr=0 stop=0 ncs6320-fd: /home/kern/bacula/k/src/filed/heartbeat.c:96-0 wait_intr=0 stop=0 ncs6320-fd: /home/kern/bacula/k/src/filed/heartbeat.c:91-0 Got BNET_SIG 0 from S D ncs6320-fd: /home/kern/bacula/k/src/filed/heartbeat.c:96-0 wait_intr=1 stop=1 ncs6320-fd: /home/kern/bacula/k/src/win32/compat/compat.cpp:924-12 sizino=8 ino= 0 file=C:/Documents and Settings/mrc/My Documents/mwm4-49.mp3 ncs6320-fd: /home/kern/bacula/k/src/filed/heartbeat.c:142-12 Send kill to heartb eat id ncs6320-fd: /home/kern/bacula/k/src/filed/backup.c:189-12 end blast_data ok=0 ncs6320-fd: /home/kern/bacula/k/src/filed/job.c:272-12 Quit command loop. Cancel ed=1 ncs6320-fd: /home/kern/bacula/k/src/filed/job.c:375-12 Calling term_find_files ncs6320-fd: /home/kern/bacula/k/src/filed/job.c:378-12 Done with term_find_files ncs6320-fd: /home/kern/bacula/k/src/win32
[Bacula-users] question about FD Connect Timeout
Hi, I am using Bacula 3.0.2(all components) on Ubuntu 9.04 to backup several clients. A few of these are Windows XP laptop clients which may get booted up for a short period, then the lid closed after the user has done some simple things like checking email, etc. Closing the lid will put the laptop in hibernate mode. My problem is when this happens after the job is started but before it is finished, it seems to "hang" in running mode. Example: *s dir ... Running Jobs: Console connected at 31-Aug-09 08:17 Console connected at 31-Aug-09 08:18 Console connected at 31-Aug-09 11:06 JobId Level Name Status == 242 Increme win-v2-backup.2009-08-31_09.00.00_05 is waiting on max Storage jobs 244 Increme tlap-backup.2009-08-31_09.00.00_07 is running 245 Increme n610c-backup.2009-08-31_09.00.00_08 is waiting on max Storage jobs ... *llist jobid=244 ... SchedTime: 2009-08-31 09:00:00 StartTime: 2009-08-31 10:02:41 EndTime: -00-00 00:00:00 ... I have the following settings in my dir.conf file director FD Connect Timeout = 20 mins job Max Start Delay = 43200 Reschedule On Error = yes Reschedule Interval = 2 mins Reschedule Times = 36 My goal here is that if one job is unable to complete like this, then it would simply abort after 20 minutes allowing the next job to start running and the job that aborted would get rescheduled and perhaps catch the user online next time. This works as expected as long as the job has not transitioned to the "running" state, ie as long as it is "waiting" then after 20 minutes it will abort and reschedule but after it starts running I'm not sure how long it will hang around. Any thoughts? Thanks, Mike Chisholm -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] number of files mismatch question
Hi all, I am a new bacula user running 3.02 on Ubuntu 8.04 LTS. I am backing up about 7 clients(mix of windows and linux) to a DDS3 tape autochanger. After testing and configuring for a few days I went live with this on Sunday with a full backup of all clients and doing incrementals Mon-Fri. So the problem... Yesterday I had a power outage. Bacula was idle, but there was a volume mounted in the drive. Today when the incrementals fired, I got an error: 05-Aug 10:25 pendual-dir JobId 39: Start Backup JobId 39, Job=mrc-vm1-backup.2009-08-05_10.25.39_04 05-Aug 10:25 pendual-dir JobId 39: Using Device "Drive-1" 05-Aug 10:25 mrc-vm1-fd JobId 39: DIR and FD clocks differ by 12 seconds, FD automatically compensating. 05-Aug 10:25 pendual-sd JobId 39: Volume "90m_1_1" previously written, moving to end of data. 05-Aug 10:26 pendual-sd JobId 39: Error: Bacula cannot write on tape Volume "90m_1_1" because: The number of files mismatch! Volume=1 Catalog=14 05-Aug 10:26 pendual-sd JobId 39: Marking Volume "90m_1_1" in Error in Catalog. It correctly loaded the next volume in the autochanger and did the backups but I'm not sure why I am getting this error? A bls on the volume shows 14 files, but does have an interesting entry at the end. # bls -j -V 90m_1_1 -c /etc/opt/bacula/conf/bacula-sd.conf Drive-1|tee 90m_1_1.out # grep JobId= 90m_1_1.out |grep -v "Volume Record"|wc -l 28 90m_1_1.out ... Begin Job Session Record: File:blk=13:1 SessId=3 SessTime=1249401525 JobId=31 Job=mrc6320-backup.2009-08-04_17.00.00_06 Date=04-Aug-2009 17:19:06 Level=I Type=B End Job Session Record: File:blk=13:579 SessId=3 SessTime=1249401525 JobId=31 Date=04-Aug-2009 17:24:18 Level=I Type=B Files=417 Bytes=37,303,402 Errors=0 Status=T 05-Aug 10:16 bls JobId 0: Error: block.c:1010 Read error on fd=3 at file:blk 14:0 on device "Drive-1" (/dev/nst0). ERR=Input/output error. 05-Aug 10:16 bls JobId 0: End of Volume at file 14 on device "Drive-1" (/dev/nst0), Volume "90m_1_1" 05-Aug 10:16 bls JobId 0: End of all volumes. 05-Aug 10:16 bls JobId 0: Alert: smartctl version 5.37 [i686-pc-linux-gnu] Copyright (C) 2002-6 Bruce Allen 05-Aug 10:16 bls JobId 0: Alert: Home page is http://smartmontools.sourceforge.net/ 05-Aug 10:16 bls JobId 0: Alert: 05-Aug 10:16 bls JobId 0: Alert: TapeAlert Errors (C=Critical, W=Warning, I=Informational): 05-Aug 10:16 bls JobId 0: Alert: [0x14] C: The tape drive needs cleaning: 05-Aug 10:16 bls JobId 0: Alert: 1. If the operation has stopped, eject the tape and clean the drive. 05-Aug 10:16 bls JobId 0: Alert: 2. If the operation has not stopped, wait for it to finish and then 05-Aug 10:16 bls JobId 0: Alert: clean the drive. 05-Aug 10:16 bls JobId 0: Alert: Check the tape drive users manual for device specific cleaning instructions. 05-Aug 10:16 bls JobId 0: Alert: [0x03] W: The operation has stopped because an error has occurred while reading 05-Aug 10:16 bls JobId 0: Alert: or writing data that the drive cannot correct. 05-Aug 10:16 bls JobId 0: Alert: 05-Aug 10:16 bls JobId 0: Alert: Error counter log: 05-Aug 10:16 bls JobId 0: Alert:Errors Corrected by Total Correction GigabytesTotal 05-Aug 10:16 bls JobId 0: Alert:ECC rereads/errors algorithm processeduncorrected 05-Aug 10:16 bls JobId 0: Alert:fast | delayed rewrites corrected invocations [10^9 bytes] errors 05-Aug 10:16 bls JobId 0: Alert: read: 00 0 1 0 0.000 0 05-Aug 10:16 bls JobId 0: Alert: write: 00 0 0 0 0.000 0 I did clean the drive and try this again, but I think that is a bogus alert based purely on the read error and is more a symptom than a cause. I think I could pretty easily fix this by simply purging the jobs and setting the volume status to recycle, but I am trying to understand why this is happening, since everything was idle when the powerfail happened. I'm assuming maybe it has something to do with EOF handling, but nothing was writing so I am a bit confused? This is a great backup utility so far, I am enjoying working with it. Thanks for any ideas/opinions. Mike -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
