Re: [Bacula-users] scheduled job different that manually initiated job? --WAS: Re: Backup problem with 1 of 2 Raspberry PI using Raspbian (Debian)
Are you setting accurate=yes only in the schedule? If so, you need to also pass accurate=yes in the bconsole run command. Alternatively, add it to the job definition. To debug the client problem, try setdebug level=100 trace=1 client=heRPI02-fd to make it create a bacula.trace file or run the bacula-fd with -f -d 100. If level 100 does not show enough, then increase it. __Martin > On Sat, 7 Apr 2018 21:57:25 +0200, Johannsen, Thorsten said: > > Hello list, > > I'm still struggeling with my Raspberry PIs of which one (heRPI01) is > backing up fine and the other one (heRPI02) isn't. > > The one that has problems during backup always terminates after "sending > accurate information to the FD". > > > - > 2018-04-07 21:00:38heRPI02-fd JobId 1692: ClientBeforeJob: exiting... > 2018-04-07 21:00:38heBacula-dir JobId 1692: Sending Accurate information to > the FD. > 2018-04-07 21:00:50heBacula-dir JobId 1692: Error: bsock.c:721 Write error > sending 97 bytes to Client: heRPI02-fd:heRPI02:9102: ERR=Connection reset by > peer > 2018-04-07 21:00:51heBacula-dir JobId 1692: Error: bsock.c:609 Socket has > errors=1 on call to Client: heRPI02-fd:heRPI02:9102 > 2018-04-07 21:00:51heBacula-dir JobId 1692: Fatal error: Network error with > FD during Backup: ERR=Connection reset by peer > 2018-04-07 21:01:51heBacula-dir JobId 1692: Fatal error: No Job status > returned from FD. > - > > > What *really* surprises me is that the jobs exits OK when I manually run it > from bconsole via "run". And that time I do not see the Accurate message in > the job log. > > - > 2018-04-07 21:45:04heRPI02-fd JobId 1693: ClientBeforeJob: exiting... > 2018-04-07 21:45:05heBacula-sd JobId 1693: Labeled new Volume > "IncBackup__heRPI02-fd__1692__2018-04-07T21.00.03" on File device > "AC-IncBackup-Dev03" (/srv/bacula-sd/AC-IncBackup). > 2018-04-07 21:45:05heBacula-sd JobId 1693: Wrote label to prelabeled Volume > "IncBackup__heRPI02-fd__1692__2018-04-07T21.00.03" on File device > "AC-IncBackup-Dev03" (/srv/bacula-sd/AC-IncBackup) > 2018-04-07 21:45:05heBacula-dir JobId 1693: Max Volume jobs=1 exceeded. > Marking Volume "IncBackup__heRPI02-fd__1692__2018-04-07T21.00.03" as Used. > 2018-04-07 21:45:06heRPI02-fd JobId 1693: Disallowed filesystem. Will > not descend from / into /dev > 2018-04-07 21:45:09heRPI02-fd JobId 1693: Disallowed filesystem. Will > not descend from / into /sys > 2018-04-07 21:45:12heRPI02-fd JobId 1693: Error: /var/lib/mysql/ib_logfile0 > mtime changed during backup. > 2018-04-07 21:45:16heRPI02-fd JobId 1693: Error: /var/lib/mysql/ibdata1 mtime > changed during backup. > 2018-04-07 21:45:20heRPI02-fd JobId 1693: Error: /var/lib/mysql/ib_logfile1 > mtime changed during backup. > 2018-04-07 21:45:23heRPI02-fd JobId 1693: Disallowed filesystem. Will > not descend from / into /run > 2018-04-07 21:45:24heRPI02-fd JobId 1693: Disallowed filesystem. Will > not descend from / into /proc > 2018-04-07 21:45:30heBacula-sd JobId 1693: Elapsed time=00:00:25, Transfer > rate=4.195 M Bytes/second > 2018-04-07 21:45:30heBacula-dir JobId 1693: Max Volume jobs=1 exceeded. > Marking Volume "IncBackup__heRPI02-fd__1692__2018-04-07T21.00.03" as Used. > 2018-04-07 21:45:30heBacula-sd JobId 1693: Sending spooled attrs to the > Director. Despooling 44,303 bytes ... > 2018-04-07 21:45:30heBacula-dir JobId 1693: Bacula Enterprise heBacula-dir > 8.8.1 (01Mar17): > - > > > How is this possible? > > > best regards > > Thorsten > > > > > > On 05.04.2018 15:17, Johannsen, Thorsten wrote: > > On 05.04.2018 13:35, Johannsen, Thorsten wrote: > >> On 05.04.2018 00:01, Jari Fredriksson wrote: > >> > >> Hi Jari, > >> > >> > >> [...] > > > >> Do you have Raspbian installed? Do you use the bacula-fd version from > >> the repository or did you compile your own? > > > > Moreover: could you please check the free memory on your 5 RPI's? > > > > Currently I have: > > > > heRPI01:~ $ free -h > > total used free shared buffers cached > > Mem: 923M 447M 476M 11M 100M 139M > > -/+ buffers/cache: 207M 716M > > Swap: 99M 0B 99M > > > > (this is the RPI where backup works) > > > > > > heRPI02:~ $ free -h > > total used free shared buff/cache >
Re: [Bacula-users] bacula and centos (7)
Hello, See below ... On 04/02/2018 08:52 PM, dhofmeister wrote: while my question is specifically related to getting *new(-ish)* bacula installed and running on centos 7 -- i think my real question is -- why are there no new-ish rpms for centos? what's "out there" for centos is bacula 5.2 and the current bacula version is 9.0.x. since the latest rpms are only fedora, is bacula 9 considered stable/production ready? You will need to talk to RedHat about that problem. I am not very happy with them releasing such an old version, but I do not have much clout with them. If a lot of users write to RedHat (not CentOS, who only rebuilds the RedHat releases) maybe something will happen. Also I have been working on having community released binaries. This is almost a reality and will surely be done within the next month. I am the current bottleneck for the documentation, but I am back from vacation and will remove the bottleneck as soon as I can. Best regards, Kern donna -- Sent from: http://bacula.10910.n7.nabble.com/Bacula-Users-f3.html -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula and centos (7)
On 04/09/18 11:31, Kern Sibbald wrote: > On 04/02/2018 08:52 PM, dhofmeister wrote: >> what's "out there" for centos is bacula 5.2 and the current bacula version >> is 9.0.x. since the latest rpms are only fedora, is bacula 9 considered >> stable/production ready? > You will need to talk to RedHat about that problem. I am not very happy > with them releasing such an old version, Honestly, this is an endemic problem with Red Hat. ...And yet then they leap headlong at unproven, misconceived projects like systemd. Ask me about kgcc in the *first* Red Hat 7.0 sometime. -- Phil Stracchino Babylon Communications ph...@caerllewys.net p...@co.ordinate.org Landline: +1.603.293.8485 Mobile: +1.603.998.6958 -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Autochanger not changing
Hello, The output from lsscsi looks odd. From what I see, I am not reassured that both the tape drives are actually part one at a time and see if physically the right tapes are mounted. I also am a bit skeptical about using a 40GB maximum file size on your LTO-4 -- that seems *much* larger than what we recommend to be an optimal compromise between restore speed and write speed. My experience on LTO-1 and LTO-4 drives is that 512K buffer sizes get quite adequate performance so I am a bit skeptical about your need for 1MB buffers, but that said, they should be OK. Also you should probably be using device independent device names rather than /dev/nst0 and /dev/nst1 as depending on the boot, the devices could get swapped -- the same goes for the /dev/sg4 name. Others on this list should be able to help you with the details of my suggestions ... Best regards, Kern On 04/02/2018 01:53 PM, Sebastian Suchanek wrote: Am 02.04.2018 um 09:54 schrieb Kern Sibbald: Hello Kern, thank you for your reply. First, I would recommend that you use at *most* 1MB block sizes for LT0-1 and LTO-4 tapes. OK, I changed that for the LTO-4 drive. (I don't want go below 1MB though, because it significantly reduces write rates.) [...] You haven't shown your full autochanger device configuration so it will be hard/impossible to diagnose your problem. No problem, here's my full bacula-sd.conf, only comments and passwords are removed: | Storage { | Name = tigersclaw-sd | SDPort = 9103 | WorkingDirectory = "/var/lib/bacula" | Pid Directory = "/var/run/bacula" | Maximum Concurrent Jobs = 20 | SDAddress = 10.1.0.1 | } | | Director { | Name = tigersclaw-dir | Password = | } | | Director { | Name = tigersclaw-mon | Password = | Monitor = yes | } | | Device { | Name = FileStorage | Media Type = File | Archive Device = /srv/bacula/file | LabelMedia = yes | Random Access = yes | AutomaticMount = yes | RemovableMedia = no | AlwaysOpen = no | } | | Autochanger { | Name = Overland-NEO2000 | Device = LTO1-Drive-1 | Device = LTO4-Drive-1 | Changer Command = "/etc/bacula/scripts/mtx-changer %c %o %S %a %d" | Changer Device = /dev/sg4 | } | | Device { | Name = LTO1-Drive-1 | Drive Index = 0 | Media Type = LTO-1 | Archive Device = /dev/nst1 | AutomaticMount = yes | AlwaysOpen = yes | RemovableMedia = yes | RandomAccess = no | AutoChanger = yes | Maximum File Size = 2GB | Alert Command = "sh -c 'tapeinfo -f %c |grep TapeAlert|cat'" | Spool Directory = "/srv/bacula/spool" | } | | Device { | Name = LTO4-Drive-1 | Drive Index = 1 | Media Type = LTO-4 | Archive Device = /dev/nst0 | AutomaticMount = yes | AlwaysOpen = yes | RemovableMedia = yes | RandomAccess = no | Maximum block size = 1MB | Maximum File Size = 40GB | AutoChanger = yes | Alert Command = "sh -c 'tapeinfo -f %c |grep TapeAlert|cat'" | Spool Directory = "/srv/bacula/spool" | } | | Messages { | Name = Standard | director = tigersclaw-dir = all | } JFTR: "tigersclaw" is the name of my server which runs (among other things) the Bacula director, storage daemon und also the client where the backup job in question comes from. (I have more jobs configured, also from other clients, but they are way to small to even fill a LTO-1 tape.) Also the output from a: lsscsi -g would be necessary. No problem either: | # lsscsi -g | [0:0:1:0]tapeHP Ultrium 4-SCSI H63H /dev/st0 /dev/sg3 | [1:0:0:0]diskATA Samsung SSD 850 2B6Q /dev/sda /dev/sg0 | [2:0:0:0]diskATA WDC WD40EFRX-68W 0A82 /dev/sdb /dev/sg1 | [3:0:0:0]diskATA WDC WD40EFRX-68W 0A82 /dev/sdc /dev/sg2 | [7:0:0:0]mediumx OVERLAND NEO Series 0616 /dev/sch0 /dev/sg4 | [7:0:0:1]tapeSEAGATE ULTRIUM06242-XXX 1603 /dev/st1 /dev/sg5 | # Note in general, if btape works then Bacula will work because the SD uses the same subroutines that btape uses for reading/writing tapes. Well, that's what I expected and that's why I'm so puzzled about this error... Consequently there may be some other problem. When the SD seems to be stuck, you can probably get more information by doing: bconsole set debuglevel=200 storage= trace=1 mount set debuglevel=0 storage= trace=0 then look at the trace file in your working directory to see what it going on. Here's the trace file from the beginning of the job until the point where the first tape was full and Bacula got stuck: https://suchanek.de/temp/tigersclaw-sd.trace (47kB) And here ist what happend when I manually cancelled the stuck job (which worked) and try to do a "release LTO4-Drive" command in bconsole. (Which didn't work, i.e. Bacula got stuck here too.) https://suchanek.de/temp/tigersclaw-sd.trace.2 (3kB) I hope you can find anything usefull in these debug files, because I'm totally lost here... Best regards Sebastian
Re: [Bacula-users] aix binary?
Sorry, I do not recall. In general we have fewer problems using g++ than the native compilers. In principle either compiler should be OK. On 04/05/2018 03:55 PM, Mike Eggleston wrote: Kern, I’m still working on building AIX FD binaries. Do you know when you were building by hand, or now on the automated system, is gcc used or the native IBM/AIX compiler (xlC)? Thanks, Mike From: Kern Sibbald [mailto:k...@sibbald.com] Sent: Tuesday, April 03, 2018 1:34 PM To: Mike Eggleston ; Bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] aix binary? I have not build the AIX version for about 5 years. Bacula Systems does it. I am not convinced that it will build without libtool, so you might try removing the --with-libtool=no. Though it should not make any difference, I would not use --without-smartalloc because we only build with smartalloc turned on. Good luck, Kern On 04/02/2018 07:02 PM, Mike Eggleston wrote: Kern, I don’t mind building it (and have built lots of stuff over the decades). Here is my PATH and the command line I’m using. What are you using? export PATH=/usr/bin:/etc:/usr/sbin:/usr/ucb:/home/meggle1/bin:/usr/bin/X11:/sbin:/usr/vacpp/bin ./configure --without-TLS --disable-TLS --without-tls --disable-tls --without-ssl --disable-ssl --without-crypto --disable-crypto --disable-ipv6 --disable-lzo --disable-nls --disable-NLS --disable-readline --disable-smartalloc --enable-client-only --with-libtool=no --without-mysql --without-smartalloc Thanks, Mike From: Kern Sibbald [mailto:k...@sibbald.com] Sent: Sunday, April 01, 2018 2:28 AM To: Mike Eggleston ; Bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] aix binary? Hello, If no one has one and you are unable to build it (actually rather easy -- build it directly on AIX but non-static), you can get one from Bacula Systems, but you will need a subscription. Though binary packages are built for the community (thanks to Bacula Systems), they are not yet released (waiting for me to do the documentation), so some time in the future there is a possibility that we could have community binaries for AIX. Best regards, Kern On 03/06/2018 10:04 PM, Mike Eggleston wrote: Does anyone have a static bacula-fd for AIX they could send me? Thanks, Mike -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] libbaccats-9.0.6.so dependency problem when installing rpm files
Try using the .spec files that are released with Bacula 9.0.6 rather than the RedHat spec files. If you are using the community .spec files, let me know and I will make sure that they are the same ones our packager is using (sometimes packagers modify packages but the changes don't always get pushed back to the source). Best regards, Kern On 04/05/2018 04:50 PM, Matthias Leopold wrote: Hi, I'm absolutely new to Bacula and basically only want to package the software for CentOS 7 so it can be used in my organization by others. I'm compiling RPMs from the spec files in bacula-9.0.6.tar.gz. I chose "%define postgresql 1" so i got a bacula-postgresql-9.0.6-1.x86_64.rpm package. When i want install it from our spacewalk server i get the following message: Error: Package: bacula-postgresql-9.0.6-1.x86_64 (our_custom_channel_x86_64) Requires: libbaccats-9.0.6.so()(64bit) When i look at the spec file i see that only the mysql package would get a "Provides: libbaccats-%{version}.so()(64bit)". How is installing packages supposed to work with postgresql versions of Bacula? thx for any advice matthias -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Backup problem with 1 of 2 Raspberry PI using Raspbian (Debian)
> Johannsen, Thorsten kirjoitti 5.4.2018 kello > 14.35: > > On 05.04.2018 00:01, Jari Fredriksson wrote: > > Hi Jari, > > > [...] > One of the Raspi's (heRPI01) is being backed up without any problems. The > other one (heRPI02), however, refused to make > backups after a first and successful backup: > > > I have 5 Raspis, all backed up with Bacula, all having accurate to set. > One of them is the ”backbone” having a 4 TB external HD with tons of > files. > > No problems so far… > > br. jarif > >> > Do you have Raspbian installed? Do you use the bacula-fd version from the > repository or did you compile your own? > Yes, I have the latest Raspbian. I have 9.0.4 on one of them and 7.4.4 on the others. I have absolutely no idea how I have got them, as I do not see anything in /usr/local/src or my home. I pretty definitely compiled the 9.0.4 from source as I have full stack of the latest at point on that Raspi, but now moved them to an lxc container on my Proliant. /etc/apt* does not have traces of some customer source either. signature.asc Description: Message signed with OpenPGP -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Backup problem with 1 of 2 Raspberry PI using Raspbian (Debian)
> Johannsen, Thorsten kirjoitti 5.4.2018 kello > 16.17: > > On 05.04.2018 13:35, Johannsen, Thorsten wrote: >> On 05.04.2018 00:01, Jari Fredriksson wrote: >> >> Hi Jari, >> >> >> [...] > >> Do you have Raspbian installed? Do you use the bacula-fd version from the >> repository or did you compile your own? > > Moreover: could you please check the free memory on your 5 RPI’s > jarif@gauntlet ~ $ free -m totalusedfree shared buff/cache available Mem:923 198 140 19 583 690 Swap: 1865 1961669 jarif@gamecock ~ $ free -m totalusedfree shared buff/cache available Mem:923 182 156 25 584 700 Swap: 1865 621803 jarif@fury:~ $ free -m totalusedfree shared buff/cache available Mem: 2011 677 979 26 3541260 Swap:99 99 0 pi@tigermoth ~ $ free -m totalusedfree shared buff/cache available Mem:927 242 106 46 578 623 Swap: 1023 34 989 pi@moth ~ $ free -m totalusedfree shared buff/cache available Mem:481 66 29 27 385 355 Swap: 981 0 981 That’s them. All of them are having bacula 7.4.4 except gauntlet. br. jarif signature.asc Description: Message signed with OpenPGP -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Backup problem with 1 of 2 Raspberry PI using Raspbian (Debian)
> Jari Fredriksson kirjoitti 9.4.2018 kello 19.01: > > > >> Johannsen, Thorsten kirjoitti 5.4.2018 kello >> 16.17: >> >> On 05.04.2018 13:35, Johannsen, Thorsten wrote: >>> On 05.04.2018 00:01, Jari Fredriksson wrote: >>> >>> Hi Jari, >>> >>> >>> [...] >> >>> Do you have Raspbian installed? Do you use the bacula-fd version from the >>> repository or did you compile your own? >> I found them: jarif@gauntlet ~ $ ll /usr/local/src/ total 5252 drwxrwxr-x 11 jarif jarif4096 Jun 11 2017 bacula-7.4.7 drwxrwxr-x 11 jarif jarif4096 Aug 20 2017 bacula-9.0.3 drwxr-xr-x 21 jarif jarif4096 Aug 20 2017 openssl-1.0.2l -rw-r--r-- 1 jarif jarif 5365054 May 25 2017 openssl-1.0.2l.tar.gz signature.asc Description: Message signed with OpenPGP -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula and centos (7)
On 04/09/2018 10:37 AM, Phil Stracchino wrote: > Honestly, this is an endemic problem with Red Hat. ...And yet then they > leap headlong at unproven, misconceived projects like systemd. The problem is sharing the loot. Software that comes with paid support from "not Red Hat" gets a rather low priority. Surprise surprise. -- Dimitri Maziuk Programmer/sysadmin BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users