Re: [Bacula-users] scheduled job different that manually initiated job? --WAS: Re: Backup problem with 1 of 2 Raspberry PI using Raspbian (Debian)

2018-04-09 Thread Martin Simmons
Are you setting accurate=yes only in the schedule?  If so, you need to also
pass accurate=yes in the bconsole run command.  Alternatively, add it to the
job definition.

To debug the client problem, try

setdebug level=100 trace=1 client=heRPI02-fd

to make it create a bacula.trace file or run the bacula-fd with -f -d 100.

If level 100 does not show enough, then increase it.

__Martin




> On Sat, 7 Apr 2018 21:57:25 +0200, Johannsen, Thorsten said:
> 
> Hello list,
> 
> I'm still struggeling with my Raspberry PIs of which one (heRPI01) is 
> backing up fine and the other one (heRPI02) isn't.
> 
> The one that has problems during backup always terminates after "sending 
> accurate information to the FD".
> 
> 
> -
> 2018-04-07 21:00:38heRPI02-fd JobId 1692: ClientBeforeJob: exiting...
> 2018-04-07 21:00:38heBacula-dir JobId 1692: Sending Accurate information to 
> the FD.
> 2018-04-07 21:00:50heBacula-dir JobId 1692: Error: bsock.c:721 Write error 
> sending 97 bytes to Client: heRPI02-fd:heRPI02:9102: ERR=Connection reset by 
> peer
> 2018-04-07 21:00:51heBacula-dir JobId 1692: Error: bsock.c:609 Socket has 
> errors=1 on call to Client: heRPI02-fd:heRPI02:9102
> 2018-04-07 21:00:51heBacula-dir JobId 1692: Fatal error: Network error with 
> FD during Backup: ERR=Connection reset by peer
> 2018-04-07 21:01:51heBacula-dir JobId 1692: Fatal error: No Job status 
> returned from FD.
> -
> 
> 
> What *really* surprises me is that the jobs exits OK when I manually run it 
> from bconsole via "run". And that time I do not see the Accurate message in 
> the job log.
> 
> -
> 2018-04-07 21:45:04heRPI02-fd JobId 1693: ClientBeforeJob: exiting...
> 2018-04-07 21:45:05heBacula-sd JobId 1693: Labeled new Volume 
> "IncBackup__heRPI02-fd__1692__2018-04-07T21.00.03" on File device 
> "AC-IncBackup-Dev03" (/srv/bacula-sd/AC-IncBackup).
> 2018-04-07 21:45:05heBacula-sd JobId 1693: Wrote label to prelabeled Volume 
> "IncBackup__heRPI02-fd__1692__2018-04-07T21.00.03" on File device 
> "AC-IncBackup-Dev03" (/srv/bacula-sd/AC-IncBackup)
> 2018-04-07 21:45:05heBacula-dir JobId 1693: Max Volume jobs=1 exceeded. 
> Marking Volume "IncBackup__heRPI02-fd__1692__2018-04-07T21.00.03" as Used.
> 2018-04-07 21:45:06heRPI02-fd JobId 1693:  Disallowed filesystem. Will 
> not descend from / into /dev
> 2018-04-07 21:45:09heRPI02-fd JobId 1693:  Disallowed filesystem. Will 
> not descend from / into /sys
> 2018-04-07 21:45:12heRPI02-fd JobId 1693: Error: /var/lib/mysql/ib_logfile0 
> mtime changed during backup.
> 2018-04-07 21:45:16heRPI02-fd JobId 1693: Error: /var/lib/mysql/ibdata1 mtime 
> changed during backup.
> 2018-04-07 21:45:20heRPI02-fd JobId 1693: Error: /var/lib/mysql/ib_logfile1 
> mtime changed during backup.
> 2018-04-07 21:45:23heRPI02-fd JobId 1693:  Disallowed filesystem. Will 
> not descend from / into /run
> 2018-04-07 21:45:24heRPI02-fd JobId 1693:  Disallowed filesystem. Will 
> not descend from / into /proc
> 2018-04-07 21:45:30heBacula-sd JobId 1693: Elapsed time=00:00:25, Transfer 
> rate=4.195 M Bytes/second
> 2018-04-07 21:45:30heBacula-dir JobId 1693: Max Volume jobs=1 exceeded. 
> Marking Volume "IncBackup__heRPI02-fd__1692__2018-04-07T21.00.03" as Used.
> 2018-04-07 21:45:30heBacula-sd JobId 1693: Sending spooled attrs to the 
> Director. Despooling 44,303 bytes ...
> 2018-04-07 21:45:30heBacula-dir JobId 1693: Bacula Enterprise heBacula-dir 
> 8.8.1 (01Mar17):
> -
> 
> 
> How is this possible?
> 
> 
> best regards
> 
> Thorsten
> 
> 
> 
> 
> 
> On 05.04.2018 15:17, Johannsen, Thorsten wrote:
> > On 05.04.2018 13:35, Johannsen, Thorsten wrote:
> >> On 05.04.2018 00:01, Jari Fredriksson wrote:
> >>
> >> Hi Jari,
> >>
> >>
> >> [...] 
> >
> >> Do you have Raspbian installed? Do you use the bacula-fd version from 
> >> the repository or did you compile your own?
> >
> > Moreover: could you please check the free memory on your 5 RPI's?
> >
> > Currently I have:
> >
> > heRPI01:~ $ free -h
> >  total   used   free shared buffers cached
> > Mem:  923M   447M   476M    11M 100M 139M
> > -/+ buffers/cache:   207M   716M
> > Swap:  99M 0B    99M
> >
> > (this is the RPI where backup works)
> >
> >
> > heRPI02:~ $ free -h
> >   total    used    free  shared buff/cache   
> 

Re: [Bacula-users] bacula and centos (7)

2018-04-09 Thread Kern Sibbald

Hello,

See below ...


On 04/02/2018 08:52 PM, dhofmeister wrote:

while my question is specifically related to getting *new(-ish)* bacula
installed and running on centos 7 -- i think my real question is -- why are
there no new-ish rpms for centos?

what's "out there" for centos is bacula 5.2 and the current bacula version
is 9.0.x.  since the latest rpms are only fedora, is bacula 9 considered
stable/production ready?
You will need to talk to RedHat about that problem.  I am not very happy 
with them releasing such an old version, but I do not have much clout 
with them.  If a lot of users write to RedHat (not CentOS, who only 
rebuilds the RedHat releases) maybe something will happen.


Also I have been working on having community released binaries. This is 
almost a reality and will surely be done within the next month.  I am 
the current bottleneck for the documentation, but I am back from 
vacation and will remove the bottleneck as soon as I can.


Best regards,
Kern



donna



--
Sent from: http://bacula.10910.n7.nabble.com/Bacula-Users-f3.html

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users




--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bacula and centos (7)

2018-04-09 Thread Phil Stracchino
On 04/09/18 11:31, Kern Sibbald wrote:
> On 04/02/2018 08:52 PM, dhofmeister wrote:
>> what's "out there" for centos is bacula 5.2 and the current bacula version
>> is 9.0.x.  since the latest rpms are only fedora, is bacula 9 considered
>> stable/production ready?
> You will need to talk to RedHat about that problem.  I am not very happy 
> with them releasing such an old version,

Honestly, this is an endemic problem with Red Hat.  ...And yet then they
leap headlong at unproven, misconceived projects like systemd.

Ask me about kgcc in the *first* Red Hat 7.0 sometime.


-- 
  Phil Stracchino
  Babylon Communications
  ph...@caerllewys.net
  p...@co.ordinate.org
  Landline: +1.603.293.8485
  Mobile:   +1.603.998.6958

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Autochanger not changing

2018-04-09 Thread Kern Sibbald

Hello,

The output from lsscsi looks odd.  From what I see, I am not reassured 
that both the tape drives are actually part one at a time and see if 
physically the right tapes are mounted.


I also am a bit skeptical about using a 40GB maximum file size on your 
LTO-4 -- that seems *much* larger than what we recommend to be an 
optimal compromise between restore speed and write speed.


My experience on LTO-1 and LTO-4 drives is that 512K buffer sizes get 
quite adequate performance so I am a bit skeptical about your need for 
1MB buffers, but that said, they should be OK.


Also you should probably be using device independent device names rather 
than /dev/nst0 and /dev/nst1 as depending on the boot, the devices could 
get swapped -- the same goes for the /dev/sg4 name.


Others on this list should be able to help you with the details of my 
suggestions ...


Best regards,

Kern



On 04/02/2018 01:53 PM, Sebastian Suchanek wrote:

Am 02.04.2018 um 09:54 schrieb Kern Sibbald:

Hello Kern,

thank you for your reply.


First, I would recommend that you use at *most* 1MB block sizes for
LT0-1 and LTO-4 tapes.

OK, I changed that for the LTO-4 drive. (I don't want go below 1MB
though, because it significantly reduces write rates.)


[...]
You haven't shown your full autochanger device configuration so it will
be hard/impossible to diagnose your problem.

No problem, here's my full bacula-sd.conf, only comments and passwords
are removed:

| Storage {
|   Name = tigersclaw-sd
|   SDPort = 9103
|   WorkingDirectory = "/var/lib/bacula"
|   Pid Directory = "/var/run/bacula"
|   Maximum Concurrent Jobs = 20
|   SDAddress = 10.1.0.1
| }
|
| Director {
|   Name = tigersclaw-dir
|   Password = 
| }
|
| Director {
|   Name = tigersclaw-mon
|   Password = 
|   Monitor = yes
| }
|
| Device {
|   Name = FileStorage
|   Media Type = File
|   Archive Device = /srv/bacula/file
|   LabelMedia = yes
|   Random Access = yes
|   AutomaticMount = yes
|   RemovableMedia = no
|   AlwaysOpen = no
| }
|
| Autochanger {
|   Name = Overland-NEO2000
|   Device = LTO1-Drive-1
|   Device = LTO4-Drive-1
|   Changer Command = "/etc/bacula/scripts/mtx-changer %c %o %S %a %d"
|   Changer Device = /dev/sg4
| }
|
| Device {
|   Name = LTO1-Drive-1
|   Drive Index = 0
|   Media Type = LTO-1
|   Archive Device = /dev/nst1
|   AutomaticMount = yes
|   AlwaysOpen = yes
|   RemovableMedia = yes
|   RandomAccess = no
|   AutoChanger = yes
|   Maximum File Size = 2GB
|   Alert Command = "sh -c 'tapeinfo -f %c |grep TapeAlert|cat'"
|   Spool Directory = "/srv/bacula/spool"
| }
|
| Device {
|   Name = LTO4-Drive-1
|   Drive Index = 1
|   Media Type = LTO-4
|   Archive Device = /dev/nst0
|   AutomaticMount = yes
|   AlwaysOpen = yes
|   RemovableMedia = yes
|   RandomAccess = no
|   Maximum block size = 1MB
|   Maximum File Size = 40GB
|   AutoChanger = yes
|   Alert Command = "sh -c 'tapeinfo -f %c |grep TapeAlert|cat'"
|   Spool Directory = "/srv/bacula/spool"
| }
|
| Messages {
|   Name = Standard
|   director = tigersclaw-dir = all
| }

JFTR: "tigersclaw" is the name of my server which runs (among other
things) the Bacula director, storage daemon und also the client where
the backup job in question comes from. (I have more jobs configured,
also from other clients, but they are way to small to even fill a LTO-1
tape.)


Also the output from a:

lsscsi -g

would be necessary.

No problem either:

| # lsscsi -g
| [0:0:1:0]tapeHP   Ultrium 4-SCSI   H63H  /dev/st0   /dev/sg3
| [1:0:0:0]diskATA  Samsung SSD 850  2B6Q  /dev/sda   /dev/sg0
| [2:0:0:0]diskATA  WDC WD40EFRX-68W 0A82  /dev/sdb   /dev/sg1
| [3:0:0:0]diskATA  WDC WD40EFRX-68W 0A82  /dev/sdc   /dev/sg2
| [7:0:0:0]mediumx OVERLAND NEO Series   0616  /dev/sch0  /dev/sg4
| [7:0:0:1]tapeSEAGATE  ULTRIUM06242-XXX 1603  /dev/st1   /dev/sg5
| #



Note in general, if btape works then Bacula will work because the SD
uses the same subroutines that btape uses for reading/writing tapes.

Well, that's what I expected and that's why I'm so puzzled about this
error...


Consequently there may be some other problem.  When the SD seems to be
stuck, you can probably get more information by doing:

bconsole
set debuglevel=200 storage= trace=1
mount
set debuglevel=0 storage= trace=0

then look at the trace file in your working directory to see what it
going on.

Here's the trace file from the beginning of the job until the point
where the first tape was full and Bacula got stuck:

https://suchanek.de/temp/tigersclaw-sd.trace   (47kB)

And here ist what happend when I manually cancelled the stuck job (which
worked) and try to do a "release LTO4-Drive" command in bconsole. (Which
didn't work, i.e. Bacula got stuck here too.)

https://suchanek.de/temp/tigersclaw-sd.trace.2   (3kB)

I hope you can find anything usefull in these debug files, because I'm
totally lost here...


Best regards

Sebastian


Re: [Bacula-users] aix binary?

2018-04-09 Thread Kern Sibbald

  
  
Sorry, I do not recall.  In general we have fewer problems using
  g++ than the native compilers.  In principle either compiler
  should be OK.


On 04/05/2018 03:55 PM, Mike Eggleston
  wrote:


  
  
  
  
Kern,
 
I’m still
working on building AIX FD binaries. Do you know when you
were building by hand, or now on the automated system, is
gcc used or the native IBM/AIX compiler (xlC)?
 

  Thanks,
  Mike

 

  
From: Kern Sibbald
[mailto:k...@sibbald.com]

Sent: Tuesday, April 03, 2018 1:34 PM
To: Mike Eggleston
;
Bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] aix binary?
  

 
I have not build the AIX version for about 5 years.  Bacula
  Systems does it.  I am not convinced that it will build
  without libtool, so you might try removing the
  --with-libtool=no.  Though it should not make any difference,
  I would not use --without-smartalloc because we only build
  with smartalloc turned on.
Good luck,
Kern
 

  On 04/02/2018 07:02 PM, Mike Eggleston
wrote:


  Kern,
   
  I don’t mind
  building it (and have built lots of stuff over the
  decades). Here is my PATH and the command line I’m using.
  What are you using?
   
  export
PATH=/usr/bin:/etc:/usr/sbin:/usr/ucb:/home/meggle1/bin:/usr/bin/X11:/sbin:/usr/vacpp/bin
   
  ./configure
  --without-TLS --disable-TLS --without-tls --disable-tls
  --without-ssl --disable-ssl --without-crypto
  --disable-crypto --disable-ipv6 --disable-lzo
  --disable-nls --disable-NLS --disable-readline
  --disable-smartalloc --enable-client-only
  --with-libtool=no --without-mysql --without-smartalloc
   
  
Thanks,
Mike
  
   
  

  From: Kern Sibbald [mailto:k...@sibbald.com]
  
  Sent: Sunday, April 01, 2018 2:28 AM
  To: Mike Eggleston ;
  Bacula-users@lists.sourceforge.net
  Subject: Re: [Bacula-users] aix binary?

  
   
  Hello,
  If no one has one and you are unable to build it (actually
rather easy -- build it directly on AIX but non-static), you
can get one from Bacula Systems, but you will need a
subscription.
  Though binary packages are built for the community (thanks
to Bacula Systems), they are not yet released (waiting for
me to do the documentation), so some time in the future
there is a possibility that we could have community binaries
for AIX.
  Best regards,
  Kern
   
  
On 03/06/2018 10:04 PM, Mike Eggleston
  wrote:
  
  
Does anyone have a static bacula-fd for
  AIX they could send me?
 
Thanks,
Mike
 




  
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot




  
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
  
   

 
  


  


--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] libbaccats-9.0.6.so dependency problem when installing rpm files

2018-04-09 Thread Kern Sibbald
Try using the .spec files that are released with Bacula 9.0.6 rather 
than the RedHat spec files.  If you are using the community .spec files, 
let me know and I will make sure that they are the same ones our 
packager is using (sometimes packagers modify packages but the changes 
don't always get pushed back to the source).


Best regards,

Kern


On 04/05/2018 04:50 PM, Matthias Leopold wrote:

Hi,

I'm absolutely new to Bacula and basically only want to package the 
software for CentOS 7 so it can be used in my organization by others. 
I'm compiling RPMs from the spec files in bacula-9.0.6.tar.gz. I chose 
"%define postgresql 1" so i got a bacula-postgresql-9.0.6-1.x86_64.rpm 
package. When i want install it from our spacewalk server i get the 
following message:


Error: Package: bacula-postgresql-9.0.6-1.x86_64 
(our_custom_channel_x86_64)

   Requires: libbaccats-9.0.6.so()(64bit)

When i look at the spec file i see that only the mysql package would 
get a "Provides: libbaccats-%{version}.so()(64bit)". How is installing 
packages supposed to work with postgresql versions of Bacula?


thx for any advice
matthias



-- 


Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users




--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Backup problem with 1 of 2 Raspberry PI using Raspbian (Debian)

2018-04-09 Thread Jari Fredriksson


> Johannsen, Thorsten  kirjoitti 5.4.2018 kello 
> 14.35:
> 
> On 05.04.2018 00:01, Jari Fredriksson wrote:
> 
> Hi Jari,
> 
> 
> [...]
> One of the Raspi's (heRPI01) is being backed up without any problems. The 
> other one (heRPI02), however, refused to make
> backups after a first and successful backup:
> 
> 
> I have 5 Raspis, all backed up with Bacula, all having accurate to set. 
> One of them is the ”backbone” having a 4 TB external HD with tons of 
> files.
> 
> No problems so far…
> 
> br. jarif
> 
>> 
> Do you have Raspbian installed? Do you use the bacula-fd version from the 
> repository or did you compile your own?
> 

Yes, I have the latest Raspbian. I have 9.0.4 on one of them and 7.4.4 on the 
others.   I have absolutely no idea how I have got them, as I do not see 
anything in /usr/local/src or my home. I pretty definitely compiled the 9.0.4 
from source as I have full stack of the latest at point  on that Raspi, but now 
moved them to an lxc container on my Proliant.

/etc/apt* does not have traces of some customer source either.



signature.asc
Description: Message signed with OpenPGP
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Backup problem with 1 of 2 Raspberry PI using Raspbian (Debian)

2018-04-09 Thread Jari Fredriksson


> Johannsen, Thorsten  kirjoitti 5.4.2018 kello 
> 16.17:
> 
> On 05.04.2018 13:35, Johannsen, Thorsten wrote:
>> On 05.04.2018 00:01, Jari Fredriksson wrote:
>> 
>> Hi Jari,
>> 
>> 
>> [...]
> 
>> Do you have Raspbian installed? Do you use the bacula-fd version from the 
>> repository or did you compile your own?
> 
> Moreover: could you please check the free memory on your 5 RPI’s

> 

jarif@gauntlet ~ $ free -m
  totalusedfree  shared  buff/cache   available
Mem:923 198 140  19 583 690
Swap:  1865 1961669

jarif@gamecock ~ $ free -m
  totalusedfree  shared  buff/cache   available
Mem:923 182 156  25 584 700
Swap:  1865  621803

jarif@fury:~ $ free -m
  totalusedfree  shared  buff/cache   available
Mem:   2011 677 979  26 3541260
Swap:99  99   0

pi@tigermoth ~ $ free -m
  totalusedfree  shared  buff/cache   available
Mem:927 242 106  46 578 623
Swap:  1023  34 989

pi@moth ~ $ free -m
  totalusedfree  shared  buff/cache   available
Mem:481  66  29  27 385 355
Swap:   981   0 981


That’s them. All of them are having bacula 7.4.4 except gauntlet.

br. jarif



signature.asc
Description: Message signed with OpenPGP
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Backup problem with 1 of 2 Raspberry PI using Raspbian (Debian)

2018-04-09 Thread Jari Fredriksson


> Jari Fredriksson  kirjoitti 9.4.2018 kello 19.01:
> 
> 
> 
>> Johannsen, Thorsten  kirjoitti 5.4.2018 kello 
>> 16.17:
>> 
>> On 05.04.2018 13:35, Johannsen, Thorsten wrote:
>>> On 05.04.2018 00:01, Jari Fredriksson wrote:
>>> 
>>> Hi Jari,
>>> 
>>> 
>>> [...]
>> 
>>> Do you have Raspbian installed? Do you use the bacula-fd version from the 
>>> repository or did you compile your own?
>> 

I found them:

jarif@gauntlet ~ $ ll /usr/local/src/
total 5252
drwxrwxr-x 11 jarif jarif4096 Jun 11  2017 bacula-7.4.7
drwxrwxr-x 11 jarif jarif4096 Aug 20  2017 bacula-9.0.3
drwxr-xr-x 21 jarif jarif4096 Aug 20  2017 openssl-1.0.2l
-rw-r--r--  1 jarif jarif 5365054 May 25  2017 openssl-1.0.2l.tar.gz




signature.asc
Description: Message signed with OpenPGP
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bacula and centos (7)

2018-04-09 Thread Dimitri Maziuk
On 04/09/2018 10:37 AM, Phil Stracchino wrote:

> Honestly, this is an endemic problem with Red Hat.  ...And yet then they
> leap headlong at unproven, misconceived projects like systemd.

The problem is sharing the loot. Software that comes with paid support
from "not Red Hat" gets a rather low priority. Surprise surprise.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users