Re: [Bacula-users] How to LTO-8

[Richard Couture]

The SAS controller was working with an IBM library with LTO-4 with 
another computer running bacula 5.xxx. When the IBM died we decided that 
it was time to upgrade rather than repair as the LTO-4 was no longer 
large enough to backup everything. We never really looked into whether 
it was the HBA or the library of both...


I noted when connecting the new library to the HBA that it hung at boot 
for 3 - 5 minutes before continuing, which gave me pause, but it finally 
continued without displaying any error. I reset the HBA to factory as 
well as changing many settings like not trying to boot and with each 
change the HBA hung at boot for a LONG time, so I am somewhat suspicious 
of the HBA.



Richard


On 1/11/19 6:27 PM, Adam Nielsen wrote:

I found another person with the very same symptoms and they resolved the
problem by changing out the SAS host adapter


Wow that's weird that a SAS controller would be to blame!  My library
and drive are HP and they supply "HP Tape Tools" which you can use to
run tests on the library (and drive) to see if they are working
properly.  Are there any vendor diagnostics for your library that you
could run to confirm it is working correctly?

It seems a bit odd it would be the SAS controller if it worked before
upgrading to the latest Bacula version.  Perhaps it's an issue with a
kernel driver, assuming you upgraded the whole OS at the same time?


I Note that both my bacula-dir and my bacula-sd conf files have a
Storage section, with a Device section only in bacula-sd.

Is this correct or should the Storage and Device be in one or the other
confs? If they or one or the other sections should  be in both confs,
should they be identical???


This is correct.  The entries in bacula-dir tell it to connect to
the bacula-sd daemon, and the entries in bacula-sd tell it which
hardware device to use.  This is because you can have multiple
bacula-sd instances on different machines, so the Director needs to
know which device is controlled by which machine.

You should have both the autochanger and the drive listed in both
config files, however the one listed in bacula-dir.conf will be much
shorter as it won't have any of the configuration, basically just the
password for the bacula-sd daemon.

I am not sure whether it is necessary to list both the drive and the
autochanger (from your config files it looks like you only include the
autochanger and not the drive) but since Bacula is calling the
mtx-changer script it would seem to be fine the way you have it now.

In case it's helpful, here are the full Storage sections from my own
bacula-dir.conf:

   Autochanger {
 Name = peapod-x
 Address = localhost
 SDPort = 9103
 Password = "xxx"
 Device = peapod-x
 Media Type = LTO-4
 Maximum Concurrent Jobs = 10
   }

   Storage {
 Name = peapod-d1
 Address = localhost
 SDPort = 9103
 Password = "xxx"
 Device = peapod-d1
 Media Type = LTO-4
 Autochanger = peapod-x
 Maximum Concurrent Jobs = 10
   }

Your Storage section with "Autochanger = yes" is equivalent to the
Autochanger section, this is just a newer way of writing it that
works with recent Bacula versions.  (Definitely 9.x, not sure
about 7.x though.)

Cheers,
Adam.



--
LinuxCabal Asociación Civil
Ing. Richard Couture
Novell CNE, ECNE, MCNE
HP/Compaq ASE
Tel.: (+52) (333) 145-2638
Cel.: (+52) (044) 333 377-7505
Web: http://www.LinuxCabal.org
E-Mail: r...@linuxcabal.org
Hosted en la nube Cloud Sigma - www.CloudSigma.com

AVISO DE CONFIDENCIALIDAD: Este correo electrónico, incluyendo en su 
caso, los archivos adjuntos al mismo, pueden contener información de 
carácter confidencial y/o privilegiada, y se envían a la atención única 
y exclusivamente de la persona y/o entidad a quien va dirigido. La 
copia, revisión, uso, revelación y/o distribución de dicha información 
confidencial sin la autorización por escrito de LinuxCabal está 
prohibida. Si usted no es el destinatario a quien se dirige el presente 
correo, favor de contactar al remitente respondiendo al presente correo 
y eliminar el correo original incluyendo sus archivos, así como 
cualesquiera copia del mismo. Mediante la recepción del presente correo 
usted reconoce y acepta que en caso de incumplimiento de su parte y/o de 
sus representantes a los términos antes mencionados, LinuxCabal tendrá 
derecho a los daños y perjuicios que esto le cause.




___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Running a script each time a client is addressed

[Adam Nielsen]

> I have a client that's remote. The connectivity to the remote client is
> established through an SSH script.
> In general the SSH connection is up or re-established when a job runs
> through Run Before Job in a JobDefs piece.
> This works properly.

Just curious - any reason why you're using SSH rather than something
like OpenVPN?  OpenVPN will automatically connect as needed so it's
much easier to manage in scripted environments, so just wondering what
makes SSH the preferred option in this case.

Cheers,
Adam.


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] How to LTO-8

[Adam Nielsen]

> I found another person with the very same symptoms and they resolved the 
> problem by changing out the SAS host adapter

Wow that's weird that a SAS controller would be to blame!  My library
and drive are HP and they supply "HP Tape Tools" which you can use to
run tests on the library (and drive) to see if they are working
properly.  Are there any vendor diagnostics for your library that you
could run to confirm it is working correctly?

It seems a bit odd it would be the SAS controller if it worked before
upgrading to the latest Bacula version.  Perhaps it's an issue with a
kernel driver, assuming you upgraded the whole OS at the same time?

> I Note that both my bacula-dir and my bacula-sd conf files have a 
> Storage section, with a Device section only in bacula-sd.
> 
> Is this correct or should the Storage and Device be in one or the other 
> confs? If they or one or the other sections should  be in both confs, 
> should they be identical???

This is correct.  The entries in bacula-dir tell it to connect to
the bacula-sd daemon, and the entries in bacula-sd tell it which
hardware device to use.  This is because you can have multiple
bacula-sd instances on different machines, so the Director needs to
know which device is controlled by which machine.

You should have both the autochanger and the drive listed in both
config files, however the one listed in bacula-dir.conf will be much
shorter as it won't have any of the configuration, basically just the
password for the bacula-sd daemon.

I am not sure whether it is necessary to list both the drive and the
autochanger (from your config files it looks like you only include the
autochanger and not the drive) but since Bacula is calling the
mtx-changer script it would seem to be fine the way you have it now.

In case it's helpful, here are the full Storage sections from my own
bacula-dir.conf:

  Autochanger {
Name = peapod-x
Address = localhost
SDPort = 9103
Password = "xxx"
Device = peapod-x
Media Type = LTO-4
Maximum Concurrent Jobs = 10
  }

  Storage {
Name = peapod-d1
Address = localhost
SDPort = 9103
Password = "xxx"
Device = peapod-d1
Media Type = LTO-4
Autochanger = peapod-x
Maximum Concurrent Jobs = 10
  }

Your Storage section with "Autochanger = yes" is equivalent to the
Autochanger section, this is just a newer way of writing it that
works with recent Bacula versions.  (Definitely 9.x, not sure
about 7.x though.)

Cheers,
Adam.


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] mtx and mtx-changer not functioning

[Richard Couture]

Here is my lsscsi -g

I use sg3 to talk to the magazine mech and st0 or nst0 to talk to the drive

I don't have a /dev/changer as many seem to have

In /dev/tape I have

[root@LTOMag ~]# ls -al /dev/tape/by-id/
total 0
drwxr-xr-x 2 root root 100 Jan  9 21:06 ./
drwxr-xr-x 4 root root  80 Jan  9 21:06 ../
lrwxrwxrwx 1 root root   9 Jan  9 21:06 scsi-1QUANTUM_F5C1834008_LLA -> 
../../sg3

lrwxrwxrwx 1 root root   9 Jan  9 21:06 scsi-3500308c3ec11e004 -> ../../st0
lrwxrwxrwx 1 root root  10 Jan  9 21:06 scsi-3500308c3ec11e004-nst -> 
../../nst0

[root@LTOMag ~]# ls -al /dev/tape/by-path
total 0
drwxr-xr-x 2 root root 80 Jan  9 21:06 ./
drwxr-xr-x 4 root root 80 Jan  9 21:06 ../
lrwxrwxrwx 1 root root  9 Jan  9 21:06 pci-:01:00.0-sas-phy3-lun-0 
-> ../../st0
lrwxrwxrwx 1 root root 10 Jan  9 21:06 
pci-:01:00.0-sas-phy3-lun-0-nst -> ../../nst0


I made a symlink from changer to sg3, without any effect

Richard


[root@LTOMag ~]# lsscsi -g
[0:0:0:0]diskATA  WDC WD10EZEX-75W 1A02  /dev/sda   /dev/sg0
[1:0:0:0]diskATA  WD5003ABYX-23WC38  /dev/sdb   /dev/sg1
[6:0:0:0]tapeIBM  ULTRIUM-HH8  J4D1  /dev/st0   /dev/sg2
[6:0:0:1]mediumx QUANTUM  Scalar i3-i6 160G  /dev/sch0  /dev/sg3


On 1/11/19 4:13 PM, Jeffrey R. Lang wrote:

In your mtx command output one thing I don't see is the Data Transfer Unit 
(i.e. tape drive) associated with the tape library.

For my tape library I get:

[root@bkupsvr3 ~]# mtx -f /dev/xchg0 status
   Storage Changer /dev/xchg0:4 Drives, 179 Slots ( 2 Import/Export )
Data Transfer Element 0:Full (Storage Element 162 Loaded):VolumeTag = 000162L5
Data Transfer Element 1:Full (Storage Element 120 Loaded):VolumeTag = 000120L5
Data Transfer Element 2:Full (Storage Element 105 Loaded):VolumeTag = 000105L5
Data Transfer Element 3:Full (Storage Element 166 Loaded):VolumeTag = 000166L5
   Storage Element 1:Full :VolumeTag=01L5
   Storage Element 2:Full :VolumeTag=02L5
   Storage Element 3:Full :VolumeTag=03L5
   Storage Element 4:Full :VolumeTag=04L5
   Storage Element 5:Full :VolumeTag=05L5
   Storage Element 6:Full :VolumeTag=06L5

So I wondering does the library either not show drives or is there an issue 
with the library seeing the tape drive.

I would investigate and make sure that the drive and library are connected 
properly.

The output of "lsscsi -g" does who the tape drive?



-Original Message-
From: Richard Couture 
Sent: Friday, January 11, 2019 1:59 PM
To: bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] mtx and mtx-changer not functioning

How odd

[root@LTOMag ~]# mt -f /dev/st0 offline
[root@LTOMag ~]# mtx -f /dev/sg3 unload 1 0 Data Transfer Element 0 is Empty

Now says the tape drive is empty

HOWEVER

[root@LTOMag ~]# mtx -f /dev/sg3 status
Storage Changer /dev/sg3:1 Drives, 30 Slots ( 5 Import/Export ) Data 
Transfer Element 0:Empty
Storage Element 1:Empty:VolumeTag=
Storage Element 2:Full :VolumeTag=02L7
Storage Element 3:Full :VolumeTag=03L7
Storage Element 4:Full :VolumeTag=04L7
Storage Element 5:Full :VolumeTag=05L7
Storage Element 6:Full :VolumeTag=06L7
Storage Element 7:Full :VolumeTag=07L7
Storage Element 8:Full :VolumeTag=08L7
Storage Element 9:Full :VolumeTag=09L7
Storage Element 10:Full :VolumeTag=10L7
Storage Element 11:Full :VolumeTag=11L7
Storage Element 12:Full :VolumeTag=12L7
Storage Element 13:Full :VolumeTag=13L7
Storage Element 14:Full :VolumeTag=14L7
Storage Element 15:Full :VolumeTag=15L7
Storage Element 16:Full :VolumeTag=16L7
Storage Element 17:Full :VolumeTag=17L7
Storage Element 18:Full :VolumeTag=18L7
Storage Element 19:Full :VolumeTag=19L7
Storage Element 20:Full :VolumeTag=20L7
Storage Element 21:Full :VolumeTag=21L7
Storage Element 22:Full :VolumeTag=22L7
Storage Element 23:Full :VolumeTag=23L7
Storage Element 24:Full :VolumeTag=24L7
Storage Element 25:Full :VolumeTag=25L7
Storage Element 26 IMPORT/EXPORT:Full :VolumeTag=CLN005CU

Storage Element 27 IMPORT/EXPORT:Full :VolumeTag=CLN004CU

Storage Element 28 IMPORT/EXPORT:Full :VolumeTag=CLN003CU

Storage Element 29 IMPORT/EXPORT:Full :VolumeTag=CLN002CU

Storage Element 30 IMPORT/EXPORT:Empty:VolumeTag=


syas that the tape was not returned to slot 1

and just for fun

[root@LTOMag ~]# mtx -f /dev/sg3 unload
Data Transfer Element 0 is Empty
[root@LTOMag ~]# mtx -f /dev/sg3 next
Loading media from Storage Element 2 into drive 0...mtx: Request Sense:
Long Report=yes
mtx: Request Sense: Valid Residual=no
mtx: Request Sense: Error Code=70 (Current)
mtx: Request Sense: Sense Key=Illegal Request
mtx: Request Sense: FileMark=no
mtx: Request Sense: 

Re: [Bacula-users] mtx and mtx-changer not functioning

[Jeffrey R. Lang]

In your mtx command output one thing I don't see is the Data Transfer Unit 
(i.e. tape drive) associated with the tape library.

For my tape library I get:

[root@bkupsvr3 ~]# mtx -f /dev/xchg0 status
  Storage Changer /dev/xchg0:4 Drives, 179 Slots ( 2 Import/Export )
Data Transfer Element 0:Full (Storage Element 162 Loaded):VolumeTag = 000162L5  
  
Data Transfer Element 1:Full (Storage Element 120 Loaded):VolumeTag = 000120L5  
  
Data Transfer Element 2:Full (Storage Element 105 Loaded):VolumeTag = 000105L5  
  
Data Transfer Element 3:Full (Storage Element 166 Loaded):VolumeTag = 000166L5  
  
  Storage Element 1:Full :VolumeTag=01L5
  Storage Element 2:Full :VolumeTag=02L5
  Storage Element 3:Full :VolumeTag=03L5
  Storage Element 4:Full :VolumeTag=04L5
  Storage Element 5:Full :VolumeTag=05L5
  Storage Element 6:Full :VolumeTag=06L5

So I wondering does the library either not show drives or is there an issue 
with the library seeing the tape drive.

I would investigate and make sure that the drive and library are connected 
properly.

The output of "lsscsi -g" does who the tape drive?



-Original Message-
From: Richard Couture  
Sent: Friday, January 11, 2019 1:59 PM
To: bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] mtx and mtx-changer not functioning

How odd

[root@LTOMag ~]# mt -f /dev/st0 offline
[root@LTOMag ~]# mtx -f /dev/sg3 unload 1 0 Data Transfer Element 0 is Empty

Now says the tape drive is empty

HOWEVER

[root@LTOMag ~]# mtx -f /dev/sg3 status
   Storage Changer /dev/sg3:1 Drives, 30 Slots ( 5 Import/Export ) Data 
Transfer Element 0:Empty
   Storage Element 1:Empty:VolumeTag=
   Storage Element 2:Full :VolumeTag=02L7
   Storage Element 3:Full :VolumeTag=03L7
   Storage Element 4:Full :VolumeTag=04L7
   Storage Element 5:Full :VolumeTag=05L7
   Storage Element 6:Full :VolumeTag=06L7
   Storage Element 7:Full :VolumeTag=07L7
   Storage Element 8:Full :VolumeTag=08L7
   Storage Element 9:Full :VolumeTag=09L7
   Storage Element 10:Full :VolumeTag=10L7
   Storage Element 11:Full :VolumeTag=11L7
   Storage Element 12:Full :VolumeTag=12L7
   Storage Element 13:Full :VolumeTag=13L7
   Storage Element 14:Full :VolumeTag=14L7
   Storage Element 15:Full :VolumeTag=15L7
   Storage Element 16:Full :VolumeTag=16L7
   Storage Element 17:Full :VolumeTag=17L7
   Storage Element 18:Full :VolumeTag=18L7
   Storage Element 19:Full :VolumeTag=19L7
   Storage Element 20:Full :VolumeTag=20L7
   Storage Element 21:Full :VolumeTag=21L7
   Storage Element 22:Full :VolumeTag=22L7
   Storage Element 23:Full :VolumeTag=23L7
   Storage Element 24:Full :VolumeTag=24L7
   Storage Element 25:Full :VolumeTag=25L7
   Storage Element 26 IMPORT/EXPORT:Full :VolumeTag=CLN005CU 

   Storage Element 27 IMPORT/EXPORT:Full :VolumeTag=CLN004CU 

   Storage Element 28 IMPORT/EXPORT:Full :VolumeTag=CLN003CU 

   Storage Element 29 IMPORT/EXPORT:Full :VolumeTag=CLN002CU 

   Storage Element 30 IMPORT/EXPORT:Empty:VolumeTag= 


syas that the tape was not returned to slot 1

and just for fun

[root@LTOMag ~]# mtx -f /dev/sg3 unload
Data Transfer Element 0 is Empty
[root@LTOMag ~]# mtx -f /dev/sg3 next
Loading media from Storage Element 2 into drive 0...mtx: Request Sense: 
Long Report=yes
mtx: Request Sense: Valid Residual=no
mtx: Request Sense: Error Code=70 (Current)
mtx: Request Sense: Sense Key=Illegal Request
mtx: Request Sense: FileMark=no
mtx: Request Sense: EOM=no
mtx: Request Sense: ILI=no
mtx: Request Sense: Additional Sense Code = 21
mtx: Request Sense: Additional Sense Qualifier = 01
mtx: Request Sense: Field in Error = 07
mtx: Request Sense: BPV=yes
mtx: Request Sense: Error in CDB=yes
mtx: Request Sense: SKSV=yes
mtx: Request Sense: Field Pointer = 00 02 MOVE MEDIUM from Element Address 4097 
to 256 Failed

And physically checking; No tape in Slot 1, it remains in the drive



Richard


On 1/11/19 1:01 PM, Jeffrey R. Lang wrote:
> I have run into tape libraries that require the tape to be unloaded from the 
> drive before performing an unload command.
> 
> The mtx-changer script supports  this feature.  You need to change the 
> .../etc/mtx-changer.conf file, specifically the line
> 
> # Set to 1 if you want to do offline before unload
> offline=0
> 
> In the example from below
> 
> mtx -f /dev/sg3 load 1 0
> mtx -f /dev/sg3 unload 1 0
> 
> add a command to unload the tape from the drive between the two lines
> 
> mt  -f  offline
> 
> -Original Message-
> From: Sebastian Suchanek 
> Sent: Friday, January 11, 2019 12:53 PM
> To: 

Re: [Bacula-users] mtx and mtx-changer not functioning

[Adzhubey, Ivan A,Ph.D.]

Hi Richard,

Have you tried updating inventory on the changer *via the firmware command*? I 
have seen this type of discrepancies appearing every time I power cycle my 
changer and it loses its inventory list stored on the device.

Best,
Ivan

On Friday, January 11, 2019 2:58:46 PM EST Richard Couture wrote:
> How odd
> 
> [root@LTOMag ~]# mt -f /dev/st0 offline
> [root@LTOMag ~]# mtx -f /dev/sg3 unload 1 0
> Data Transfer Element 0 is Empty
> 
> Now says the tape drive is empty
> 
> HOWEVER
> 
> [root@LTOMag ~]# mtx -f /dev/sg3 status
>Storage Changer /dev/sg3:1 Drives, 30 Slots ( 5 Import/Export )
> Data Transfer Element 0:Empty
>Storage Element 1:Empty:VolumeTag=
>Storage Element 2:Full :VolumeTag=02L7
>Storage Element 3:Full :VolumeTag=03L7
>Storage Element 4:Full :VolumeTag=04L7
>Storage Element 5:Full :VolumeTag=05L7
>Storage Element 6:Full :VolumeTag=06L7
>Storage Element 7:Full :VolumeTag=07L7
>Storage Element 8:Full :VolumeTag=08L7
>Storage Element 9:Full :VolumeTag=09L7
>Storage Element 10:Full :VolumeTag=10L7
>Storage Element 11:Full :VolumeTag=11L7
>Storage Element 12:Full :VolumeTag=12L7
>Storage Element 13:Full :VolumeTag=13L7
>Storage Element 14:Full :VolumeTag=14L7
>Storage Element 15:Full :VolumeTag=15L7
>Storage Element 16:Full :VolumeTag=16L7
>Storage Element 17:Full :VolumeTag=17L7
>Storage Element 18:Full :VolumeTag=18L7
>Storage Element 19:Full :VolumeTag=19L7
>Storage Element 20:Full :VolumeTag=20L7
>Storage Element 21:Full :VolumeTag=21L7
>Storage Element 22:Full :VolumeTag=22L7
>Storage Element 23:Full :VolumeTag=23L7
>Storage Element 24:Full :VolumeTag=24L7
>Storage Element 25:Full :VolumeTag=25L7
>Storage Element 26 IMPORT/EXPORT:Full :VolumeTag=CLN005CU
> 
>Storage Element 27 IMPORT/EXPORT:Full :VolumeTag=CLN004CU
> 
>Storage Element 28 IMPORT/EXPORT:Full :VolumeTag=CLN003CU
> 
>Storage Element 29 IMPORT/EXPORT:Full :VolumeTag=CLN002CU
> 
>Storage Element 30 IMPORT/EXPORT:Empty:VolumeTag=
> 
> 
> syas that the tape was not returned to slot 1
> 
> and just for fun
> 
> [root@LTOMag ~]# mtx -f /dev/sg3 unload
> Data Transfer Element 0 is Empty
> [root@LTOMag ~]# mtx -f /dev/sg3 next
> Loading media from Storage Element 2 into drive 0...mtx: Request Sense:
> Long Report=yes
> mtx: Request Sense: Valid Residual=no
> mtx: Request Sense: Error Code=70 (Current)
> mtx: Request Sense: Sense Key=Illegal Request
> mtx: Request Sense: FileMark=no
> mtx: Request Sense: EOM=no
> mtx: Request Sense: ILI=no
> mtx: Request Sense: Additional Sense Code = 21
> mtx: Request Sense: Additional Sense Qualifier = 01
> mtx: Request Sense: Field in Error = 07
> mtx: Request Sense: BPV=yes
> mtx: Request Sense: Error in CDB=yes
> mtx: Request Sense: SKSV=yes
> mtx: Request Sense: Field Pointer = 00 02
> MOVE MEDIUM from Element Address 4097 to 256 Failed
> 
> And physically checking; No tape in Slot 1, it remains in the drive
> 
> 
> 
> Richard
> 
> On 1/11/19 1:01 PM, Jeffrey R. Lang wrote:
> > I have run into tape libraries that require the tape to be unloaded from
> > the drive before performing an unload command.
> > 
> > The mtx-changer script supports  this feature.  You need to change the
> > .../etc/mtx-changer.conf file, specifically the line
> > 
> > # Set to 1 if you want to do offline before unload
> > offline=0
> > 
> > In the example from below
> > 
> > mtx -f /dev/sg3 load 1 0
> > mtx -f /dev/sg3 unload 1 0
> > 
> > add a command to unload the tape from the drive between the two lines
> > 
> > mt  -f  offline
> > 
> > -Original Message-
> > From: Sebastian Suchanek 
> > Sent: Friday, January 11, 2019 12:53 PM
> > To: bacula-users@lists.sourceforge.net
> > Subject: Re: [Bacula-users] mtx and mtx-changer not functioning
> > 
> > ◆ This message was sent from a non-UWYO address. Please exercise caution
> > when clicking links or opening attachments from external sources.> 
> > Am 11.01.2019 um 14:49 schrieb Richard Couture:
> >>> Does mtx work when you explicitly specify the slots? I.e.:
> >>> 
> >>> mtx -f /dev/sg3 load 1 0
> >>> mtx -f /dev/sg3 unload 1 0
> >> 
> >> No
> > 
> > Then, in my opinion, the problem is somewhere outside of Bacula.
> > My best guess is that either your library and your version of mtx are
> > incompatible or your library is broken (e.g. faulty firmware).
> > 
> > 
> > Best regards
> > 
> > Sebastian

-- 
Ivan Adzhubey, Ph.D.
Instructor
Division of Genetics, Dept of Medicine
Brigham & Women's Hospital
Harvard Medical School
New Research Building, Room 0464C
77 Avenue Louis Pasteur
Boston, MA 02115
tel.: (617) 525-4728
fax:  (617) 525-4705
web: http://genetics.bwh.harvard.edu/wiki/sunyaevlab/




The information in this 

Re: [Bacula-users] mtx and mtx-changer not functioning

[Richard Couture]

How odd

[root@LTOMag ~]# mt -f /dev/st0 offline
[root@LTOMag ~]# mtx -f /dev/sg3 unload 1 0
Data Transfer Element 0 is Empty

Now says the tape drive is empty

HOWEVER

[root@LTOMag ~]# mtx -f /dev/sg3 status
  Storage Changer /dev/sg3:1 Drives, 30 Slots ( 5 Import/Export )
Data Transfer Element 0:Empty
  Storage Element 1:Empty:VolumeTag=
  Storage Element 2:Full :VolumeTag=02L7
  Storage Element 3:Full :VolumeTag=03L7
  Storage Element 4:Full :VolumeTag=04L7
  Storage Element 5:Full :VolumeTag=05L7
  Storage Element 6:Full :VolumeTag=06L7
  Storage Element 7:Full :VolumeTag=07L7
  Storage Element 8:Full :VolumeTag=08L7
  Storage Element 9:Full :VolumeTag=09L7
  Storage Element 10:Full :VolumeTag=10L7
  Storage Element 11:Full :VolumeTag=11L7
  Storage Element 12:Full :VolumeTag=12L7
  Storage Element 13:Full :VolumeTag=13L7
  Storage Element 14:Full :VolumeTag=14L7
  Storage Element 15:Full :VolumeTag=15L7
  Storage Element 16:Full :VolumeTag=16L7
  Storage Element 17:Full :VolumeTag=17L7
  Storage Element 18:Full :VolumeTag=18L7
  Storage Element 19:Full :VolumeTag=19L7
  Storage Element 20:Full :VolumeTag=20L7
  Storage Element 21:Full :VolumeTag=21L7
  Storage Element 22:Full :VolumeTag=22L7
  Storage Element 23:Full :VolumeTag=23L7
  Storage Element 24:Full :VolumeTag=24L7
  Storage Element 25:Full :VolumeTag=25L7
  Storage Element 26 IMPORT/EXPORT:Full :VolumeTag=CLN005CU 

  Storage Element 27 IMPORT/EXPORT:Full :VolumeTag=CLN004CU 

  Storage Element 28 IMPORT/EXPORT:Full :VolumeTag=CLN003CU 

  Storage Element 29 IMPORT/EXPORT:Full :VolumeTag=CLN002CU 

  Storage Element 30 IMPORT/EXPORT:Empty:VolumeTag= 



syas that the tape was not returned to slot 1

and just for fun

[root@LTOMag ~]# mtx -f /dev/sg3 unload
Data Transfer Element 0 is Empty
[root@LTOMag ~]# mtx -f /dev/sg3 next
Loading media from Storage Element 2 into drive 0...mtx: Request Sense: 
Long Report=yes

mtx: Request Sense: Valid Residual=no
mtx: Request Sense: Error Code=70 (Current)
mtx: Request Sense: Sense Key=Illegal Request
mtx: Request Sense: FileMark=no
mtx: Request Sense: EOM=no
mtx: Request Sense: ILI=no
mtx: Request Sense: Additional Sense Code = 21
mtx: Request Sense: Additional Sense Qualifier = 01
mtx: Request Sense: Field in Error = 07
mtx: Request Sense: BPV=yes
mtx: Request Sense: Error in CDB=yes
mtx: Request Sense: SKSV=yes
mtx: Request Sense: Field Pointer = 00 02
MOVE MEDIUM from Element Address 4097 to 256 Failed

And physically checking; No tape in Slot 1, it remains in the drive



Richard


On 1/11/19 1:01 PM, Jeffrey R. Lang wrote:

I have run into tape libraries that require the tape to be unloaded from the 
drive before performing an unload command.

The mtx-changer script supports  this feature.  You need to change the 
.../etc/mtx-changer.conf file, specifically the line

# Set to 1 if you want to do offline before unload
offline=0

In the example from below

mtx -f /dev/sg3 load 1 0
mtx -f /dev/sg3 unload 1 0

add a command to unload the tape from the drive between the two lines

mt  -f  offline

-Original Message-
From: Sebastian Suchanek 
Sent: Friday, January 11, 2019 12:53 PM
To: bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] mtx and mtx-changer not functioning

◆ This message was sent from a non-UWYO address. Please exercise caution when 
clicking links or opening attachments from external sources.


Am 11.01.2019 um 14:49 schrieb Richard Couture:


Does mtx work when you explicitly specify the slots? I.e.:

mtx -f /dev/sg3 load 1 0
mtx -f /dev/sg3 unload 1 0


No


Then, in my opinion, the problem is somewhere outside of Bacula.
My best guess is that either your library and your version of mtx are 
incompatible or your library is broken (e.g. faulty firmware).


Best regards

Sebastian



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users



--
LinuxCabal Asociación Civil
Ing. Richard Couture
Novell CNE, ECNE, MCNE
HP/Compaq ASE
Tel.: (+52) (333) 145-2638
Cel.: (+52) (044) 333 377-7505
Web: http://www.LinuxCabal.org
E-Mail: r...@linuxcabal.org
Hosted en la nube Cloud Sigma - www.CloudSigma.com

AVISO DE CONFIDENCIALIDAD: Este correo electrónico, incluyendo en su 
caso, los archivos adjuntos al mismo, pueden contener información de 
carácter confidencial y/o privilegiada, y se envían a la atención única 
y exclusivamente de la persona y/o entidad a quien va dirigido. La 
copia, revisión, uso, revelación y/o distribución de dicha información 
confidencial sin la autorización por 

[Bacula-users] Running a script each time a client is addressed

[PenguinWhispererThe]

Hi,

What I'm trying to do feels obvious but I can't find what I'm looking for.

I have a client that's remote. The connectivity to the remote client is
established through an SSH script.
In general the SSH connection is up or re-established when a job runs
through Run Before Job in a JobDefs piece.
This works properly.

Once in a while I want to retrieve the status of the client. This
frequently times out and the cause seems to be that the Run Before Job is
not being executed (which is obviously as designed).
Now I'd like to know if there's a way to start a script every time you
connect to the client.
I've checked the documentation on the Client definition but couldn't see
anything that fits my needs.

How could I make this work? Or what is the configuration to accomplish this?

Thanks in advance.
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] mtx and mtx-changer not functioning

[Jeffrey R. Lang]

I have run into tape libraries that require the tape to be unloaded from the 
drive before performing an unload command.   

The mtx-changer script supports  this feature.  You need to change the 
.../etc/mtx-changer.conf file, specifically the line

# Set to 1 if you want to do offline before unload
offline=0

In the example from below

mtx -f /dev/sg3 load 1 0
mtx -f /dev/sg3 unload 1 0

add a command to unload the tape from the drive between the two lines

mt  -f  offline

-Original Message-
From: Sebastian Suchanek  
Sent: Friday, January 11, 2019 12:53 PM
To: bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] mtx and mtx-changer not functioning

◆ This message was sent from a non-UWYO address. Please exercise caution when 
clicking links or opening attachments from external sources.


Am 11.01.2019 um 14:49 schrieb Richard Couture:

>> Does mtx work when you explicitly specify the slots? I.e.:
>>
>> mtx -f /dev/sg3 load 1 0
>> mtx -f /dev/sg3 unload 1 0
>
> No

Then, in my opinion, the problem is somewhere outside of Bacula.
My best guess is that either your library and your version of mtx are 
incompatible or your library is broken (e.g. faulty firmware).


Best regards

Sebastian



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] mtx and mtx-changer not functioning

[Sebastian Suchanek]

Am 11.01.2019 um 14:49 schrieb Richard Couture:

>> Does mtx work when you explicitly specify the slots? I.e.:
>>
>> mtx -f /dev/sg3 load 1 0
>> mtx -f /dev/sg3 unload 1 0
>
> No

Then, in my opinion, the problem is somewhere outside of Bacula.
My best guess is that either your library and your version of mtx are
incompatible or your library is broken (e.g. faulty firmware).


Best regards

Sebastian



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Baculum restorations issues

[Frédéric F .]

Hello,

Thank you for your answer, I will try your fork next week.
I use CentOS for intructions.

If anyone have an idea about my issues, I am interested.

Le ven. 11 janv. 2019 à 12:27, Wanderlei Huttel
 a écrit :
>
> Are you using CentOS or Debian?
>
> Best regards
>
> Wanderlei Hüttel
> http://www.bacula.com.br
>
>
> Em sex, 11 de jan de 2019 às 09:24, Chris Wilkinson  
> escreveu:
>>
>> My Portuguese is not so good
>>
>> Regards
>> Chris Wilkinson
>>
>> On Fri, 11 Jan 2019, 11:22 am Wanderlei Huttel > wrote:
>>>
>>> Hello Chris
>>>
>>> Yes there is, but the instructions are in Portuguese.
>>> https://github.com/wanderleihuttel/bacula-utils/tree/master/tutorial
>>>
>>>
>>> Best regards
>>>
>>> Wanderlei Hüttel
>>> http://www.bacula.com.br
>>>
>>>
>>> Em sex, 11 de jan de 2019 às 09:16, Chris Wilkinson 
>>>  escreveu:

 Very interesting. Is there a link for the installation instructions? The 
 docs folder appears to be old.

 Regards
 Chris Wilkinson

 On Fri, 11 Jan 2019, 9:34 a.m. Wanderlei Huttel >>> wrote:
>
> Hello Frederic
>
> I have a fork o Webacula with a new visual and some improvements.
> https://github.com/wanderleihuttel/webacula
>
> You cant take a look in the screens here:
> https://github.com/wanderleihuttel/webacula/wiki
>
> Best regards
>
> Wanderlei Hüttel
> http://www.bacula.com.br
>
>
> Em qui, 10 de jan de 2019 às 20:48, Frédéric F.  
> escreveu:
>>
>> Hello everyone,
>> I use Bacula for 3 months and I am happy to use it.
>> However I have several problems with the GUI Baculum.
>>
>> In Baculum, I have problem to restore files with path contains '
>> character like "D:\Data\l'information"
>> I can see in baculum the folder but when I select it, I can't browse
>> into, the sub folder is empty.
>> I can restore upper folder but it's not a great job.
>> Any advice to browse in baculum with folders with special character ?
>> I have a lot...
>>
>> Another problem with Baculum :
>> Randomly, I have some lag (about 20 minutes) when I select a "group
>> most recent backup" or one full backup in the list.
>> My postgresql DB is working at 100% on 1CPU/8 for about 20 minutes.
>>
>> I optimize my postgresql DB and with pg_stat_statements, I found the
>> slow bacula query (sorry for presentation) :
>>
>> postgres=# SELECT *
>> FROM
>>   pg_stat_statements
>> ORDER BY
>>   total_time DESC;
>>  userid | dbid  |  queryid   |  query | calls  |total_time|
>> min_time|   max_time|  mean_time  | stddev_time
>> |   rows| shared_blks_hit | shared_blks_read | shared_blks_dirtied
>> | shared_blks_written | local_blks_hit | local_blks_read |
>> local_blks_dirtied | local_blks_written | temp_blks_read |
>> temp_blks_written | blk_read_time | blk_write_time
>>
>>  10 | 16384 | 1980744281 | INSERT INTO PathVisibility (PathId,
>> JobId)  SELECT a.PathId,$1 FROM ( SELECT DISTINCT h.PPathId AS PathId
>> FROM PathHierarchy AS h JOIN  P
>> athVisibility AS p ON (h.PathId=p.PathId) WHERE p.JobId=$2) AS a LEFT
>> JOIN (SELECT PathId FROM PathVisibility WHERE JobId=$3) AS b ON
>> (a.PathId = b.PathId) WHERE b.Path
>> Id IS NULL  | 60 |   1478982.747849 |  0.225819 |
>> 484839.953712 |  24649.71246415 | 105518.8118646
>> 13 |  4074 |   205691266 |  165 |
>> 62 |   0 |  0 |   0 |
>> 0 |
>>0 |   1011 |  1014 | 0 |  >> 0
>>
>> I am not sure it is a DB problem rather a bacula optimization but what ?
>>
>> According to my stats, I have :
>> - 5.31 TB of data saved, around 13M files
>> - Bacula DB 5,18 Go
>> - Fileset : 82
>>
>> OS : CentOS 7.5.1804
>> Postgresql : 10.6
>> Bacula : 9.2.1-1-el7
>>
>> Postgresql.conf tweaks :
>>
>> max_connections = 100
>> shared_buffers = 2016MB
>> maintenance_work_mem = 512MB
>> effective_cache_size = 6GB
>> max_worker_processes = 8
>> max_parallel_workers_per_gather = 2
>> max_parallel_workers = 8
>>
>>
>> Hardware
>> HP Proliant server (2017)
>> CPU Xeon 4/8 cores
>> Memory : 8 Go
>> HD in RAID 5 (no SSD)
>>
>> Off topic question : is there another web GUI to restore files easily ?
>>
>> Thank you for your help
>>
>> PS : sorry for my approximate english.
>>
>>
>> ___
>> Bacula-users mailing list
>> Bacula-users@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> 

Re: [Bacula-users] How to LTO-8

[Richard Couture]

I found another person with the very same symptoms and they resolved the 
problem by changing out the SAS host adapter


I Note that both my bacula-dir and my bacula-sd conf files have a 
Storage section, with a Device section only in bacula-sd.


Is this correct or should the Storage and Device be in one or the other 
confs? If they or one or the other sections should  be in both confs, 
should they be identical???




Richard


On 1/10/19 6:50 PM, Adam Nielsen wrote:

As mentioned earlier, the command

./mtx-changer /dev/sg3 load 1 /dev/st0 0

actually put the desired tape into the drive, however

./mtx-changer /dev/sg3 unload 1 /dev/st0 0

returns the following error message


This to me looks like the mtx-changer script is not able to talk to
your autochanger properly.  I had to modify the script to work with my
autochanger, and this is appears to be by design (the mtx-changer
script supplied is a default that you are meant to customise for your
hardware) so I guess modifying this script is the next step.

If the script was present and working with your old Bacula set up, that
might be a good place to start looking to see what has changed.


̣root@LTOMag scripts]# ./mtx-changer /dev/sg3 unload 1 /dev/st0 0
Unloading drive 0 into Storage Element 1...
mtx: Request Sense: Sense Key=Illegal Request
MOVE MEDIUM from Element Address 256 to 4096 Failed


I don't know much about low level autochanger commands, but it seems
odd that telling the autochanger to put the tape in slot 1 results in a
command asking it to put the tape in "element 4096", which the
autochanger says is an illegal request.  Maybe that's normal but it
seems a bit weird.

I would start by modifying mtx-changer to output the commands it's
trying to run, and then running those commands manually, tweaking them
until you figure out how they are supposed to work, and then applying
those changes back to mtx-changer.

This is assuming nobody else has posted a working mtx-changer script
for your autochanger already of course!


I split my bacula-dir into components so here are the relevant ones


Everything else here looks like it should be fine.  Once you get
mtx-changer working properly I think everything else should be fine.

Cheers,
Adam.



--
LinuxCabal Asociación Civil
Ing. Richard Couture
Novell CNE, ECNE, MCNE
HP/Compaq ASE
Tel.: (+52) (333) 145-2638
Cel.: (+52) (044) 333 377-7505
Web: http://www.LinuxCabal.org
E-Mail: r...@linuxcabal.org
Hosted en la nube Cloud Sigma - www.CloudSigma.com

AVISO DE CONFIDENCIALIDAD: Este correo electrónico, incluyendo en su 
caso, los archivos adjuntos al mismo, pueden contener información de 
carácter confidencial y/o privilegiada, y se envían a la atención única 
y exclusivamente de la persona y/o entidad a quien va dirigido. La 
copia, revisión, uso, revelación y/o distribución de dicha información 
confidencial sin la autorización por escrito de LinuxCabal está 
prohibida. Si usted no es el destinatario a quien se dirige el presente 
correo, favor de contactar al remitente respondiendo al presente correo 
y eliminar el correo original incluyendo sus archivos, así como 
cualesquiera copia del mismo. Mediante la recepción del presente correo 
usted reconoce y acepta que en caso de incumplimiento de su parte y/o de 
sus representantes a los términos antes mencionados, LinuxCabal tendrá 
derecho a los daños y perjuicios que esto le cause.




___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] mtx and mtx-changer not functioning

[Richard Couture]

No


Richard

On 1/10/19 11:08 PM, Sebastian Suchanek wrote:

Am 11.01.2019 um 02:05 schrieb Richard Couture:


[...]
[root@LTOMag scripts]# mtx -f /dev/sg3 unload
Unloading drive 0 into Storage Element 1...mtx: Request Sense: Long
Report=yes
mtx: Request Sense: Valid Residual=no
mtx: Request Sense: Error Code=70 (Current)
mtx: Request Sense: Sense Key=Illegal Request
mtx: Request Sense: FileMark=no
mtx: Request Sense: EOM=no
mtx: Request Sense: ILI=no
mtx: Request Sense: Additional Sense Code = 53
mtx: Request Sense: Additional Sense Qualifier = 01
mtx: Request Sense: Field in Error = 00
mtx: Request Sense: BPV=no
mtx: Request Sense: Error in CDB=no
mtx: Request Sense: SKSV=yes
mtx: Request Sense: Field Pointer = 00 00
MOVE MEDIUM from Element Address 256 to 4096 Failed
[root@LTOMag scripts]#
[...]


Does mtx work when you explicitly specify the slots? I.e.:

mtx -f /dev/sg3 load 1 0
mtx -f /dev/sg3 unload 1 0


Best regards

Sebastian



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users



--
LinuxCabal Asociación Civil
Ing. Richard Couture
Novell CNE, ECNE, MCNE
HP/Compaq ASE
Tel.: (+52) (333) 145-2638
Cel.: (+52) (044) 333 377-7505
Web: http://www.LinuxCabal.org
E-Mail: r...@linuxcabal.org
Hosted en la nube Cloud Sigma - www.CloudSigma.com

AVISO DE CONFIDENCIALIDAD: Este correo electrónico, incluyendo en su 
caso, los archivos adjuntos al mismo, pueden contener información de 
carácter confidencial y/o privilegiada, y se envían a la atención única 
y exclusivamente de la persona y/o entidad a quien va dirigido. La 
copia, revisión, uso, revelación y/o distribución de dicha información 
confidencial sin la autorización por escrito de LinuxCabal está 
prohibida. Si usted no es el destinatario a quien se dirige el presente 
correo, favor de contactar al remitente respondiendo al presente correo 
y eliminar el correo original incluyendo sus archivos, así como 
cualesquiera copia del mismo. Mediante la recepción del presente correo 
usted reconoce y acepta que en caso de incumplimiento de su parte y/o de 
sus representantes a los términos antes mencionados, LinuxCabal tendrá 
derecho a los daños y perjuicios que esto le cause.




___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Problem with volume are not present when the tape is empty on incremental

[Olivier Delestre]

Hi,
Thanks for the answer.

i have a pool for a client.
And i have a script python for purge+delete volume before the Full 
backup. ( for optimize the disk space on retention , script -> Full , 
Incr, Incr ../.. , script -> Full , incr, incr ...)


This script utilize the modify query 3 + 4 ( see below ) and with the 
result i purge and delete the volume on FS.


And if the empty volume are not in list , there are not purge + deleted 
. normal ;)


I'm watching all this. this has worked for many years.
some other things seem strange since the update in 9.2.2. I lead my 
research and keep you informed.


-
"cur.execute("""SELECT DISTINCT StartTime
 FROM Client,Job,JobMedia,Media
 WHERE Client.Name='{hostname}-fd'
 AND Client.ClientId=Job.ClientId
 AND Level='F' AND JobStatus IN ('T', 'W')
 AND JobMedia.JobId=Job.JobId AND JobMedia.MediaId=Media.MediaId
 ORDER BY Job.StartTime DESC LIMIT 1;""".format(hostname=hostname))
../.. And
cur.execute("""SELECT DISTINCT Job.JobId,Client.Name as 
Client,Level,StartTime,JobFiles,JobBytes,VolumeName

 FROM Client,Job,JobMedia,Media
 WHERE Client.Name='{hostname}-fd'
 AND Client.ClientId=Job.ClientId
 AND JobStatus IN ('T', 'W')
 AND JobMedia.JobId=Job.JobId AND JobMedia.MediaId=Media.MediaId
 AND Job.StartTime < '{DateSelect}'
 ORDER BY Job.StartTime;""".format(hostname=hostname, 
DateSelect=DateSelect))

"

Le 11/01/2019 à 11:58, Radosław Korzeniewski a écrit :

Hello,

czw., 10 sty 2019 o 14:40 Olivier Delestre 
> napisał(a):


hi,

i use bacula v9.2.2 and storage on disk.
i notice that when an incremantal is empty, bacula make a tape
with a file ( 612 bytes ).
when you list with the query "5: List all backups for a Client" ,
this volume is not present.


This is absolutely fine. Bacula will create a volume for your job as 
it has to have a place to save your backup. Then it start to search 
for data to save - the "empty" volume is already created. When Bacula 
cannot find any data to save - the "incremental is empty" then the 
volume remains empty for this job. As the volume does not contain any 
data from this particular job - do you remember your "incremental is 
empty" then it cannot be listed as a resource for this job.


In Bacula the single volume can have a multiple jobs saved and the 
single job can span a multiple volumes.


but present in the pool and the file system.
see below on the vol conty-2546


Well, you configured your job and especially your pool to close volume 
as soon as it is created by a single job, so the operations you 
observe are performed on your request. If this is not what you expect 
then you should change your configuration accordingly.


note : the query is issue from sample-query.sql

How to have this volume in my list ?


Why?

A Bug or not ??


Why do you think it is a bug?


Thanks

Choose a query (1-21): 5
Enter Client Name: conty-fd

++--+---+---+-+--+++
| jobid  | client   | fileset   | level | starttime  
| jobfiles | jobbytes   | volumename |

++--+---+---+-+--+++
| 15,276 | conty-fd | fileset_conty | F | 2018-12-01 22:00:02
|    8,121 | 11,532,984,139 | conty-2471 |
| 15,323 | conty-fd | fileset_conty | I | 2018-12-03 22:00:02
|    1 |    221,917 | conty-2481 |
| 15,540 | conty-fd | fileset_conty | I | 2018-12-10 22:00:02
|    1 |    222,648 | conty-2487 |
| 15,683 | conty-fd | fileset_conty | I | 2018-12-14 22:00:03
|    1 |  0 | conty-2503 |
| 15,755 | conty-fd | fileset_conty | I | 2018-12-17 22:00:02
|    1 |    223,377 | conty-2510 |
| 15,977 | conty-fd | fileset_conty | I | 2018-12-24 22:00:02
|    1 |    224,106 | conty-2514 |
| 16,198 | conty-fd | fileset_conty | I | 2018-12-31 22:00:01
|    1 |    224,835 | conty-2529 |
| 16,374 | conty-fd | fileset_conty | F | 2019-01-05 22:02:31
|    8,120 | 11,532,987,786 | conty-2401 |
| 16,421 | conty-fd | fileset_conty | I | 2019-01-07 22:00:02
|    1 |    225,566 | conty-2407 |
| 16,495 | conty-fd | fileset_conty | I | 2019-01-09 22:00:02
|  226 | 10,177,801,880 | conty-2412 |

++--+---+---+-+--+++
*list media pool=conty

+-++---+-++--+--+-+--+---+---+-+--+-+---+
| mediaid | volumename | volstatus | enabled | volbytes   |
volfiles | volretention | recycle | slot | inchanger | mediatype |
voltype | 

Re: [Bacula-users] Baculum restorations issues

[Wanderlei Huttel]

Are you using CentOS or Debian?

Best regards

*Wanderlei Hüttel*
http://www.bacula.com.br


Em sex, 11 de jan de 2019 às 09:24, Chris Wilkinson 
escreveu:

> My Portuguese is not so good 
>
> Regards
> Chris Wilkinson
>
> On Fri, 11 Jan 2019, 11:22 am Wanderlei Huttel  wrote:
>
>> Hello Chris
>>
>> Yes there is, but the instructions are in Portuguese.
>> https://github.com/wanderleihuttel/bacula-utils/tree/master/tutorial
>>
>>
>> Best regards
>>
>> *Wanderlei Hüttel*
>> http://www.bacula.com.br
>>
>>
>> Em sex, 11 de jan de 2019 às 09:16, Chris Wilkinson <
>> winstonia...@gmail.com> escreveu:
>>
>>> Very interesting. Is there a link for the installation instructions? The
>>> docs folder appears to be old.
>>>
>>> Regards
>>> Chris Wilkinson
>>>
>>> On Fri, 11 Jan 2019, 9:34 a.m. Wanderlei Huttel <
>>> wanderleihut...@gmail.com wrote:
>>>
 Hello Frederic

 I have a fork o Webacula with a new visual and some improvements.
 https://github.com/wanderleihuttel/webacula

 You cant take a look in the screens here:
 https://github.com/wanderleihuttel/webacula/wiki

 Best regards

 *Wanderlei Hüttel*
 http://www.bacula.com.br


 Em qui, 10 de jan de 2019 às 20:48, Frédéric F. 
 escreveu:

> Hello everyone,
> I use Bacula for 3 months and I am happy to use it.
> However I have several problems with the GUI Baculum.
>
> In Baculum, I have problem to restore files with path contains '
> character like "D:\Data\l'information"
> I can see in baculum the folder but when I select it, I can't browse
> into, the sub folder is empty.
> I can restore upper folder but it's not a great job.
> Any advice to browse in baculum with folders with special character ?
> I have a lot...
>
> Another problem with Baculum :
> Randomly, I have some lag (about 20 minutes) when I select a "group
> most recent backup" or one full backup in the list.
> My postgresql DB is working at 100% on 1CPU/8 for about 20 minutes.
>
> I optimize my postgresql DB and with pg_stat_statements, I found the
> slow bacula query (sorry for presentation) :
>
> postgres=# SELECT *
> FROM
>   pg_stat_statements
> ORDER BY
>   total_time DESC;
>  userid | dbid  |  queryid   |  query | calls  |total_time|
> min_time|   max_time|  mean_time  | stddev_time
> |   rows| shared_blks_hit | shared_blks_read | shared_blks_dirtied
> | shared_blks_written | local_blks_hit | local_blks_read |
> local_blks_dirtied | local_blks_written | temp_blks_read |
> temp_blks_written | blk_read_time | blk_write_time
>
>  10 | 16384 | 1980744281 | INSERT INTO PathVisibility (PathId,
> JobId)  SELECT a.PathId,$1 FROM ( SELECT DISTINCT h.PPathId AS PathId
> FROM PathHierarchy AS h JOIN  P
> athVisibility AS p ON (h.PathId=p.PathId) WHERE p.JobId=$2) AS a LEFT
> JOIN (SELECT PathId FROM PathVisibility WHERE JobId=$3) AS b ON
> (a.PathId = b.PathId) WHERE b.Path
> Id IS NULL  | 60 |   1478982.747849 |  0.225819 |
> 484839.953712 |  24649.71246415 | 105518.8118646
> 13 |  4074 |   205691266 |  165 |
> 62 |   0 |  0 |   0 |
> 0 |
>0 |   1011 |  1014 | 0 |
>   0
>
> I am not sure it is a DB problem rather a bacula optimization but what
> ?
>
> According to my stats, I have :
> - 5.31 TB of data saved, around 13M files
> - Bacula DB 5,18 Go
> - Fileset : 82
>
> OS : CentOS 7.5.1804
> Postgresql : 10.6
> Bacula : 9.2.1-1-el7
>
> Postgresql.conf tweaks :
>
> max_connections = 100
> shared_buffers = 2016MB
> maintenance_work_mem = 512MB
> effective_cache_size = 6GB
> max_worker_processes = 8
> max_parallel_workers_per_gather = 2
> max_parallel_workers = 8
>
>
> Hardware
> HP Proliant server (2017)
> CPU Xeon 4/8 cores
> Memory : 8 Go
> HD in RAID 5 (no SSD)
>
> Off topic question : is there another web GUI to restore files easily ?
>
> Thank you for your help
>
> PS : sorry for my approximate english.
>
>
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users

>>>
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Problem with volume are not present when the tape is empty on incremental

[Radosław Korzeniewski]

Hello,

czw., 10 sty 2019 o 14:40 Olivier Delestre 
napisał(a):

> hi,
>
> i use bacula v9.2.2 and storage on disk.
> i notice that when an incremantal is empty, bacula make a tape with a file
> ( 612 bytes ).
> when you list with the query "5: List all backups for a Client" , this
> volume is not present.
>

This is absolutely fine. Bacula will create a volume for your job as it has
to have a place to save your backup. Then it start to search for data to
save - the "empty" volume is already created. When Bacula cannot find any
data to save - the "incremental is empty" then the volume remains empty for
this job. As the volume does not contain any data from this particular job
- do you remember your "incremental is empty" then it cannot be listed as a
resource for this job.

In Bacula the single volume can have a multiple jobs saved and the single
job can span a multiple volumes.


> but present in the pool and the file system.
> see below on the vol conty-2546
>

Well, you configured your job and especially your pool to close volume as
soon as it is created by a single job, so the operations you observe are
performed on your request. If this is not what you expect then you should
change your configuration accordingly.


> note : the query is issue from sample-query.sql
>
> How to have this volume in my list ?
>

Why?


> A Bug or not ??
>

Why do you think it is a bug?


>
> Thanks
> 
> Choose a query (1-21): 5
> Enter Client Name: conty-fd
>
> ++--+---+---+-+--+++
> | jobid  | client   | fileset   | level | starttime   |
> jobfiles | jobbytes   | volumename |
>
> ++--+---+---+-+--+++
> | 15,276 | conty-fd | fileset_conty | F | 2018-12-01 22:00:02 |
> 8,121 | 11,532,984,139 | conty-2471 |
> | 15,323 | conty-fd | fileset_conty | I | 2018-12-03 22:00:02 |
> 1 |221,917 | conty-2481 |
> | 15,540 | conty-fd | fileset_conty | I | 2018-12-10 22:00:02 |
> 1 |222,648 | conty-2487 |
> | 15,683 | conty-fd | fileset_conty | I | 2018-12-14 22:00:03 |
> 1 |  0 | conty-2503 |
> | 15,755 | conty-fd | fileset_conty | I | 2018-12-17 22:00:02 |
> 1 |223,377 | conty-2510 |
> | 15,977 | conty-fd | fileset_conty | I | 2018-12-24 22:00:02 |
> 1 |224,106 | conty-2514 |
> | 16,198 | conty-fd | fileset_conty | I | 2018-12-31 22:00:01 |
> 1 |224,835 | conty-2529 |
> | 16,374 | conty-fd | fileset_conty | F | 2019-01-05 22:02:31 |
> 8,120 | 11,532,987,786 | conty-2401 |
> | 16,421 | conty-fd | fileset_conty | I | 2019-01-07 22:00:02 |
> 1 |225,566 | conty-2407 |
> | 16,495 | conty-fd | fileset_conty | I | 2019-01-09 22:00:02 |
> 226 | 10,177,801,880 | conty-2412 |
>
> ++--+---+---+-+--+++
> *list media pool=conty
>
> +-++---+-++--+--+-+--+---+---+-+--+-+---+
> | mediaid | volumename | volstatus | enabled | volbytes   | volfiles |
> volretention | recycle | slot | inchanger | mediatype | voltype | volparts
> | lastwritten | expiresin |
>
> +-++---+-++--+--+-+--+---+---+-+--+-+---+
> |   2,401 | conty-2401 | Used  |   1 | 11,542,823,537 |2
> |5,529,600 |   1 |0 | 0 | File  |   1 |
> 0 | 2019-01-05 22:05:03 | 5,124,733 |
> |   2,404 | conty-2404 | Used  |   1 |612 |0
> |5,529,600 |   1 |0 | 0 | File  |   1 |
> 0 | 2019-01-06 22:00:02 | 5,210,832 |
> |   2,407 | conty-2407 | Used  |   1 |226,476 |0
> |5,529,600 |   1 |0 | 0 | File  |   1 |
> 0 | 2019-01-07 22:00:02 | 5,297,232 |
> |   2,410 | conty-2410 | Used  |   1 |612 |0
> |5,529,600 |   1 |0 | 0 | File  |   1 |
> 0 | 2019-01-08 22:00:02 | 5,383,632 |
> |   2,412 | conty-2412 | Used  |   1 | 10,185,386,134 |2
> |5,529,600 |   1 |0 | 0 | File  |   1 |
> 0 | 2019-01-09 22:00:34 | 5,470,064 |
> |   2,415 | conty-2415 | Recycle   |   1 |  1 |0
> |5,529,600 |   1 |0 | 0 | File  |   1 |
> 0 | 2018-11-12 22:00:40 |   458,870 |
> |   2,418 | conty-2418 | Purged|   1 | 56,360,634 |0
> |5,529,600 |   1 |0 | 0 | File  |   1 |
> 0 | 2018-11-13 22:00:07 |   545,237 |
> |   2,422 | conty-2422 | Purged|   1 |  9,601,588,270 |2
> |5,529,600 |   1 |0 |  

Re: [Bacula-users] Baculum restorations issues

[Chris Wilkinson]

My Portuguese is not so good 

Regards
Chris Wilkinson

On Fri, 11 Jan 2019, 11:22 am Wanderlei Huttel  Hello Chris
>
> Yes there is, but the instructions are in Portuguese.
> https://github.com/wanderleihuttel/bacula-utils/tree/master/tutorial
>
>
> Best regards
>
> *Wanderlei Hüttel*
> http://www.bacula.com.br
>
>
> Em sex, 11 de jan de 2019 às 09:16, Chris Wilkinson <
> winstonia...@gmail.com> escreveu:
>
>> Very interesting. Is there a link for the installation instructions? The
>> docs folder appears to be old.
>>
>> Regards
>> Chris Wilkinson
>>
>> On Fri, 11 Jan 2019, 9:34 a.m. Wanderlei Huttel <
>> wanderleihut...@gmail.com wrote:
>>
>>> Hello Frederic
>>>
>>> I have a fork o Webacula with a new visual and some improvements.
>>> https://github.com/wanderleihuttel/webacula
>>>
>>> You cant take a look in the screens here:
>>> https://github.com/wanderleihuttel/webacula/wiki
>>>
>>> Best regards
>>>
>>> *Wanderlei Hüttel*
>>> http://www.bacula.com.br
>>>
>>>
>>> Em qui, 10 de jan de 2019 às 20:48, Frédéric F. 
>>> escreveu:
>>>
 Hello everyone,
 I use Bacula for 3 months and I am happy to use it.
 However I have several problems with the GUI Baculum.

 In Baculum, I have problem to restore files with path contains '
 character like "D:\Data\l'information"
 I can see in baculum the folder but when I select it, I can't browse
 into, the sub folder is empty.
 I can restore upper folder but it's not a great job.
 Any advice to browse in baculum with folders with special character ?
 I have a lot...

 Another problem with Baculum :
 Randomly, I have some lag (about 20 minutes) when I select a "group
 most recent backup" or one full backup in the list.
 My postgresql DB is working at 100% on 1CPU/8 for about 20 minutes.

 I optimize my postgresql DB and with pg_stat_statements, I found the
 slow bacula query (sorry for presentation) :

 postgres=# SELECT *
 FROM
   pg_stat_statements
 ORDER BY
   total_time DESC;
  userid | dbid  |  queryid   |  query | calls  |total_time|
 min_time|   max_time|  mean_time  | stddev_time
 |   rows| shared_blks_hit | shared_blks_read | shared_blks_dirtied
 | shared_blks_written | local_blks_hit | local_blks_read |
 local_blks_dirtied | local_blks_written | temp_blks_read |
 temp_blks_written | blk_read_time | blk_write_time

  10 | 16384 | 1980744281 | INSERT INTO PathVisibility (PathId,
 JobId)  SELECT a.PathId,$1 FROM ( SELECT DISTINCT h.PPathId AS PathId
 FROM PathHierarchy AS h JOIN  P
 athVisibility AS p ON (h.PathId=p.PathId) WHERE p.JobId=$2) AS a LEFT
 JOIN (SELECT PathId FROM PathVisibility WHERE JobId=$3) AS b ON
 (a.PathId = b.PathId) WHERE b.Path
 Id IS NULL  | 60 |   1478982.747849 |  0.225819 |
 484839.953712 |  24649.71246415 | 105518.8118646
 13 |  4074 |   205691266 |  165 |
 62 |   0 |  0 |   0 |
 0 |
0 |   1011 |  1014 | 0 |
   0

 I am not sure it is a DB problem rather a bacula optimization but what ?

 According to my stats, I have :
 - 5.31 TB of data saved, around 13M files
 - Bacula DB 5,18 Go
 - Fileset : 82

 OS : CentOS 7.5.1804
 Postgresql : 10.6
 Bacula : 9.2.1-1-el7

 Postgresql.conf tweaks :

 max_connections = 100
 shared_buffers = 2016MB
 maintenance_work_mem = 512MB
 effective_cache_size = 6GB
 max_worker_processes = 8
 max_parallel_workers_per_gather = 2
 max_parallel_workers = 8


 Hardware
 HP Proliant server (2017)
 CPU Xeon 4/8 cores
 Memory : 8 Go
 HD in RAID 5 (no SSD)

 Off topic question : is there another web GUI to restore files easily ?

 Thank you for your help

 PS : sorry for my approximate english.


 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users

>>> ___
>>> Bacula-users mailing list
>>> Bacula-users@lists.sourceforge.net
>>> https://lists.sourceforge.net/lists/listinfo/bacula-users
>>>
>>
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Baculum restorations issues

[Wanderlei Huttel]

Hello Chris

Yes there is, but the instructions are in Portuguese.
https://github.com/wanderleihuttel/bacula-utils/tree/master/tutorial


Best regards

*Wanderlei Hüttel*
http://www.bacula.com.br


Em sex, 11 de jan de 2019 às 09:16, Chris Wilkinson 
escreveu:

> Very interesting. Is there a link for the installation instructions? The
> docs folder appears to be old.
>
> Regards
> Chris Wilkinson
>
> On Fri, 11 Jan 2019, 9:34 a.m. Wanderlei Huttel  wrote:
>
>> Hello Frederic
>>
>> I have a fork o Webacula with a new visual and some improvements.
>> https://github.com/wanderleihuttel/webacula
>>
>> You cant take a look in the screens here:
>> https://github.com/wanderleihuttel/webacula/wiki
>>
>> Best regards
>>
>> *Wanderlei Hüttel*
>> http://www.bacula.com.br
>>
>>
>> Em qui, 10 de jan de 2019 às 20:48, Frédéric F. 
>> escreveu:
>>
>>> Hello everyone,
>>> I use Bacula for 3 months and I am happy to use it.
>>> However I have several problems with the GUI Baculum.
>>>
>>> In Baculum, I have problem to restore files with path contains '
>>> character like "D:\Data\l'information"
>>> I can see in baculum the folder but when I select it, I can't browse
>>> into, the sub folder is empty.
>>> I can restore upper folder but it's not a great job.
>>> Any advice to browse in baculum with folders with special character ?
>>> I have a lot...
>>>
>>> Another problem with Baculum :
>>> Randomly, I have some lag (about 20 minutes) when I select a "group
>>> most recent backup" or one full backup in the list.
>>> My postgresql DB is working at 100% on 1CPU/8 for about 20 minutes.
>>>
>>> I optimize my postgresql DB and with pg_stat_statements, I found the
>>> slow bacula query (sorry for presentation) :
>>>
>>> postgres=# SELECT *
>>> FROM
>>>   pg_stat_statements
>>> ORDER BY
>>>   total_time DESC;
>>>  userid | dbid  |  queryid   |  query | calls  |total_time|
>>> min_time|   max_time|  mean_time  | stddev_time
>>> |   rows| shared_blks_hit | shared_blks_read | shared_blks_dirtied
>>> | shared_blks_written | local_blks_hit | local_blks_read |
>>> local_blks_dirtied | local_blks_written | temp_blks_read |
>>> temp_blks_written | blk_read_time | blk_write_time
>>>
>>>  10 | 16384 | 1980744281 | INSERT INTO PathVisibility (PathId,
>>> JobId)  SELECT a.PathId,$1 FROM ( SELECT DISTINCT h.PPathId AS PathId
>>> FROM PathHierarchy AS h JOIN  P
>>> athVisibility AS p ON (h.PathId=p.PathId) WHERE p.JobId=$2) AS a LEFT
>>> JOIN (SELECT PathId FROM PathVisibility WHERE JobId=$3) AS b ON
>>> (a.PathId = b.PathId) WHERE b.Path
>>> Id IS NULL  | 60 |   1478982.747849 |  0.225819 |
>>> 484839.953712 |  24649.71246415 | 105518.8118646
>>> 13 |  4074 |   205691266 |  165 |
>>> 62 |   0 |  0 |   0 |
>>> 0 |
>>>0 |   1011 |  1014 | 0 |
>>> 0
>>>
>>> I am not sure it is a DB problem rather a bacula optimization but what ?
>>>
>>> According to my stats, I have :
>>> - 5.31 TB of data saved, around 13M files
>>> - Bacula DB 5,18 Go
>>> - Fileset : 82
>>>
>>> OS : CentOS 7.5.1804
>>> Postgresql : 10.6
>>> Bacula : 9.2.1-1-el7
>>>
>>> Postgresql.conf tweaks :
>>>
>>> max_connections = 100
>>> shared_buffers = 2016MB
>>> maintenance_work_mem = 512MB
>>> effective_cache_size = 6GB
>>> max_worker_processes = 8
>>> max_parallel_workers_per_gather = 2
>>> max_parallel_workers = 8
>>>
>>>
>>> Hardware
>>> HP Proliant server (2017)
>>> CPU Xeon 4/8 cores
>>> Memory : 8 Go
>>> HD in RAID 5 (no SSD)
>>>
>>> Off topic question : is there another web GUI to restore files easily ?
>>>
>>> Thank you for your help
>>>
>>> PS : sorry for my approximate english.
>>>
>>>
>>> ___
>>> Bacula-users mailing list
>>> Bacula-users@lists.sourceforge.net
>>> https://lists.sourceforge.net/lists/listinfo/bacula-users
>>>
>> ___
>> Bacula-users mailing list
>> Bacula-users@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/bacula-users
>>
>
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Baculum restorations issues

[Chris Wilkinson]

Very interesting. Is there a link for the installation instructions? The
docs folder appears to be old.

Regards
Chris Wilkinson

On Fri, 11 Jan 2019, 9:34 a.m. Wanderlei Huttel  Hello Frederic
>
> I have a fork o Webacula with a new visual and some improvements.
> https://github.com/wanderleihuttel/webacula
>
> You cant take a look in the screens here:
> https://github.com/wanderleihuttel/webacula/wiki
>
> Best regards
>
> *Wanderlei Hüttel*
> http://www.bacula.com.br
>
>
> Em qui, 10 de jan de 2019 às 20:48, Frédéric F. 
> escreveu:
>
>> Hello everyone,
>> I use Bacula for 3 months and I am happy to use it.
>> However I have several problems with the GUI Baculum.
>>
>> In Baculum, I have problem to restore files with path contains '
>> character like "D:\Data\l'information"
>> I can see in baculum the folder but when I select it, I can't browse
>> into, the sub folder is empty.
>> I can restore upper folder but it's not a great job.
>> Any advice to browse in baculum with folders with special character ?
>> I have a lot...
>>
>> Another problem with Baculum :
>> Randomly, I have some lag (about 20 minutes) when I select a "group
>> most recent backup" or one full backup in the list.
>> My postgresql DB is working at 100% on 1CPU/8 for about 20 minutes.
>>
>> I optimize my postgresql DB and with pg_stat_statements, I found the
>> slow bacula query (sorry for presentation) :
>>
>> postgres=# SELECT *
>> FROM
>>   pg_stat_statements
>> ORDER BY
>>   total_time DESC;
>>  userid | dbid  |  queryid   |  query | calls  |total_time|
>> min_time|   max_time|  mean_time  | stddev_time
>> |   rows| shared_blks_hit | shared_blks_read | shared_blks_dirtied
>> | shared_blks_written | local_blks_hit | local_blks_read |
>> local_blks_dirtied | local_blks_written | temp_blks_read |
>> temp_blks_written | blk_read_time | blk_write_time
>>
>>  10 | 16384 | 1980744281 | INSERT INTO PathVisibility (PathId,
>> JobId)  SELECT a.PathId,$1 FROM ( SELECT DISTINCT h.PPathId AS PathId
>> FROM PathHierarchy AS h JOIN  P
>> athVisibility AS p ON (h.PathId=p.PathId) WHERE p.JobId=$2) AS a LEFT
>> JOIN (SELECT PathId FROM PathVisibility WHERE JobId=$3) AS b ON
>> (a.PathId = b.PathId) WHERE b.Path
>> Id IS NULL  | 60 |   1478982.747849 |  0.225819 |
>> 484839.953712 |  24649.71246415 | 105518.8118646
>> 13 |  4074 |   205691266 |  165 |
>> 62 |   0 |  0 |   0 |
>> 0 |
>>0 |   1011 |  1014 | 0 |  0
>>
>> I am not sure it is a DB problem rather a bacula optimization but what ?
>>
>> According to my stats, I have :
>> - 5.31 TB of data saved, around 13M files
>> - Bacula DB 5,18 Go
>> - Fileset : 82
>>
>> OS : CentOS 7.5.1804
>> Postgresql : 10.6
>> Bacula : 9.2.1-1-el7
>>
>> Postgresql.conf tweaks :
>>
>> max_connections = 100
>> shared_buffers = 2016MB
>> maintenance_work_mem = 512MB
>> effective_cache_size = 6GB
>> max_worker_processes = 8
>> max_parallel_workers_per_gather = 2
>> max_parallel_workers = 8
>>
>>
>> Hardware
>> HP Proliant server (2017)
>> CPU Xeon 4/8 cores
>> Memory : 8 Go
>> HD in RAID 5 (no SSD)
>>
>> Off topic question : is there another web GUI to restore files easily ?
>>
>> Thank you for your help
>>
>> PS : sorry for my approximate english.
>>
>>
>> ___
>> Bacula-users mailing list
>> Bacula-users@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/bacula-users
>>
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Error on Virt Full backup

[info]

Hello Kern,

we've updated to 9.4.1 and the situation is the same.

Do you have any recommendations how to identify the reason for such an
error?

Regards.


Tuesday, January 8, 2019, 11:19:20 PM:

KS> Hello,

KS> I would recommend that you consider doing an upgrade to 9.4.1, because
KS> from 9.0.x to 9.4.x, we have
KS> fixed a number of bugs with Virtual full backups, and significantly 
KS> improved how it works, particularly
KS> when using virtual full in conjunction with accurate mode.

KS> Best regards,
KS> Kern

KS> On 1/8/19 2:42 AM, i...@alink.biz wrote:
>> Hello,
>>
>> while the last virtual full backup Bacula exits with the following
>> error, anyone with suggestions what may cause this and how to fix it?
>>
>> 1. after several OK reports in the log like this:
>> 08-Jan 08:04 Storage JobId 22340: Recycled volume "VOL0064" on File device 
>> "vDrive-1" (/home/bacula), all previous data lost.
>> 08-Jan 08:04 Storage JobId 22340: New volume "VOL0064" mounted on device 
>> "vDrive-1" (/home/bacula) at 08-Jan-2019 08:04.
>> 08-Jan 08:05 Storage JobId 22340: End of Volume "VOL0655" at addr=5368693664 
>> on device "vDrive-4" (/home/bacula).
>> 08-Jan 08:05 Storage JobId 22340: Ready to read from volume "VOL0603" on 
>> File device "vDrive-4" (/home/bacula).
>> 08-Jan 08:05 Storage JobId 22340: Forward spacing Volume "VOL0603" to 
>> addr=217
>> 08-Jan 08:05 Storage JobId 22340: End of Volume "VOL0603" at addr=1195665354 
>> on device "vDrive-4" (/home/bacula).
>>
>> 2. may be at the end of the procedure follows this error:
>> 08-Jan 08:05 Storage JobId 22340: Elapsed time=03:05:54, Transfer rate=24.16 
>> M Bytes/second
>> 08-Jan 08:05 Storage JobId 22340: Sending spooled attrs to the Director. 
>> Despooling 911,828,525 bytes ...
>> 08-Jan 08:06 Director JobId 22340: Fatal error: sql.c:591 Path length is 
>> zero. File=
>> 08-Jan 08:06 Director JobId 22340: Error: Bacula Director 9.0.6 (20Nov17):
>>Build OS:   x86_64-redhat-linux-gnu redhat
>>...
>>Backup Level:   Virtual Full
>>...
>>Elapsed time:   2 hours 1 min 27 secs
>>Priority:   10
>>SD Files Written:   0
>>SD Bytes Written:   0 (0 B)
>>Rate:   0.0 KB/s
>>Volume name(s): 
>> VOL0705|VOL0707|VOL0708|VOL0734|VOL0735|VOL0736|VOL0737|VOL0738|VOL0739|VOL0740|VOL0741|VOL0742|VOL0743|VOL0744|VOL0745|VOL0755|VOL0751|VOL0753|VOL0756|VOL0758|VOL0026|VOL0027|VOL0028|VOL0029|VOL0030|VOL0031|VOL0043|VOL0044|VOL0045|VOL0046|VOL0047|VOL0048|VOL0049|VOL0050|VOL0051|VOL0052|VOL0053|VOL0241|VOL0242|VOL0054|VOL0055|VOL0056|VOL0381|VOL0057|VOL0058|VOL0059|VOL0060|VOL0061|VOL0062|VOL0063|VOL0064
>>Volume Session Id:  131
>>Volume Session Time:1546269164
>>Last Volume Bytes:  1,470,626,226 (1.470 GB)
>>SD Errors:  0
>>SD termination status:  SD despooling Attributes
>>Termination:*** Backup Error ***
>>
>>
>>
>>
>>
>> ___
>> Bacula-users mailing list
>> Bacula-users@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/bacula-users
>>




___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Virtual full backup ends with error

[azurit]

Hi Wanderlei,

i thought that too before i found that error message in syslog. Before  
that, i tried:

 - setting Heartbeat Interval in Director and Storage daemon to 1000 minutes
 AND
 - setting TCP keepalive in /proc/sys/net/ipv4/tcp_keepalive_time to  
10 on Director and SD

(after that i restasted both Dir and SD)


I was also sniffing all communication between Director and SD to see  
if some device between then (switch?) is not resetting the connection  
- and no, connection was correctly closed (TCP FIN) by SD.


Anyway, message in syslog is clear enought to know that problem wasn't  
in closed connection. There's probably some kind of a bug in SD which  
caused SD to not send that error to Director so it can be logged.






Citát Wanderlei Huttel :


Hello Azur

It looks that problem was an error on the connection:



*11-jan 05:42 server00-dir JobId 56875: Error: Director's connection to  SD
for this Job was lost.  *

You could try enable "Heartbeat Interval in your config files:
https://github.com/wanderleihuttel/bacula-utils/blob/master/dicas/heartbeat_interval.md

Best regards

*Wanderlei Hüttel*
http://www.bacula.com.br


Em sex, 11 de jan de 2019 às 06:08,  escreveu:


Hi all,

i'm having problems with virtual full backup on one of our clients.
Everything was working fine for years but, suddenly, Bacula is unable
to complete the job - i was trying to run it about 10 times during
past few days, all of them ends with the same weird error.

The error is occuring near of the end of the job, after 240 volumes
were created (we have a limit of 5 GB for volume size) and 1,2 TB of
data was copied.

Here are last lines from job report:

11-jan 05:40 server08-sd JobId 56875: Ready to read from volume
"cloud0015-16052" on File device "cloud0015-file-storage"
(/backup/cloud0015).
11-jan 05:40 server08-sd JobId 56875: Forward spacing Volume
"cloud0015-16052" to addr=226
11-jan 05:40 server00-dir JobId 56875: Volume used once. Marking
Volume "cloud0015-17313" as Used.
11-jan 05:40 server08-sd JobId 56875: End of medium on Volume
"cloud0015-17313" Bytes=5,368,688,735 Blocks=83,220 at 11-Jan-2019
05:40.
11-jan 05:40 server00-dir JobId 56875: Created new
Volume="cloud0015-17314", Pool="cloud0015-pool",
MediaType="File-cloud0015" in catalog.
11-jan 05:40 server08-sd JobId 56875: Labeled new Volume
"cloud0015-17314" on File device "cloud0015-file-storage-2"
(/backup/cloud0015).
11-jan 05:40 server08-sd JobId 56875: Wrote label to prelabeled Volume
"cloud0015-17314" on File device "cloud0015-file-storage-2"
(/backup/cloud0015)
11-jan 05:40 server00-dir JobId 56875: Volume used once. Marking
Volume "cloud0015-17314" as Used.
11-jan 05:40 server08-sd JobId 56875: New volume "cloud0015-17314"
mounted on device "cloud0015-file-storage-2" (/backup/cloud0015) at
11-Jan-2019 05:40.
11-jan 05:40 server00-dir JobId 56875: Volume used once. Marking
Volume "cloud0015-17314" as Used.
11-jan 05:40 server00-dir JobId 56875: Volume used once. Marking
Volume "cloud0015-17314" as Used.
11-jan 05:41 server00-dir JobId 56875: Volume used once. Marking
Volume "cloud0015-17314" as Used.
11-jan 05:41 server00-dir JobId 56875: Volume used once. Marking
Volume "cloud0015-17314" as Used.
11-jan 05:41 server08-sd JobId 56875: End of Volume "cloud0015-16052"
at addr=5368688648 on device "cloud0015-file-storage"
(/backup/cloud0015).
11-jan 05:41 server08-sd JobId 56875: Ready to read from volume
"cloud0015-16053" on File device "cloud0015-file-storage"
(/backup/cloud0015).
11-jan 05:41 server08-sd JobId 56875: Forward spacing Volume
"cloud0015-16053" to addr=226
11-jan 05:41 server00-dir JobId 56875: Volume used once. Marking
Volume "cloud0015-17314" as Used.
11-jan 05:41 server08-sd JobId 56875: End of medium on Volume
"cloud0015-17314" Bytes=5,368,688,678 Blocks=83,220 at 11-Jan-2019
05:41.
11-jan 05:41 server00-dir JobId 56875: Created new
Volume="cloud0015-17315", Pool="cloud0015-pool",
MediaType="File-cloud0015" in catalog.
11-jan 05:41 server08-sd JobId 56875: Labeled new Volume
"cloud0015-17315" on File device "cloud0015-file-storage-2"
(/backup/cloud0015).
11-jan 05:41 server08-sd JobId 56875: Wrote label to prelabeled Volume
"cloud0015-17315" on File device "cloud0015-file-storage-2"
(/backup/cloud0015)
11-jan 05:41 server00-dir JobId 56875: Volume used once. Marking
Volume "cloud0015-17315" as Used.
11-jan 05:41 server08-sd JobId 56875: New volume "cloud0015-17315"
mounted on device "cloud0015-file-storage-2" (/backup/cloud0015) at
11-Jan-2019 05:41.
11-jan 05:41 server00-dir JobId 56875: Volume used once. Marking
Volume "cloud0015-17315" as Used.
11-jan 05:42 server00-dir JobId 56875: Volume used once. Marking
Volume "cloud0015-17315" as Used.
11-jan 05:42 server00-dir JobId 56875: Volume used once. Marking
Volume "cloud0015-17315" as Used.
11-jan 05:42 server00-dir JobId 56875: Volume used once. Marking
Volume "cloud0015-17315" as Used.
11-jan 05:42 server00-dir JobId 56875: Error: Director's connection to
SD for this 

Re: [Bacula-users] Virtual full backup ends with error

[Alfred Weintoegl]

Hello azur,

we had an Error a few days ago which is very like to yours: VFull was 
working fine about half a year and suddenly Bacula can't complete the 
VFull-Job. The error occurs near the end of the job.


Here our last lines from job report:
...
.
.
05-Jan 02:04 npkj-dir JobId 668: All records pruned from Volume 
"VFullHallo02_02-0018"; marking it "Purged"

05-Jan 02:04 npkj-dir JobId 668: Recycled volume "VFullHallo02_02-0018"
05-Jan 02:04 npkj-sd JobId 668: Recycled volume "VFullHallo02_02-0018" 
on File device "FileChgr2-Dev2" (/bacula/backup), all previous data lost.
05-Jan 02:04 npkj-sd JobId 668: New volume "VFullHallo02_02-0018" 
mounted on device "FileChgr2-Dev2" (/bacula/backup) at 05-Jan-2019 02:04.
05-Jan 07:47 npkj-sd JobId 668: End of Volume "VFullHallo02_02-0011" at 
addr=536870854879 on device "FileChgr2-Dev1" (/bacula/backup).
05-Jan 07:47 npkj-sd JobId 668: Ready to read from volume 
"VFullHallo02_02-0012" on File device "FileChgr2-Dev1" (/bacula/backup).
05-Jan 07:47 npkj-sd JobId 668: Forward spacing Volume 
"VFullHallo02_02-0012" to addr=265
05-Jan 07:47 npkj-sd JobId 668: Fatal error: block_util.c:425 Volume 
data error at 0:0! Wanted ID: "BB02", got "". Buffer discarded.
05-Jan 07:47 npkj-sd JobId 668: Fatal error: vbackup.c:130 Fatal append 
error on device "FileChgr2-Dev2" (/bacula/backup): ERR=file_dev.c:190 
Could not open(/bacula/backup/Next-0026,OPEN_READ_WRITE,0640): ERR=No 
such file or directory


05-Jan 07:47 npkj-sd JobId 668: Elapsed time=11:17:33, Transfer 
rate=31.00 M Bytes/second

05-Jan 07:47 npkj-dir JobId 668: Error: Bacula npkj-dir 9.0.6 (20Nov17):
  Build OS:   x86_64-redhat-linux-gnu redhat (Core)
...
.
.

These are my permissions:

[root@bacula backup]# ls -ld
drwx-- 2 bacula bacula 4096 Dec  9 09:38 .
[root@bacula backup]# pwd
/bacula/backup
[root@bacula backup]# ls -l
total 10550886592
-rw-r- 1 bacula tape   4033140368 Dec  9 09:40 Next-0026
[root@bacula backup]# df -h
Filesystem  Size  Used Avail Use% Mounted on
...
/dev/mapper/bacula-bacula30T  9.9T   21T  33% /bacula
...


I'll try again a VFull this weekend ...


Regards
Alfred


Am 11.01.2019 um 08:45 schrieb azu...@pobox.sk:

Hi all,

i'm having problems with virtual full backup on one of our clients. 
Everything was working fine for years but, suddenly, Bacula is unable to 
complete the job - i was trying to run it about 10 times during past few 
days, all of them ends with the same weird error.


The error is occuring near of the end of the job, after 240 volumes were 
created (we have a limit of 5 GB for volume size) and 1,2 TB of data was 
copied.


Here are last lines from job report:

11-jan 05:40 server08-sd JobId 56875: Ready to read from volume 
"cloud0015-16052" on File device "cloud0015-file-storage" 
(/backup/cloud0015).
11-jan 05:40 server08-sd JobId 56875: Forward spacing Volume 
"cloud0015-16052" to addr=226
11-jan 05:40 server00-dir JobId 56875: Volume used once. Marking Volume 
"cloud0015-17313" as Used.
11-jan 05:40 server08-sd JobId 56875: End of medium on Volume 
"cloud0015-17313" Bytes=5,368,688,735 Blocks=83,220 at 11-Jan-2019 05:40.
11-jan 05:40 server00-dir JobId 56875: Created new 
Volume="cloud0015-17314", Pool="cloud0015-pool", 
MediaType="File-cloud0015" in catalog.
11-jan 05:40 server08-sd JobId 56875: Labeled new Volume 
"cloud0015-17314" on File device "cloud0015-file-storage-2" 
(/backup/cloud0015).
11-jan 05:40 server08-sd JobId 56875: Wrote label to prelabeled Volume 
"cloud0015-17314" on File device "cloud0015-file-storage-2" 
(/backup/cloud0015)
11-jan 05:40 server00-dir JobId 56875: Volume used once. Marking Volume 
"cloud0015-17314" as Used.
11-jan 05:40 server08-sd JobId 56875: New volume "cloud0015-17314" 
mounted on device "cloud0015-file-storage-2" (/backup/cloud0015) at 
11-Jan-2019 05:40.
11-jan 05:40 server00-dir JobId 56875: Volume used once. Marking Volume 
"cloud0015-17314" as Used.
11-jan 05:40 server00-dir JobId 56875: Volume used once. Marking Volume 
"cloud0015-17314" as Used.
11-jan 05:41 server00-dir JobId 56875: Volume used once. Marking Volume 
"cloud0015-17314" as Used.
11-jan 05:41 server00-dir JobId 56875: Volume used once. Marking Volume 
"cloud0015-17314" as Used.
11-jan 05:41 server08-sd JobId 56875: End of Volume "cloud0015-16052" at 
addr=5368688648 on device "cloud0015-file-storage" (/backup/cloud0015).
11-jan 05:41 server08-sd JobId 56875: Ready to read from volume 
"cloud0015-16053" on File device "cloud0015-file-storage" 
(/backup/cloud0015).
11-jan 05:41 server08-sd JobId 56875: Forward spacing Volume 
"cloud0015-16053" to addr=226
11-jan 05:41 server00-dir JobId 56875: Volume used once. Marking Volume 
"cloud0015-17314" as Used.
11-jan 05:41 server08-sd JobId 56875: End of medium on Volume 
"cloud0015-17314" Bytes=5,368,688,678 Blocks=83,220 at 11-Jan-2019 05:41.
11-jan 05:41 server00-dir JobId 56875: Created new 
Volume="cloud0015-17315", Pool="cloud0015-pool", 

Re: [Bacula-users] Virtual full backup ends with error

[Wanderlei Huttel]

Hello Azur

It looks that problem was an error on the connection:



*11-jan 05:42 server00-dir JobId 56875: Error: Director's connection to  SD
for this Job was lost.  *

You could try enable "Heartbeat Interval in your config files:
https://github.com/wanderleihuttel/bacula-utils/blob/master/dicas/heartbeat_interval.md

Best regards

*Wanderlei Hüttel*
http://www.bacula.com.br


Em sex, 11 de jan de 2019 às 06:08,  escreveu:

> Hi all,
>
> i'm having problems with virtual full backup on one of our clients.
> Everything was working fine for years but, suddenly, Bacula is unable
> to complete the job - i was trying to run it about 10 times during
> past few days, all of them ends with the same weird error.
>
> The error is occuring near of the end of the job, after 240 volumes
> were created (we have a limit of 5 GB for volume size) and 1,2 TB of
> data was copied.
>
> Here are last lines from job report:
>
> 11-jan 05:40 server08-sd JobId 56875: Ready to read from volume
> "cloud0015-16052" on File device "cloud0015-file-storage"
> (/backup/cloud0015).
> 11-jan 05:40 server08-sd JobId 56875: Forward spacing Volume
> "cloud0015-16052" to addr=226
> 11-jan 05:40 server00-dir JobId 56875: Volume used once. Marking
> Volume "cloud0015-17313" as Used.
> 11-jan 05:40 server08-sd JobId 56875: End of medium on Volume
> "cloud0015-17313" Bytes=5,368,688,735 Blocks=83,220 at 11-Jan-2019
> 05:40.
> 11-jan 05:40 server00-dir JobId 56875: Created new
> Volume="cloud0015-17314", Pool="cloud0015-pool",
> MediaType="File-cloud0015" in catalog.
> 11-jan 05:40 server08-sd JobId 56875: Labeled new Volume
> "cloud0015-17314" on File device "cloud0015-file-storage-2"
> (/backup/cloud0015).
> 11-jan 05:40 server08-sd JobId 56875: Wrote label to prelabeled Volume
> "cloud0015-17314" on File device "cloud0015-file-storage-2"
> (/backup/cloud0015)
> 11-jan 05:40 server00-dir JobId 56875: Volume used once. Marking
> Volume "cloud0015-17314" as Used.
> 11-jan 05:40 server08-sd JobId 56875: New volume "cloud0015-17314"
> mounted on device "cloud0015-file-storage-2" (/backup/cloud0015) at
> 11-Jan-2019 05:40.
> 11-jan 05:40 server00-dir JobId 56875: Volume used once. Marking
> Volume "cloud0015-17314" as Used.
> 11-jan 05:40 server00-dir JobId 56875: Volume used once. Marking
> Volume "cloud0015-17314" as Used.
> 11-jan 05:41 server00-dir JobId 56875: Volume used once. Marking
> Volume "cloud0015-17314" as Used.
> 11-jan 05:41 server00-dir JobId 56875: Volume used once. Marking
> Volume "cloud0015-17314" as Used.
> 11-jan 05:41 server08-sd JobId 56875: End of Volume "cloud0015-16052"
> at addr=5368688648 on device "cloud0015-file-storage"
> (/backup/cloud0015).
> 11-jan 05:41 server08-sd JobId 56875: Ready to read from volume
> "cloud0015-16053" on File device "cloud0015-file-storage"
> (/backup/cloud0015).
> 11-jan 05:41 server08-sd JobId 56875: Forward spacing Volume
> "cloud0015-16053" to addr=226
> 11-jan 05:41 server00-dir JobId 56875: Volume used once. Marking
> Volume "cloud0015-17314" as Used.
> 11-jan 05:41 server08-sd JobId 56875: End of medium on Volume
> "cloud0015-17314" Bytes=5,368,688,678 Blocks=83,220 at 11-Jan-2019
> 05:41.
> 11-jan 05:41 server00-dir JobId 56875: Created new
> Volume="cloud0015-17315", Pool="cloud0015-pool",
> MediaType="File-cloud0015" in catalog.
> 11-jan 05:41 server08-sd JobId 56875: Labeled new Volume
> "cloud0015-17315" on File device "cloud0015-file-storage-2"
> (/backup/cloud0015).
> 11-jan 05:41 server08-sd JobId 56875: Wrote label to prelabeled Volume
> "cloud0015-17315" on File device "cloud0015-file-storage-2"
> (/backup/cloud0015)
> 11-jan 05:41 server00-dir JobId 56875: Volume used once. Marking
> Volume "cloud0015-17315" as Used.
> 11-jan 05:41 server08-sd JobId 56875: New volume "cloud0015-17315"
> mounted on device "cloud0015-file-storage-2" (/backup/cloud0015) at
> 11-Jan-2019 05:41.
> 11-jan 05:41 server00-dir JobId 56875: Volume used once. Marking
> Volume "cloud0015-17315" as Used.
> 11-jan 05:42 server00-dir JobId 56875: Volume used once. Marking
> Volume "cloud0015-17315" as Used.
> 11-jan 05:42 server00-dir JobId 56875: Volume used once. Marking
> Volume "cloud0015-17315" as Used.
> 11-jan 05:42 server00-dir JobId 56875: Volume used once. Marking
> Volume "cloud0015-17315" as Used.
> 11-jan 05:42 server00-dir JobId 56875: Error: Director's connection to
> SD for this Job was lost.
>
>
>
>
>
> This is what is logged to syslog on SD side:
>
> Jan 11 05:42:43 server08 bacula-sd[13585]: server08-sd:
> vbackup.c:130-56875 Fatal append error on device
> "cloud0015-file-storage-2" (/backup/cloud0015): ERR=file_dev.c:190
> Could not
> open(/backup/cloud0015/cloud0015-17315,OPEN_READ_WRITE,0640): ERR=No
> such file or directory
>
>
>
>
>
>
>
>
> There's no reason why the volume wasn't created. Permissions are ok:
>
> # ls -ld /backup/cloud0015/
> drwxr-x--- 2 bacula tape 36864 Jan 11 05:41 /backup/cloud0015/
>
>
> Free disk space is sufficient:
>
> # df -h /backup/
> Filesystem  

Re: [Bacula-users] Baculum restorations issues

[Wanderlei Huttel]

Hello Frederic

I have a fork o Webacula with a new visual and some improvements.
https://github.com/wanderleihuttel/webacula

You cant take a look in the screens here:
https://github.com/wanderleihuttel/webacula/wiki

Best regards

*Wanderlei Hüttel*
http://www.bacula.com.br


Em qui, 10 de jan de 2019 às 20:48, Frédéric F. 
escreveu:

> Hello everyone,
> I use Bacula for 3 months and I am happy to use it.
> However I have several problems with the GUI Baculum.
>
> In Baculum, I have problem to restore files with path contains '
> character like "D:\Data\l'information"
> I can see in baculum the folder but when I select it, I can't browse
> into, the sub folder is empty.
> I can restore upper folder but it's not a great job.
> Any advice to browse in baculum with folders with special character ?
> I have a lot...
>
> Another problem with Baculum :
> Randomly, I have some lag (about 20 minutes) when I select a "group
> most recent backup" or one full backup in the list.
> My postgresql DB is working at 100% on 1CPU/8 for about 20 minutes.
>
> I optimize my postgresql DB and with pg_stat_statements, I found the
> slow bacula query (sorry for presentation) :
>
> postgres=# SELECT *
> FROM
>   pg_stat_statements
> ORDER BY
>   total_time DESC;
>  userid | dbid  |  queryid   |  query | calls  |total_time|
> min_time|   max_time|  mean_time  | stddev_time
> |   rows| shared_blks_hit | shared_blks_read | shared_blks_dirtied
> | shared_blks_written | local_blks_hit | local_blks_read |
> local_blks_dirtied | local_blks_written | temp_blks_read |
> temp_blks_written | blk_read_time | blk_write_time
>
>  10 | 16384 | 1980744281 | INSERT INTO PathVisibility (PathId,
> JobId)  SELECT a.PathId,$1 FROM ( SELECT DISTINCT h.PPathId AS PathId
> FROM PathHierarchy AS h JOIN  P
> athVisibility AS p ON (h.PathId=p.PathId) WHERE p.JobId=$2) AS a LEFT
> JOIN (SELECT PathId FROM PathVisibility WHERE JobId=$3) AS b ON
> (a.PathId = b.PathId) WHERE b.Path
> Id IS NULL  | 60 |   1478982.747849 |  0.225819 |
> 484839.953712 |  24649.71246415 | 105518.8118646
> 13 |  4074 |   205691266 |  165 |
> 62 |   0 |  0 |   0 |
> 0 |
>0 |   1011 |  1014 | 0 |  0
>
> I am not sure it is a DB problem rather a bacula optimization but what ?
>
> According to my stats, I have :
> - 5.31 TB of data saved, around 13M files
> - Bacula DB 5,18 Go
> - Fileset : 82
>
> OS : CentOS 7.5.1804
> Postgresql : 10.6
> Bacula : 9.2.1-1-el7
>
> Postgresql.conf tweaks :
>
> max_connections = 100
> shared_buffers = 2016MB
> maintenance_work_mem = 512MB
> effective_cache_size = 6GB
> max_worker_processes = 8
> max_parallel_workers_per_gather = 2
> max_parallel_workers = 8
>
>
> Hardware
> HP Proliant server (2017)
> CPU Xeon 4/8 cores
> Memory : 8 Go
> HD in RAID 5 (no SSD)
>
> Off topic question : is there another web GUI to restore files easily ?
>
> Thank you for your help
>
> PS : sorry for my approximate english.
>
>
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Virtual full backup ends with error

[azurit]

Hi all,

i'm having problems with virtual full backup on one of our clients.  
Everything was working fine for years but, suddenly, Bacula is unable  
to complete the job - i was trying to run it about 10 times during  
past few days, all of them ends with the same weird error.


The error is occuring near of the end of the job, after 240 volumes  
were created (we have a limit of 5 GB for volume size) and 1,2 TB of  
data was copied.


Here are last lines from job report:

11-jan 05:40 server08-sd JobId 56875: Ready to read from volume  
"cloud0015-16052" on File device "cloud0015-file-storage"  
(/backup/cloud0015).
11-jan 05:40 server08-sd JobId 56875: Forward spacing Volume  
"cloud0015-16052" to addr=226
11-jan 05:40 server00-dir JobId 56875: Volume used once. Marking  
Volume "cloud0015-17313" as Used.
11-jan 05:40 server08-sd JobId 56875: End of medium on Volume  
"cloud0015-17313" Bytes=5,368,688,735 Blocks=83,220 at 11-Jan-2019  
05:40.
11-jan 05:40 server00-dir JobId 56875: Created new  
Volume="cloud0015-17314", Pool="cloud0015-pool",  
MediaType="File-cloud0015" in catalog.
11-jan 05:40 server08-sd JobId 56875: Labeled new Volume  
"cloud0015-17314" on File device "cloud0015-file-storage-2"  
(/backup/cloud0015).
11-jan 05:40 server08-sd JobId 56875: Wrote label to prelabeled Volume  
"cloud0015-17314" on File device "cloud0015-file-storage-2"  
(/backup/cloud0015)
11-jan 05:40 server00-dir JobId 56875: Volume used once. Marking  
Volume "cloud0015-17314" as Used.
11-jan 05:40 server08-sd JobId 56875: New volume "cloud0015-17314"  
mounted on device "cloud0015-file-storage-2" (/backup/cloud0015) at  
11-Jan-2019 05:40.
11-jan 05:40 server00-dir JobId 56875: Volume used once. Marking  
Volume "cloud0015-17314" as Used.
11-jan 05:40 server00-dir JobId 56875: Volume used once. Marking  
Volume "cloud0015-17314" as Used.
11-jan 05:41 server00-dir JobId 56875: Volume used once. Marking  
Volume "cloud0015-17314" as Used.
11-jan 05:41 server00-dir JobId 56875: Volume used once. Marking  
Volume "cloud0015-17314" as Used.
11-jan 05:41 server08-sd JobId 56875: End of Volume "cloud0015-16052"  
at addr=5368688648 on device "cloud0015-file-storage"  
(/backup/cloud0015).
11-jan 05:41 server08-sd JobId 56875: Ready to read from volume  
"cloud0015-16053" on File device "cloud0015-file-storage"  
(/backup/cloud0015).
11-jan 05:41 server08-sd JobId 56875: Forward spacing Volume  
"cloud0015-16053" to addr=226
11-jan 05:41 server00-dir JobId 56875: Volume used once. Marking  
Volume "cloud0015-17314" as Used.
11-jan 05:41 server08-sd JobId 56875: End of medium on Volume  
"cloud0015-17314" Bytes=5,368,688,678 Blocks=83,220 at 11-Jan-2019  
05:41.
11-jan 05:41 server00-dir JobId 56875: Created new  
Volume="cloud0015-17315", Pool="cloud0015-pool",  
MediaType="File-cloud0015" in catalog.
11-jan 05:41 server08-sd JobId 56875: Labeled new Volume  
"cloud0015-17315" on File device "cloud0015-file-storage-2"  
(/backup/cloud0015).
11-jan 05:41 server08-sd JobId 56875: Wrote label to prelabeled Volume  
"cloud0015-17315" on File device "cloud0015-file-storage-2"  
(/backup/cloud0015)
11-jan 05:41 server00-dir JobId 56875: Volume used once. Marking  
Volume "cloud0015-17315" as Used.
11-jan 05:41 server08-sd JobId 56875: New volume "cloud0015-17315"  
mounted on device "cloud0015-file-storage-2" (/backup/cloud0015) at  
11-Jan-2019 05:41.
11-jan 05:41 server00-dir JobId 56875: Volume used once. Marking  
Volume "cloud0015-17315" as Used.
11-jan 05:42 server00-dir JobId 56875: Volume used once. Marking  
Volume "cloud0015-17315" as Used.
11-jan 05:42 server00-dir JobId 56875: Volume used once. Marking  
Volume "cloud0015-17315" as Used.
11-jan 05:42 server00-dir JobId 56875: Volume used once. Marking  
Volume "cloud0015-17315" as Used.
11-jan 05:42 server00-dir JobId 56875: Error: Director's connection to  
SD for this Job was lost.






This is what is logged to syslog on SD side:

Jan 11 05:42:43 server08 bacula-sd[13585]: server08-sd:  
vbackup.c:130-56875 Fatal append error on device  
"cloud0015-file-storage-2" (/backup/cloud0015): ERR=file_dev.c:190  
Could not  
open(/backup/cloud0015/cloud0015-17315,OPEN_READ_WRITE,0640): ERR=No  
such file or directory









There's no reason why the volume wasn't created. Permissions are ok:

# ls -ld /backup/cloud0015/
drwxr-x--- 2 bacula tape 36864 Jan 11 05:41 /backup/cloud0015/


Free disk space is sufficient:

# df -h /backup/
Filesystem  Size  Used Avail Use% Mounted on
/dev/sdc1   7.3T  5.1T  2.2T  70% /backup







Another strange thing is that while virtual full was running, new  
incremental backup was queue for that client. After full failed,  
incremetnal was run AND completed fine while using THAT ONE ERRONEOUS  
VOLUME:


11-jan 05:42 server00-dir JobId 56897: Start Backup JobId 56897,  
Job=cloud0015.2019-01-11_01.00.17_25
11-jan 05:42 server00-dir JobId 56897: There are no more Jobs  
associated with Volume "cloud0015-17315". Marking it