[Bacula-users] Backup to file, filesize limit not working

2018-03-15 Thread Sebastian Suchanek
Hi all!

Currently, I'm trying to set up and getting familiar with Bacula.
(v5.2.6 - that's the version that comes with my Linux distribution
Debian Jessie.)

For making backups of the Bacula catalog, I've made the following
configurations:

- bacula-sd.conf --
[...]
Device {
  Name = FileStorage
  Media Type = File
  Archive Device = /srv/bacula/file
  LabelMedia = yes
  Random Access = yes
  AutomaticMount = yes
  RemovableMedia = no
  AlwaysOpen = no
}
[...]
---

- bacula-dir.conf -
[]
Job {
  Name = "BackupCatalog"
  JobDefs = "DefaultJob"
  Level = Full
  FileSet="Catalog"
  Schedule = "WeeklyCycleAfterBackup"
  RunBeforeJob = "/etc/bacula/scripts/make_catalog_backup.pl MyCatalog"
  RunAfterJob  = "/etc/bacula/scripts/delete_catalog_backup"
  Write Bootstrap = "/var/lib/bacula/%n.bsr"
  Priority = 11
}

Schedule {
  Name = "WeeklyCycleAfterBackup"
  Run = Full sun-sat at 20:10
}

FileSet {
  Name = "Catalog"
  Include {
Options {
  signature = MD5
}
File = "/var/lib/bacula/bacula.sql"
  }
}

Storage {
  Name = File
  Address = localhost
  SDPort = 9103
  Password = "xIOrJZDj98rAAfP3S_dN8ipaa6RbxCkV9"
  Device = FileStorage
  Media Type = File
}

Pool {
  Name = File
  Pool Type = Backup
  Recycle = yes
  AutoPrune = yes
  Volume Retention = 365 days
  Maximum Volume Bytes = 500MB
  Maximum Volumes = 10
  LabelFormat = "file"
}
---

With this configuration, I would expect that Bacula writes the jobs to a
file "file" in /srv/bacula/file and, as soon as this file's size
reaches 500MB, creates a new file and continues with that. (Up to ten
files.) But instead, Bacula keeps writing to a single file, which
currently has grown to around 690MB, IOW well above 500MB.
What's going wrong here? How can I make Bacula create a new file once
the current file's size has reached 500MB?


Regards

Sebastian

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Backup to file, filesize limit not working

2018-03-15 Thread Sebastian Suchanek
Am 15.03.2018 um 20:38 schrieb Pedro Oliveira:

Hi Pedro!

> Hi Sebastian, try to change the 
> 
> Maximum Volume Bytes = 500MB 
> 
> To 
> 
> Maximum Volume Bytes = 5 

I just did - unfortunately, with no effect. After restarting the
director and letting the backup job run manually, the backup file just
got even bigger.

> I also recommend to upgrade to version 9.x

I'm rather reluctant to use software "outside" of my distribution's
repository. I /could/ upgrade from Debian Jessie to Debian Stretch,
which would come with Bacula v7.4.4, but since this update will cause a
lot of work because of other interdependencies (independent of Bacula),
I'm postponing this for the moment.


Regards

Sebastian


--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Backup to file, filesize limit not working

2018-03-15 Thread Sebastian Suchanek
Am 15.03.2018 um 21:47 schrieb Dimitri Maziuk:
> On 03/15/2018 03:11 PM, Sebastian Suchanek wrote:
> 
>> I just did - unfortunately, with no effect. After restarting the
>> director and letting the backup job run manually, the backup file just
>> got even bigger.
> 
> I wonder if you have to run "update volume maxvolbytes=NNN" in bconsole
> in order for it to apply to existing volume.
> [...]

That did the trick. Thank you!


Regards

Sebastian

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Schedule for every second month?

2018-03-26 Thread Sebastian Suchanek
Hi everyone!

In Bacula v5.2.6, I would like to define a job that runs on the first
Monday every second month. As an example:
- 1st Monday in January -> Full Backup
- 1st Monday in February -> Differential Backup
- 1st Monday in March -> Full Backup
- 1st Monday in April -> Differetial Backup
and so on...

Is there a more elegant way to define this kind of schedule other than
plainly writing the following?

Schedule {
  Name = "BiMonthly"
  Run = Full 1st mon jan at 01:00
  Run = Differential 1st mon feb at 01:00
  Run = Full 1st mon mar at 01:00
  Run = Differential 1st apr feb at 01:00
  ...
}

Maybe something similar like "0 1 1 */2 *" would do in crontab for the
first day of every second month?


Best regards

Sebastian

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Simultaneously spooling and writing to tape

2018-03-27 Thread Sebastian Suchanek
Hi everyone!

Currently, my Bacula seup (v5.2.6) is as follows:
The director, the storage daemon and a file daemon are running on my
server, two backup jobs are configured to run directly from the server.
Additionally, there's a client with another file daemon and one backup
job configured. The data of all three jobs is supposed to be written to
the same tape drive.
Since the client is connected to the server only via internet (not via
LAN), the backup data from there is spooled on the server.

All three jobs are scheduled for the same time and with the current
config, the jobs are queued by Bacula and are executed one after
another, including the spooling of the data from the external client.
But since this spooling can take quite some time, I would like Bacula to
start the spooling from the external client first and, while spooling,
to simultaneously start writing one (or both) local backup jobs to the tape.
Disk I/O shouldn't be an issue on the server, since the source of the
local backup jobs and the spooling disk are two physically separate drives.

I've already tried to set the priority number of the remote job to a
lower value and set "Maximum Concurrent Jobs = 2" for the director. (If
I've understood the Bacula documentation correctly, the default maximum
concurrent job value for the storage daemon should be 4 anyway.)

But also with these settings, the backup jobs are still executed
strictly consecutively.
What can I do to achieve the desired behaviour?


TIA,

Sebastian

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Autochanger not changing

2018-04-01 Thread Sebastian Suchanek
Hi everyone,

while still setting up Bacula (v5.2.6), I've come accross a rather
strange issue with my tape library (an Overland NEO2000) with a
LTO4-FC-Drive. When I do "fill" test with btape over multiple tapes,
everything works fine. Also, for example, when I do a "label barcodes"
command in btape over multiple slots, the individual tapes are moved
into the drive, get written and are put back into their original slot.

But when I run a "real" backup job which spans more than one tape, the
job gets stuck as soon as the end of the first tape is reached. The last
messages from the job are:

| [...]
| 2018-04-01 14:16:42   tigersclaw-sd JobId 111: Volume "SU4103L4"
previously written, moving to end of data.
| 2018-04-01 15:55:32   tigersclaw-sd JobId 111: End of Volume "SU4103L4"
at 21:2548 on device "LTO4-Drive-1" (/dev/nst0). Write of 200 bytes
got -1.

And after that, nothing happens anymore. Not even if I wait for half an
hour.

Here's the (hopefully) relevant part of my bacula-sd.conf:

| [...]
| Autochanger {
|   Name = Overland-NEO2000
|   Device = LTO1-Drive-1
|   Device = LTO4-Drive-1
|   Changer Command = "/etc/bacula/scripts/mtx-changer %c %o %S %a %d"
|   Changer Device = /dev/sg4
| }
|
| Device {
|   Name = LTO4-Drive-1
|   Drive Index = 1
|   Media Type = LTO-4
|   Archive Device = /dev/nst0
|   AutomaticMount = yes
|   AlwaysOpen = yes
|   RemovableMedia = yes
|   RandomAccess = no
|   Maximum block size = 2MB
|   Maximum File Size = 40GB
|   AutoChanger = yes
|   Alert Command = "sh -c 'tapeinfo -f %c |grep TapeAlert|cat'"
|   Spool Directory = "/srv/bacula/spool"
| }
| [...]

Any idea what exactly is going wrong here? What can I do to track down
the reason for this error? What can I do to fix it?


Best regards

Sebastian

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Autochanger not changing

2018-04-02 Thread Sebastian Suchanek
Am 02.04.2018 um 09:54 schrieb Kern Sibbald:

Hello Kern,

thank you for your reply.

> First, I would recommend that you use at *most* 1MB block sizes for
> LT0-1 and LTO-4 tapes.

OK, I changed that for the LTO-4 drive. (I don't want go below 1MB
though, because it significantly reduces write rates.)

> [...]
> You haven't shown your full autochanger device configuration so it will 
> be hard/impossible to diagnose your problem.

No problem, here's my full bacula-sd.conf, only comments and passwords
are removed:

| Storage {
|   Name = tigersclaw-sd
|   SDPort = 9103
|   WorkingDirectory = "/var/lib/bacula"
|   Pid Directory = "/var/run/bacula"
|   Maximum Concurrent Jobs = 20
|   SDAddress = 10.1.0.1
| }
|
| Director {
|   Name = tigersclaw-dir
|   Password = 
| }
|
| Director {
|   Name = tigersclaw-mon
|   Password = 
|   Monitor = yes
| }
|
| Device {
|   Name = FileStorage
|   Media Type = File
|   Archive Device = /srv/bacula/file
|   LabelMedia = yes
|   Random Access = yes
|   AutomaticMount = yes
|   RemovableMedia = no
|   AlwaysOpen = no
| }
|
| Autochanger {
|   Name = Overland-NEO2000
|   Device = LTO1-Drive-1
|   Device = LTO4-Drive-1
|   Changer Command = "/etc/bacula/scripts/mtx-changer %c %o %S %a %d"
|   Changer Device = /dev/sg4
| }
|
| Device {
|   Name = LTO1-Drive-1
|   Drive Index = 0
|   Media Type = LTO-1
|   Archive Device = /dev/nst1
|   AutomaticMount = yes
|   AlwaysOpen = yes
|   RemovableMedia = yes
|   RandomAccess = no
|   AutoChanger = yes
|   Maximum File Size = 2GB
|   Alert Command = "sh -c 'tapeinfo -f %c |grep TapeAlert|cat'"
|   Spool Directory = "/srv/bacula/spool"
| }
|
| Device {
|   Name = LTO4-Drive-1
|   Drive Index = 1
|   Media Type = LTO-4
|   Archive Device = /dev/nst0
|   AutomaticMount = yes
|   AlwaysOpen = yes
|   RemovableMedia = yes
|   RandomAccess = no
|   Maximum block size = 1MB
|   Maximum File Size = 40GB
|   AutoChanger = yes
|   Alert Command = "sh -c 'tapeinfo -f %c |grep TapeAlert|cat'"
|   Spool Directory = "/srv/bacula/spool"
| }
|
| Messages {
|   Name = Standard
|   director = tigersclaw-dir = all
| }

JFTR: "tigersclaw" is the name of my server which runs (among other
things) the Bacula director, storage daemon und also the client where
the backup job in question comes from. (I have more jobs configured,
also from other clients, but they are way to small to even fill a LTO-1
tape.)

> Also the output from a:
> 
> lsscsi -g
> 
> would be necessary.

No problem either:

| # lsscsi -g
| [0:0:1:0]tapeHP   Ultrium 4-SCSI   H63H  /dev/st0   /dev/sg3
| [1:0:0:0]diskATA  Samsung SSD 850  2B6Q  /dev/sda   /dev/sg0
| [2:0:0:0]diskATA  WDC WD40EFRX-68W 0A82  /dev/sdb   /dev/sg1
| [3:0:0:0]diskATA  WDC WD40EFRX-68W 0A82  /dev/sdc   /dev/sg2
| [7:0:0:0]mediumx OVERLAND NEO Series   0616  /dev/sch0  /dev/sg4
| [7:0:0:1]tapeSEAGATE  ULTRIUM06242-XXX 1603  /dev/st1   /dev/sg5
| #


> Note in general, if btape works then Bacula will work because the SD 
> uses the same subroutines that btape uses for reading/writing tapes.

Well, that's what I expected and that's why I'm so puzzled about this
error...

> Consequently there may be some other problem.  When the SD seems to be 
> stuck, you can probably get more information by doing:
> 
> bconsole
> set debuglevel=200 storage= trace=1
> mount
> set debuglevel=0 storage= trace=0
> 
> then look at the trace file in your working directory to see what it 
> going on.

Here's the trace file from the beginning of the job until the point
where the first tape was full and Bacula got stuck:

   https://suchanek.de/temp/tigersclaw-sd.trace   (47kB)

And here ist what happend when I manually cancelled the stuck job (which
worked) and try to do a "release LTO4-Drive" command in bconsole. (Which
didn't work, i.e. Bacula got stuck here too.)

   https://suchanek.de/temp/tigersclaw-sd.trace.2   (3kB)

I hope you can find anything usefull in these debug files, because I'm
totally lost here...


Best regards

Sebastian

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Autochanger not changing

2018-04-08 Thread Sebastian Suchanek
Am 01.04.2018 um 17:12 schrieb Sebastian Suchanek:

> while still setting up Bacula (v5.2.6), I've come accross a rather
> strange issue with my tape library (an Overland NEO2000) with a
> LTO4-FC-Drive. When I do "fill" test with btape over multiple tapes,
> everything works fine. Also, for example, when I do a "label barcodes"
> command in btape over multiple slots, the individual tapes are moved
> into the drive, get written and are put back into their original slot.
> 
> But when I run a "real" backup job which spans more than one tape, the
> job gets stuck as soon as the end of the first tape is reached. The last
> messages from the job are:
> 
> | [...]
> | 2018-04-01 14:16:42 tigersclaw-sd JobId 111: Volume "SU4103L4"
> previously written, moving to end of data.
> | 2018-04-01 15:55:32 tigersclaw-sd JobId 111: End of Volume 
> "SU4103L4"
> at 21:2548 on device "LTO4-Drive-1" (/dev/nst0). Write of 200 bytes
> got -1.
> 
> And after that, nothing happens anymore. Not even if I wait for half an
> hour.
> [...]

In the meantime, one of my LTO1 tapes (which of course is written in the
LTO1 drive of my library) managed to fill up during a backup job. And
now it get's really weird: this time, the tape was exchanged without any
noticable problems.

This makes me wonder if the problem is maybe caused by the LTO4 drive
itself. But what I didn't mention so far: during my various trial runs
around this problem, I also replaced the LTO4 drive with another one.
(AFAIR both of them were the same Seagate model, though...)


Best regards

Sebastian


--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Autochanger not changing

2018-04-08 Thread Sebastian Suchanek
Am 07.04.2018 um 22:11 schrieb Dan Langille:
>> On Apr 1, 2018, at 11:12 AM, Sebastian Suchanek  wrote:
>> 
>> [...]
>> Any idea what exactly is going wrong here? What can I do to track down
>> the reason for this error? What can I do to fix it?
> 
> It is usually permissions. It it nearly always permission.

I agree - during my years of dealing with Linux, I've come across many
problems that were caused by permission issues of some sort.

> This might be your best bet: 
> https://dan.langille.org/2016/02/04/dell-tl4000-tape-library-running-btape-and-configuring-baculas-mtx-changer/
> [...]

I repeated almost all tests you described in your blog post (of course
adapted to my system):

- 8< -

bacula@tigersclaw:~$ lsscsi -g
[0:0:1:0]tapeHP   Ultrium 4-SCSI   H63H  /dev/st0   /dev/sg3
[1:0:0:0]diskATA  Samsung SSD 850  2B6Q  /dev/sda   /dev/sg0
[2:0:0:0]diskATA  WDC WD40EFRX-68W 0A82  /dev/sdb   /dev/sg1
[3:0:0:0]diskATA  WDC WD40EFRX-68W 0A82  /dev/sdc   /dev/sg2
[7:0:0:0]mediumx OVERLAND NEO Series   0616  /dev/sch0  /dev/sg4
[7:0:0:1]tapeSEAGATE  ULTRIUM06242-XXX 1603  /dev/st1   /dev/sg5

bacula@tigersclaw:~$ /usr/sbin/mtx -f /dev/sg4 inquiry
Product Type: Medium Changer
Vendor ID: 'OVERLAND'
Product ID: 'NEO Series  '
Revision: '0616'
Attached Changer API: No

bacula@tigersclaw:~$ /usr/sbin/tapeinfo -f /dev/nst0
mtx: Request Sense: Long Report=yes
mtx: Request Sense: Valid Residual=no
mtx: Request Sense: Error Code=0 (Unknown?!)
mtx: Request Sense: Sense Key=No Sense
mtx: Request Sense: FileMark=no
mtx: Request Sense: EOM=no
mtx: Request Sense: ILI=no
mtx: Request Sense: Additional Sense Code = 00
mtx: Request Sense: Additional Sense Qualifier = 00
mtx: Request Sense: BPV=no
mtx: Request Sense: Error in CDB=no
mtx: Request Sense: SKSV=no
INQUIRY Command Failed

bacula@tigersclaw:~$ /usr/sbin/tapeinfo -f /dev/sg3
Product Type: Tape Drive
Vendor ID: 'HP  '
Product ID: 'Ultrium 4-SCSI  '
Revision: 'H63H'
Attached Changer API: No
SerialNumber: 'HUE4020D8F'
MinBlock: 1
MaxBlock: 16777215
SCSI ID: 1
SCSI LUN: 0
Ready: yes
BufferedMode: yes
Medium Type: Not Loaded
Density Code: 0x46
BlockSize: 0
DataCompEnabled: yes
DataCompCapable: yes
DataDeCompEnabled: yes
CompType: 0x1
DeCompType: 0x1
BOP: yes
Block Position: 0
Partition 0 Remaining Kbytes: 799204
Partition 0 Size in Kbytes: 799204
ActivePartition: 0
EarlyWarningSize: 0
NumPartitions: 0
MaxPartitions: 0

bacula@tigersclaw:~$ /usr/sbin/tapeinfo -f /dev/sg4
Product Type: Medium Changer
Vendor ID: 'OVERLAND'
Product ID: 'NEO Series  '
Revision: '0616'
Attached Changer API: No
SerialNumber: '2B44300035'
SCSI ID: 0
SCSI LUN: 0
Ready: yes

bacula@tigersclaw:~$ /usr/sbin/mtx -f /dev/sg4 status
  Storage Changer /dev/sg4:2 Drives, 30 Slots ( 1 Import/Export )
Data Transfer Element 0:Full (Storage Element 1 Loaded):VolumeTag = SU1001L1
Data Transfer Element 1:Full (Storage Element 20 Loaded):VolumeTag =
SU4101L4
  Storage Element 1:Empty
  Storage Element 2:Full :VolumeTag=SU1002L1
  Storage Element 3:Full :VolumeTag=SU1003L1
  Storage Element 4:Full :VolumeTag=SU1004L1
  Storage Element 5:Full :VolumeTag=SU1005L1
  Storage Element 6:Full :VolumeTag=SU1006L1
  Storage Element 7:Full :VolumeTag=SU1007L1
  Storage Element 8:Full :VolumeTag=SU1008L1
  Storage Element 9:Full :VolumeTag=SU1009L1
  Storage Element 10:Full :VolumeTag=SU1010L1
  Storage Element 11:Full :VolumeTag=SU1101L1
  Storage Element 12:Full :VolumeTag=SU1102L1
  Storage Element 13:Full :VolumeTag=SU1103L1
  Storage Element 14:Full :VolumeTag=SU1104L1
  Storage Element 15:Full :VolumeTag=SU4001L4
  Storage Element 16:Full :VolumeTag=SU4002L4
  Storage Element 17:Full :VolumeTag=SU4003L4
  Storage Element 18:Full :VolumeTag=SU4004L4
  Storage Element 19:Full :VolumeTag=SU4005L4
  Storage Element 20:Empty
  Storage Element 21:Full :VolumeTag=SU4102L4
  Storage Element 22:Full :VolumeTag=SU4103L4
  Storage Element 23:Full :VolumeTag=SU4104L4
  Storage Element 24:Full :VolumeTag=SU4105L4
  Storage Element 25:Full :VolumeTag=SU4106L4
  Storage Element 26:Full :VolumeTag=SU4107L4
  Storage Element 27:Full :VolumeTag=SU4108L4
  Storage Element 28:Full :VolumeTag=SU4109L4
  Storage Element 29:Full :VolumeTag=SU4110L4
  Storage Element 30 IMPORT/EXPORT:Empty

bacula@tigersclaw:~$ /usr/sbin/mtx -f /dev/sg4 load 1 0
Loading media from Storage Element 1 into drive 0...done

bacula@tigersclaw:~$ mt -f /dev/nst1 status
SCSI 2 tape drive:
File number=0, block number=0, partition=0.
Tape block size 512 bytes. Density code 0x0 (default).
Soft error count since last status=0
General status bits on (4101):

Re: [Bacula-users] Autochanger not changing

2018-04-13 Thread Sebastian Suchanek
Am 09.04.2018 um 17:46 schrieb Kern Sibbald:

Hi Kern!

> The output from lsscsi looks odd.  From what I see, I am not reassured 
> that both the tape drives are actually part one at a time and see if 
> physically the right tapes are mounted.

I'm afraid, I didn't fully understand what you meant to say here. But I
assume, you are wondering why the devices of the library are so
"distributed".
That I can explain at least partially: The reason is, that the way the
library is connected to the server is somewhat "unique".
The library is an Overland NEO2000 which, unlike most other libraries,
has a dedicated controller card with its own parallel SCSI connectors.
The LTO1 drive also has its own parallel SCSI connectors. The LTO4
drive, on the other hand, has a Fibre Channel connection. In order not
having to use two different host adapters (SCSI & FC), I installed a
FC-to-SCSI bridge in library. (An ATTO FibrBridge 2390C, relabled by
Overland.) On the server side, I'm using a dual channel FC controller
Emulex LPe 11002.
The LTO4 drive and the FibreBridge are connected directly to one of the
FC controller ports respectively.

Or, as a sketch:

-. .-
 Server  | | Library
 | +-.
 .---+  Fibre Channel  | |
 |   |=| LTO4 drive  |
 | FC HA | | |
 |   |==## +-'
 '---+  || |
 |  || +-.
-'  || | |
|| ,---+ LTO1 drive  |
|| |   | |
||SCSI |   +-'
|| |   |
|| |   +-.
|| '---+ |
|| | Controller  |
|| .---+ |
|| |   +-'
||SCSI |   |
|| |   +-.
|| '---+ |
|| | FibreBridge |
##=| |
  Fibre Channel+-'
   |
   '-

But I don't have the slightest clue why the kernel splits up the two
channels of the single FC controller into two non-consecutive controller
numbers (0 and 7). But this number asignment is persitent through system
reboots, though...

> [...]
> My experience on LTO-1 and LTO-4 drives is that 512K buffer sizes get 
> quite adequate performance so I am a bit skeptical about your need for 
> 1MB buffers, but that said, they should be OK.

Well, that's what I found out with some btape "speed" test runs:

https://hirnfasching.de/2018/02/19/geschwindigkeitsmessung-lto-4-laufwerk/

The blog post itself is in German - sorry for that - but the figures
should be understandable anyway.
OK, I have to admit "significantly" is a bit of an exaggeration when
comparing the 1MB values with the 512kB block size values, but 1MB does
result in a larger throughput after all.


Best regards

Sebastian


--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Support bacula please help me

2018-05-08 Thread Sebastian Suchanek
Am 08.05.2018 um 09:26 schrieb Hang Vinh Nam:

> - I see compression job, but i don't understand why backup file on hdd
> is lager data on client as you see attach file.

Because, looking at the mailbox content you posted previously, Bacula
tried to write at least three backup jobs to the file "ANG1205-19042018"
- likely even more. Bacula did so because you configured it to keep
every single backup job for at least six month. (Can be seen in the
config screenshot you attached to your first message.)

As a sidenote, may I suggest that you try to track down and eliminate
all the errors you're getting in your backup jobs? It seems as up to
now, not a single Full backup was done successfully from that particular
client, so Bacula will try over and over again to do a Full backup -
which of course uses a lot of space in your backup storage.


HTH,

Sebastian

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Autochanger not changing

2018-05-08 Thread Sebastian Suchanek
Am 08.04.2018 um 21:08 schrieb Sebastian Suchanek:

> [...]
> This makes me wonder if the problem is maybe caused by the LTO4 drive
> itself. But what I didn't mention so far: during my various trial runs
> around this problem, I also replaced the LTO4 drive with another one.
> (AFAIR both of them were the same Seagate model, though...)

JFTR: Finally, also the LTO4 drive works as expected. (Tested in the
meantime by two "live" backup jobs with ~2TB each.) The realy
funny/strange thing is: I only changed the Maximum block size from "1MB"
to "1048576" and reduced the Maximum file size from "40GB" to "10737418240".
Anyway - as long as it works, I don't care too much about the details. ;-)


Regards,

Sebastian

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Support bacula please help me

2018-05-09 Thread Sebastian Suchanek
Am 09.05.2018 um 09:30 schrieb Hang Vinh Nam:

> - Can you show me how to eliminate all backup error?

No, not really - sorry. But given the fact that your logs contain a lot
of "gethostbyname()" errors and "Error: Director's connection to SD for
this Job was lost." messages, my best guess is that your network is
misconfigured and/or seriously unstable.

> and how long should
> i set job retention for avoid hdd is full.

That's a question only you can answer, because it depends on several
factors that only you know:

- Total size of the data to be backed (determines the size of a Full
  backup job)
- Typical amount of data that changes per day/per week (determines the
  size of Incremental and Differential backup jobs)
- Space available on the device(s)/media that the backup jobs are
  stored to

> - How can i configure for bacula run full backup override last one. I
> set schedule backup run at first monday of month. And my desire, full
> backup on this month will override last month.

Having exactly on Full backup might be a bit tricky. I think, I would
try a configuration with a dedicated pool where the Full backups go to
which contains only a single volume and having set "Maximum Volume Jobs"
to 1.

But then, on the other hand, I would reconsider having only a single
Full backup job generation. Because in this configuration, your old Full
backup data is deleted at the very beginning of a new Full backup job.
This means that during the time between starting the next Full backup
job and successfully(!) completing it, you're left with no consistent
Full backup data at all. IMHO, this is Murphy's Law waiting to strike.


Regards

Sebastian


--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula-Web 8.0.1 released

2018-07-03 Thread Sebastian Suchanek
Am 22.06.2018 um 17:45 schrieb bacula-...@dflc.ch:

Hi Davide!

> I'm pleased to inform you that Bacula-Web 8.0.1 is available now.

First of all, thank you for Bacula-Web and all the efforts you're
putting into it, I've been using it for some months now (v7.4.0) and I
like it a lot.
Recently, I upgraded to v8 - since the download of v8.0.1 was broken at
that time (it seems to fine again now), my following comments actually
refer to v8.0.0.

1. I couldn't find any hint in documentation on the default login
credentials after a fresh install or upgrade from an older version
without access control. Is that information really missing or have I
been too clumsy to find it? (I've managed to add my own credentials
directly to the sqlite database, though, so the problem is solved for me.)

2. My server is currently configured to show PHP deprecated warnings and
when I visit the Bacula login page, I'm getting the following warnings:

| Deprecated: Methods with the same name as their class will not be
| constructors in a future version of PHP; Smarty has a deprecated
| constructor in
/bacula-web/vendor/smarty/smarty/libs/Smarty.class.php on line 64
|
| Deprecated: Methods with the same name as their class will not be
| constructors in a future version of PHP; Smarty_Compiler has a
| deprecated constructor in
/bacula-web/vendor/smarty/smarty/libs/Smarty_Compiler.class.php on
line 35

Yes, I know it's just warnings and no errors, but from my personal
experience, if you don't fix it right now, you will be very suprised
when the "future PHP version" is released and put into production. ;-)

3. On the "general settings" page, I can't change any setting, all
options and input fields are inactive. Is this a problem with my
configuration (filesystem access rights maybe?) or is this page
currently just a dummy for future functionality in Bacula-web?

4. And, last but not least, a feature request: could you please
re-include the shortcuts that clicking on the pie charts for jobs and
pools takes you directly to the respective reports? I used these
shortcuts in v7.4.0 quite a lot...


Best regards

Sebastian

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Changing volume of running job?

2018-09-03 Thread Sebastian Suchanek
Hi everyone,

last night I encountered the following situation: a scheduled backup
started, using a certain backup pool (a set of tapes). From that pool,
Bacula (v7.4.4) selected an empty volume X, but since this was not in
the tapelibrary, Bacula kept asking for it. (Since I was ~250km away, I
couldn't do that.) However, another volume Y, which was also totally
empty, would have been available in the tapelibrary.

Basically, I have two question about this:
1. Why does Bacula prefer an empty volume which is not available over
   another empty volume that would have been available?
2. Is there any way to sort of re-direct an already running job to
   another (available) volume?


Best regards

Sebastian

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Changing volume of running job?

2018-09-03 Thread Sebastian Suchanek
Am 03.09.2018 um 19:54 schrieb Tilman Schmidt:
> Am 03.09.2018 um 16:52 schrieb Sebastian Suchanek:
>> Hi everyone,
>> 
>> last night I encountered the following situation: a scheduled backup
>> started, using a certain backup pool (a set of tapes). From that pool,
>> Bacula (v7.4.4) selected an empty volume X, but since this was not in
>> the tapelibrary, Bacula kept asking for it. (Since I was ~250km away, I
>> couldn't do that.) However, another volume Y, which was also totally
>> empty, would have been available in the tapelibrary.
>> 
>> Basically, I have two question about this:
>> 1. Why does Bacula prefer an empty volume which is not available over
>>another empty volume that would have been available?
> 
> Because Bacula's idea of available is different from yours or mine. :-)
> To sort out the specifics you'd have to share the precise state of the
> volumes involved at the time, which is probably not available anymore.

The state is still available because I canceled the abovementioned job:

*list media pool=LTO11
Automatically selected Catalog: MyCatalog
Using Catalog "MyCatalog"
+-++---+-+-+--+--+-+--+---+---+-+---+
| MediaId | VolumeName | VolStatus | Enabled | VolBytes|
VolFiles | VolRetention | Recycle | Slot | InChanger | MediaType |
LastWritten | ExpiresIn |
+-++---+-+-+--+--+-+--+---+---+-+---+
|  14 | SU1102L1   | Full  |   1 | 106,528,859,136 |
55 |1,209,600 |   1 |   12 | 1 | LTO-1 | 2018-05-06
23:50:03 | 0 |
|  15 | SU1103L1   | Full  |   1 | 114,858,390,528 |
58 |1,209,600 |   1 |   13 | 1 | LTO-1 | 2018-08-05
21:31:25 | 0 |
|  16 | SU1104L1   | Full  |   1 | 109,644,788,736 |
54 |1,209,600 |   1 |   14 | 1 | LTO-1 | 2018-09-02
22:28:53 | 1,128,832 |
|  17 | SU1105L1   | Append|   1 |  64,512 |
0 |1,209,600 |   1 |0 | 0 | LTO-1 | -00-00
00:00:00 | NULL  |
|  18 | SU1101L1   | Append|   1 |  64,512 |
0 |1,209,600 |   1 |   11 | 1 | LTO-1 | -00-00
00:00:00 | NULL  |
|  19 | SU1106L1   | Append|   1 |  64,512 |
0 |1,209,600 |   1 |0 | 0 | LTO-1 | -00-00
00:00:00 | NULL  |
|  20 | SU1107L1   | Append|   1 |  64,512 |
0 |1,209,600 |   1 |0 | 0 | LTO-1 | -00-00
00:00:00 | NULL  |
|  21 | SU1108L1   | Append|   1 |  64,512 |
0 |1,209,600 |   1 |0 | 0 | LTO-1 | -00-00
00:00:00 | NULL  |
|  22 | SU1109L1   | Append|   1 |  64,512 |
0 |1,209,600 |   1 |0 | 0 | LTO-1 | -00-00
00:00:00 | NULL  |
|  23 | SU1110L1   | Append|   1 |  64,512 |
0 |1,209,600 |   1 |0 | 0 | LTO-1 | -00-00
00:00:00 | NULL  |
+-++---+-+-+--+--+-+--+---+---+-+---+
*

(Hopefully this works without broken linebreaks...)
The job in question actually started on volume "SU1104L1" and when that
volume had filled up, Bacula asked for "SU1105L1" instead of using
"SU1101L1".
Maybe that's because of the lower MediaId of SU1105L1 instead of SU1101L1?

>> 2. Is there any way to sort of re-direct an already running job to
>>another (available) volume?
> 
> What I do in similar situations is
> 
> 1. purge the volume I want Bacula to use
> 2. update the volume status of the volume I don't want Bacula to use to
> "Used".
> 
> Sometimes the process has to be repeated because Bacula would still
> recycle a different volume than the one I purged for it, but eventually,
> after re-setting all volumes to "Used" which Bacula chose, it will end
> up using the volume you want it to use.

How can I set a volume manually to "used" (and un-set it aftwards)?


Best regards

Sebastian


--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Changing volume of running job?

2018-09-03 Thread Sebastian Suchanek
Am 03.09.2018 um 21:15 schrieb Bill Arlofski:
> 
> Assuming this is a tape library with barcode reader, 

Yes, it is.

> you will need to let
> Bacula know which tapes are in the library:
> 
> * update slots storage= drive=
> 
> Bacula honors the "InChanger" field for volumes when choosing a volume.
> [...]

Well, that's the behaviour I would've expected - but Bacula didn't do so
in my case.

For better readability, here's the status of the pool with correct
linebreaks:

   https://suchanek.de/temp/listmedia.txt

As you can see, volume 1101 is empty and in the changer, while Bacula
asked for 1105, which is not in the changer (and also marked as such in
Bacula's catalog).


Best regards

Sebastian


--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Changing volume of running job?

2018-09-04 Thread Sebastian Suchanek
Am 04.09.2018 um 13:54 schrieb Martin Simmons:
>>>>>> On Mon, 3 Sep 2018 21:40:02 +0200, Sebastian Suchanek said:
>> Am 03.09.2018 um 21:15 schrieb Bill Arlofski:
>> > 
>> > [...]
>> > Bacula honors the "InChanger" field for volumes when choosing a volume.
>> > [...]
>> 
>> Well, that's the behaviour I would've expected - but Bacula didn't do so
>> in my case.
> 
> Does the Storage definition in your Director's bacula-dir.conf contain
> Autochanger = Yes?  The Director will ignore the InChanger field if this is
> missing, even if the bacula-sd has it configured as an autochanger.
> [...]

No, it wasn't. I added it and now it seems to work - thanks a lot!

The only thing that still puzzles me: When I just re-ran the aborted
job, Bacula didn't ask for a tape that isn't in the changer, but didn't
use the empty (and available) tape 1101 either. Instead, Bacula recycled
the full volume 1103. (For further details, please see the output of
"list media" in my previous e-mail.)
Any ideas why *that* happened?


Best regards

Sebastian


--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Changing volume of running job?

2018-09-05 Thread Sebastian Suchanek
Am 05.09.2018 um 17:16 schrieb Martin Simmons:
>>>>>> On Tue, 4 Sep 2018 19:50:43 +0200, Sebastian Suchanek said:
>> 
>> [...]
>> The only thing that still puzzles me: When I just re-ran the aborted
>> job, Bacula didn't ask for a tape that isn't in the changer, but didn't
>> use the empty (and available) tape 1101 either. Instead, Bacula recycled
>> the full volume 1103. (For further details, please see the output of
>> "list media" in my previous e-mail.)
>> Any ideas why *that* happened?
> 
> It should prefer a volume with the Append status, so that is strange.  Is the
> Media.StorageID set correctly for tape 1101?

Yes, it should be.
When I added the volumes to the pool with "label barcode" commands,
something went wrong with some tapes (I can't remember what exactly), so
tape 1101 was skipped at first and added later. Therefore, the order of
the MediaID is not consistent with the order of the names of the volumes.


Best regards

Sebastian


--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula-Web 8.1.0 release

2018-11-11 Thread Sebastian Suchanek
Am 10.11.2018 um 11:41 schrieb Chris Wilkinson:

> I had trouble with the curl -o command but got it with wget instead.
> CURL just downloaded ~370 bytes.

Yes, me too. I guess it's because the manual states a HTTP address which
the server redirects to a HTTPS address which can't be handled by curl.

Also I've noticed some glitches in the upgrade manual at
http://docs.bacula-web.org/en/v8.1.0/02_install/upgrade.html#install-upgrade

- There are some typos around the "application" part in path names,
  e.g. "appication" and "appilcation". (Of course it's obvious when you
  read it and type in the command manually, but a pitfall when you try
  to copy and paste the commands.

- The upgrade manual doesn't mention to set the file ownership of
  /application/assets/protected/application.db back to the
  webserver user after restoring it from backup. If this isn't done,
  one get's an error message of bad file permissions.

Aside from this, the upgrade went smooth and also the new version itself
works fine - thanks!


Best regards

Sebastian



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula-Web 8.1.0 release

2018-11-11 Thread Sebastian Suchanek
Am 11.11.2018 um 20:16 schrieb Maciolek, Mark:

Hi!

> These are my permissions for application.db
> 
> /var/www/html/bacula-web/application/assets/protected$ ls -al
> total 16
> drwxr-xr-- 2 www-data www-data 4096 Nov 10 04:22 .
> drwxr-xr-x 6 root root 4096 Nov 10 02:06 ..
> -rw-r- 1 www-data www-data 4096 Nov 10 04:22 application.db
> -rw-r--r-- 1 www-data root   98 Nov 10 02:06 .htaccess

It's pretty much the same on my installation:

| # ls -la
| total 24
| drwxrwxr-x 2 www-data www-data  4096 Nov 11 19:05 .
| drwxr-xr-x 6 www-data www-data  4096 Nov 10 08:06 ..
| -rw-r--r-- 1 www-data www-data 12288 Nov 11 19:05 application.db
| -rwxr-xr-x 1 www-data www-data98 Nov 10 08:06 .htaccess
| #

Just an additional read permission for everyone, but that shouldn't make
a difference with regard to this error.


> I still get the error
> Problem: Bad ownership / permissions for protected assets folder 
> (application/assets/protected)
> 
> 
> So what should they be?

What's your output of "ps aux | grep apache"?


Best regards

Sebastian



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Volume status "Used" vs. "Full"

2018-11-18 Thread Sebastian Suchanek
Hi everyone!

In my Bacula installation (v7.4.4, Debian), I have a certain Full backup
job that is configured to go to a pool of tapes. One run of this backup
job currently spans abot 2.5 tapes. In order to make handling of the
tapes a bit more easier (I'm taking them to an off-site storage and will
re-use them after a few months), I would like to have the last,
half-used tape of a job run not to be used for the beginning of the
subsequent job run. Therefore, I configured "Maximum Volume Jobs = 1"
for this pool.
In principle, this works as itended, but there's one thing that
irritates me: The first two tapes being used in a job run are not marked
as "Full" in the Bacula catalog (as I would've expected since they are
actually full), but as "Used".
Is this a bug or a feature? How can I configure that last half-used
volume from a job run isn't reused for the subsequent job run and at the
same time having actually full volumes marked as "Full"?


TIA,

Sebastian


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Tape shoe-shining with spooling enabled - why?

2018-12-22 Thread Sebastian Suchanek
Am 22.12.2018 um 01:46 schrieb Adam Nielsen:

> I've been using Bacula for a number of years but recently got hold of
> an old tape autochanger with an LTO-4 drive, which I would like to use
> to have Bacula write to tape instead of my previous disk/file config.
> 
> I think I have everything set up, all the tapes are labelled and Bacula
> switches tapes when each one fills up, however after the first tape
> started writing at 80MB/sec, the rest of them only write at 60-65MB/sec.
> [...]

Are you sure that both the drive and the tapes are still in a decent
shape, not being worn-out? Have you tested the drive with btape? If yes,
what was the result?


Best regards

Sebastian


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] "ERR=database or disk is full" while building directory tree for restore

2018-12-27 Thread Sebastian Suchanek
Am 27.12.2018 um 08:32 schrieb Adam Nielsen:

> [...]
> MariaDB has already replaced MySQL in most Linux distributions, at
> least those aimed at the desktop.  There have been very few
> compatibility problems.  I am currently running Bacula with MariaDB on
> the Arch Linux distribution and haven't encountered any issues so far,
> but then my backups are only home-user sized.

Full-ACK. (Although I'm running Bacula and MariaDB on Debian, not on Arch.)
For reference: my Bacula database in MariaDB is currently ~1.5GB in
size, with ~6.5 mio. entries in the "File" table.

> As long as Bacula sticks
> to the common feature set and doesn't use any of the new
> Oracle-MySQL-specific features then it will probably continue to work
> just fine with both MySQL and MariaDB for some time yet, with no special
> maintenance effort.
> [...]

Yes, I'd assume that too.


Best regards

Sebastian



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] mtx and mtx-changer not functioning

2019-01-10 Thread Sebastian Suchanek
Am 11.01.2019 um 02:05 schrieb Richard Couture:

> [...]
> [root@LTOMag scripts]# mtx -f /dev/sg3 unload
> Unloading drive 0 into Storage Element 1...mtx: Request Sense: Long 
> Report=yes
> mtx: Request Sense: Valid Residual=no
> mtx: Request Sense: Error Code=70 (Current)
> mtx: Request Sense: Sense Key=Illegal Request
> mtx: Request Sense: FileMark=no
> mtx: Request Sense: EOM=no
> mtx: Request Sense: ILI=no
> mtx: Request Sense: Additional Sense Code = 53
> mtx: Request Sense: Additional Sense Qualifier = 01
> mtx: Request Sense: Field in Error = 00
> mtx: Request Sense: BPV=no
> mtx: Request Sense: Error in CDB=no
> mtx: Request Sense: SKSV=yes
> mtx: Request Sense: Field Pointer = 00 00
> MOVE MEDIUM from Element Address 256 to 4096 Failed
> [root@LTOMag scripts]#
> [...]

Does mtx work when you explicitly specify the slots? I.e.:

mtx -f /dev/sg3 load 1 0
mtx -f /dev/sg3 unload 1 0


Best regards

Sebastian



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] mtx and mtx-changer not functioning

2019-01-11 Thread Sebastian Suchanek
Am 11.01.2019 um 14:49 schrieb Richard Couture:

>> Does mtx work when you explicitly specify the slots? I.e.:
>>
>> mtx -f /dev/sg3 load 1 0
>> mtx -f /dev/sg3 unload 1 0
>
> No

Then, in my opinion, the problem is somewhere outside of Bacula.
My best guess is that either your library and your version of mtx are
incompatible or your library is broken (e.g. faulty firmware).


Best regards

Sebastian



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] mtx and mtx-changer not functioning

2019-01-12 Thread Sebastian Suchanek
Am 11.01.2019 um 23:13 schrieb Jeffrey R. Lang:
> In your mtx command output one thing I don't see is the Data Transfer Unit 
> (i.e. tape drive) associated with the tape library.
> [...]

Have a second look, there is a "Data Transfer Element" line in Richard's
output. It seems as if your mail client wrapped the line a bit strangely...


Best regards

Sebastian



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula-Web 8.2.0 released

2019-01-12 Thread Sebastian Suchanek
Am 07.01.2019 um 12:19 schrieb Davide Franco:
> Dear all,
> 
> I'm pleased to inform you that Bacula-Web 8.2.0 is available from now.
> 
> This version Include 2 new features and 7 bug fixes 
> 
> The release notes is available here 
> https://www.bacula-web.org/2019/01/06/bacula-web-8-2-0/
> [...]

Just as a very quick feedback: I just made the upgrade and all seems to
work well so far.


Best regards

Sebastian



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Long pause with no logging or any activity at all

2019-02-16 Thread Sebastian Suchanek
Am 15.02.2019 um 16:10 schrieb William Muriithi:
>> have you tried the "stat client" command? If you run it a few times you 
>> should be able to spot if there's still data transfer activity.
> 
> Daemon started 12-Feb-19 11:53. Jobs: run=4 running=0.
>  Heap: heap=135,168 smbytes=586,060 max_bytes=639,633 bufs=465 max_bufs=515
>  Sizeof: boffset_t=8 size_t=8 debug=0 trace=0 
> Running Jobs:
> JobId 7 Job BackupClient2.2019-02-12_16.08.21_03 is running.
> Full Backup Job started: 12-Feb-19 16:08
> Files=14,795,540 Bytes=3,362,575,559,435 Bytes/sec=14,178,390 Errors=0
> Files Examined=14,795,541
> Processing file: 
> /export/eng/deuterium.eng.example.com/eng/tools/synopsys/pa-vrtzr/F-2011.06-SP1/SLS/linux/InnoGUI/wine/localdotwine/dosdevices/z:/export/eng/projects/cad_admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/tools/rhel5/subversion-1.6.18/subversion/libsvn_subr/.libs/libsvn_subr-1.so.0.0.0

That path looks a bit unsual, to say the least. Are you sure the
filesystem on the machine running the filedaemon isn't broken?

> [...] 
> Terminated Jobs:
>  JobId  LevelFiles  Bytes   Status   FinishedName 
> ==
>180  Full  0 0   Error11-Feb-19 13:53 BackupCatalog
>  3  Full  0 0   OK   12-Feb-19 14:09 BackupCatalog
>  4  Full 102.281 M  Error12-Feb-19 15:08 BackupClient1
>  5  Full  0 0   OK   12-Feb-19 15:10 BackupCatalog
>  6  Full  0 0   OK   12-Feb-19 15:58 BackupClient2
> 
> 
> That has been the status since yesterday
> 
> Strace is also silent, look as below since last night but one:
> [...]

Does the output of "messages" in the bacula console give any useful
information?


Best regards

Sebastian



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] MySQL files filling up the disk

2019-03-02 Thread Sebastian Suchanek
Am 02.03.2019 um 19:35 schrieb Shawn Rappaport:

> I'm running Bacula 9.06 on CentOS 7.5 with MariaDB version 5.5.56-2.
> The Bacula-web interface shows the DB is 69.10GB in size. However, the
> MySQL files on my server are consuming 442GB of disk space, which is
> starting to fill up the disk on my Director server. I see 374 mysql-bin
> files which are almost all 1.1GB in size.

Sounds like binary logfiles. Check, if binary logging is enabled in
MariaDB. You can limit the total size of binary logfiles or you can turn
it off altogether if you don't need it.

https://mariadb.com/kb/en/library/binary-log/

> I also see an ibdata1 file which is 73GB.

That's the actual database.

> Do I need to perform some sort of maintenance on the DB to get things under 
> control?

IMHO, a "OPTIMIZE TABLE" statement every now and then, especially for
the Bacula tables "Filename" and "FileSet" shouldn't hurt but shouldn't
be really required either.


HTH,

Sebastian



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Problems with LTO5 drive

2019-04-07 Thread Sebastian Suchanek
Hi all!

Currently, I'm running a Bacula installation that writes backups to a
LTO4 drive. This is all running perfectly fine.

Recently, I bought a second-hand LTO5 drive to beef up my storage
capacity a bit. But when I wanted to test the "new" drive, I came across
a somewhat strange problem: When I run btape with the "test" command,
everything seems to work fine. But when I try to run the "fill" command,
btape seems to succeed to write the volume name, but crahes immediately
when it try write "payload" data with a segmentation faul 11.
I'll attach the btraceback data below, but that's all greek to me.
Any idea what is going wrong here?


Best regards

Sebastian

-

/root/btape: No such file or directory.
[New LWP 24284]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
0x7fc1785b0b5a in __waitpid (pid=24397, stat_loc=0x7ffd9aef8b6c,
options=0) at ../sysdeps/unix/sysv/linux/waitpid.c:29
29  ../sysdeps/unix/sysv/linux/waitpid.c: No such file or directory.
$1 = 1093482288
$2 = 1885434978
$3 = 470585720
$4 = 470585784
$5 = 0
$6 = 0
$7 = 2021694149
$8 = 2021694118
$9 = 2021694111
$10 = 2021694145
$11 = 1701276020
$12 = 2021694138
Environment variable "TestName" not defined.
#0  0x7fc1785b0b5a in __waitpid (pid=24397, stat_loc=0x7ffd9aef8b6c,
options=0) at ../sysdeps/unix/sysv/linux/waitpid.c:29
#1  0x7fc1787f4f7e in signal_handler () from
/usr/lib/bacula/libbac-7.4.4.so
#2  
#3  0x55f81bdc7456 in ?? ()
#4  0x55f81bdbf759 in ?? ()
#5  0x7fc1770b12e1 in __libc_start_main (main=0x55f81bdbf1f0,
argc=4, argv=0x7ffd9aef9e88, init=, fini=,
rtld_fini=, stack_end=0x7ffd9aef9e78) at
../csu/libc-start.c:291
#6  0x55f81bdbfa3a in ?? ()

Thread 2 (Thread 0x7fc17684e700 (LWP 24284)):
#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at
../sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:225
#1  0x7fc1787ff361 in watchdog_thread () from
/usr/lib/bacula/libbac-7.4.4.so
#2  0x7fc1785a74a4 in start_thread (arg=0x7fc17684e700) at
pthread_create.c:456
#3  0x7fc177179d0f in clone () at
../sysdeps/unix/sysv/linux/x86_64/clone.S:97

Thread 1 (Thread 0x7fc178e37040 (LWP 24282)):
#0  0x7fc1785b0b5a in __waitpid (pid=24397, stat_loc=0x7ffd9aef8b6c,
options=0) at ../sysdeps/unix/sysv/linux/waitpid.c:29
#1  0x7fc1787f4f7e in signal_handler () from
/usr/lib/bacula/libbac-7.4.4.so
#2  
#3  0x55f81bdc7456 in ?? ()
#4  0x55f81bdbf759 in ?? ()
#5  0x7fc1770b12e1 in __libc_start_main (main=0x55f81bdbf1f0,
argc=4, argv=0x7ffd9aef9e88, init=, fini=,
rtld_fini=, stack_end=0x7ffd9aef9e78) at
../csu/libc-start.c:291
#6  0x55f81bdbfa3a in ?? ()
#0  0x7fc1785b0b5a in __waitpid (pid=24397, stat_loc=0x7ffd9aef8b6c,
options=0) at ../sysdeps/unix/sysv/linux/waitpid.c:29
29  in ../sysdeps/unix/sysv/linux/waitpid.c
resultvar = 18446744073709551104
sc_cancel_oldtype = 0
#1  0x7fc1787f4f7e in signal_handler () from
/usr/lib/bacula/libbac-7.4.4.so
No symbol table info available.
#2  
No locals.
#3  0x55f81bdc7456 in ?? ()
No symbol table info available.
#4  0x55f81bdbf759 in ?? ()
No symbol table info available.
#5  0x7fc1770b12e1 in __libc_start_main (main=0x55f81bdbf1f0,
argc=4, argv=0x7ffd9aef9e88, init=, fini=,
rtld_fini=, stack_end=0x7ffd9aef9e78) at
../csu/libc-start.c:291
291 ../csu/libc-start.c: No such file or directory.
result = 
unwind_buf = {cancel_jmp_buf = {{jmp_buf = {0, -8885532658628884604,
94524107651600, 140727202848384, 0, 0, -3406061076198258812,
-3403904697575602300}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0,
0x7ffd9aef9eb0, 0x7fc178e4d170}, data = {prev = 0x0, cleanup = 0x0,
canceltype = -1695572304}}}
not_first_call = 
#6  0x55f81bdbfa3a in ?? ()
No symbol table info available.
#0  0x in ?? ()
No symbol table info available.


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Why did Bacula not reuse an Error tape?

2019-06-03 Thread Sebastian Suchanek
Am 03.06.2019 um 12:15 schrieb Ian Douglas:
> On Monday, 03 June 2019 11:44:34 SAST Tilman Schmidt wrote:
> 
>> It's by design. The "Error" state for a tape means it's defective and should
>> not be used anymore. If you want Bacula to use it again (and i you are sure
>> what you are doing) you have to change its state manually from "Error" to
>> something else, eg. "Used".
> 
> So noted, thanks. 
> 
> I'm sure the tape is fine, the problem is that when we have power outages 
> during a backup my network goes down and then Bacula gets confused. 
> 
> I have UPS on bacula-dir machine and tape drive controller and tape drive, 
> just one LAN switch that still needs to be connected to a UPS... and that's 
> causing the problems.

Shouldn't such an "incident" cause a *job* error instead of Bacula
marking the *tape* as faulty?


Best regards

Sebastian



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Tape issue: less size than before for LTO-4 tapes

2020-03-13 Thread Sebastian Suchanek
Am 10.03.2020 um 09:26 schrieb Pierre Bernhardt:

> since beginning of this year a tape issue has been arrived my backups.
> All my LTO-4 Tapes will not fill any more to the ~ 760 GiByte than
> before. Only ~ 510-580 GiByte will be stored on the tapes which is
> shown by the list volume command.

Looks like a worn-out drive to me.


Best regards

Sebastian


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] sqlite to postgres|maridb migration -- how to confirm success?

2020-12-23 Thread Sebastian Suchanek
Am 23.12.2020 um 05:21 schrieb Gary R. Schmidt:

> [...]
> I would suggest moving to PostgreSQL rather than MariaDB.
> 
> PostgreSQL is fully supported by Bacula, MariaDB has thrown up a few 
> nasties where is is not quite the same as MySQL, and those will probably 
> increase.
> [...]

Just out of curiosity: what "nasties" would that be? I'm running MariaDB
as a replacement for MySQL for some years now (both for Bacula and for
my own projects) and haven't had any issues so far.


Best regards

Sebastian


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Backup of Windows clients - best practices?

2021-02-21 Thread Sebastian Suchanek
Hi all!

So far, I'm using Bacula to back up various Linux clients and it works
great. Now, I would like to add another client to be backup which is
running under Windows 10 Pro 64bit.

I already went through the "Windows" chapter of the Bacula main manual,
but this seems to be focusing more on older versions of Windows. The
main thing I took away from that was that it might be good idea to use
"Enable VSS = yes" in the fileset definition.

Aside from that - are there any best practices that I should follow when
backing up Windows clients? E.g. which paths should be included and
which should be excluded in the fileset(s)?
Or is it maybe a better idea to first create a system image with
Window's built-in image functionality and then back up the resulting
image file(s) via Bacula?
Any comments are appreciated.


Best regards

Sebastian


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Problem with missing EOD/EOF on LTO-5 Tape

2021-02-26 Thread Sebastian Suchanek
Am 23.02.2021 um 15:11 schrieb Christian Lehmann:

> I have a problem with a single LTO-5 Tape drive (Tandberg LTO-5 HH).
> 
> I do backups spanning multiple Tapes, changing them manually.
> 
> So I configured the storage daemon that it is automatically pushing out
> the tape as soon as it is full.
> 
> So my users (and me) can see this and load a new/the next tape. Than
> bacula automatically mounts it and continue with the backup. This works
> fine.
> 
> But problems arise as soon as I have a tape, which is not full and I
> want to unload it (for example to label a new tape or to restart bacula
> or the server). If I just restart tape is pushed out as soon as bacula
> is shutting down or during the restart (it is also rewinded as
> expected). The same happens, if I "unmount" the tape using bconsole.
> [...]

At home, I'm running a tape library with LTO tapes for Bacula to do
backups on. But since I want to limit the noise and energy consumption
of the library, I only power on the library when backups are due and
shut it down again after the backups. I have this done automatically
with a few little scripts and a power switch which can be controlled via
TCP/IP. At first I ran into a lot of problems when tapes remained in the
LTO drives at shutdown until I figured out to use the "release" command
in bconsole console prior to shutdown. "unmount" also caused some
unexpected problems.

Long story short: have also tried the "release" command instead of the
"unmount" command?


Regards

Sebastian


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] How are "new" files determined?

2021-12-30 Thread Sebastian Suchanek
Hi everyone!

How exactly are "new" files, which have to be backed up, determined by
Bacula?

The reason for asking: Recently, I migrated my main data to a new set of
hard drives. I did so by using "rsync -aH" which *should* leave all file
timestamps etc. untouched. After the migration was finished, also all
paths etc. were exactly the same as before, just with a new set of HDDs
"underneath". However, in the next scheduled Bacula run (which was
scheduled as Incremental), Bacula stared to backup *everything* of the
abovementioned data.
(I cancelled the job and will resume doing backups on this particular
fileset with next regular Full backup which is scheduled for the
upcoming Sunday anyway.)

So - what went wrong here and how could this have been avoided?


Regards

Sebastian


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] I am missing Debs for Buster 32 bit (for Raspberry Pi machines running RaspiOS)

2022-08-26 Thread Sebastian Suchanek

Am 26.08.2022 um 14:19 schrieb Justin Case:
You mean the script will also work on RaspiOS 32 bit? (note: Raspbian != 
RasiOS)

[...]


To be honest, I've never heard of a system called "RaspiOS" exactly, but 
"Raspberry Pi OS" is definetly just a rename of what was formerly called 
"Raspbian" - as it also stated on the Raspberry homepage:


   https://www.raspberrypi.com/software/

Concerning your original question: Unfortunately, I don't run a 
Raspberry Pi on Buster, but I do run three of them under Raspberry Pi OS 
(a.k.a. Raspbian) Stretch and one under Bullseye. For both versions, 
Bacula came in the original Raspbian repository. (Bacula 7.4.4 on 
Stretch and Bacula 9.6.7 on Bullseye.) I've set up Bacula FDs on all of 
my RasPis from the respective Raspbian repository and they all work well.


Assuming that "RaspiOS" indeed is something different then "Raspberry Pi 
OS"/"Raspbian" - have you already checked the corresponding repository 
for Bacula?



HTH,

Sebastian


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] advice about tape drives

2024-04-22 Thread Sebastian Suchanek

Am 22.04.2024 um 16:58 schrieb Alan Polinsky:

[...]
I need to understand the backward capabilities of more recent drives.


As a rule of thumb, LTO drives can write to one previous generation of 
tapes and read from two previous generations of tapes. (There are some 
exceptions for LTO8 and LTO9.)



How high could I go with LTO based
machines while still maintaining the ability to read (and hopefully
write) those old LTO2 tapes?


LTO2 tapes can be read by LTO2, LTO3 and LTO4 drives and written by LTO2 
and LTO3 drives.



HTH,

Sebastian



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users