[Bacula-users] Volume issues with 11.0.6 running in docker
I recently migrated my bacula director and storage daemon to version 11 and am running them in docker. Ever since, I have started getting occasional volume errors that can only be resolved by restarting the bacula-sd container or in some cases deleting and relabeling a volume. Thinks will run fine for a week or two (or more) and then start throwing errors. Has anyone else seen anything like this? These volumes are file volumes that live on my Synology and are mounted over NFS. Here’s a example of what I’m seeing: 07-Aug 06:10 morpheus-dir JobId 3671: shell command: run BeforeJob "/opt/bacula/etc/scripts/make_catalog_backup.pl MyCatalog" 07-Aug 06:11 morpheus-dir JobId 3671: Start Backup JobId 3671, Job=BackupCatalog.2023-08-07_06.10.00_18 07-Aug 06:11 morpheus-dir JobId 3671: Using Device "vDrive-03" to write. 07-Aug 06:11 morpheus-sd JobId 3671: Fatal error: block_util.c:478 Volume data error at 0:0! Wanted ID: "BB02", got "". Buffer discarded. 07-Aug 06:11 morpheus-fd JobId 3671: Fatal error: job.c:3012 Bad response from SD to Append Data command. Wanted 3000 OK data , got len=257 msg="3903 Error append data: Read label block failed: requested Volume "morpheus-0076" on File device "vDrive-03" (/srv/backup) is not a Bacula labeled Volume, because: ERR=block_util.c:478 Volume data error at 0:0! Wanted ID: "BB02", got "". Buffer discarded." 07-Aug 06:11 morpheus-dir JobId 3671: Error: Bacula morpheus-dir 11.0.6 (10Mar22): Build OS: x86_64-redhat-linux-gnu-bacula redhat (Core) JobId: 3671 Job: BackupCatalog.2023-08-07_06.10.00_18 Backup Level: Full Client: "morpheus-fd" 9.6.7 (10Dec20) x86_64-pc-linux-gnu,ubuntu,20.04 FileSet: "Catalog" 2022-08-07 06:10:00 Pool: "morpheus" (From Job resource) Catalog: "MyCatalog" (From Client resource) Storage: "File" (From Job resource) Scheduled time: 07-Aug-2023 06:10:00 Start time: 07-Aug-2023 06:11:39 End time: 07-Aug-2023 06:11:40 Elapsed time: 1 sec Priority: 10 FD Files Written: 0 SD Files Written: 0 FD Bytes Written: 0 (0 B) SD Bytes Written: 0 (0 B) Rate: 0.0 KB/s Software Compression: None Comm Line Compression: None Snapshot/VSS: no Encryption: no Accurate: no Volume name(s): Volume Session Id: 72 Volume Session Time: 1690744006 Last Volume Bytes: 1 (1 B) Non-fatal FD errors: 1 SD Errors: 1 FD termination status: Error SD termination status: Error Termination: *** Backup Error *** Dan Rich | http://www.employees.org/~drich/ | "Step up to red alert!" "Are you sure, sir? | It means changing the bulb in the sign..." | - Red Dwarf (BBC) signature.asc Description: Message signed with OpenPGP using AMPGpg ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] New bacula install
Did you drop the database and recreate it after you tried to create the tables with the root user? That sounds like there were already tables there when you ran that command, and it couldn’t recreate them because of the constraints on the existing tables. If you don’t have any data it in, I would drop and recrecreate the database; then run that script again. Dan Rich | http://www.employees.org/~drich/ | "Step up to red alert!" "Are you sure, sir? | It means changing the bulb in the sign..." | - Red Dwarf (BBC) On April 5, 2023 at 08:14:06, Andrew Meyer via Bacula-users (bacula-users@lists.sourceforge.net) wrote: I'm trying to set up bacula on AlmaLinux 8.7 w/ MariaDB 10.11 and getting the following error: $ sudo /usr/libexec/bacula/make_mysql_tables -u bacula -p Enter password: ERROR 1005 (HY000) at line 112: Can't create table `bacula`.`Job` (errno: 150 "Foreign key constraint is incorrectly formed") ERROR 1005 (HY000) at line 286: Can't create table `bacula`.`Pool` (errno: 150 "Foreign key constraint is incorrectly formed") Creation of Bacula MySQL tables succeeded. The error was much worse when I tried to run this as mysql root user. Can someone point me in the right direction to resolve this? ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users signature.asc Description: Message signed with OpenPGP using AMPGpg ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Cloud storage and bacula 11
Has anyone been able to use cloud storage reliably with Bacula 11? I am trying
to convert from using volumes on local disk to using minio as a cloud service
without much luck.
The odd thing is, it will work for a time. But if bacula-sd or bacula-dir
restarts, I end up in a state where the device status shows things like:
> Device Cloud (S3 Plugin): "cloudDrive-01" (/tmp/cloudDrive-01) is not open.
> Device is BLOCKED waiting for mount of volume "rpi-0002",
> Pool: rpi
> Media type: CloudType
> Drive 0 is not loaded.
and I don't see any obvious way to force it to mount the cloud storage into
that device node -- short of running s3fs to mount the volume as if I was doing
a restore. I would think that would not be needed since this mount request is
from a backup.
Restores are another problem, as I have yet to get one to work reliably with
cloud media. Maybe I just need to tune my settings a bit more, but doing a
mount of a volume with lots of small files via. s3fs is painful at best, and
doesn't work at all in the worst case. Having to mount that under a specifc
directory when I'm running bacula-sd in a docker container is even more
painful, since it requires reconfiguing and restarting bacula-sd any time I
want to restore something.
Here's a sample of my config (with passwords/hostnames obsfucated of course):
> Device {
> Name = cloudDrive-01
> Device Type = Cloud
> Media Type = CloudType
> Archive Device = /tmp/cloudDrive-01
> AutomaticMount = yes
> AlwaysOpen = no
> RemovableMedia = yes
> Label Media = yes
> Random Access = yes
> Autochanger = yes
> Maximum Part Size = 50MB
> Maximum File Size = 50MB
> Cloud = minio-nas
> }
> Autochanger {
> Name = CloudAutoChangerS3
> Changer Device = /dev/null
> Changer Command = ""
> Device = cloudDrive-01, cloudDrive-02, cloudDrive-03, cloudDrive-04
> }
> Cloud {
> Name = "minio-nas"
> Driver = S3
> HostName = "nas.xxx.com:9000"
> BucketName = "bacula"
> AccessKey = "bacula"
> SecretKey = "xx"
> Protocol = HTTP
> UriStyle = "Path"
> Truncate Cache = "AfterUpload"
> Upload = "EachPart"
> Region = us-xxx-1
> MaximumUploadBandwidth = 100MB/s
> }
>
Dan Rich
http://www.employees.org/~drich/
"Step up to red alert!" "Are you sure, sir?
It means changing the bulb in the sign..."
- Red Dwarf (BBC)
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Ubuntu 20.04, Bacula, and MariaDB
I asked a very similar question nearly 2 years ago (https://sourceforge.net/p/bacula/mailman/bacula-users/thread/4ef25e47-7fc9-49c9-9d8b-c8b73414c9a3@Spark/) — is there any hope of getting Debian packages for Bacula built with MariaDB in addition to MySQL? Virtually everything else I use is built with the MariaDB dependencies these days, and I can’t upgrade to Bacula 9.6 w/o building my own packages at this point. I was hoping to migrate from local disk to s3 storage, but that can’t happen w/o a newer version of bacula that what comes with Ubuntu. And even the debian.org packages are still mysql-only. Dan Rich http://www.employees.org/~drich/ "Step up to red alert!" "Are you sure, sir? It means changing the bulb in the sign..." - Red Dwarf (BBC) ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Deb packages for mariadb?
On Dec 17, 2020, 14:25 -0800, Sven Hartge , wrote: > On 17.12.20 22:49, Daniel Rich wrote: > > > The ones that come with Ubuntu 20.04 are nearly a year old (9.4.2) > > That is not something we Debian Developers can directly influence. But > you can take the Debian sources and rebuild them on a Ubuntu-System and > it will work. That is likely going to be what I end up doing. But again, they use different package names and layout from the bacula.org packages, so I have to convert my configs and scripts back to /etc/bacula instead of /opt/bacula as well as update my ansible cookbooks to use the Debian package names instead of the bacula.org package names. > > and don’t include mysql support as far as I can tell. I don’t really > > want to have to covert my configs back to the debian-supplied version > > since I’ve been running the bacula.org version for over a years. > > Nobody uses MySQL anymore, every distribution has converted over to > MariaDB by now. This will not go away. Except the packages that are built at bacula.org that still have mysql as dependencies. And that’s in the most recent packages for 9.6.6. This is what started me down the path of looking for the source package in the first place so I can build my own package for 9.6.6. The bacula-director package that comes with Ubuntu 20.04, doesn’t include any database support as far as I can tell other than possibly sqlite. I couldn’t even get it to start with the database configs I currently have. I have a vague memory that this is what had me convert over to the bacula.org packages from the OS provided ones a year or two ago. > > Since I’m building a new server, I’m considering moving to 11.0, but > > there aren’t packages for that yet, so I would still need the debian > > package files to build my own. > > I would hold back on 11 for a bit. The database transition from 9 to 11 > is a bit rocky at the moment. So far, the official word on 11 is "it is > a beta". > Hmm… I figured since it was actually announced those issues had been resolved... Dan Rich http://www.employees.org/~drich/ "Step up to red alert!" "Are you sure, sir? It means changing the bulb in the sign..." - Red Dwarf (BBC) ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Deb packages for mariadb?
The ones that come with Ubuntu 20.04 are nearly a year old (9.4.2) and don’t include mysql support as far as I can tell. I don’t really want to have to covert my configs back to the debian-supplied version since I’ve been running the bacula.org version for over a years. Since I’m building a new server, I’m considering moving to 11.0, but there aren’t packages for that yet, so I would still need the debian package files to build my own. Dan Rich http://www.employees.org/~drich/ "Step up to red alert!" "Are you sure, sir? It means changing the bulb in the sign..." - Red Dwarf (BBC) On Dec 16, 2020, 23:17 -0800, Sven Hartge , wrote: > On 17.12.20 07:22, Daniel Rich wrote: > > > Does anyone know where I can find the packaging files for bacula? I > > cloned the git repo, but while it has the source for building the > > software it doesn’t have any of the packaging files (i.e. the debian > > directory and assorted files). > > > > Since I can’t install the current binary packages without removing > > MariaDB and installing MySQL, it looks like building my own from source > > is the only way to go. And I really don’t want to have to run a manual > > install if I can build debian packages instead. > > > > Debian provides up-to-date Bacula packages working with MariaDB via > Buster-Backports. > > The only downside of those package is they don't support S3 and the > Docker-Plugin. > > Grüße, > Sven. > > > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Deb packages for mariadb?
Does anyone know where I can find the packaging files for bacula? I cloned the git repo, but while it has the source for building the software it doesn’t have any of the packaging files (i.e. the debian directory and assorted files). Since I can’t install the current binary packages without removing MariaDB and installing MySQL, it looks like building my own from source is the only way to go. And I really don’t want to have to run a manual install if I can build debian packages instead. Dan Rich http://www.employees.org/~drich/ "Step up to red alert!" "Are you sure, sir? It means changing the bulb in the sign..." - Red Dwarf (BBC) On Dec 9, 2020, 16:18 -0800, Daniel Rich , wrote: > Alternatives could be used to specify what database to use, but I don’t know > that it can override dependencies that are hard-coded into the package spec. > The only solutions I know of is for either bacula-mysql to not depend on the > mysql packages, or to have a separate bacula-mariadb with the dependencies on > the MariaDB packages. > > I may take a stab at building my own packages this evening so I can move my > server over to a new box that is running Ubuntu 20.04 and MariaDB. > > Dan Rich > http://www.employees.org/~drich/ > "Step up to red alert!" "Are you sure, sir? > It means changing the bulb in the sign..." > - Red Dwarf (BBC) > On Dec 9, 2020, 11:31 -0800, Phil Stracchino , wrote: > > On 12/9/20 1:58 PM, Daniel Rich wrote: > > > This might be a better question for bacula-devel, but are there plans to > > > provide MariaDB packages in addition to the existing MySQL packages? The > > > current bacula-mysql package fails to install on my Ubuntu 20.04 system > > > with MariaDB due to the embedded mysql dependencies. I was hoping that > > > there were some compatibility packages that would take care of this, but > > > I haven’t been able to track any down. > > > > > > The following packages have unmet dependencies: > > > bacula-mysql : Depends: mysql-client but it is not going to be installed > > > Depends: libmysqlclient20 (>= 5.7.11) but it is not > > > installable > > > > > > It seems to me like this is a problem that ought to be overcome by the > > Debian alternatives system. > > > > > > > > -- > > Phil Stracchino > > Babylon Communications > > ph...@caerllewys.net > > p...@co.ordinate.org > > Landline: +1.603.293.8485 > > Mobile: +1.603.998.6958 > > > > > > ___ > > Bacula-users mailing list > > Bacula-users@lists.sourceforge.net > > https://lists.sourceforge.net/lists/listinfo/bacula-users > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Deb packages for mariadb?
Alternatives could be used to specify what database to use, but I don’t know that it can override dependencies that are hard-coded into the package spec. The only solutions I know of is for either bacula-mysql to not depend on the mysql packages, or to have a separate bacula-mariadb with the dependencies on the MariaDB packages. I may take a stab at building my own packages this evening so I can move my server over to a new box that is running Ubuntu 20.04 and MariaDB. Dan Rich http://www.employees.org/~drich/ "Step up to red alert!" "Are you sure, sir? It means changing the bulb in the sign..." - Red Dwarf (BBC) On Dec 9, 2020, 11:31 -0800, Phil Stracchino , wrote: > On 12/9/20 1:58 PM, Daniel Rich wrote: > > This might be a better question for bacula-devel, but are there plans to > > provide MariaDB packages in addition to the existing MySQL packages? The > > current bacula-mysql package fails to install on my Ubuntu 20.04 system > > with MariaDB due to the embedded mysql dependencies. I was hoping that > > there were some compatibility packages that would take care of this, but > > I haven’t been able to track any down. > > > > The following packages have unmet dependencies: > > bacula-mysql : Depends: mysql-client but it is not going to be installed > > Depends: libmysqlclient20 (>= 5.7.11) but it is not > > installable > > > It seems to me like this is a problem that ought to be overcome by the > Debian alternatives system. > > > > -- > Phil Stracchino > Babylon Communications > ph...@caerllewys.net > p...@co.ordinate.org > Landline: +1.603.293.8485 > Mobile: +1.603.998.6958 > > > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Deb packages for mariadb?
This might be a better question for bacula-devel, but are there plans to provide MariaDB packages in addition to the existing MySQL packages? The current bacula-mysql package fails to install on my Ubuntu 20.04 system with MariaDB due to the embedded mysql dependencies. I was hoping that there were some compatibility packages that would take care of this, but I haven’t been able to track any down. The following packages have unmet dependencies: bacula-mysql : Depends: mysql-client but it is not going to be installed Depends: libmysqlclient20 (>= 5.7.11) but it is not installable Dan Rich http://www.employees.org/~drich/ "Step up to red alert!" "Are you sure, sir? It means changing the bulb in the sign..." - Red Dwarf (BBC) ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
