Re: [Bacula-users] Does anybody have a working Linux ISO that will allow me to restore from an offsite Bacula backup?
Hello Myles, > I commissioned our cloud server, installing our business services and then > securing with community edition Bacula system backup to an offsite Koofr > storage backend, via rclone. I was one of the first people to try Bacula + rclone integration techniques, but I don't recommend it anymore. While it works, it is a rather inefficient and riskier integration, and now there is a Bacula S3 plugin that allows direct bucket writing in both community (bacula.org packages) and enterprise editions: https://www.bacula.lat/enterprise-bacula-s3-swift-ceph-and-cloud-storage-driver-quick-guide/?lang=en > I then attempted to install element.io (as a potential Slack replacement for > our company) and all he** broke loose, the microk8s installer completely > decimated my NGINX configuration and all services stopped working. The > element.io "support" team declined to help me recover my system from an > installer that crashed halfway through, leaving the system in an unstable > state. I also heard a lot of good things from RocketChat: https://www.rocket.chat/ > Thus, I wish to restore the entire bare metal cloud server from a complete > Bacula backup I took just prior to doing this test install. After trying and failing to use more low-level manual means, I`m now pivoting and trying to adapt an existing Live Ubuntu ISO and install appropriate Bacula packages and storage backend linkages using CUBIC. I plan to test the ISO on local VirtualBox and ultimately bring it up in a virtual CDROM on my cloud server`s ASMB9-iKV. I then want the ISO to come up with all Bacula services primed and ready for a full system restore. Bacula Enterprise has a very good BareMetal plugin for both *nix and Windows systems. It is a very sophisticated solution however, that even allows dissimilar hardware restore, re-partitioning, among others. I don't think it is easily reproducible with open source solutions, such as Linux. I understood this is Kubernets container? If that's is the case, you might have what you need with a Kubernetes backup approach. https://bacula.org/13.0.x-manuals/en/main/Plugins.html If you want a Bare Metal from the full Kubernetes host, than a VM/Cloud image level backup via API might be more practical, maybe using bpipe. Of course, it depends of your VM/Cloud technology, Rgds. ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] LTO tape performances, again...
Hello Marco, > i have: > Maximum blocksize = 512K I usually don't like setting fixed block sizes, but letting Bacula determine. But Maximum Block Size = 1 MB or even a little bit more should be safe for LTO-9. https://www.bacula.lat/otimizando-a-velocidade-de-fitas/ https://www.bareos.com/whitepapers/optimizing-the-tape-speed.pdf You can use the btape speed test to verify the best values. The File Size also exerts a role in performance, a trade-off if I remember well between backup and restore speeds. Rgds. MSc,MBA Heitor Faria (Miami/USA) Bacula LATAM CIO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 bacula.lat | bacula.com.br ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Again LTO9 and performances...
Hello Marco, > Anyway, i'm hit another trouble. Seems that creating the spool file took an insane amount of time: source to backup are complex dirs, with millions of files. Filesystem is ZFS. Is the ZFS local? Does it have ZFS compression or dedup enabled? I wouldn't use those options for data spooling. You have to also consider the number of disks: https://arstechnica.com/gadgets/2020/05/zfs-versus-raid-eight-ironwolf-disks-two-filesystems-one-winner/ You can test Disks reading and writing capacity with hdparm, dd/iostat. https://www.bacula.lat/benchmarking-disks-reading-and-writing-capacity/?lang=en And network with iperf: https://www.bacula.lat/testing-bacula-machines-network-capacity-iperf/?lang=en I wouldn't also use Bacula compression software compression for tapes. > How can i do to improve the spooling performance? What factors impact more? Probably better network and better/more disks, such as Enterprise Grade NVMe/SSDs. Rgds. MSc,MBA Heitor Faria (Miami/USA) Bacula LATAM CIO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 bacula.lat | bacula.com.br ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] IBM TS3500 LTO7 ULT3580-TD7 Sense Key : Data Protect [current] Add. Sense: Operator selected write protect
Dear Bacula Users, I wonder if someone had faced a similar problem that have been haunting me for weeks and I found no exact similar case on the internet. This partitioned tape library with two drivers for the Bacula machine cannot perform a weof diretcly: [root@localhost Device]# mt -f /dev/tape/by-id/scsi-35005076044064c01-nst weof /dev/tape/by-id/scsi-35005076044064c01-nst: Input/output error mt: The tape is write-protected. And the dmesg displays the error: [Thu Apr 18 17:32:01 2024] st 14:0:0:0: [st0] Sense Key : Data Protect [current] [Thu Apr 18 17:32:01 2024] st 14:0:0:0: [st0] Add. Sense: Operator selected write protect However, if we do an eod before weof, it displays no error. [root@localhost Device]# mt -f /dev/tape/by-id/scsi-35005076044064c01-nst eod [root@localhost Device]# mt -f /dev/tape/by-id/scsi-35005076044064c01-nst weof But still, I cannot use the tape with Bacula, or test it with btape: [root@localhost Device]# /opt/bacula/bin/btape /dev/tape/by-id/scsi-35005076044064c01-nst Tape block granularity is 1024 bytes. btape: butil.c:296-0 Using device: "/dev/tape/by-id/scsi-35005076044064c01-nst" for writing. btape: btape.c:475-0 open device "Drive-0" (/dev/tape/by-id/scsi-35005076044064c01-nst): OK *label Enter Volume Name: test btape: block.c:301-0 [SE0201] Write error at 0:0 on device "Drive-0" (/dev/tape/by-id/scsi-35005076044064c01-nst) Vol=test. ERR=Input/output error. 18-Apr 17:39 btape JobId 0: Error: block.c:301 [SE0201] Write error at 0:0 on device "Drive-0" (/dev/tape/by-id/scsi-35005076044064c01-nst) Vol=test. ERR=Input/output error. And the same dmesg Data Protect message appears. The curious thing is we are able to write and restore some files using tar using the same drive, but only if we manually move the tape: [root@localhost Device]# tar cvf /dev/tape/by-id/scsi-35005076044064c01-nst /etc/resolv.conf tar: Removing leading `/' from member names /etc/resolv.conf [root@localhost Device]# tar tvf /dev/tape/by-id/scsi-35005076044064c01-nst tar: This does not look like a tar archive tar: Exiting with failure status due to previous errors [root@localhost Device]# mt -f /dev/tape/by-id/scsi-35005076044064c01-nst bsf 2 [root@localhost Device]# mt -f /dev/tape/by-id/scsi-35005076044064c01-nst fsf [root@localhost Device]# tar tvf /dev/tape/by-id/scsi-35005076044064c01-nst -rw-r--r-- root/root 74 2024-04-18 16:24 etc/resolv.conf mt status as follows: [root@localhost Device]# mt -f /dev/tape/by-id/scsi-35005076044064c01-nst status SCSI 2 tape drive: File number=20, block number=1, partition=0. Tape block size 0 bytes. Density code 0x5c (LTO-7). Soft error count since last status=0 General status bits on (101): ONLINE IM_REP_EN The tapes are new, LTO7 such as the drive, the red read-only physical tape switches are open, no encryption is used by the drivers. We already tried two different OSes with the same behavior. Ubuntu and Rocky Linux. There are no relevant tape library error logs. Any hints? Rgds. MSc,MBA Heitor Faria (Miami/USA) Bacula LATAM CIO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 bacula.lat | bacula.com.br ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Fix documentation on deduplication
Hello Roberto, This guide was written by me, and it is not part of the bacula.org project. That said, the step-by-step deployment was made using ddumbfs, despite the fact I briefly mention that ZFS could also be used. Rgds. MSc,MBA Heitor Faria (Miami/USA) Bacula LATAM CIO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 bacula.lat | bacula.com.br From: "Roberto Greiner" To: "bacula-users" Sent: Wednesday, April 17, 2024 9:06 AM Subject: [Bacula-users] Fix documentation on deduplication Hy, I've installed a bacula system using ZFS deduplication in an Ubuntu 22.4 server, and one thing that made me lose a lot of time is that there is an error in the documentation, more specifically on this page: https://www.bacula.lat/community/block-level-file-system-deduplication-with-aligned-volumes-tutorial-bacula-9-0-8-and-above/?lang=en The same page is available in Portuguese, with the same problem, in the following address: https://www.bacula.lat/community/dedup-alinhado/ The error is at the end of the page, where it says that you can see how much space is being used using 'df -h', but the problem is that df can't actually see the space gain from dedup, it shows how much would be used without dedup. After some search, I found in the chapter 1.7 of 'https://bacula.org/whitepapers/DedupVolumes.pdf' that the proper command for checking dedup usage in ZFS is 'zpool list', and that command did show that dedup was working properly. These are my outputs with the two commands: user@bacula2:~$ df -h Filesystem Size Used Avail Use% Mounted on tmpfs 788M 2,8M 786M 1% /run /dev/mapper/ubuntu--vg-ubuntu--lv 910G 52G 812G 6% / tmpfs 3,9G 0 3,9G 0% /dev/shm tmpfs 5,0M 0 5,0M 0% /run/lock /dev/sda2 2,0G 252M 1,6G 14% /boot zfs 6,4T 128K 6,4T 1% /zfs zfs/mnt 9,2T 2,9T 6,4T 31% /zfs/mnt tmpfs 788M 4,0K 788M 1% /run/user/0 tmpfs 788M 4,0K 788M 1% /run/user/1000 user@bacula2:~$ zpool list NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT zfs 7.27T 850G 6.44T - - 3% 11% 3.41x ONLINE - So, could someone please correct the two above mentioned pages? It would avoid others from having the same problem. Thank you, Roberto -- - Marcos Roberto Greiner Os otimistas acham que estamos no melhor dos mundos Os pessimistas tem medo de que isto seja verdade James Branch Cabell - ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Again vchanger and volumes in error...
Hello Bill, RDX has to working modes: disks and VTL. Many years ago I configured it as a VTL with Bacula, and it worked very well. For Disk mode, maybe configuring a Bacula Storage for each disk could be manageable. Or a crazier idea would be to create a CEPH cluster on the top of all disks. Rgds. Get BlueMail for Android On Mar 18, 2024, at 3:42 PM, Bill Arlofski via Bacula-userswrote: This is in response to Josh...In my experience, with RDX, the docking bay itself shows up as a device... (/dev/usbX or /dev/sdX, I forget)But plugging/unplugging an RDX cartridge does not notify the kernel in any way, so udev rules are not possible to do anything automatically with RDX.This was my experience about 8 or more years ago which is why I abandoned any attempts to use RDX with my own customers, and went with plain old removable eSATA drives, fully encrypted with LUKs, and auto-mounted with autofs.I'd love to know if something has changed in this regard in the past 8 years or so. :)___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Research] Tape-library udevadm info Drives Order identification
Hello Bill, I will explain the reasons for that research. RHEL 9 introduced new udev rules for tape devices creation (ID_SCSI_SERIAL): [root@ebacula rules.d]# grep -rnw tape /usr/lib/udev/rules.d/ /usr/lib/udev/rules.d/50-udev-default.rules:81:SUBSYSTEM=="scsi_generic|scsi_tape", SUBSYSTEMS=="scsi", ATTRS{type}=="1|8", GROUP="tape" /usr/lib/udev/rules.d/60-persistent-storage-tape.rules:3:# persistent storage links: /dev/tape/{by-id,by-path} /usr/lib/udev/rules.d/60-persistent-storage-tape.rules:10: SYMLINK+="tape/by-id/scsi-$env{ID_SERIAL} tape/by-id/scsi-$env{ID_SERIAL}-changer" /usr/lib/udev/rules.d/60-persistent-storage-tape.rules:15: SYMLINK+="tape/by-id/scsi-$env{ID_SCSI_SERIAL}" /usr/lib/udev/rules.d/60-persistent-storage-tape.rules:18: SYMLINK+="tape/by-path/$env{ID_PATH}-changer" /usr/lib/udev/rules.d/60-persistent-storage-tape.rules:26:KERNEL=="st*[0-9]", ENV{ID_SERIAL}=="?*", SYMLINK+="tape/by-id/$env{ID_BUS}-$env{ID_SERIAL}", OPTIONS+="link_priority=10" /usr/lib/udev/rules.d/60-persistent-storage-tape.rules:27:KERNEL=="st*[0-9]", ENV{ID_SCSI_SERIAL}=="?*", SYMLINK+="tape/by-id/$env{ID_BUS}-$env{ID_SCSI_SERIAL}" /usr/lib/udev/rules.d/60-persistent-storage-tape.rules:28:KERNEL=="nst*[0-9]", ENV{ID_SERIAL}=="?*", SYMLINK+="tape/by-id/$env{ID_BUS}-$env{ID_SERIAL}-nst" /usr/lib/udev/rules.d/60-persistent-storage-tape.rules:29:KERNEL=="nst*[0-9]", ENV{ID_SCSI_SERIAL}=="?*", SYMLINK+="tape/by-id/$env{ID_BUS}-$env{ID_SCSI_SERIAL}-nst" /usr/lib/udev/rules.d/60-persistent-storage-tape.rules:33:KERNEL=="st*[0-9]", ENV{ID_PATH}=="?*", SYMLINK+="tape/by-path/$env{ID_PATH}" /usr/lib/udev/rules.d/60-persistent-storage-tape.rules:34:KERNEL=="nst*[0-9]", ENV{ID_PATH}=="?*", SYMLINK+="tape/by-path/$env{ID_PATH}-nst" /usr/lib/udev/rules.d/61-scsi-sg3_id.rules:8:# This code used to live in 60-persistent-storage-tape.rules. It can be a extremely fast solution for a very old problem. I wonder if the links order will match the Drivers physical tape library order. In fact, what I need from the tape library users, is: The output from the command: "for i in $(ls /dev/tape/by-id/*); do udevadm info --name $i |tee; done" The output from the command: "ls -lah /dev/tape/by-id/*" The operating system version. Rgds. ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] [Research] Tape-library udevadm info Drives Order identification
Hello All, I'm doing a research on more automated ways of determining the Tape Library Drives' order identification from Linux standpoint. If you have a physical tape, would you please send me in private the following? The output of the command: "for i in $(ls /dev/tape/by-id/*); do udevadm info --name $i |tee; done" The operating system version. Rgds. MSc,MBA Heitor Faria (Miami/USA) Bacula LATAM CIO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 bacula.lat | bacula.com.br ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] BAT Installation
Morning Cupcake (Bill), "So, any volunteers? :)" I not only volunteer, but I would be willing to prospect and sponsor a Brazilian QT developer to work with this project, but we need to know how to start. I believe Git Lab is now the CBacula current developer platform: https://gitlab.bacula.org/bacula-community-edition/bacula-community So it is just a matter of creating a specialized team. Personally I prefer WhatsApp or Telegram groups for faster communication. Emails are for old people, and I just turned 40. =P One key aspect for me is the lack of documentation on Windows packages cross-compiling, which is (unfortunately) the most common BAT use case. Rgds. Get BlueMail for Android On Feb 2, 2024, at 12:44 PM, Bill Arlofski <w...@protonmail.com> wrote: On 2/2/24 08:53, Heitor Faria wrote: "*Having said that, years ago, I had customers that LOVE LOVE LOVED BAT, and would not move away from it even at my urging, so there is one reason, I guess. :)" Frankly, I never understood this community's urge to regularly create "one more Bacula GUI", instead of just fixing and improve the state-of-art. IMHO bacula.org <http://bacula.org> should adopt and sponsor BAT and Bacularis/Baculum GUIs development, get people together, integrate bacula-web features and organize this mess. Rgds.Hello Heitor!I can't say I disagree with this idea.Imagine a fully-functional BAT? Able to do configuration too? All the bugs fixed?So, any volunteers? :)Best regards,Bill___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] BAT Installation
Hello Howard, "On Feb 3, 2024, at 7:08 AM, computer...@familyhistoryact.org.au wrote: Hi,Thanks for all the responses, an interesting discussion.Bacularis would probably be a good solution for us except for the security concern. Allowing Apache access to the backup directory would mean all web apps would have access and that doesn't seem like a good idea on a multi-purpose server. We're not big enough to need, or afford, a dedicated backup server.Does anyone have a suggestion?I understand that many people think the command line is best, but we have limited skills and the GUI helps" First of all, if you are storing backups in the same production data machine this is not backup. IMHO you should try to build an integrated backup appliance with Bacula with a small or even used servers, to process and store tha backup, even if having to use SATA disks. NVMe is also surprisingly cheap nowadays. It is probably the most inexpensive, usual and relatively safer solution. Personally, I designed with my team and I'm selling many backup Appliances with Bacula Enterprise and our own operating system (BaculaOS), with more than 30 security enhancements, including IDS and CRC. AFAIK Apache is present in more than 90% of the most accessed Internet websites. It is pretty safe. Many proprietary applications use Apache for critical systems. Also, Bacularis does not access Bacula volumes directly (which is the most critical data). Bacularis only access catalog via API, wich is a security abstraction layer, and confs via bjson modules. Those are also very safe IMHO. If you are concerned with Apache security you can always use allow/deny lists, firewall rules and certificates to improve the security, among other techniques. Rgds. BlueMail for Andronid On Feb 3, 2024, at 7:08 AM, computer...@familyhistoryact.org.au wrote: Hi,Thanks for all the responses, an interesting discussion.Bacularis would probably be a good solution for us except for the security concern. Allowing Apache access to the backup directory would mean all web apps would have access and that doesn't seem like a good idea on a multi-purpose server. We're not big enough to need, or afford, a dedicated backup server.Does anyone have a suggestion?I understand that many people think the command line is best, but we have limited skills and the GUI helps with that.RegardsHoward ViccarsComputer ManagerFamily History ACTemail: computer...@familyhistoryact.org.auurl: familyhistoryact.org.au-Original Message-From: Bill Arlofski via Bacula-users Sent: Saturday, February 3, 2024 4:50 AMTo: bacula-users@lists.sourceforge.netSubject: Re: [Bacula-users] BAT InstallationOn 2/2/24 09:35, Phil Stracchino wrote: BAT still does everything I want a Bacula console to do. The things that it does NOT do, like configuration, I don't WANT it to; I want to do those myself, by hand, using a proper editor.Hi Phil!You sound like one of the customers of mine I mentioned. :) To be truthful, I detest the "Everything is a web page/application" model.I never liked this either. I will note that there are a few known bugs in BAT, notably that some purge operations can produce *multiple* simultaneous pop-up confirmation alerts that can be confusing.My experience with BAT over the many years I have been using Bacula has been... let's just say "poor", with BAT randomly just hanging for no apparent reason, requiring me to kill and restart it so often I just gave up.Of course this is my experience, on several platforms, over several versions in several of my customers' environments.I do everything from the command line and avoid Web GUIs at all costs - which does not say anything about the quality nor capabilities of them, just more about my abhorrence to Web GUIs in general. :)Best regards,Bill--Bill Arlofskiw...@protonmail.comBacula-users mailing listBacula-users@lists.sourceforge.nethttps://lists.sourceforge.net/lists/listinfo/bacula-users___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] BAT Installation
"*Having said that, years ago, I had customers that LOVE LOVE LOVED BAT, and would not move away from it even at my urging, so there is one reason, I guess. :)" Frankly, I never understood this community's urge to regularly create "one more Bacula GUI", instead of just fixing and improve the state-of-art. IMHO bacula.org should adopt and sponsor BAT and Bacularis/Baculum GUIs development, get people together, integrate bacula-web features and organize this mess. Rgds. Get BlueMail for Android On Feb 2, 2024, at 10:32 AM, Bill Arlofski via Bacula-userswrote: On 2/2/24 05:48, Rob Gerber wrote: As far as I know, BAT is available only with enterprise bacula.Hello Rob, (and Howard Viccars),BAT (Bacula Administration Tool) is a long-unmaintained QT graphical interface to 'manage' Bacula and is available in Community.I say 'manage' because BAT is more like BMT (Bacula Management Tool) since you cannot configure anything using BAT, you can only start, stop, monitor jobs and view information about your system (Clients, Jobs, Pools, Media, etc) just like with bconsole. :) I believe your choices with regard to bacula community are baculum, bacularis, and bacula-web. Bacularis is a friendly fork of baculum, and is the better maintained package. Developer is on this list. Bacula-web - I have not tested it, but I hear it provides good reporting, but no active control. Developer is on this list.All good information.And I would strongly urge to move away from BAT in favor of Bacularis (for example).Bacularis, unlike BAT allows you to configure every aspect of your Bacula environment, and as Rob mentioned, Marcin Haba, a Bacula Systems employee maintains it as an open-source and free tool, and he is quite active and helpful on this list. :)Bottom line: Abandon BAT. It has not received any love in a very long time, and quite frankly I am sure it will not. It did what it was designed to do, but now that we have some very powerful web gui administration tools, there is no reason not to abandon it.* (Just my two cents)*Having said that, years ago, I had customers that LOVE LOVE LOVED BAT, and would not move away from it even at my urging, so there is one reason, I guess. :)Best regards,Bill___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Backup of Postgres databases using FIFO Files
Hello Ismael, Please consider using bpipe: https://www.bacula.lat/using-bpipe-to-stream-dumps-vm-clones-and-another-data-to-your-backup/?lang=en It is a much more automated way of performing backups using tubes. You can also automate the restore. Examples from my book: PostgreSQL This method is very similar to the one used for MySQL. The only difference is, in order to automatically import the restored database into the PostgreSQL service, the dump must be generated in binary mode. Restoring to a file: Plugin = "bpipe:/fifo/anydb.sql:sudo -u postgres pg_dump heitorpg:dd of=/root/anydb.sql" Direct restore to PostgreSQL (different FIFO read and write commands): Plugin = "bpipe:/fifo/anydb.sql:sudo -u postgres pg_dump --format=c heitorpg:sudo -u postgres pg_restore -d template1 -C" Dynamic configuration script for granular backup of all databases (example)1: #!/bin/sh # Suggested name: \\|/etc/bacula/scripts/bpipe-pg-db # Set the postgres access command SUCMD="su - postgres -c" # Fetch existing databases names for dbname in `$SUCMD 'psql -d template1 -q -U postgres -t' <http://wiki.bacula.org/doku.php?id=application_specific_backups:postgresql You can also upgrade your Community Edition for the Enterprise one. It brings a PostgreSQL plugin with much more advanced and automated features, while being able to restore all your legacy backups. I can assist you with that if you send me a private email. Also please do not use GZIP compression over level 6. It will fry your clients CPU with marginal compression rate reduction gains. Rgds. MSc Heitor Faria (Miami/USA) Bacula LATAM CIO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 bacula.lat | bacula.com.br From: "Ismael Matos" To: "undefined" Sent: Saturday, January 13, 2024 5:07 PM Subject: [Bacula-users] Backup of Postgres databases using FIFO Files Dear all, One of my production Postgres databases is growing faster than anticipated and I'm exploring the use of FIFO files instead of writing the output of pg_dump to intermediate files within /tmp structure. Currently all jobs work fine while using the intermediate files. But when I test with the FIFO files, data is not pulled from the pipes. All files are properly located, but ZERO bytes get backed up. The pg_dump tasks are still running after the backup job completed successfully. Looks like the FIFO files have not been touched by bacula-fd after the script ended and the "readfifo=yes" option has not been honored. What am I missing? Is anyone using successfully the FIFO files with postgres databases able to share some tips? Many thanks in advance. Cheers, Ismael Here is the script used in the bacula clients: # Database Backups to temporary storage export DUMPDIR=/tmp/bacula_pgdatadump # make the redirections to null exec > /dev/null rm -f -r $DUMPDIR mkdir $DUMPDIR mkdir $DUMPDIR/backups mkdir $DUMPDIR/logs pg_dumpall -g -v -f $DUMPDIR/backups/dumpallGlobal.bkp 2>$DUMPDIR/logs/dumpallGlobal.log for dbname in `psql -d template1 -q -t <$DUMPDIR/logs/$dbname.log & done # ends output redirection exit Here is the relevant section of the bacula-dir.conf file in the server: ... Fileset { Name = FullSet Include { File = /etc File = /home File = /opt File = /root File = /tmp/bacula_pgdatadump File = /usr/local/sbin File = /usr/sbin File = /usr/share File = /var ExcludeDirContaining = .baculaexclude Options { Compression = Gzip9 Signature = Md5 readfifo=yes } } Exclude { File = /var/cache ...___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] fd lose connection
Hello Lionel, On 11/7/23 19:26, Lionel PLASSE wrote: > I’m sorry but no wi-fi nor 5G in our factory, and don't use my phone too to > backup my servers :) . > I was talking about ssh (scp) transfer just to Just to show out I have no > problem when uploading big continuous data using other tools through this > wan. The wan connection is quite stable. > > "So it is fine when the NIC is up. Since this is Windows," > no windows. I discarder windows problem hypothesis by using a migration job, > so from linux sd to linux sd "OK. I see that now. You also tried without compression and without encryption. Have you tried reducing Maximum Network Buffer Size back to the default 32768? There must be some reason why the client seems to be sending 30 bytes more than its Maximum Network Buffer Size. Bacula first tries the Maximum Network Buffer Size, but if the OS does not accept that size, then it adjusts the value down until the OS accepts it. Maybe the actual buffer size gets calculated differently on Debian 12? Why is the send size exceeding the buffer size? Or could there be a typo in the Maximum Network Buffer Size setting on one side?" In addition to the Josh considerations, I would consider trying BBR: https://www.bacula.lat/bacula-e-prototoclo-bbr-para-backups-via-internet-perdas-de-pacote-desconecoes-etc/?lang=en I have a mixed OnP+cloud customer +1000 machines situations, where this was the only solution for the network interruptions. The BBR is not only more resilient to transmission contingencies (NATs, firewall drops, switches/router resets etc.), but also provides much faster throughput recovery in case of failure. Underlying VPN is also something that, by my experience, are prone to disconnections that have huge impact on Linux default congestion protocol. Rgds.___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Copy backups to more than one storage
Hello All, > I am using PoolUncopiedJobs with a RunAfterJob which executes a script > when the job successfully finishes. The script inserts the job ID of > a copied job into a table created specifically for that purpose. > The original job ID can be passed to a shell script using "%I". > > This requires additional admin job that starts jobs that will perform > a copy using the list of job IDs from the table. > Those copy jobs also use RunAfterJob calling a shell script that > removes a job ID from the table in case the copy job finished > successfully. This is the Selection Pattern I use: # # Copies all jobs never copied which can be used for more than one destination pool SELECT public.job.jobid FROM public.pool INNER JOIN public.job ON public.pool.poolid=public.job.poolid WHERE public.pool.name='' AND Job.jobBytes > 0 AND public.job.jobid NOT IN (SELECT public.job.priorjobid FROM public.pool INNER JOIN public.job ON public.pool.poolid=public.job.poolid WHERE public.pool.name=''); # Rgds. -- MSc Heitor Faria (Miami/USA) Bacula LATAM CIO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ][ http://www.bacula.com.br/ ] [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Backup without files records
Hello Ana,IMHO the direcrive description is innacurate.When there is no File table information, the user is still able to use the restore command to restore the whole Job contents.This is easy to reproduce pruning only the File table information.Rgds.--MSc Heitor Faria (Miami/USA)CIO Bacula LatAmmobile1: + 1 909 655-8971mobile2: + 55 61 98268-4220[ http://bacula.lat/]Get BlueMail for Android On Jan 12, 2023, 3:08 PM, at 3:08 PM, "Ana Emília M. Arruda" wrote:Bacula-users mailing listBacula-users@lists.sourceforge.nethttps://lists.sourceforge.net/lists/listinfo/bacula-users___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Backup without files records
Hello Yateen,Try the Pool resource directive "Store Files in Catalog = yes|no".It is a feature from the Bacula Enterprise Edition. Not sure if ported to the Community 11 or 13 versions.Regards,--MSc Heitor Faria (Miami/USA)CIO Bacula LatAmmobile1: + 1 909 655-8971mobile2: + 55 61 98268-4220[ http://bacula.lat/]Get BlueMail for Android On Jan 7, 2023, 9:43 AM, at 9:43 AM, "Yateen Shaligram Bhagat (Nokia)" wrote:Bacula-users mailing listBacula-users@lists.sourceforge.nethttps://lists.sourceforge.net/lists/listinfo/bacula-users___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Backup Catalog
Hello All, Please just use bpipe: Plugin = "bpipe:/opt/bacula/working/bacula.sql:sudo -i -u postgres pg_dump --format=c bacula:sudo -i -u postgres pg_restore -d template1 -C" #or Plugin = "bpipe:/opt/bacula/working/bacula.sql:sudo -u postgres pg_dump bacula:dd of=/tmp/bacula.sql" Rgds. > From: "Sebastian Neumeier" > To: "bacula-users" > Sent: Wednesday, October 19, 2022 6:58:55 AM > Subject: Re: [Bacula-users] Backup Catalog > Hi Gina :) > I didn't test it wether it might be the problem. But can it be that you > mistaken > the paths? > The error says: "cannot create /opt/ bacula/working /bacula.sql". > You wrote that you gave all users privilleges to "/opt/ bacula/scripts/". That > is a different directory. > I'm no cyber security expert but as far what I read, giving all users > privileges > to a really important file is a bad idea. > If I remember correctly giving that directory to the bacula user and giving > privleges to the bacula user should be sufficient. > If you can trust all users in the "www-data" group I would at least remove the > write privilege of "others". It should look like this: > rwxrwxr-x. > Like I said, I'm not a trained system adminstrator. Giving read and execute > permissions to "others" and the "www-data" group also might be a bad idea in > that case, so please take the advice with a huge grain of salt. > (I'm a mechanical engineering/computational science and engineering studend > running bacula for my home system and documents). > Best regards > Sebastian > Am 19-Oct-2022 12:17:57 +0200 schrieb gina.co...@uc.pt: >> Hi. >> I’m using bacula 11, that has a default job “Backup Catalog” to make backup >> of >> Bacula Catalog (database). >> When I run the job I get the following message: >> shell command: run BeforeJob "/opt/bacula/scripts/make_catalog_backup.pl >> MyCatalog" >> BeforeJob: sh: 1: cannot create /opt/bacula/working/bacula.sql: Permission >> denied >> The directory /opt/bacula/scripts/ is configured with this privileges: >> drwxrwxrwx 3 bacula www-data 4096 Oct 19 11:02 working >> Anyone can help me >> Thanks >> Gina Costa >> Universidade de Coimbra • Administração >> SGSIIC-Serviço de Gestão de Sistemas e Infraestruturas de Informação e >> Comunicação >> Divisão de Infraestruturas de TIC >> Rua do Arco da Traição | 3000-056 COIMBRA • PORTUGAL >> Tel.: +351 239 242 870 >> [ mailto:gina.co...@uc.pt | E-mail: gina.co...@uc.pt ] >> [ http://www.uc.pt/administracao | www.uc.pt/administracao ] >> Este e-mail pretende ser amigo do ambiente. Pondere antes de o imprimir! >> This e-mail is environment friendly. Please think twice before printing it! > FreeMail powered by [ https://mail.de/ | mail.de ] - mehr Sicherheit, > Seriosität > und Komfort > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users -- MSc Heitor Faria (Miami/USA) Bacula LATAM CIO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ][ http://www.bacula.com.br/ ] [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Prune all volumes
Hello Chris, Whats your Bacula version? I have an environment with the exact same problem. The "prune expired volume yes" and "purge action=truncate ..." commands find zero volumes to purge. BTW: a command or a sqlquery example to fetch the amount of media jobs would be great. Regards, -- MSc Heitor Faria (Miami/USA) CIO Bacula LatAm mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ http://bacula.lat/] Original Message From: Chris Wilkinson Sent: Monday, September 26, 2022 05:21 AM To: bacula-users Subject: [Bacula-users] Prune all volumes >After a series of failed backups I am left with a number of volumes not >used by any job but still within their expiry time. They exist on disk and >in the database but no job is using them. I would like to delete them first >in the database and then truncate the physical volumes to recover the space. > >I need the prune command for this but it seems I have to specify the >volume. Is there a prune option that will cycle through and prune all >volumes? > >Regards > >Chris Wilkinson > > >___ >Bacula-users mailing list >Bacula-users@lists.sourceforge.net >https://lists.sourceforge.net/lists/listinfo/bacula-users ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Different copy jobs and in which pool to be the target
I believe it does, but this is very easy to confirm. You can validate the Bacula daemons configurations syntax and directives with the e.g. bacula-dir -t Rgds. -- MSc Heitor Faria (Miami/USA) CIO Bacula LatAm mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ http://bacula.lat/]___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Question about scratch pool
> Still unsupported... Sorry. You are right. It is not needed for scalability purposes, but one Director can have many different Catalogs as desired. > -- > MSc Heitor Faria (Miami/USA) > CIO Bacula LatAm > mobile1: + 1 909 655-8971 > mobile2: + 55 61 98268-4220 > [ http://bacula.lat/] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Question about scratch pool
Still unsupported... -- MSc Heitor Faria (Miami/USA) CIO Bacula LatAm mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ http://bacula.lat/]___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Question about scratch pool
Egoitz, The Scratch pool is a hardcoded reserved name. "Maybe" you will be luckier setting a "ScratchPool" for each one of the Production pools. Anyway: you are doing "gambiarra" (Brazilian Portuguese). Bacula has its own means of providing multitenancy via ACLs, Pools, users etc. Two Directors using the same catalog is not supported, according to Kern. However, using (e.g.) a Pgsql cluster is supported for HA. Rgds. -- MSc Heitor Faria (Miami/USA) CIO Bacula LatAm mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ http://bacula.lat/]___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula client with several policies retention
>> Hi everyone! Hello, >> Does anyone know if is it possible to configure a bacula client with >> different policies retention? >> >> For example.. 5 years for logs files and 3 months for the rest files. As long as they are two different jobs with different FileSets writing to two different backup pools (e.g. 5 years, 3 months), yes. You could use a "hack" to use the Client's resource File/Job Retention, which is having two Client entries (just different names), for the connection to the same remote Bacula Client. Then you could have a single Pool and granular volume recycling if using "MaximumVolumeJobs=1". Regards, -- MSc Heitor Faria (Miami/USA) Bacula LATAM CIO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ][ http://www.bacula.com.br/ ] [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] restore jobs
Hello Enzo, You only really need one generic Restore job as a code requirement. Practically, it basically serves to provide the default "where=" parameter default value. All the other restore parameters are dinamically generated by the restore command. Regards, -- MSc Heitor Faria (Miami/USA) CIO Bacula LatAm mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ http://bacula.lat/]___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] IRC channel on freenode
Hello Justin, > As expressed, it is a personal decision. > I want to limit the amount of chat apps I install and use. > Technical security is not about my social security number (in fact no system > can > protect your information from being ready by any 3rd party, if you put it into > any publicly accessible group, no matter how technically secure it might be), I respect your opinion, but our mobile phones already have enough bloatware for the FANGs to snoop information and to play Pavlov's Dogs experiments with us. I can't idulge myself in this way because I gotta be where my consumer is. Nevertheless: "there are cases where Signal can be less private and less safe [than Telegram] depending on your definition – for example Signal requires use a phone number for connection with other users, which can have significant physical safety risks for many people who are targeted by stalkers. Telegram for example allows the use of a username instead which can be significantly safer for many people." > but that`s a different can of worms and I guess off topic for this mailing > list. I don't think this is off-topic at all, since we are discussing other ways of user's community communication. And frankly speaking: email is extremely dated and prone to unreliability. Regards, -- MSc Heitor Faria (Miami/USA) Bacula LATAM CIO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ][ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] IRC channel on freenode
> What a pity, I don’t do Telegram by personal decision. If war-wise: UFC didn't ban Volkov that fought today in London under the Russian flag. ATP, Miami Open, Indian-Wells didn't ban Medvedev. It is not like you are financing Sukhois or whatever. I'm sure Ukraine could survive with or without you. If security wise: it is a technical group. It is not like you are going to enter your social security number (if American) or any sensitive information. Regards, -- MSc Heitor Faria (Miami/USA) Bacula LATAM CIO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ][ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] IRC channel on freenode
> Awesome, to what IRC network is the English Telegram group bridged and what is > the IRC channel name for it? We used to have a bridge in the past to the main group. I belive Dan Langille was the most active admin. But the IRC group was kind of dead like you also observed, and I think we just gave up maitaining the bridge. Regards, -- MSc Heitor Faria (Miami/USA) Bacula LATAM CIO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ][ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to remove all volumes?
Hello Justin, > Or asked differently: Is it possible to declare all volumes as expired without > having to execute a command for each existing volume individually? (something > like “set all volumes to expired”)? You can use the purge command to recycle the desired volumes prematurely. Rgds. -- MSc Heitor Faria (Miami/USA) Bacula LATAM CIO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] IRC channel on freenode
We have a 60 ppl English group in Tg: https://t.me/baculabackup 30 in Spanish: https://t.me/baculaes 1300 in Portuguese: https://t.me/baculabr Rgds -- MSc Heitor Faria (Miami/USA) CIO Bacula LatAm mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ http://bacula.lat/]___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to remove all volumes?
> Dear all, Hello Justin, > I need to use a different disk drive for Bacula and I would like to start over > in the sense of deleting all volume files in a clean way, i.e. not corrupting > the catalog. The goal is to free up the space occupied by all Bacula volumes. Normally one user does not really need to free the volume space until the VolumeRetention is expired and the Volume is demanded by a new backup, but I understand some users might want to have better control of the current real necessary backup disk occupation to fulfill configured retentions. Please refer to my small post: https://www.bacula.lat/truncate-bacula-volumes-to-free-disk-space/?lang=en > All the best, Regards, > JC > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users -- MSc Heitor Faria (Miami/USA) Bacula LATAM CIO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Q: about default volume numbering in pools
Hello Justin, > Naively I was assuming the autolabeling would start with 0001 for each > different > pool name prefix, however, it does not seem to work like that. If no variable is set, Bacula appends such number, which is based on the MediaId value. If you want to number the volumes according to the Pool amount, look into the Bacula's ${NumVols} variable. Regards, -- MSc Heitor Faria (Miami/USA) Bacula LATAM CIO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] newbie questions
> Hello fellow users, Hello Justin, > I will only use disk storage and S3 buckets, I do not own any tape drives. > > There are up to 10 FDs (Linux and macOS), one of the SDs runs on the same > machine as the Director and the SD which is going to write to the disks and to > the S3 bucket(s). The remote S3 bucket will also be implemented by myself > using > minIO. Bacula can work with minIO, but you don't need. Bacula S3 Driver can write to any S3 compatible cloud. > The Linux FD running on the same host as the Dir and SD is going to have jobs > for: > -onsite SMB shares for Synology servers in a DMZ, so that I do not need to run > an FD in the DMZ which would need to reach into my LAN. > -diverse non-Bacula backups form diverse systems, such as ESXi ghettoVCB, > macOS > TimeMachine, onsite minIO S3 buckets used by Synology DSM HyperBackup GhetoVCB is a very well-intentioned, but extremely poor solution to perform VSphere VM backups in terms of performance and features. If you want a 100% open source solution, I would migrate to Proxmox. > Each backup job is intended to create 3 redundant “copies” (not meaning the > Copy > concept of Bacula) for safety reasons: > - Tier 1 (fastest): 1 to n internal SATA hard disk drives (ideally no manual > intervention when individual disks 1,.., n-1 fill up) > - Tier 2 (medium speed): 1 to m external USB hard disk drives (ideally no > manual intervention when individual disks 1,.., n-1 fill up) > - Tier 3 (slowest): 1 or more offsite S3 buckets implemented using minIO > Docker > container on Synology DSM I would use one Cloud Storage with the CacheRetention directive for tiers 1 and 3. External USB (ew!) can be a Bacula Copy Job or a completely different redundant Job with its own Full and partials chain (e.g. Job1-cloud; Job1-usb). > As I have the luxury of more than 1 drive per tier, I would like to > understand, > if it is possible to define a pool on top of more than one disk device (e.g. > using AutoChanger with disk devices instead of tape devices?), so that first > one device is used and if it is full, further volumes are automatically > written > to the next disk device (without the need for manual intervention). As for disks, I would just use LVM or any sort of RAID to present Bacula. More practical. Rgds. -- MSc Heitor Faria (Miami/USA) Bacula LATAM CIO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Tape library problem
> The baculi documentation discourages the use of LabelMedia = yes with > libraries > [ https://www.bacula.org/11.0.x-manuals/en/main/Basic_Volume_Management.html | > https://www.bacula.org/11.0.x-manuals/en/main/Basic_Volume_Management.html ] And I never undestood why... Rgds. -- MSc Heitor Faria (Miami/USA) Bacula LATAM CIO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Backup Error with "SD despooling Attributes"
Hello Sergio, > /dev/mapper/bacula01--vg-root 30G 27G 1,3G 96% / > /dev/sdb1 236M 158M 67M 71% /boot > /dev/sda1 1,8T 1,3T 483G 73% /backup/external > The backup it takes a lot of time, AFAIK despooling attributes, what could be > the cause of this error? I believe there is a strong chance your root partitions is getting full during the backup. 1,3G is too low, specially if you use the bacula default Catalog backup script to generate a dump during the backup. Rgds. -- MSc Heitor Faria (Miami/USA) Bacula LATAM CIO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Cloud Storage Alternatives to AWS
Hello Chris, > I have SD pointing to a local mount point mounted by rclone mount... so gdrive > just appears as a directory, same as any disk. So I'm not sure what you mean > by > Cloud resource? Nevermind. I thought you are using the Bacula S3 Cloud Driver. Mounted object storages are really slow. That's why you have the Driver etc. > Best > Chris Rgds. -- MSc Heitor Faria (Miami/USA) Bacula LATAM CIO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Cloud Storage Alternatives to AWS
Hello Chris, > I got 'rclone mount..’ working to mount GDrive as a local mount. A 1GB test > backup took 2h:41m (109kb/s), so not a great result. The server running > SD/FD/DIR is on a 1Gbe connection to a 300/50 FTTP line so Google seems to be > the bandwidth limiter here. > However I did not find a Bacula directive ‘MaximumConcurrentUploads’. It is supposed to be in the bacula-sd.conf Cloud resource, mas it is possible that it was not ported to CBacula yet. However, I think it is also possible to change that value in the awscli configuration file. > Best > -Chris- Rgds. -- MSc Heitor Faria (Miami/USA) Bacula LATAM CIO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula for QNAP?
> I did consider completely wiping the thing and installing either Gentoo > Linux or Solaris x86. But I hesitate to do that on a brand new unit > still under warranty. "Warranty does not apply, if the warranty period is expired, the warranty label is broken or removed, the serial number label is missing or unrecognizable, the product has been modified or repaired by any unauthorized service center or personnel, the defect was subject to abuse, improper use not conforming to product manual instructions, or environment conditions more severe than those specified in the manual and specification. the defect was subject to Force Majeure, such as acts of God, flood, lightning, earthquake, war, vandalism, theft, brownouts or sags (damage due to low voltage disturbances)". Ref.: <https://www.qnap.com/en-in/support/con_show.php?cid=7> Also, on <https://download.qnap.com/Storage/TechnicalDocument/Storage/Enterprise%20NAS/ts-hx86/ts-hx86-ug-05-en-us.pdf> page 44: "You can revert to QuTS hero operating system anytime. For details, see QuTS hero user guide." So... Is it kind of optional? There is a Telegram TrueNAS user group with more than 700 users. I would definitely install TrueNAS over the Hero OS. Rgds. -- MSc Heitor Faria (Miami/USA) Bacula LATAM CIO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula for QNAP?
>> (I note that the ENTIRE REASON this problem arises in the first place is >> because QNAP sees fit to ship the device with a fully ... well, MOSTLY >> functional Linux OS *with no system compiler installed*.) > > So do all the other brands I ever saw :( > > If you know a NAS (not as expensive as a proper server) who provides its > compiler, I'd be interested in knowing the brand/model. These providers do that because they think it would be very hard or even impossible to give support to a NAS with an OS that the user can freely modify. Therefore, you could try TrueNAS <https://www.truenas.com/>, which is based on FreeBSD, or build your own (e.g.) <https://www.servethehome.com/buyers-guides/top-hardware-components-for-truenas-core-servers/>. There are a lot of recipes also on YouTube. You can usually also erase proprietary NAS' OS and install TrueNAS. But returning to the main thread, I still think the best solution for Phil's situation would be to use a NAS built-in virtualization capabilities. I hope he has success anyways. Rgds. -- MSc Heitor Faria (Miami/USA) Bacula LATAM CIO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Wild card expansion
You should use the WildDir FileSet Options sub-resource directive, together with the Exclude one. Rgds. -- MSc Heitor Faria (Miami/USA) CIO Bacula LatAm mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ http://bacula.lat/] Original Message From: Richard Couture Sent: Sunday, January 2, 2022 08:11 PM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] Wild card expansion >Greetings and happy 2022 to all > >In my filesets.conf I have a bunch of includes and excludes like > >File = "/var/spool/samba/netdrive/ASA/Ventas/Curriculum/2012" >File = "/var/spool/samba/netdrive/ASA/Ventas/Curriculum/2013" >File = "/var/spool/samba/netdrive/ASA/Ventas/Curriculum/2014" >File = "/var/spool/samba/netdrive/ASA/Ventas/Competencia/2012" >File = "/var/spool/samba/netdrive/ASA/Ventas/Competencia/2013" >File = "/var/spool/samba/netdrive/ASA/Ventas/Competencia/2014" >File = "/var/spool/samba/netdrive/ASA/Ventas/Competencia/2015" > >Can I write >File = "/var/spool/samba/netdrive/ASA/Ventas/Curriculum/201[234] >File = "/var/spool/samba/netdrive/ASA/Ventas/Competencia/201[2345] > >or some such > >Also in the includes can I write > >File = "/var/spool/samba/netdrive/home/*/Historical >instead of listing each and every one?? > >Thanks > > >Richard > >-- >LinuxCabal Asociación Civil >Ing. Richard Couture >Novell CNE, ECNE, MCNE >HP/Compaq ASE >Tel.: (+52) (333) 145-2638 >Cel.: (+52) (044) 333 377-7505 >Web: http://www.LinuxCabal.org >E-Mail: r...@linuxcabal.org >Hosted en la nube Cloud Sigma - www.CloudSigma.com > >AVISO DE CONFIDENCIALIDAD: Este correo electrónico, incluyendo en su >caso, los archivos adjuntos al mismo, pueden contener información de >carácter confidencial y/o privilegiada, y se envían a la atención única >y exclusivamente de la persona y/o entidad a quien va dirigido. La >copia, revisión, uso, revelación y/o distribución de dicha información >confidencial sin la autorización por escrito de LinuxCabal está >prohibida. Si usted no es el destinatario a quien se dirige el presente >correo, favor de contactar al remitente respondiendo al presente correo >y eliminar el correo original incluyendo sus archivos, así como >cualesquiera copia del mismo. Mediante la recepción del presente correo >usted reconoce y acepta que en caso de incumplimiento de su parte y/o de >sus representantes a los términos antes mencionados, LinuxCabal tendrá >derecho a los daños y perjuicios que esto le cause. > > > >___ >Bacula-users mailing list >Bacula-users@lists.sourceforge.net >https://lists.sourceforge.net/lists/listinfo/bacula-users ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula for QNAP?
Hello Phil, >>> (a) trying to figure out how to get a Bacula sd and fd installed on it >> >> The happiest days of my life were after I got dedicated equipment for home >> network modem, routing, and wireless mesh accessing points. >> That said, I never understood this very common user fetish of installing >> Bacula >> components in the NAS. OK: you avoid one more network node but the hardware >> is >> not designed to handle the extra workload. > > > Because when the backup scheme is disk to disk to removable disk, the > transfer rate going directly across the backplane is much higher than I > can get across a gigabit network. > > Also, I don't want to burn the power to run another node that > functionally does nothing but run a storage daemon. > > Extra workload on the NAS isn't an issue. It has 32GB RAM and eight > Xeon D-1622 cores. But then, even you you manage to build the SD you will probably be stuck with the same Bacula version forever. I guess you haven't disclosed this specific NAS model, but you might consider using a VM in the QuTS Hero "Virtual Machine Sation" solution. Ref.: <https://www.qnap.com/en/product/ts-h886> Then the OS is not a problem anymore. > -- > Phil Stracchino > Babylon Communications > ph...@caerllewys.net > p...@co.ordinate.org > Landline: +1.603.293.8485 >Mobile: +1.603.998.6958 Rgds. -- MSc Heitor Faria (Miami/USA) Bacula LATAM CIO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula for QNAP?
Hello Phil, > (a) trying to figure out how to get a Bacula sd and fd installed on it The happiest days of my life were after I got dedicated equipment for home network modem, routing, and wireless mesh accessing points. That said, I never understood this very common user fetish of installing Bacula components in the NAS. OK: you avoid one more network node but the hardware is not designed to handle the extra workload. Just backup the exported disk volumes with regular bacula-fds where they are mounted, preferrably with the ACL support. If you want to write backups to the NAS, NFS or iSCSI if supported. > -- > Phil Stracchino > Babylon Communications > ph...@caerllewys.net > p...@co.ordinate.org > Landline: +1.603.293.8485 > Mobile: +1.603.998.6958 Rgds, -- MSc Heitor Faria (Miami/USA) Bacula LATAM CIO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Cloud Storage Alternatives to AWS
Hello Chris, > I've seen several users have implemented AWS for backup storage. Whilst > looking > at other options, I came across Expandrive ( [ > https://www.expandrive.com/server/ | https://www.expandrive.com/server/ ] ). > This appears to be a wrapper around multiple cloud storage suppliers such as > Dropbox, Google Drive and others that can't be used directly as mounted > drives. > I wanted to ask the list if anyone has implemented this and what their > experience has been. > On the face of it, it seems attractive at approx $15/m for 5Tb backend storage > plus the Expandrive $25/y single user subscription and allowing to retire a > bank of local drives. Granted this would not work for someone on standard > broadband but fibre should be fine. > Regards > Chris Wilkinson This is not a new technique. The Linux fuse library has been able to mount S3 buckets for a long time right now. Rclone can also do the same stuff you are proposing (GDrive, Dropbox) for free. They all should work with Bacula, but I don't think they are an optimal solution for an array of reasons. I deployed a few environments with the Bacula S3 Cloud Driver (https://www.bacula.lat/enterprise-bacula-s3-swift-ceph-and-cloud-storage-driver-quick-guide/?lang=en) and Wasabi, which does not charge per egress data and charges only 5.99 USD per TB/m. The driver is available with the [ http://www.bacula.org/ | www.bacula.org ] installation packages. For some reason, however, I could only achieve about 2 MB/s maximum upload transfer rate per part. Then I had to use a greater number of MaximumConcurrentUploads (and Downloads) - e.g. 20. Eventually I was able to reach speeds close to 40 MB/s, that were suitable for the workload. Rgds. -- MSc Heitor Faria (Miami/USA) Bacula LATAM CIO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] "Airgapping" USB drives used for backup?
> Hi! Hello Anders, > I was pondering this as a lower-cost alternative to tape and wondering if this > is possible? It all depends on your workload. For several TBs, 70 USD per LTO plus the autoloader (Tandberg on Amazon US for 800 USD) can easily be cheaper than a bunch of disks. > Have a few USB drives that were connected through an USB Multiplexer (not hub) > so that the drives were > rotated every weekday. One USB Drive per day. > > The rotation would be handled completely independent from the backup system in > such a way that changeover > happens when bacups are not running. > > How would Bacula handle this? I assume the SD would not mind, but what about > the > database? Is it written > completely to disk on every backup? There is a very new, exciting feature in the Bacula Enterprise called Storage Group. It provides fail-over and load-balancing to the Bacula Storages. Maybe you could create one Storage for each USB device, and let Bacula handle the distribution automagically. But I didn't test that yet. It's also necessary to verify if this feature will be able for the 13.x community version. > -- > Med vänlig hälsning > > Anders Gustafsson, ingenjör > anders.gustafs...@pedago.fi | Support +358 18 12060 | Direkt +358 9 315 45 > 121 | Mobil +358 40506 7099 Rgds. -- MSc Heitor Faria (Miami/USA) Bacula LATAM CIO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Distributed Bacula daemons
Hello Yateen, > Note : I complied the bacula-server source code for FreeBSD. I wanted to have > an > option to compile only bacula-SD. But looks like there is no such option. Yes. There is a configure option for that: "--enable-build-dird This option causes the make process to build the Director and the Director's tools. By default, this option is on, but you may turn it off by using --disable-build-dird to prevent the Director from being built." Ref.: <http://blog.bacula.org/doku.php?id=bacula_manual:installing_bacula#enable-build-dird> > Regards, > Yateen Regards, -- MSc Heitor Faria (Miami/USA) Bacula LATAM CIO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Distributed Bacula daemons
Hello Yateen, > We need to host bacula-dir, bacula-sd and PostgreSQL on different servers, > what > is an efficient architecture amongst the two options given below: >1. Hosting bacula-dir and PostgreSQL together on one host, bacula-sd on > another > host >2. Hosting bacula-dir on one host, bacula-sd and PostgreSQL together on > another > host IMHO one should only spam machines if required by the sizing (https://www.bacula.lat/bacula-sizing/?lang=en), or for network optimization (e.g. a SD closer to the FDs in a remote network). A SD is sufficient to backup about 400 machines. Other than that you will use more resources and have a larger surface of possible vulnrerabilities (the oposite of the hardening technique). But again, it is just my opinion. If you still need to make this splti I would go for option "A. Hosting bacula-dir and PostgreSQL together on one host, bacula-sd on another host", because it will be more pratical to manage the database creation and configuration, one less network service and a little bit safer. Director and DB also require different types of machines resources. > Thanks, Regards, > Yateen Bhagat -- MSc Heitor Faria (Miami/USA) Bacula LATAM CIO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Documentation MaximumVolumes Inaccuracy Bacula Manual 11
90 Last Volume Bytes: 685,469 (685.4 KB) Non-fatal FD errors:0 SD Errors: 0 FD termination status: OK SD termination status: OK Termination:Backup OK | ++ +---+-+-+--+---+--+--+---+ | jobid | name| starttime | type | level | jobfiles | jobbytes | jobstatus | +---+-+-+--+---+--+--+---+ | 9,561 | BaculaConfs | 2021-12-17 13:03:30 | B| I |3 | 683,842 | T | +---+-+-----+------+---+--+--+---+ > __Martin Perhaps that documentation line should explicity citate the PurgeOldestVolume directive. Regards, -- MSc Heitor Faria (Miami/USA) Bacula LATAM CIO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Why isn't bacula recycling these volumes?
Hello Large, > I'll send to bacula-devel. > (FTR: I'm a Site Reliability Engineer for a LARGE travel company by day, > and have been in > IT for >40 years in support/ops). Such a large company chooses to not pay for a backup supported software and to reply on the community? IMHO it tells me how serious this company is. =) Regards, -- MSc Heitor Faria (Miami/USA) Bacula LATAM CIO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Why isn't bacula recycling these volumes?
Hello Larry, > I set all the volretentions to zero in the Database. > > I'd love some direction from dev or someone else. > > I'd also be willing to give access. I'm not sure if you understand how GPL licensing works, but it is a software that comes with no support or warranties. What I mean, is all people here provided answers to your problem voluntarely using their free time. BTW: I'm pretty sure my diagnostic is right. Also, I strongly recommend you to have a test environment to deploy features before putting them into production, and to not perform manual Catalog SQL updates. That said, this is an user group. If you want the developers feedback you should address your message to: "bacula-devel" . Regards, -- MSc Heitor Faria (Miami/USA) Bacula LATAM CEO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Why isn't bacula recycling these volumes?
Hello Larry, > That was called out in the 11 release notes as letting the JOB > retentions > determine volume retentions. > > Did I misread something? That was new with 11. I wasn't aware of this new feature. Thanks for pointing out. Most likely, your problem now is that these volumes were created and purged with old Bacula Bacula versions that didn't have this feature. An easy workaround is just to disable or delete these volumes, or just start a new Pool that aims to use this new feature. Regards, -- MSc Heitor Faria (Miami/USA) Bacula LATAM CEO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Why isn't bacula recycling these volumes?
Hello Larry, Your jobs do not show the need for a new volume. However, your configuration does not look good: "Pool { Name = Default Pool Type = Backup Recycle = yes # Bacula can automatically recycle Volumes AutoPrune = yes # Prune expired volumes *Volume Retention = 0* LabelFormat="LERCTR-" #Use Volume Once = yes #Maximum Volume Jobs = 4 Maximum Volume Bytes=100GB Volume Use Duration = 12h Action On Purge = Truncate Recycle Oldest Volume = no }" Its unusual to have a VolumeRetention=0, in fact I believe Bacula could even understand it as infinite. It should mess the Bacula recycling algortithm. Regards, -- MSc Heitor Faria (Miami/USA) Bacula LATAM CEO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Why isn't bacula recycling these volumes?
Hello Larry, > I can re-send all my configs if needed, as well as give access to the > server. Please show your configurations, and also a full job log where a new volume is created. Regards, -- MSc Heitor Faria (Miami/USA) Bacula LATAM CEO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Documentation MaximumVolumes Inaccuracy Bacula Manual 11
| jobstatus | +---+-+-+--+---+--+--+---+ | 9,558 | BaculaConfs | 2021-12-17 09:59:18 | B | I | 20 | 752,748 | T | +---+-+-+--+---+--+--+-------+ Regards, -- MSc Heitor Faria (Miami/USA) Bacula LATAM CEO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Why isn't bacula recycling these volumes?
Hello all, "If there is no maximum volumes set, Bacula will continue to create new volumes in favor of using existing volumes, even if they are pruned/purged. (at least this is how it is documented and how it is taught in Bacula Systems' Admin I course)" I would have to perform a lab, but this doesn't look accurate at all. I performed dozens with installations with pools with no MV set, and Bacula algo prefers to write to an append or recycled tape, if existent. The only practical application mor MV (IMHO) is to limit a condition when Bacula enters in a bad loop and keeps trying to create an infinite number of volumes, but I guess this was corrected in newer versions. Regards, -- MSc Heitor Faria (Miami/USA) CIO Bacula LatAm mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ http://bacula.lat/]___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] META: Repeated posts
Hello Gary, > I don't know if this is down to Sourceforge or the OP, but every ten > minutes my filters catch a duplicate delivery of Bill Arlofski's message > with the Message ID: . Not me. I use an aaS Zimbra hosted in Deutschland and administrated by a friend in Brazil: https://www.kyahosting.com/ (@anahuac on Telegram), and I can't see anything weird on the https://spfbl.net/en/ filter. Regards, -- MSc Heitor Faria (Miami/USA) Bacula LATAM CEO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Packet size too big (NOT a version mismatch)
Hello They, Are all the NICs using the same MTU? Have you checked for network layer problems? I have no clue regarding your error, but I would try to limit the packet size with the following FD directive: Maximum Network Buffer Size = Rgds. -- MSc Heitor Faria (Miami/USA) CEO Bacula LatAm mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 América Latina [ http://bacula.lat/]___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Slow transfer rate - MS Win 2019
Just in time: <https://techcommunity.microsoft.com/t5/ask-the-directory-services-team/top-10-common-causes-of-slow-replication-with-dfsr/ba-p/394905>. Rgds. -- MSc Heitor Faria (Miami/USA) CEO Bacula LatAm mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 América Latina [ http://bacula.lat/]___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Slow transfer rate - MS Win 2019
Hello Andras, I would use an external tool such as diskspd or any other to validate the DFS directory reading speed. E.g. <https://www.windowscentral.com/how-test-hard-drive-performance-diskspd-windows-10?amp>. IMHO Clustered Filesystems will hardly have the same speed of regular ones. Hadoop has even a special command (distcp) to copy data from several nodes. The best way of finding a performance bottleneck is the scientific. You gotta test each one of the involved components, including client disk reading, network capacity and actual negotiation (even faulty cable can matters). VSS snapshot also can impact, as mentioned before. Atte. -- MSc Heitor Faria (Miami/USA) CEO Bacula LatAm mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 América Latina [ http://bacula.lat/]___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Slow transfer rate - MS Win 2019
Hello Andras, "I forgot to mention that I am trying to backup a folder which is DFS synchronized. I do not know if it matters or not. " It should matter. Please benchmark the Windows DFS directory read speed (copy from) to a local disk. Atte. -- MSc Heitor Faria (Miami/USA) CEO Bacula LatAm mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 América Latina [ http://bacula.lat/]___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] dynamic fileset and /usr/global
Hello Bill, "Currently, it is "working as designed, but not as I expect it to"™ :)" IMHO the FileSet script hack should not work after the BeforeJob RubScript. I don't think it isnt even possible to make such a Bacula code change without a lot of effort. It is specifically that characteristic that allows (e.g.) dynamic FileSet's contents generation. Regards, -- MSc Heitor Faria (Miami/USA) CEO Bacula LatAm mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 América Latina [ http://bacula.lat/] Original Message From: Bill Arlofski via Bacula-users Sent: Tuesday, November 2, 2021 12:41 PM To: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] dynamic fileset and /usr/global >On 11/1/21 21:57, Shaligram Bhagat, Yateen (Nokia - IN/Bangalore) wrote: >> Hi, >> >> We are using Bacula 9.4.4 on Centos. >> >> We use dynamic fileset using a script executed on the client. Also there is >> a clientRunBeforeJob script. >> >> But we found that the dynamic fileset script is executed first and then the >> clientRunBeforeJob script. >> >> We need to have it the other way round. >> >> How to accomplish it ? >> >> -Yateen >> > >Hello Yateen, > >This is something I have noticed and have raised an internal ticket with the >Bacula Systems developers to ask this very same >question a few weeks back. > >Currently, it is "working as designed, but not as I expect it to"™ :) > > >Best regards, >Bill > >-- >Bill Arlofski >w...@protonmail.com > > > >___ >Bacula-users mailing list >Bacula-users@lists.sourceforge.net >https://lists.sourceforge.net/lists/listinfo/bacula-users ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restore to cifs-mounted share fails to restore timestamps
Hello Uwe, Yes, you are right. But they are all metadata... "After spending a day, in vain, on this, I'll just post results of my testing below. In short, using a CIFS share from Linux or Mac is wildly inconsistent regarding unix permissions and more importantly file and directory timestamps." Ref.: <https://www.truenas.com/community/threads/smb-cifs-windows-share-permissions-and-timestamps.38494/>. From the Bacula side, I would study the FileSet ACL Support option. Rgds. -- MSc Heitor Faria (Miami/USA) CEO Bacula LatAm mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 América Latina [ http://bacula.lat/]___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restore to cifs-mounted share fails to restore timestamps
Hello Uwe, I read somewhere that CIFS' ACLs are not supported from a Linux mount point. Maybe is that the cause of your problem? Regards, -- MSc Heitor Faria (Miami/USA) CEO Bacula LatAm mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 América Latina [ http://bacula.lat/]___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] dynamic fileset and /usr/global
Hello, Maybe your FileSet script can call a second script at the end? Or you can have a second FileSet script? Regards, -- MSc Heitor Faria (Miami/USA) CEO Bacula LatAm mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 América Latina [ http://bacula.lat/]___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Slow transfer rate - MS Win 2019
"1. The windows 2019 server has the default Virus and Threat protection settings no 3rd party virus scanner is deployed on the server. Can you recommend what to check? How to exclude bacula-fd?" Consult your AV provider to find out. "2. This would be a bigger project in our case but sure I will consider this... " The 11.x version (odd) from bacula.org is also open source. Do not confuse with the Bacula Enterprise Edition (even) versions. Rgds. -- MSc Heitor Faria (Miami/USA) CEO Bacula LatAm mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 América Latina [ http://bacula.lat/] Original Message From: Andras Horvai Sent: Monday, November 1, 2021 04:40 PM To: bacula-users Subject: Re: [Bacula-users] Slow transfer rate - MS Win 2019 >Hello Heitor, > >How much is very slow? i think on a 1 Gigabit/s connection around 100 >Mbit/s is slow considering that the network test between sd and the client >gives 925.6 Mbit/s - 977.6 Mbtit/s result >(I used bacula to test it) The problem is that when it comes to real >backup it drops to around 100 Mbit/s. >1. The windows 2019 server has the default Virus and Threat protection >settings no 3rd party virus scanner is deployed on the server. Can you >recommend what to check? How to exclude bacula-fd? >2. This would be a bigger project in our case but sure I will consider >this... >3. Well this is something I can take into account as well > > >Thanks, > >Andras > > > >On Sun, Oct 31, 2021 at 1:47 PM Heitor Faria wrote: > >> Hello Andras, >> >> How much is very low? >> Bacula only displays the transfer rate after the sw compression reduction, >> what IMHO is very misleading since it is a "higher-the better" value. Worst >> decision ever. >> You gotta divide the ReadBytes by the Job Duration to have the processed >> data rate. >> Anyway: >> >> 1. Please check for Windows AV presence and put the bacula-fd as an >> exception. Try again. >> 2. Update Bacula to the latest 11.0.5 packages from bacula.org, which has >> a few improvements. >> 3. Ultimately, you can manually split the FileSet in the Bacula Community >> edition to paralelize the workload and eventually achieve a better >> performance, specially for Windows different volumes. >> >> Rgds. >> -- >> MSc Heitor Faria (Miami/USA) >> CEO Bacula LatAm >> mobile1: + 1 909 655-8971 >> mobile2: + 55 61 98268-4220 >> >> América Latina >> [ http://bacula.lat/] >> > > >___ >Bacula-users mailing list >Bacula-users@lists.sourceforge.net >https://lists.sourceforge.net/lists/listinfo/bacula-users ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Slow transfer rate - MS Win 2019
Hello Andras, How much is very low? Bacula only displays the transfer rate after the sw compression reduction, what IMHO is very misleading since it is a "higher-the better" value. Worst decision ever. You gotta divide the ReadBytes by the Job Duration to have the processed data rate. Anyway: 1. Please check for Windows AV presence and put the bacula-fd as an exception. Try again. 2. Update Bacula to the latest 11.0.5 packages from bacula.org, which has a few improvements. 3. Ultimately, you can manually split the FileSet in the Bacula Community edition to paralelize the workload and eventually achieve a better performance, specially for Windows different volumes. Rgds. -- MSc Heitor Faria (Miami/USA) CEO Bacula LatAm mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 América Latina [ http://bacula.lat/]___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] /etc/init.d/bacula-director file NOT STARTING
Hello, Please try: chown -R bacula /opt/bacula And try again. If it doesn't start, run the SD and Dir with sudo -u bacula and -d 200 options to see any error messages. Atte. -- MSc Heitor Faria (Miami/USA) CEO Bacula LatAm mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 América Latina [ http://bacula.lat/]___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Need Linux installation help (was: n00b installation problem)
Hello Davin, Thanks, but I don't think I need a book about usage. I just need to get the software downloaded. Sorry, I made a mistake. I was supposed to thanks Sebastian, no you. Good luck* with your problem. Regards, -- MSc Heitor Faria (Miami/USA) Bacula LATAM CEO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Need Linux installation help (was: n00b installation problem)
Hello Davin, > Thanks, but I don't think I need a book about usage. I just need to get the > software downloaded. Sorry, I made a mistake. I was supposed to thanks Sebastian, no you. Good lucky with your problem. Regards, -- MSc Heitor Faria (Miami/USA) Bacula LATAM CEO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Need Linux installation help (was: n00b installation problem)
Hello Davin, >> If you want to get more familiar with bacula I can suggest the book: "Bacula: >> The Open Source Backup Software (English Edition), by Heitor Faria and >> Melissa >> Faria , paperbackISBN-13 : 978-1520105178, ebookASIN:B01MG7U5M4 . >> The book is really good and was for me the starting point I needed to >> understand >> how it works and to become able to work with the official documentation. Thanks for the mention, but no one should buy currently the paperback edition (only the Kindle one, that can be always updated). The current version is outdated and the person who translated did a lot of mistakes. I'm personally reviewing and updating the English edition these days. I will post in this forum as soon as finished. Rgds. -- MSc Heitor Faria (Miami/USA) Bacula LATAM CEO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula-sd can't upload to AWS S3
Hello Otaci, IMHO your scenario is kind of confusing. 1. Your service init file is using the root Linux user. Like I wrote before, not recommendable: "[Service] Type=simple User=root" 2. You are using /tmp as cache/volume storage, what is absolutely not recommendable. Regards, ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula-sd can't upload to AWS S3
Otaci, "sudo /opt/bacula/bin/bacula-sd -fP -c /opt/bacula/etc/bacula-sd.conf" Please run the SD with the Linux always bacula user. Debug mode should give you more information. E.g. "sudo -u bacula bacula-sd -d 200" Rgds. -- MSc Heitor Faria (Miami/USA) CEO Bacula LatAm mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 América Latina [ http://bacula.lat/]___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula-sd can't upload to AWS S3
Hello Otaci, If you click in the error URL it will point you what's is wrong. I believe you are using the wrong service AWS endpoint address: "This XML file does not appear to have any style information associated with it. The document tree is shown below. PermanentRedirect The bucket you are attempting to access must be addressed using the specified endpoint. Please send all future requests to this endpoint. s3.amazonaws.com mybucket KMXXEQJBMJVK965E z7u4pxRSwCHji+wl1sNqDAeDVvc3AHo6RqVbC7Ur5XvexPnCyhg0bfeNbqzDUjepYdYKt3iuGwE= " Rgds. -- MSc Heitor Faria (Miami/USA) CEO Bacula LatAm mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 América Latina [ http://bacula.lat/]___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to force bextract to use whatever volume is present?
> Hello. Hello Sean, > I have an old tape from which I need to try to restore files on a new > Debian system. I'm trying to use bextract -V* but it keeps complaining > that the tape appears unlabeled. I was previously able to get bls -V* to > work and it listed a bunch of files (before the drive hung and I had to > power cycle the computer,) but now that also complains of an unlabeled > volume. AFAIK it is not possible to use wildcards to match volume names. > The tape was previously used in an autochanger which used the bar code > labels on the tape for volume labels, but this drive is apparently not > seeing those. You must be able to see the volume name with the "mtx -f /dev/xxx status" command. If you can't see the volume label, likely your tape was erased, written by another software or you have a media/drive problem. > Is there any other way to tell or force bextract to just work on > whatever volume is currently loaded? -p has no effect That is not the -p function. Regards -- MSc Heitor Faria (Miami/USA) Bacula LATAM CEO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] STORAGE DEVICES
> Hello, Heitor. Hello Rodrigo, > “Just use the storage as cache, then you don't need to copy anything to > nowhere. > BTW: the directive name is CacheRetention.” > I need cloud backup, network storage and external disks. > So, I wanted to automate this process, is it possible to do it through bacula? Yes, I already said that. It is just a matter to set up the CacheRetention directive to a time duration that fits your needs and don't fill the whole disk. > Or I disable truncate and copy the data to my destination (Storage and > External > Disks) via a script outside bacula. You don't need that. The Cloud Driver purpose is to optimally upload data to the cloud Object Storage. Regards, -- MSc Heitor Faria (Miami/USA) Bacula LATAM CEO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] STORAGE DEVICES
"I need the backup on local network for a while, and these copies on another storage are automatically. If I set the option "TruncateCache" to "No", I can create a script to copy the volume files to another storage, this is an solution, but I wanted to do this inside bacula to be able to have a catalog." Just use the storage as cache, then you don't need to copy anything to nowhere. BTW: the directive name is CacheRetention. Rgds -- MSc Heitor Faria (Miami/USA) CEO Bacula LatAm mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 América Latina [ http://bacula.lat/]___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] STORAGE DEVICES
IMHO the Bacula Cloud Storage runs more efficiently as single Bacula Storage for this scenario, where you just use the "TruncateRetention" option to retain your local NAS stored cache for the desired time frame. More practical. Regards, -- MSc Heitor Faria (Miami/USA) CEO Bacula LatAm mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 América Latina [ http://bacula.lat/]___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Overlapping scheduled jobs
> Hi, greetings everyone. Hello Marcos, > I searched for this subject in other posts in this list, but I didn't > find something that was similar, so I decided to post my question. > Is there any way to prevent jobs scheduled on a certain day from > overlapping jobs that were previously scheduled and are still in the > execution queue, even if the priority number of new jobs is lower? > On Friday the FULL backups are started, and often the differential > backup that starts on Saturday is merged with the one on Friday. > Grateful for any help. Please refer to Allow Duplicate Jobs = and next directives: https://www.bacula.org/11.0.x-manuals/en/main/Configuring_Director.html#SECTION002120 Our company provides Bacula Community training, deployment and support, specially for the government and under the elicitation dismissal price, if you need a more professional support to your environment. > Márcio > Prefeitura Municipal de Indaiatuba > Telefone: (19) 3834-9000 > Site: http://www.indaiatuba.sp.gov.br/ Atte. -- MSc Heitor Faria (Miami/USA) Bacula LATAM CEO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Encrypted restore fails with openssl errors
> Greetings, Bacula User Types! Long time no see! Hello Robert! > Because I am in the throes of doing many dangerous maintenance tasks on my > server, I took the liberty of testing a few restores of critical files. I was > unsurprised to find that they all failed. > aten-sd JobId 3746: Ready to read from volume "Vol0160" on File device > "FileStorage" (/backup). > aten-sd JobId 3746: Forward spacing Volume "Vol0160" to addr=7999614780 > aten-sd JobId 3746: Elapsed time=00:00:01, Transfer rate=2.608 K Bytes/second > aten-fd JobId 3746: Error: openssl.c:68 Encryption session provided an invalid > symmetric key: ERR=error:0407109F:rsa > routines:RSA_padding_check_PKCS1_type_2:pkcs decoding error > aten-fd JobId 3746: Error: openssl.c:68 Encryption session provided an invalid > symmetric key: ERR=error:04065072:rsa > routines:rsa_ossl_private_decrypt:padding > check failed > aten-fd JobId 3746: Error: openssl.c:68 Encryption session provided an invalid > symmetric key: ERR=error:0607A082:digital envelope > routines:EVP_CIPHER_CTX_set_key_length:invalid key length > aten-fd JobId 3746: Error: restore.c:764 Failed to initialize decryption > context > for /tmp/restore/etc/bind/bind.keys > Now, the configuration docs say nothing about me needing to modify config, as > long as I have not lost keys, zorched the whole system, etc. This guy had the same error: <https://stackoverflow.com/questions/39228128/cant-decrypt-rsa-data-with-open-ssl> > The troubleshooting docs, I must remark, are wafer-thin compared to the > complexity of this enterprise software application. I did a simple Ctrl-F > "crypt" and found no mention at all, not even [ > https://www.bacula.org/9.6.x-manuals/en/problems/Testing_Your_Tape_Drive_Wit.html#SECTION00431000 > | in this section ] ... > I cranked up verbosity and debugging on bacula-dir The encryption tasks are performed by the bacula-fd. > and ran it in the foreground as prescribed, but there is no extra logging > anywhere that I can find (since Bacula refuses to conform to the FHS > Filesystem > Hierarchy Standard, and I had old versions from Ubuntu's repos, Bacula and its > disused detritus is spreadeagled all over my filesystem like a drunken > octopus.) I don't think Bacula directory setup is related to your problem. > So I must throw myself upon the mercy of the community to debug this. Thanks. We like you, but the openssl community might be more qualified to answer your question. Regards, -- MSc Heitor Faria (Miami/USA) Bacula LATAM CEO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Migrating file volumes between MediaTypes
Hello Robert, > Anyway, I have scoured Baculum and Bconsole and not found any way to modify > MediaType. Would a direct SQL query be necessary? What shape would that take? AFAIK a SQL query is necessary to update the volumes MediaType. Alternatively, you can always use a copy or migrate job, to move data to new correct MediaType values. Regards, -- MSc Heitor Faria (Miami/USA) Bacula LATAM CEO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Cloud Backup + upload command segfault. traps: bacula-sd[39055] general protection ip:7f5589651499 sp:7f555f5ed260 error:0 in libbacsd-11.0.5.so[7f5589618000+69000]
Hello Users, I wonder if someone can confirm this segfault that I found in CentOS Linux release 7.9.2009 (Core), bacula.org 11.0.5 packages. The steps to reproduce it, are: 1. Run a significant Full, or in my case Base level backup, using the Bacula S3 Plugin. 2. Run a bconsole cloud upload command during the backup execution. My example: Joblog <http://dontpad.com/joblog_segfault> Admin upload command: "cloud upload allpools allfrompool storage=Wasabi-Marpa" Cloud bacula-sd.conf resource: ### Cloud { Name = "Wasabi-Marpa" Driver = "S3" HostName = "s3.wasabisys.com" BucketName = "" Region = "us-east-1" AccessKey = "" SecretKey = "" TruncateCache = "AfterUpload" Upload = "EachPart" } ### Segfault message: [Sex Jul 23 06:11:41 2021] traps: bacula-sd[39055] general protection ip:7f5589651499 sp:7f555f5ed260 error:0 in libbacsd-11.0.5.so[7f5589618000+69000] The bacula-sd obviously crashes after the segfault. I know I can use Priority=12 in the Admin Job as a workaround. Let me also know if it is worthy of a Mantis bug report. Regards, -- MSc Heitor Faria (Miami/USA) Bacula LATAM CEO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula scripts not found during Bacula 11.0.2 install.
> Hi, Hello Pierre, > I am installing Bacula 11.0.2 on Oracle Linux 8.4. I downloaded the CentOS > manual install script from this link: [ > https://www.bacula.lat/community/bacula-community-9-x-official-packages-installation-script/?lang=en > | > https://www.bacula.lat/community/bacula-community-9-x-official-packages-installation-script/?lang=en > ] > I changed the script on the MySQL section to: > … > # Install MySQL > rpm --import /tmp/RPM-GPG-KEY-mysql > wget -c [ > https://dev.mysql.com/get/mysql80-community-release-el8-1.noarch.rpm | > https://dev.mysql.com/get/mysql80-community-release-el8-1.noarch.rpm ] -O > /tmp/mysql80-community-release-el8-1.noarch.rpm > rpm -ivh /tmp/mysql80-community-release-el8-1.noarch.rpm > dnf install -y @mysql:8.0 > mysqld --initialize-insecure --user=mysql > systemctl enable mysqld > systemctl start mysqld > dnf install -y bacula-mysql --skip-broken > # Create the database of Bacula data with MySQL > /opt/bacula/scripts/create_mysql_database > /opt/bacula/scripts/make_mysql_tables > /opt/bacula/scripts/grant_mysql_privileges > … > However, I get the following error message: > ./bacula_manual_install.sh: line 81: > /opt/bacula/scripts/create_mysql_database: > The file or directory does not exist > ./bacula_manual_install.sh: line 83: /opt/bacula/scripts/make_mysql_tables: > The > file or directory does not exist > ./bacula_manual_install.sh: line 85: > /opt/bacula/scripts/grant_mysql_privileges: > The file or directory does not exist > Any ideas what might be wrong? Did you check the script output? Most likely the packages installation from bacula.org repo failed. You can verify that with a "rpm -qa |grep bacula" Shell command. > Regards, Regards. > Pierre V. -- MSc Heitor Faria (Miami/USA) Bacula LATAM CEO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] S3 cloud plugin does not load on FreeBSD 13.0
Hello All, >> The error in bacula-sd I am getting is the following: >> > my-sd: init_dev.c:488-0 Driver=cloud entry point=800d4fe60 >> > my-sd: cloud_dev.c:876-0 Open SD driver at >> > /usr/local/lib/bacula-sd-cloud-s3-driver-11.0.5.so >> > my-sd: cloud_dev.c:879-0 Driver=s3 handle=800d19408 >> > my-sd: cloud_dev.c:881-0 Lookup "BaculaCloudDriver" in driver=s3 >> > my-sd: cloud_dev.c:883-0 Driver=s3 entry point=0 >> > my-sd: cloud_dev.c:889-0 Lookup of symbol "BaculaCloudDriver" >> > driver=/usr/local/lib/bacula-sd-cloud-s3-driver-11.0.5.so failed: >> > ERR=Undefined symbol "BaculaCloudDriver" > This line above ... >> > my-sd: message.c:1831-0 cloud_dev.c:1001 Could not open Cloud driver >> > type=1 for Device=CloudStorage. >> > my-sd: message.c:1831-0 cloud_dev.c:1032 Cloud driver initialization >> > error Cloud driver not properly loaded >> > my-sd: htable.c:67-0 malloc buf=801c71ae8 size=100 rem=76 >> > my-sd: init_dev.c:235-0 init_dev allocated: 801c1cc28 >> > my-sd: init_dev.c:437-0 init_dev: tape=0 >> > dev_name=/backup/backupdisk1/bacula-storage >> > my-sd: dev.c:1143-0 DEVICE::register_metrics called. 0x801c1cc28 >> > collector=0x80101c938 >> > my-sd: stored.c:706-0 SD init done CloudStorage (0x801c1cc28) >> I comppiled the cloud-driver and the cloud-s3-driver with the following >> commands: >> > $ /usr/ports/sysutils/bacula11-server/work/bacula-11.0.5/src/stored >> > > make install-cloud >> > LT Compiling cloud_parts.c >> > LT Compiling cloud_transfer_mgr.c >> > LT Compiling cloud_dev.c >> > cloud_dev.c:1818:17: warning: address of array 'tpkt->m_hash64' will >> > always evaluate to 'true' [-Wpointer-bool-conversion] >> > if (tpkt->m_hash64) { >> > ~~ ~~^~~~ >> > 1 warning generated. >> > LT Compiling file_driver.c >> > /usr/ports/sysutils/bacula11-server/work/bacula-11.0.5/libtool >> > --silent --tag=CXX --mode=link /usr/bin/c++ -L/usr/local/lib >> > -L/usr/local/lib -L/usr/local/lib -fstack-protector-strong -shared >> > cloud_parts.lo cloud_transfer_mgr.lo cloud_dev.lo file_driver.lo -o >> > bacula-sd-cloud-driver.la -R /usr/local/lib -rpath /usr/local/lib >> > -module -export-dynamic -release 11.0.5 >> > /usr/ports/sysutils/bacula11-server/work/bacula-11.0.5/autoconf/mkinstalldirs >> > /usr/local/lib >> > /usr/ports/sysutils/bacula11-server/work/bacula-11.0.5/libtool >> > --silent --tag=CXX --mode=install /usr/bin/install -c -m 755 >> > bacula-sd-cloud-driver.la /usr/local/lib >> > /bin/rm -f /usr/local/lib/bacula-sd-cloud-driver.la >> > $ /usr/ports/sysutils/bacula11-server/work/bacula-11.0.5/src/stored >> > > make install-s3-cloud >> > /usr/ports/sysutils/bacula11-server/work/bacula-11.0.5/autoconf/mkinstalldirs >> > /usr/local/lib >> > /usr/ports/sysutils/bacula11-server/work/bacula-11.0.5/libtool >> > --silent --tag=CXX --mode=install /usr/bin/install -c -m 755 >> > bacula-sd-cloud-driver.la /usr/local/lib >> > /bin/rm -f /usr/local/lib/bacula-sd-cloud-driver.la >> > LT Compiling s3_driver.c >> > /usr/ports/sysutils/bacula11-server/work/bacula-11.0.5/libtool >> > --silent --tag=CXX --mode=link /usr/bin/c++ -L/usr/local/lib >> > -L/usr/local/lib -L/usr/local/lib -fstack-protector-strong -shared >> > cloud_parts.lo cloud_transfer_mgr.lo s3_driver.lo -o >> > bacula-sd-cloud-s3-driver.la -R /usr/local/lib -rpath /usr/local/lib >> > -module -export-dynamic -release 11.0.5 >> > /usr/ports/sysutils/bacula11-server/work/bacula-11.0.5/autoconf/mkinstalldirs >> > /usr/local/lib >> > /usr/ports/sysutils/bacula11-server/work/bacula-11.0.5/libtool >> > --silent --tag=CXX --mode=install /usr/bin/install -c -m 755 >> > bacula-sd-cloud-s3-driver.la /usr/local/lib >> > /bin/rm -f /usr/local/lib/bacula-sd-cloud-s3-driver.la >> But when I start bacula-sd with bacula-sd -d 255, I am getting the above >> > ERR=Undefined symbol "BaculaCloudDriver" >> error message. > Matches this line. My thoughts: don't try to start bacula-sd until that > compile > time error is fixed. I reported a similar bug in the 11.0.2 version for CentOS. Maybe is the FreeBSD part not fixed. If you are feeling adventurous you can try to fix it from the thread information <https://bugs.bacula.org/view.php?id=2615>. Regards, -- MSc Heitor Faria (Miami/USA) Bacula LATAM CEO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Which OS is best for bacula ?
> Hello, Hello Kern, > As originator of Bacula (and still the highest in the gitstats list of > contributors), my personal vote is for Ubuntu. We really appreciate that. A life dedication is the human greatest sacrifice. Thank you. > That said, > I would be very happy to run Bacula on any version of Debian -- the Bacula > packagers for Debian work closely with the Bacula project -- I would be a lot > happier if they would learn to install it in /opt/bacula instead of spreading > it all over the filesystem though. This will probably never happen due to the FHS rules pointed by Sven. I even spoke with him about that topic in the past. *Maybe* with a very special agreement with the Debian Community such as the one they made with RedHat (I heard of, couldn't find it) to make a few things standard (such as the systemd services). > In light of the wide spread attacks of ransomware, it is even more important > to > ensure that restoration of Bacula is simple and easy. There is a lot of info > on > ransomeware on bacula.org. I've ever heard or read about a Linux system affected by ransomware, only FUD. Ref.: <https://www.statista.com/statistics/701020/major-operating-systems-targeted-by-ransomware/> Bacula is one of the top worldwide backup systems that runs on Linux. Running the Director and SD as the Linux bacula user is a builtin ransomware protection feature. IMHO bacula.org should advertise that and advise all users to only provide disk volumes write permissions to the bacula user. IMHO 2, the state-of-the-art will be when Bacula automatically set the closed volumes (used, full, readonly, archive, disabled) as immutable (chattr +i). Then, not even the root user could encrypt the disk volumes. > There is no need you should have to pay for a Bacula Windows client either > today > or any time in the future. Bacula Systems will ensure that the community > Bacula > runs on the most popular operating systems (Windows client, MacOS, FreeBSD, > Solaris, even Oracle, ...) Regards, > Best regards, > Kern > On 7/8/21 9:47 PM, Thing wrote: >> Hi, >> Which OS you choose depends on which one is best suited to your >> application(s), >> I just work on that then try and make the ancillary apps fit. If Bacula does >> not, use a different backup product. >> Centos7 is effectively approaching end of life as Redhat kills it off to make >> you pay, so I wouldnt suggest that OS or say Stream for this reason. Windows >> 2012 R2 is also end of life so best to migrate that to 2019? and you might >> need >> to pay for a Bacula Windows client? (you did in the past) You need to look at >> this as as Bacula or indeed any application advances 2012 will be left >> behind. >> Your problem will be what version of Bacula will work across all of these. >> In my >> case I ended up with Bacula on Debian as that was the bulk of my OSes and >> then >> had to port Bacula client Centos7 to a compatible version, it was a total >> nightmare I never got a client for Mac OS to work. >> regards >> Steven >> On Wed, 7 Jul 2021 at 17:20, Marc Ferrand < [ mailto:marcferr...@gmail.com | >> marcferr...@gmail.com ] > wrote: >>> If you had a choice, on which system would you install bacula and why ? >>> These are OSes I'm familiar with in order or preference : >>> lint Mint (20, fork of Ubuntu/Debian), CentOS 7 (free version of RHEL), >>> Windows >>> 10 (Desktop), DragonFly BSD (fork of freeBSD), Windows Server 2012 R2. >>> Any advice or suggestion is welcome, thanks in advance, Marc. >>> ___ >>> Bacula-users mailing list >>> [ mailto:Bacula-users@lists.sourceforge.net | >>> Bacula-users@lists.sourceforge.net >>> ] >>> [ https://lists.sourceforge.net/lists/listinfo/bacula-users | >>> https://lists.sourceforge.net/lists/listinfo/bacula-users ] >> ___ >> Bacula-users mailing list [ mailto:Bacula-users@lists.sourceforge.net | >> Bacula-users@lists.sourceforge.net ] [ >> https://lists.sourceforge.net/lists/listinfo/bacula-users | >> https://lists.sourceforge.net/lists/listinfo/bacula-users ] > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users -- MSc Heitor Faria (Miami/USA) Bacula LATAM CEO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula first install on WinServer ; Director params
Hell All, > On 07/07/2021 14:09, Marc Ferrand wrote: >> Hello, I'm a noob and just installed bacula on WinServer 2012 R2 from >> binary, during install, it asks for Director parameters: name, address >> (and passwd). What should I fill in, please? Most likely you chose to install also the Console for Windows, what is not really advisable since you probably only want to extract backups from it. Please have a look at my notes: <https://www.bacula.lat/enterprise/bacula-client-installation/?lang=en> > The address and details for your Bacula Director - which will be on a > UNIX or Linux system, usually where your Bacula Storage Daemon runs as > well, to manage your tape drive or other storage. The Storage Daemon is currently present in the Windows Packages. And Bacula Systems supports them. I just don't understand why anyone would use an OS 1000x more likely of being contaminated by ransomware. =) > There hasn't been a Windows Director or Storage Daemon for a long, long Regards, > time. > > Cheers, > GaryB-) > > > > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users -- MSc Heitor Faria (Miami/USA) Bacula LATAM CEO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Release 11.0.5
> Hello All, Hello, > Trying to upgrade from Bacula11.0.2 to the version 11.0.5, and getting the > following messages when running sudo apt update: > ... > Ign:19 [ https://bacula.org/packages/./debs/11.0.5/focal/amd64 | > https://bacula.org/packages/./debs/11.0.5/focal/amd64 ] focal InRelease > Err:21 [ https://bacula.org/packages/./debs/11.0.5/focal/amd64 | > https://bacula.org/packages/./debs/11.0.5/focal/amd64 ] focal Release > Certificate verification failed: The certificate is NOT trusted. The name in > the > certificate does not match the expected. Could not handshake: Error in the > certificate verification. [IP: 80.244.178.6 443] > Reading package lists... Done s/bacula.org/www.bacula.org/ > Thanks for helping. Regards, -- MSc Heitor Faria (Miami/USA) Bacula LATAM CEO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] I need to reuse volume1 inmediately
> Hello: Hello Denis, > I have built a bacula 11 successfuly. I am testing saving a few files to a > file > type device, using a little Pool of up to 3 volumes of 100Mb each one. I need > to see how bacula creates the three volumes automatically as I repeat a job > some times in order to fill up the three volumes. And It happens indeed. The > three volumes get full. But then, a new job execution remains running for a > long time and need to be stopped. It seems that the first volume can not be > rewriten. Even when directive volume retention = 0 is set on the pool. File > and > Job retention = 0 is set on the client resource. What else should I do ? I > mean, to rewrite the first volume automatically. I think when you sed VolumeRetention=0 Bacula assumes infinite retention. Try 1 or 2 (seconds), or used de directive PurgeOldestVolume=yes. Regards, -- MSc Heitor Faria (Miami/USA) Bacula LATAM CEO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] noticing an occasional incremental backup act like full
Hello Joseph, There is no surprise in that finding. If it is not in the catalog, it doesn't exist. IMHO Bacula default File and Job values should be much higher, e.g. 5 years or unlimited. If the user have special machines with millions of files, he should lower the File Retention accordingly. This is the exception use case scenario. Regards, -- MSc Heitor Faria (Miami/USA) CEO Bacula LatAm mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 América Latina [ http://bacula.lat/] Original Message From: Joseph Zatarski Sent: Sunday, May 30, 2021 04:27 PM To: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] noticing an occasional incremental backup act like full >Hello again everyone, > >I've figured out what is happening to cause this issue. > >Long story short, bacula pruned the file records from my last full >backup job out of the catalog. It didn't prune the job itself, just the >file records. This causes any file that hadn't been backed up since my >initial full backup job to be considered as a new file to bacula when it >does the incremental. Since most of my files don't change very often, >that explains the behavior entirely. > >There's plenty of warnings in the documentation about trying to restore >from jobs that have had their file records pruned, but nothing about >trying to do an incremental on top of a full that had it's files pruned. >Obviously thinking about this a little bit would reveal that it's an issue. > >Best Regards, >Joe Zatarski > > >___ >Bacula-users mailing list >Bacula-users@lists.sourceforge.net >https://lists.sourceforge.net/lists/listinfo/bacula-users ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Daily Bacula backup report summary email (finally) ported to Python
Hello , > The current version is available on Github here: > > https://github.com/waa/bacula > > All feedback is welcome. I vote this to be included in the Bacula code. And Bill for the US presidency. > Best regards, Regards, > Bill > > -- > Bill Arlofski > w...@protonmail.com > > > > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users -- MSc Heitor Faria (Miami/USA) Bacula LATAM CEO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to determine which files have been restored
Hello, Yes, there is. If you configure the bacula-fd.conf Messages resource correctly, you can use an option to print the restored files. I believe it is the "restored" keyword. Regards, -- MSc Heitor Faria (Miami/USA) CEO Bacula LatAm mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 América Latina [ http://bacula.lat/] Original Message From: Chris Wilkinson Sent: Tuesday, May 11, 2021 06:14 AM To: bacula-users Subject: [Bacula-users] How to determine which files have been restored >Is there a way to list which files have been restored in a restore job? > >I ran a restore job that was set not to overwrite existing files. Some >bytes were restored but I haven't been able to see which file(s) they were. > >Neither Baculum, Bacula Web or bconsole appear to do this for restore; only >for backup jobs. > >Many thanks >Chris Wilkinson > > >___ >Bacula-users mailing list >Bacula-users@lists.sourceforge.net >https://lists.sourceforge.net/lists/listinfo/bacula-users ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] S3 "Driver" Doesn't Work 11.0.2
Hello Martin, Thanks! I should have mentioned that earlier. All my tests were using the bacula.org packages. I don't have to build packages from source anymore. Thanks, bacula.org. 😆 Rgds. -- MSc Heitor Faria (Miami/USA) CEO Bacula LatAm mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 América Latina [ http://bacula.lat/] Original Message From: Martin Simmons Sent: Friday, May 7, 2021 06:35 AM To: Heitor Faria Subject: Re: [Bacula-users] S3 "Driver" Doesn't Work 11.0.2 CC: k...@sibbald.com,jim joyce ,sru...@gemneye.org,bacula-users@lists.sourceforge.net >That failure to find BaculaCloudDriver is not surprising. The >bacula-sd-cloud-driver-11.0.2.so is a "SD" driver, but the code in cloud_dev.c >is looking for a "Cloud" driver. You need both to make S3 work. > >I suggest checking bacula/src/stored/Makefile in your build to see the value >of CLOUD_INSTALL_TARGETS. If it is empty then you have not configured the S3 >driver. > >__Martin > > >>>>>> On Thu, 6 May 2021 20:22:15 -0300 (BRT), Heitor Faria said: >> >> Hello Kern, >> >> Move is not enough because the SD is looking for the plugin with both >> different names (don't ask me why). >> However, I was able to load the driver and receive a different message >> before the "not loaded message": >> >> cp /opt/bacula/plugins/bacula-sd-cloud-driver-11.0.2.so >> /opt/bacula/plugins/bacula-sd-cloud-s3-driver-11.0.2.so >> >> And the debug: >> >> baculacommunity-sd: init_dev.c:481-0 Open SD driver at >> /opt/bacula/plugins/bacula-sd-cloud-driver-11.0.2.so >> baculacommunity-sd: init_dev.c:484-0 Driver=cloud handle=7fd6d400ba20 >> baculacommunity-sd: init_dev.c:486-0 Lookup "BaculaSDdriver" in driver=cloud >> baculacommunity-sd: init_dev.c:488-0 Driver=cloud entry point=7fd6e062c4d0 >> baculacommunity-sd: cloud_dev.c:876-0 Open SD driver at >> /opt/bacula/plugins/bacula-sd-cloud-s3-driver-11.0.2.so >> baculacommunity-sd: cloud_dev.c:879-0 Driver=s3 handle=7fd6d400cec0 >> baculacommunity-sd: cloud_dev.c:881-0 Lookup "BaculaCloudDriver" in >> driver=s3 >> baculacommunity-sd: cloud_dev.c:883-0 Driver=s3 entry point=0 >> baculacommunity-sd: cloud_dev.c:889-0 Lookup of symbol "BaculaCloudDriver" >> driver=/opt/bacula/plugins/bacula-sd-cloud-s3-driver-11.0.2.so failed: >> ERR=/opt/bacula/plugins/bacula-sd-cloud-s3-driver-11.0.2.so: undefined >> symbol: BaculaCloudDriver >> baculacommunity-sd: message.c:1831-0 cloud_dev.c:1001 Could not open Cloud >> driver type=1 for Device=AWS-Drive-0. >> baculacommunity-sd: message.c:1831-0 cloud_dev.c:1032 Cloud driver >> initialization error Cloud driver not properly loaded >> >> Ref.: [ https://bugs.bacula.org/view.php?id=2615 | >> https://bugs.bacula.org/view.php?id=2615 ] >> >> Regards, >> >> > From: "kern" >> > To: "Jim Joyce" , "Heitor Faria" >> > , >> > "sruckh" >> > Cc: "bacula-users" >> > Sent: Thursday, May 6, 2021 12:01:41 PM >> > Subject: Re: [Bacula-users] S3 "Driver" Doesn't Work 11.0.2 >> >> > Hello, >> >> > Though I am "mostly" retired, I thought I might respond to some of your >> > points. >> >> > First, I am sorry you are having problems building the S3 plugin. >> >> > The Bacula project does test a lot, and puts out source code prior to >> > release in >> > many cases, so that users can test it and report any problems. >> > The one thing that Bacula does not do is test every build option possible >> > -- >> > there are probably thousands of different OS, library, and build (deb, rpm, >> > ...) permutations, any one of which could have difficulties. >> >> > You asked in a previous email why we don't test on Ubuntu. Well all the >> > initial >> > development and testing of the S3 plugin was done on Ubuntu. I can testify >> > to >> > that because I am the Bacula developer who did it -- this message is being >> > written on a Ubuntu 20.-4 system :-) >> >> > In your case, I see that you are doing a number of build operations that >> > can >> > lead to minor problems because of OS specific scripting for debs and such. >> > Normally, Bacula developers build and install the libs3 directly. You are >> > creating (apparently) a libs3 debs package -- that is something that Bacula >> > developers never
Re: [Bacula-users] S3 "Driver" Doesn't Work 11.0.2
Hello Kern, Move is not enough because the SD is looking for the plugin with both different names (don't ask me why). However, I was able to load the driver and receive a different message before the "not loaded message": cp /opt/bacula/plugins/bacula-sd-cloud-driver-11.0.2.so /opt/bacula/plugins/bacula-sd-cloud-s3-driver-11.0.2.so And the debug: baculacommunity-sd: init_dev.c:481-0 Open SD driver at /opt/bacula/plugins/bacula-sd-cloud-driver-11.0.2.so baculacommunity-sd: init_dev.c:484-0 Driver=cloud handle=7fd6d400ba20 baculacommunity-sd: init_dev.c:486-0 Lookup "BaculaSDdriver" in driver=cloud baculacommunity-sd: init_dev.c:488-0 Driver=cloud entry point=7fd6e062c4d0 baculacommunity-sd: cloud_dev.c:876-0 Open SD driver at /opt/bacula/plugins/bacula-sd-cloud-s3-driver-11.0.2.so baculacommunity-sd: cloud_dev.c:879-0 Driver=s3 handle=7fd6d400cec0 baculacommunity-sd: cloud_dev.c:881-0 Lookup "BaculaCloudDriver" in driver=s3 baculacommunity-sd: cloud_dev.c:883-0 Driver=s3 entry point=0 baculacommunity-sd: cloud_dev.c:889-0 Lookup of symbol "BaculaCloudDriver" driver=/opt/bacula/plugins/bacula-sd-cloud-s3-driver-11.0.2.so failed: ERR=/opt/bacula/plugins/bacula-sd-cloud-s3-driver-11.0.2.so: undefined symbol: BaculaCloudDriver baculacommunity-sd: message.c:1831-0 cloud_dev.c:1001 Could not open Cloud driver type=1 for Device=AWS-Drive-0. baculacommunity-sd: message.c:1831-0 cloud_dev.c:1032 Cloud driver initialization error Cloud driver not properly loaded Ref.: [ https://bugs.bacula.org/view.php?id=2615 | https://bugs.bacula.org/view.php?id=2615 ] Regards, > From: "kern" > To: "Jim Joyce" , "Heitor Faria" , > "sruckh" > Cc: "bacula-users" > Sent: Thursday, May 6, 2021 12:01:41 PM > Subject: Re: [Bacula-users] S3 "Driver" Doesn't Work 11.0.2 > Hello, > Though I am "mostly" retired, I thought I might respond to some of your > points. > First, I am sorry you are having problems building the S3 plugin. > The Bacula project does test a lot, and puts out source code prior to release > in > many cases, so that users can test it and report any problems. > The one thing that Bacula does not do is test every build option possible -- > there are probably thousands of different OS, library, and build (deb, rpm, > ...) permutations, any one of which could have difficulties. > You asked in a previous email why we don't test on Ubuntu. Well all the > initial > development and testing of the S3 plugin was done on Ubuntu. I can testify to > that because I am the Bacula developer who did it -- this message is being > written on a Ubuntu 20.-4 system :-) > In your case, I see that you are doing a number of build operations that can > lead to minor problems because of OS specific scripting for debs and such. > Normally, Bacula developers build and install the libs3 directly. You are > creating (apparently) a libs3 debs package -- that is something that Bacula > developers never do and have never tested. > Your fundamental problem in making the S3 plugin work is that plugin has the > wrong name -- this can be seen from the -D200 debug output you supplied. The > Bacula SD is looking for plugins named: xxx-sd.so, and your plugin is named > xxx.so, so Bacula is not finding it. > There is a reasonable possibility that if you simply rename your plugin from > xxx.so to xxx-sd.so (I am assuming you know how to replace xxx with the > correct > name), the plugin *might* work. > If you would like to get reasonable answers from this list, it might help if > you > would remember that this is free software that relies on community > participation. > One last thing: I take issue with your statements about Bacula Systems. Bacula > Systems binaries are heavily tested, and they do work. In the off chance they > don't the company will quickly (usually within a day or two) build new > binaries > that do work. I do not mean to imply that you or anyone else must buy a Bacula > Systems subscription to get working software. However, I do think it likely > that at some point a Bacula Systems developer will probably see this problem > and fix it or explain the build problem. > Good luck, > Kern > On 5/5/21 3:55 AM, Jim Joyce wrote: >> As you can see, nobody except imaginary super admins have been able to load >> the >> S3 plug-in. IT DOES NOT WORK. I implore the community to demand the code & >> package be rescinded from the repo until somebody with magical coding prowess >> can get it to work. Community users are wasting their time and energy on >> something that will not work unless you fork the darn thing and start all >> over >> again! >> bacula.org package ver
Re: [Bacula-users] S3 "Driver" Doesn't Work 11.0.2
Hello All, Just FYI, I built a new enviroment and was able to reproduce the following error: "dlopen of SD driver=s3 at /opt/bacula/plugins/bacula-sd-cloud-s3-driver-11.0.2.so failed: ERR=/opt/bacula/plugins/bacula-sd-cloud-s3-driver-11.0.2.so: cannot open shared object file: No such file or directory" I also filled a bug report at the Mantis bug tracker. > Regards Regards, > Reiner >> Am 05.05.2021 um 03:55 schrieb Jim Joyce < [ mailto:jim.jo...@vecna.com | >> jim.jo...@vecna.com ] >: >> As you can see, nobody except imaginary super admins have been able to load >> the >> S3 plug-in. IT DOES NOT WORK. I implore the community to demand the code & >> package be rescinded from the repo until somebody with magical coding prowess >> can get it to work. Community users are wasting their time and energy on >> something that will not work unless you fork the darn thing and start all >> over >> again! >> [ http://bacula.org/ | bacula.org ] package versions you are trying to >> install. >> 9.6.7 debs >> libs3 version and installation commands >> cd libs3-20200523 >> make deb >> cd build/pkg >> dpkg -i libs3_4.1.bac_amd64.deb >> root@backup:~/libs3-20200523/build/pkg# apt show libs3 >> Package: libs3 >> Version: 4.1.bac >> Status: install ok installed >> operating system exact version >> cat /etc/debian_version >> 10.9 >> bacula-sd -d 200 loading debug output >> root@backup:/opt/bacula/bin# ./bacula-sd -d 200 >> root@backup:/opt/bacula/bin# bacula-sd: address_conf.c:274-0 Initaddr >> 0.0.0.0:9103 >> backup-sd: jcr.c:131-0 read_last_jobs seek to 192 >> backup-sd: jcr.c:138-0 Read num_items=2 >> backup-sd: plugins.c:97-0 load_plugins >> backup-sd: plugins.c:133-0 Rejected plugin: want=-sd.so name=bpipe-fd.so >> len=11 >> backup-sd: plugins.c:133-0 Rejected plugin: want=-sd.so >> name=bacula-sd-cloud-driver-9.6.7.so len=31 >> backup-sd: plugins.c:121-0 Failed to find any plugins in /opt/bacula/plugins >> ... >> root@backup:/opt/bacula/plugins# ls >> bacula-sd-cloud-driver-9.6.7.so bpipe-fd.so >> steps to reproduce the error. >> Install 9.6.7, install S3 lib hack, define a storage device using the S3 >> driver >> in bacula-sd.conf. Volia! Get the dreaded "driver not loaded" error. >> From: Heitor Faria < [ mailto:hei...@bacula.com.br | hei...@bacula.com.br ] > >> Sent: Monday, May 3, 2021 7:09 PM >> To: sruckh < [ mailto:sru...@gemneye.org | sru...@gemneye.org ] > >> Cc: bacula-users < [ mailto:bacula-users@lists.sourceforge.net | >> bacula-users@lists.sourceforge.net ] > >> Subject: Re: [Bacula-users] S3 "Driver" Doesn't Work 11.0.2 >>>> Despite of the not-working testimonials in this thread, until now I see no >>>> related bug reports in the Bacula bug tracker: [ >>>> https://bugs.bacula.org/view_all_bug_page.php | >>>> https://bugs.bacula.org/view_all_bug_page.php ] >>>> IMHO it would be of great help if you could make the bug reports with the >>>> maximum details, such as: >>>> - [ http://bacula.org/ | bacula.org ] package versions you are trying to >>>> install. >>>> - libs3 version and installation commands >>>> - operating system exact version >>>> - bacula-sd -d 200 loading debug output >>>> - steps to reproduce the error. >>>> I believe this is the fastest way of the [ http://bacula.org/ | bacula.org >>>> ] >>>> team to address this problem properly. >>>> Regards, >>> Problem has been reported. >> Hello Sruckh: the error you reported is different from the OP. >> For everyone also having the: "Apr 27 20:59:59 backup bacula-sd[498]: >> cloud_dev.c:1001 Could not open Cloud driver type=1 for Device=.", you >> are >> encouraged also to full a bug report. >>> Thank You. >> Regards, >> -- >> MSc Heitor Faria (Miami/USA) >> Bacula LATAM CEO >> mobile1: + 1 909 655-8971 >> mobile2: + 55 61 98268-4220 >> [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] >> [ http://www.bacula.com.br/ ] >> América Latina >> [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | >> bacula.com.br ] >> ___ >> Bacula-users mailing list >> [ mailto:Bacula-users@lists.sourceforge.net | >> Bacula-users@lists.sourceforge.net >> ] >> [ https://lists.sourceforge.net/lists/listinfo/bacula-users | >> https://lists.sourceforge.net/lists/listinfo/bacula-users ] -- MSc Heitor Faria (Miami/USA) Bacula LATAM CEO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] S3 "Driver" Doesn't Work 11.0.2
>> Despite of the not-working testimonials in this thread, until now I see no >> related bug reports in the Bacula bug tracker: [ >> https://bugs.bacula.org/view_all_bug_page.php | >> https://bugs.bacula.org/view_all_bug_page.php ] >> IMHO it would be of great help if you could make the bug reports with the >> maximum details, such as: >> - bacula.org package versions you are trying to install. >> - libs3 version and installation commands >> - operating system exact version >> - bacula-sd -d 200 loading debug output >> - steps to reproduce the error. >> I believe this is the fastest way of the bacula.org team to address this >> problem >> properly. >> Regards, > Problem has been reported. Hello Sruckh: the error you reported is different from the OP. For everyone also having the: "Apr 27 20:59:59 backup bacula-sd[498]: cloud_dev.c:1001 Could not open Cloud driver type=1 for Device=xxxx.", you are encouraged also to full a bug report. > Thank You. Regards, -- MSc Heitor Faria (Miami/USA) Bacula LATAM CEO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] S3 "Driver" Doesn't Work 11.0.2
Hello r0002, Despite of the not-working testimonials in this thread, until now I see no related bug reports in the Bacula bug tracker: [ https://bugs.bacula.org/view_all_bug_page.php | https://bugs.bacula.org/view_all_bug_page.php ] IMHO it would be of great help if you could make the bug reports with the maximum details, such as: - bacula.org package versions you are trying to install. - libs3 version and installation commands - operating system exact version - bacula-sd -d 200 loading debug output - steps to reproduce the error. I believe this is the fastest way of the bacula.org team to address this problem properly. Regards, > I have tried for weeks to get the S3 module to work on the Community edition > of > Bacula, to no avail. > Are you working with the community edition, or the paid edition? > Regards, > Al > On 5/2/21 1:17 PM, sruckh--- via Bacula-users wrote: >> On 2021-04-30 09:23, Heitor Faria wrote: >>> Hello, >>>> If you read the email thread, I was not asking for technical help. I was >>>> simply >>>> asking if anyone has had success with the S3 plugin. With the lack of >>>> responses, I can only assume nobody has got it working. >>> Of course. After less than 20 hours from the original post that was the only >>> possible assumption. I guess everyone have to, voluntarily and promptly, >>> provide the answers that you need. >>>> Which means the plugin does not work, so it should be removed from the >>>> repo. >>> I personally know at least 10 administrators that use the CBacula 9/11 >>> version >>> Cloud driver in different sectors. It also works in one of my lab machines: >> I am running bacula 9.6.7 on CentOS 7 where the packages came from [ >> https://bacula.org/packages/x/rpms/9.6.7/el7/x86_64/ | >> https://bacula.org/packages/x/rpms/9.6.7/el7/x86_64/ ] . In my >> case >> the S3 drivers seemed to stop working after 9.6.5 (if I remember correctly. >> It >> was a couple of versions ago when it stopped working). >> With the current packages, bacula-mysql-9.6.7-1.el7.x86_64, >> bacula-aligned-9.6.7-1.el7.x86_64, bacula-cloud-storage-9.6.7-1.el7.x86_64, >> and >> bacula-libs-9.6.7-1.el7.x86_64, the S3LIB files (discussed in this thread >> earlier) are provided by package bacula-cloud-storage. The libs3.so.4 file >> gets >> installed in /opt/bacula/lib64/. The problem being that if you do a ldd on >> /opt/bacula/plugins/bacula-sd-cloud-driver-9.6.7.so it shows it uses, >> libs3.so.4, but that it is missing. So I tried to create the file >> /etc/ld.so.conf.d/bacula.conf and added /opt/bacula/lib64 path to the file >> and >> ran ldconfig to rebuild the cache. By doing this, running ldd on >> bacula-sd-cloud-driver-9.6.7.so now shows libs3.so.4 coming from >> /opt/bacula/lib64. >> Unfortunately, even with this change, a configuration that used to work fine >> in >> older versions of bacula, no longer work in the current version installed. >> The >> S3 drivers seems to load, but I ultimately end up with this error: 3999 Error >> with the upload: ERR=RequestTorrentOfBucketError . >> On a hunch, I went ahead and built an RPM package from the link provided >> earlier >> in the thread for the libs3 library. I went ahead and installed this RPM >> after >> building it and the libs3.so.4 file is now in /usr/lib/ . I went ahead and >> removed the /etc/ld.so.conf.d/bacula.conf, and again rebuilt the cache with >> ldconfig. Now when running ldd on bacula-sd-cloud-driver-9.6.7.so the >> libs3.so.4 now shows to be coming from /usr/lib/ . >> Unfortunately, I get the same error as before. This time, I just went into >> bconsole, and tried to use the cloud command to upload the volume. After a >> few >> minutes the bconsole command times out with the exact error mentioned above >> that is received when trying to perform a backup. >> This exact configuration used to work going straight to S3 cloud bucket, and >> also when using minio as a middle-man to go to Backblaze storage before they >> supported native S3 commands. >> So, in my experience, the S3 cloud plugin has not worked for me after >> something >> changed from an older version. >> _______ >> Bacula-users mailing list [ mailto:Bacula-users@lists.sourceforge.net | >> Bacula-users@lists.sourceforge.net ] [ >> https://lists.sourceforge.net/lists/listinfo/bacula-users | >> https://lists.sourceforge.net/lists/listinfo/bacula-users ] > _
Re: [Bacula-users] S3 "Driver" Doesn't Work 11.0.2
Hello, > If you read the email thread, I was not asking for technical help. I was > simply > asking if anyone has had success with the S3 plugin. With the lack of > responses, I can only assume nobody has got it working. Of course. After less than 20 hours from the original post that was the only possible assumption. I guess everyone have to, voluntarily and promptly, provide the answers that you need. > Which means the plugin does not work, so it should be removed from the repo. I personally know at least 10 administrators that use the CBacula 9/11 version Cloud driver in different sectors. It also works in one of my lab machines: ... baculacommunity-sd: init_dev.c:152-0 Num drivers=15 baculacommunity-sd: init_dev.c:165-0 loadable=1 type=14 loaded=0 name=cloud handle=0 baculacommunity-sd: init_dev.c:432-0 loadable=1 type=14 loaded=0 name=cloud handle=0 baculacommunity-sd: init_dev.c:437-0 Open SD driver at /opt/bacula/plugins/bacula-sd-cloud-driver-9.6.6.so baculacommunity-sd: init_dev.c:440-0 Driver=cloud handle=7f9e24001250 baculacommunity-sd: init_dev.c:442-0 Lookup "BaculaSDdriver" in driver=cloud baculacommunity-sd: init_dev.c:444-0 Driver=cloud entry point=7f9e2b61ccf0 baculacommunity-sd: htable.c:67-0 malloc buf=7f9e36697038 size=100 rem=76 baculacommunity-sd: init_dev.c:212-0 init_dev allocated: 7f9e2400a578 baculacommunity-sd: init_dev.c:393-0 init_dev: tape=0 dev_name=/mnt/cloud ... Regards, > From: Heitor Faria > Sent: Friday, April 30, 2021 7:09 AM > To: Jim Joyce > Cc: bacula-users > Subject: Re: [Bacula-users] S3 "Driver" Doesn't Work 11.0.2 > Hello Jim, >> For anyone following this thread, I did compile/install the Bacula hacked >> libs3 >> and I'm still getting driver not loaded error. > You are not interested in solving your technical error. If that was true, you > would bring the OS, Bacula and libs3 versions you tried, commands, inputs and > outputs. > IMHO you are more concerned in expressing your frustrations. It is > comprehensible due to this hard times, I feel you. >> I can only assume that Bacula does not test their community version very >> well, >> if at all. > Like I wrote before, free software relies most in volunteer work and comes > with > no warranty or support. > I'm not part of the project but I believe your company (Vecna) never made a > single contribution to it. Why are you so entitled? >> Also, as we all know, CentOS is dead, so why not focus development on >> Ubuntu/Debian? > RHEL and CentOS were and stil are the mainstream OSs for many enterprise grade > applications, APIs and variant distributions, such as VMware VSphere, RHV, > Citrix Xen, Oracle Linux, Oracle DB etc. Most hardware vendors (such as Dell > and EMC that I think you know well) only homologate hardware for RHEL, when > they do. > CentOS 7 still has support untill 2024. Bacula development will probably use > and > recommend the new distribution that will attend most of the enterprise users > needs and requirements, not the one you like more or cheer for. > Regards, >> From: Heitor Faria >> Sent: Thursday, April 29, 2021 7:32 PM >> To: Jim Joyce >> Cc: bacula-users >> Subject: Re: [Bacula-users] S3 "Driver" Doesn't Work 11.0.2 >> Hello Jim, >>> Ok, nobody has successfully loaded the S3 Driver. That's what I figured as I >>> have tried the latest version and various 9.x versions with the same "Driver >>> not properly loaded" results. The only distro I haven't tried is CentOS 7.x >>> as >>> that distro is being discontinued. I guess there is zero QA for this >>> so-called >>> plug-in. Time to start looking for another backup solution. >> I think you missed that part where GPL software comes for free to the company >> that you work, but without any kind of support or warranty. You can always >> build the code yourself and make it work, or acquire a software license with >> support. >> That said, your error is most likely caused by not having the the proper >> libs3 >> packages maintained by the bacula.org project. The reason for this, if I >> remember right, is that the original libs3 author is not updating the >> libraries >> to keep up with the S3 protocol evolution. >> That drawback was highly advertised and discussed in this very same list: >>> "[snip] ... S3 driver: If you are trying to build the S3 drivers, please >>> remember to use the >>> community supplied (from Bacula Enterprise) version of libs3 .so found at: [ >>> https://www.bacula.org/downloads/libs3-20181010.tar.gz | >>> https://www.bacula.org/downloads/l
Re: [Bacula-users] S3 "Driver" Doesn't Work 11.0.2
Hello Jim, > For anyone following this thread, I did compile/install the Bacula hacked > libs3 > and I'm still getting driver not loaded error. You are not interested in solving your technical error. If that was true, you would bring the OS, Bacula and libs3 versions you tried, commands, inputs and outputs. IMHO you are more concerned in expressing your frustrations. It is comprehensible due to this hard times, I feel you. > I can only assume that Bacula does not test their community version very well, > if at all. Like I wrote before, free software relies most in volunteer work and comes with no warranty or support. I'm not part of the project but I believe your company (Vecna) never made a single contribution to it. Why are you so entitled? > Also, as we all know, CentOS is dead, so why not focus development on > Ubuntu/Debian? RHEL and CentOS were and stil are the mainstream OSs for many enterprise grade applications, APIs and variant distributions, such as VMware VSphere, RHV, Citrix Xen, Oracle Linux, Oracle DB etc. Most hardware vendors (such as Dell and EMC that I think you know well) only homologate hardware for RHEL, when they do. CentOS 7 still has support untill 2024. Bacula development will probably use and recommend the new distribution that will attend most of the enterprise users needs and requirements, not the one you like more or cheer for. Regards, > From: Heitor Faria > Sent: Thursday, April 29, 2021 7:32 PM > To: Jim Joyce > Cc: bacula-users > Subject: Re: [Bacula-users] S3 "Driver" Doesn't Work 11.0.2 > Hello Jim, >> Ok, nobody has successfully loaded the S3 Driver. That's what I figured as I >> have tried the latest version and various 9.x versions with the same "Driver >> not properly loaded" results. The only distro I haven't tried is CentOS 7.x >> as >> that distro is being discontinued. I guess there is zero QA for this >> so-called >> plug-in. Time to start looking for another backup solution. > I think you missed that part where GPL software comes for free to the company > that you work, but without any kind of support or warranty. You can always > build the code yourself and make it work, or acquire a software license with > support. > That said, your error is most likely caused by not having the the proper libs3 > packages maintained by the bacula.org project. The reason for this, if I > remember right, is that the original libs3 author is not updating the > libraries > to keep up with the S3 protocol evolution. > That drawback was highly advertised and discussed in this very same list: >> "[snip] ... S3 driver: If you are trying to build the S3 drivers, please >> remember to use the >> community supplied (from Bacula Enterprise) version of libs3 .so found at: [ >> https://www.bacula.org/downloads/libs3-20181010.tar.gz | >> https://www.bacula.org/downloads/libs3-20181010.tar.gz ] " > You have to download them and build them from source. On CentOS 7 I had > success > using the following script: > yum install curl libcurl-devel libxml2 > cd /usr/src > wget https://www.bacula.org/downloads/libs3-20200523.tar.gz > tar -xzvf libs3-20200523.tar.gz > cd /usr/src/libs3-20200523 > make > make install > Nevertheless, the Bacula Enterprise version Drivers and Plugins come with all > builtin necessary libraries. These ones are tested by a highly skilled QA > team, > they work out-of-the-box, and they support all clouds (not only the S3 > protocol). Perhaps you should consider that due to your high quality > standards. > Regards, > -- > MSc Heitor Faria (Miami/USA) > Bacula LATAM CEO > mobile1: + 1 909 655-8971 > mobile2: + 55 61 98268-4220 > [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] > [ http://www.bacula.com.br/ ] > América Latina > [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | > bacula.com.br ] > _______ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users -- MSc Heitor Faria (Miami/USA) Bacula LATAM CEO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] S3 "Driver" Doesn't Work 11.0.2
Hello Jim, Ok, nobody has successfully loaded the S3 Driver. That's what I figured as I have tried the latest version and various 9.x versions with the same "Driver not properly loaded" results. The only distro I haven't tried is CentOS 7.x as that distro is being discontinued. I guess there is zero QA for this so-called plug-in. Time to start looking for another backup solution. I think you missed that part where GPL software comes for free to the company that you work, but without any kind of support or warranty. You can always build the code yourself and make it work, or acquire a software license with support. That said, your error is most likely caused by not having the the proper libs3 packages maintained by the bacula.org project. The reason for this, if I remember right, is that the original libs3 author is not updating the libraries to keep up with the S3 protocol evolution. That drawback was highly advertised and discussed in this very same list: BQ_BEGIN "[snip] ... S3 driver: If you are trying to build the S3 drivers, please remember to use the community supplied (from Bacula Enterprise) version of libs3 .so found at: [ https://www.bacula.org/downloads/libs3-20181010.tar.gz | https://www.bacula.org/downloads/libs3-20181010.tar.gz ] " BQ_END You have to download them and build them from source. On CentOS 7 I had success using the following script: yum install curl libcurl-devel libxml2 cd /usr/src wget https://www.bacula.org/downloads/libs3-20200523.tar.gz tar -xzvf libs3-20200523.tar.gz cd /usr/src/libs3-20200523 make make install Nevertheless, the Bacula Enterprise version Drivers and Plugins come with all builtin necessary libraries. These ones are tested by a highly skilled QA team, they work out-of-the-box, and they support all clouds (not only the S3 protocol). Perhaps you should consider that due to your high quality standards. Regards, -- MSc Heitor Faria (Miami/USA) Bacula LATAM CEO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] visualization of backup and restore_related data
Hello Saleh, > Hello everyone, > I am a student in Master e-Secure at University of Caen Normandy. As part of > my > internship, I am working on the visualization of backup and restore_related > data, particularly on the Bacula ones. > I would be grateful if you could help me. How? Please take a few minutes of > your > time to fill in the questionnaire available here: [ > https://survey.teicee.com/index.php/213527 | > https://survey.teicee.com/index.php/213527 ] Many thanks! > Bonjour la communauté, > Je suis étudiant en master E-secure à l'université de Caen Normandie. Dans le > cadre de mon stage de fin d'études je travaille sur la visualisation des > données liées à la sauvegarde et à la restauration, > en particulier celles de Bacula. Je m'adresse aujourd'hui à vous, car j'ai > besoin de votre aide ! J'apprécierais beaucoup si vous pouviez prendre >quelques > minutes de votre temps pour répondre au > questionnaire que vous trouverez à l'adresse suivante: [ > https://survey.teicee.com/index.php/213527 | > https://survey.teicee.com/index.php/213527 ] Grand merci par avance ! Done. Good Job, IMHO your work must be very good. Regards, > -- > [ https://www.teicee.com/?pk_campaign=Email ] Saleh Ahmedou > Bureau Caen: Quartier Kœnig - 153, rue Géraldine MOCK - 14760 > Bretteville-sur-Odon > Bureau Vitré: Zone de la baratière - 12, route de Domalain - 35500 Vitré > 02 72 34 13 20 | [ https://www.teicee.com/?pk_campaign=Email | www.teicee.com > ] > [ https://www.facebook.com/teicee ] [ https://twitter.com/Teicee_fr ] [ > https://www.linkedin.com/company/t-c-e ] [ > https://fr.viadeo.com/fr/company/teicee ] > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users -- MSc Heitor Faria (Miami/USA) Bacula LATAM CEO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Help with regexp
Hello Tom, > Thank you Heitor. But that says that over 500,000 files will be restored! > That's > the whole backup > I'm going to try the bscan method and rebuild the database with the purged > data. You can also use the bextract with the -i /tmp/list (e.g.) option, and this list contains one wildcard expression per line of restore included contents. For example: cat /tmp/list /projects/2020/220089/* It will be faster than the bscan and catalog rebuilding plan. Thomas Plancon CAD/IT MANAGER E: [ mailto:tplan...@bkaarchs.com | tplan...@bkaarchs.com ] W: [ http://www.bkaarchs.com/ | www.bkaarchitects.com ] [ https://www.linkedin.com/company/bka-architects/ ] [ https://www.facebook.com/pages/category/Commercial---Industrial/BKA-Architects-Inc-164150853637095/ ] [ https://www.instagram.com/bka_architects/ ] Rgds. -- MSc Heitor Faria Bacula LATAM CEO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Help with regexp
>> I need to restore data from Sept of 2020. I have the tape but the data has >> been >> purged from the database. Bconsole is asking for "Regexp matching files to >> restore? (empty to abort):". >> I'm embarrassed to say regexp is alien to me! The path I need is >> "/projects/2020/220089/". All files below that is what I need. >> Any help here is greatly appreciated! Thank you! > => [ https://regex101.com/ | https://regex101.com/ ] > I usually test the Python flavor for Bacula expressions. Just in time: "/projects/2020/220089/.*" should work. > Regards, > -- > Thomas Plancon > CAD/IT MANAGER > E: [ mailto:tplan...@bkaarchs.com | tplan...@bkaarchs.com ] > W: [ http://www.bkaarchs.com/ | www.bkaarchitects.com ] > [ https://www.linkedin.com/company/bka-architects/ ] [ > https://www.facebook.com/pages/category/Commercial---Industrial/BKA-Architects-Inc-164150853637095/ > ] [ https://www.instagram.com/bka_architects/ ] > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users > -- > MSc Heitor Faria > Bacula LATAM CEO > mobile1: + 1 909 655-8971 > mobile2: + 55 61 98268-4220 > [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] > [ http://www.bacula.com.br/ ] > América Latina > [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | > bacula.com.br ] > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Help with regexp
> Hi folks, Hello, > I need to restore data from Sept of 2020. I have the tape but the data has > been > purged from the database. Bconsole is asking for "Regexp matching files to > restore? (empty to abort):". > I'm embarrassed to say regexp is alien to me! The path I need is > "/projects/2020/220089/". All files below that is what I need. > Any help here is greatly appreciated! Thank you! => [ https://regex101.com/ | https://regex101.com/ ] I usually test the Python flavor for Bacula expressions. Regards, -- Thomas Plancon CAD/IT MANAGER E: [ mailto:tplan...@bkaarchs.com | tplan...@bkaarchs.com ] W: [ http://www.bkaarchs.com/ | www.bkaarchitects.com ] [ https://www.linkedin.com/company/bka-architects/ ] [ https://www.facebook.com/pages/category/Commercial---Industrial/BKA-Architects-Inc-164150853637095/ ] [ https://www.instagram.com/bka_architects/ ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- MSc Heitor Faria Bacula LATAM CEO mobile1: + 1 909 655-8971 mobile2: + 55 61 98268-4220 [ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] [ http://www.bacula.com.br/ ] América Latina [ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | bacula.com.br ] ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users